The document discusses the challenges of producing OpenStack, an open-source cloud computing platform. It notes that OpenStack has over 130 code repositories and 1.8 million lines of code, making coordination and leadership difficult. It also receives contributions from various companies and countries with different cultures and no traditional management structure. The document outlines the processes used to manage releases through milestones every six weeks and gate-centric development, with principles of automated testing, code reviews, time-based releases, and automating processes. It notes the large scale of changes, reviews, and tests occurring weekly in producing OpenStack releases.

1. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Behind the scenes
How we produce OpenStack
Thierry Carrez
Release Manager, OpenStack

2. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
OpenStack is large & growing
130+ git repositories
1.8+ MLOC

4. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
OpenStack is painful
Difficult to deploy
Difficult to test
Difficult to keep up with the changes

5. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
OpenStack is open innovation
Anyone can propose a change
Lots of different companies
Lots of different countries/cultures
No traditional management structure

6. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
?

7. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
5 Principles

8. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
1Not tested Not working→
Not automatically tested Not tested→

9. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
2Code reviews
Nobody gets a free pass

10. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
3Gate-centric development
I, for one, welcome our new robotic overlords

11. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
4Time-based releases
How I stopped worrying and embraced the coordination benefits

12. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
5Automate all the things
...especially the boring tasks

13. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Processes

14. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
6months
Design Summit, 4 days to discuss next release goals
PTLs define release goals
Milestones every 6 weeks
Last milestone, no more features (Feature Freeze)
RC1, creation of the release branch
Final release

15. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Design
Write
Code
Code
review
Milestone
Final
release
Tests Gate
Design
review
Tests

16. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Your git
branch
master git
branch
github
git.o.o
tarballs.o.o
review.o.o
developer
reviewers
infrastructure
PEP8
Hacking
Unit tests
Integration tests

17. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Challenges

25. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Numbers
On a typical week day

26. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
1000
Patchsets proposed

27. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
7500
Gerrit comments and votes

28. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
16000
Test runs, most spinning complete clouds

29. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
250
Changes merged into OpenStack code

30. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
Thank you !

31. Coordination and
Leadership challenges
in producing OpenStack
Thierry Carrez (@tcarrez)
Release management PTL
thierry@openstack.org
http://fnords.wordpress.com
@tcarrez on
ttx on
picture credits
Chaos by Daniela Hartman (https://www.flickr.com/photos/29487767@N02/4255026872)
Coordination by Doug88888 (https://www.flickr.com/photos/doug88888/4687906267)
Boring tasks by Alex Eylar (https://www.flickr.com/photos/hoyvinmayvin/5166095952)
Congestion by Joiseyshowaa (https://www.flickr.com/photos/joiseyshowaa/7454479488)
Rare issues by University of Liverpool HLS (https://www.flickr.com/photos/liverpoolhls/10740309163)
Community focus by Thierry Carrez
Watercooler by Eric Domont (https://www.flickr.com/photos/edomond/5348007434)
Tension by J.D. Hancock (https://www.flickr.com/photos/jdhancock/7186117659)