This document provides an overview of continuous integration (CI) practices at Atlassian, a software company. It discusses Atlassian's large build infrastructure that includes 11 Bamboo instances, 900 elastic agents, and over 20,000 build plans. It also describes some of the challenges of implementing CI at a large company, such as long test suites, plugin development, and integrating cloud services. The document emphasizes that CI requires changes to both processes and culture in order to be successful.

1. ESTHER ASENJO • BAMBOO DEV • ATLASSIAN • @STHREO
Games of Codes, the CI battle
A view behind the Atlassian curtains

2. Who am I?

3. Who am I?

4. Who am I?

5. Who am I?

6. Who am I?

7. Who am I?

8. Who am I?

9. Who am I?

10. Who am I?

11. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

12. Continuous Integration is a software development practice where
members of a team integrate their work frequently. Each integration
is verified by an automated build to detect integration errors as
quickly as possible. This leads to significantly reduced integration
problems and allows a team to develop cohesive software more
rapidly.
”
“
MARTIN FOWLER, THOUGHTWORKS

13. HARDER.work it

14. HARDER.
BETTER.
work it
make it

15. HARDER.
BETTER.
FASTER.
work it
make it
do it

16. HARDER.
BETTER.
FASTER.
STRONGER.
work it
make it
do it
make us

17. HARDER processes

18. HARDER
BETTER
processes
quality

19. HARDER
BETTER
FASTER
processes
quality
delivery

20. HARDER
BETTER
FASTER
STRONGER
processes
quality
delivery
teams

21. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

22. Atlassian, a software company

23. Atlassian, a software company
782 R&D Staff

24. Atlassian, a software company
782 R&D Staff
451 developers

25. Atlassian, a software company
782 R&D Staff
Products
451 developers

26. Atlassian, a software company
782 R&D Staff
Products
451 developers

27. Atlassian, a software company
782 R&D Staff
Products
451 developers

28. Atlassian, a software company
782 R&D Staff
Products
451 developers

29. Atlassian, a software company
782 R&D Staff
Products Services
www.atlassian.com
my.atlassian.com
451 developers

30. Atlassian, a software company
782 R&D Staff
Products Services
www.atlassian.com
my.atlassian.com
Ecosystem
451 developers

31. Continuous Integration
is a battle.

36. The Continuous Integration battle,
IT DOES NOT COUNT UNTIL IT’S SHIPPED

37. When you play the Game of Codes,
you ship or you fail.

38. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

39. Infrastructure
Tools
Processes
People

40. Build Infrastructure
Engineering

41. Build Infrastructure
Engineering Collaboration

42. Build Infrastructure
Engineering Collaboration JIRA family

43. Build Infrastructure
Engineering Collaboration JIRA family Dev Tools

44. Build Infrastructure
Engineering Collaboration JIRA family Dev Tools
Internal
Services

45. Build Infrastructure
EcosystemEngineering Collaboration JIRA family Dev Tools
Internal
Services

46. Build Engineering
Build Infrastructure
EcosystemEngineering Collaboration JIRA family Dev Tools
Internal
Services

47. Build Infrastructure
Remote agents
Elastic agents Build infrastructure
EcosystemEngineering Collaboration JIRA family Dev Tools
Internal
Services
Build Engineering
Maven repositories

48. Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
Build Engineering

49. Build Engineering
Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
900elastic agents 20 AMIs
150
remote agents

50. Build Engineering
Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
900elastic agents 20 AMIs
150
remote agents
6Nexus instances

51. Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
150
remote agents
6Nexus instances
20 AMIs
20k
build plans
Build Engineering
900elastic agents

52. Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
150
remote agents
6Nexus instances
20 AMIs
20k
build plans
120kbranch build plans
Build Engineering
900elastic agents

53. Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
150
remote agents
6Nexus instances
20 AMIs
20k
build plans
120kbranch build plans
Build Engineering
900elastic agents3 years ago:
21k
builds / month

54. Maven repositories
EcosystemEngineering
Build Infrastructure
Collaboration JIRA family Dev Tools
Internal
Services
Remote agents
Elastic agents Build infrastructure
11
Bamboo instances
150
remote agents
6Nexus instances
20 AMIs
20k
build plans
120kbranch build plans
Build Engineering
900elastic agents3 years ago:
21k
builds / month
Nowadays:
127k
builds / month

55. Infrastructure
Tools
Processes
People

56. Processes Tools : A pipeline anatomy
Developer

57. Developer Commit
!
Processes Tools : A pipeline anatomy

58. Developer Commit Build
!
Processes Tools : A pipeline anatomy

59. Developer TestCommit Build
!
Processes Tools : A pipeline anatomy

60. Developer Test DeliverCommit Build
!
Processes Tools : A pipeline anatomy

61. Developer Test DeliverCommit Build
!
Processes Tools : A pipeline anatomy

62. MIKE ROBERTS, THOUGHTWORKS
Continuous Integration is more often
than what you think.
”
“

63. Confluence pipeline
!

64. !
Confluence pipeline

65. !
Confluence pipeline

66. !
Confluence pipeline

67. !
Confluence pipeline

68. !
Confluence pipeline

69. !
!
!
!
!
!!
!
! !
!
!
!
!
!
!
!
Confluence pipeline

70. !
!
!
!
!
!!
!
! !
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Confluence pipeline

71. !
!
!
!
!
!!
!
! !
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
Confluence pipeline

72. 1,5 days
100
developers
420
commits/day
20,000
tests
435
build plans
Deliver
Confluence pipeline

73. I’m not slacking off,
my build plans are still running.
“
”
ME

74. I’m not slacking off,
my build plans are queued.
“
”
DANIEL KJELLIN
I’m not slacking off,
my build plans are

75. CI challenges our processes
Green production-ready master Build plan branching
Long running branches Dark features
Big&slow test suite Build grid
Quick feedback Build strategy

76. CI challenges our processes
Green production-ready master Build plan branching
Long running branches Dark features
Big&slow test suite Build grid
Quick feedback Build strategy

77. CI challenges our processes
Green production-ready master Build plan branching
Long running branches Dark features
Big&slow test suite Build grid
Quick feedback Build strategy

78. CI challenges our processes
Green production-ready master Build plan branching
Long running branches Dark features
Big&slow test suite Build grid
Quick feedback Build strategy

79. Confluence pipeline strategy
+ +++ =

80. + +++ =
Confluence pipeline strategy

81. + +++ =
Confluence pipeline strategy

82. Core
Test Suite
+ +++ =
30 min
Confluence pipeline strategy

83. Core
Test Suite
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

84. Core
Test Suite
Full Test Suite
Performance testing
Cross-Platform testing
Ecosystem testing
Acceptance testing
1,5 days
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

85. Core
Test Suite
Confluence team
dog fooding
Full Test Suite
Performance testing
Cross-Platform testing
Ecosystem testing
Acceptance testing
1,5 days
1 per day
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

86. Core
Test Suite
Confluence team
dog fooding
Full Test Suite
Performance testing
Cross-Platform testing
Ecosystem testing
Acceptance testing
1,5 days
1 per day
Cloud release
Every 2 weeks*
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

87. Core
Test Suite
Confluence team
dog fooding
Full Test Suite
Performance testing
Cross-Platform testing
Ecosystem testing
Acceptance testing
1,5 days
1 per day
1 per week*
Atlassian
dog fooding
Cloud release
Every 2 weeks*
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

88. Core
Test Suite
Confluence team
dog fooding
Full Test Suite
Performance testing
Cross-Platform testing
Ecosystem testing
Acceptance testing
1,5 days
1 per day
1 per week*
Atlassian
dog fooding
Cloud release
Every 2 weeks*
Monthly bug fixing
Server release
Quarterly release
90 min
Cloud
Test Suite
30 min
+ +++ =
Confluence pipeline strategy

89. CI challenges Atlassian processes
User acceptance testing Dog fooding
Monolithic applications Plugin development
Plugin development Cross-compatibility pipelines
Cloud integration Cloud delivery pipeline

90. CI challenges Atlassian processes
User acceptance testing Dog fooding
Monolithic applications Plugin development
Plugin development Cross-compatibility pipelines
Cloud integration Cloud delivery pipeline

91. CI challenges Atlassian processes
User acceptance testing Dog fooding
Monolithic applications Plugin development
Plugin development Cross-compatibility pipelines
Cloud integration Cloud delivery pipeline

92. CI challenges our processes
User acceptance testing Dog fooding
Monolithic applications Plugin development
Plugin development Cross-compatibility pipelines
Cloud integration Cloud delivery pipeline

93. 817

94. quarantined tests
817

95. Infrastructure
Tools
Processes
People

96. CI is a practice, not a tool,
and requires discipline from the
development team.
“
”
CONTINUOUS DELIVERY, THE BOOK

97. The Culture of Green
powered by

98. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

99. Culture is what happens when
the founders are not around.

100. The Build Master

101. The Build Breaker

102. Red is the new green.

103. Give feedback to people,
so it’s fed-back.

117. 0

118. 0quarantined tests

119. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

120. ! ! !!
A deployment pipeline

121. 10:00
09:00 !
dev
! ! !!
10:00
16:15
Purchasing deployment pipeline

122. 10:00
09:00 !
dev
! ! !!
10:00
16:15
dev staging prod
Purchasing deployment pipeline

123. 10:00
09:00 !
dev
! ! !!
10:00
16:15
dev staging prod
Purchasing deployment pipeline

124. 10:00
09:00 !
dev
! ! !!
10:00
16:15
!
dev
! ! !!
Purchasing deployment pipeline

125. 10:00
09:00 !
dev
! ! !!
10:00
16:15
!
dev
! ! !!
dev staging prod
Purchasing deployment pipeline

126. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15
!
dev
! ! !!
Purchasing deployment pipeline

127. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15
!
dev
! ! !!
dev staging prod
Purchasing deployment pipeline

128. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15 !
!
dev
! ! !!
Purchasing deployment pipeline

129. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15 !
!
dev
! ! !!
Purchasing deployment pipeline

130. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15 !
!
dev
! ! !!
Purchasing deployment pipeline

131. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15 !
!
dev
! ! !!
Missing thumbs-up.
Purchasing deployment pipeline

132. 10:00
09:00 !
dev
! ! !!
16:00 !stg
10:00
16:15 !
!prd
!
dev
! ! !!
Purchasing deployment pipeline

133. !
dev
! ! !!
!
dev
! ! !!
10:00
09:00
16:00 !stg
10:00
16:15 !
!prd
dev staging prod
Purchasing deployment pipeline

134. Free people to do
the interesting stuff,
and let Bamboo do the rest.

135. Agenda
CI ANATOMY
THE CI BATTLE, IN ATLASSIAN
CI CULTURE
CI INTRODUCTION
THE CD BATTLE, IN ATLASSIAN
CONCLUSION

136. Still not sure what this slide will be.
Maybe a mind map?

137. 19
34
18
42

138. Do it, or do not.
There is no try. ”
“

139. Do it, or do not.
There is no try. ”
“

140. Do it,
with . ”
“

141. Thank you!
ESTHER ASENJO • BAMBOO DEV • ATLASSIAN • @STHREO

142. Game of Codes: the CI battle
Submit your feedback:
go.atlassian.com/accodes