Analyze This!
CloudBees Jenkins Cluster Operations and Analytics
Ryan Campbell
Cyrille Le Clerc
Today’s Presenters
Cyrille Le Clerc
Director, Product Management
cleclerc@cloudbees.com
@cyrilleleclerc
Ryan Campbell
Engineer
rcampbell@cloudbees.com
@recampbell
Using WebEx
Questions?
Submit via the Q&A window at any time during
the presentation.
We will cover Q&A at the end of the presentation.
Session is being recorded.
Q&A Window
Agenda
● Problem statement
● Jenkins Reference Architecture
● CloudBees Analytics
● Cluster Operations
● Conclusion
● Q&As
Problem Statement
Problem Statement
How to onboard more and more teams on a Jenkins
Continuous Delivery Platform
How to scale Jenkins in an organization
The top down “structured” and “lets grow
vertically” approach
5 projects
0 slaves
25 projects
5 slaves
100 projects
25 slaves
300 projects
50 slaves
600 projects
200 slaves
Vertical Scaling Issue
When is the next failure ?
One size fits all?
Single point of failure
The “organic” agile growth –
“let each group do what they want to” approach
Horizontally … Virally
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Share slaves between masters
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Share security
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Manage the Jenkins
masters “globally”
plugin
core
upgrade / restart
backup
script
Horizontal Issues: I Would Like to…
master-a
master-b master-c
Monitor the Jenkins
masters “globally”
Jenkins Operations Center by CloudBees
master-a
master-b master-c
Jenkins Operations Center
plugin
core
upgrade / restart
backup
script
Jenkins Reference
Architecture
Reference Architecture
LB master-a
LB master-n
***
slaves
LB
Jenkins
Operations
Center
shared slaves
Role Based
Access Control
Update Center
SSO
LB master-test
Update Center
Jenkins Test
Environment
master-a
master-b master-c
Jenkins Operations Center
JOC features
plugin
core
upgrade / restart
backup
CloudBees Analytics
Cluster Operations
CloudBees Analytics
CloudBees Analytics
master-a
master-b master-c
Monitor the Jenkins
masters “globally”
Drivers for Analytics
● Easily understand the performance and behavior
of hundreds of Jenkins nodes
● Consistent interface allowing for easy
comparisons over time and between nodes
● Key questions:
○ What is the user experience?
○ Why is Jenkins slow?
○ How is Jenkins being used?
○ How are resources being used? → capacity
CloudBees Analytics
master
Jenkins Operations Center
Data Collection
Scalable compute and
storage backend
Rich visualization interface
Embedded Architecture
Jenkins Operations Center
Embedded
Elasticsearch
Embedded Kibana
Horizontally Scaled Architecture
Jenkins Operations Center
Embedded Kibana
Multiple Remote
Elasticsearch Instances
Analytics Demo
JOC Dashboard
Analytics Demo
Build Analytics
Analytics Demo
Performance Analytics
Analytics Demo
Dashboard Creator
Cluster Operations
Cluster Operations
master-a
master-b master-c
Manage the Jenkins
masters “globally”
plugin
core
upgrade / restart
backup
script
Cluster Operations Agenda
● Update all plugins on all masters and restart
● Deploy new plugin on masters
● Cluster Operations Ref Card
Update Plugins on All Masters and
Safely Restart
Demo time!
Cluster Operations
Standard Jenkins Style: New Item “Clustered Operations”
Cluster Ops > Master Operation
Standard Jenkins Style: Add Operation “Masters”
Master Operation > Select Targets
Select the Client Masters on which you perform the operation
Master Operation > Define Operations
Define the sequence of operations to apply on the Client Masters
Deploy Plugin on Masters
via a Custom Update Center
Deploy New Plugin
Update Center master-test
Upload Plugin
Refresh Update Center Metadata
Install Plugin
Demo time!
Deploy Plugin on Masters
Parameterized build: File Parameter
Deploy Plugin on Masters
Target Update Center
Deploy Plugin on Masters
Upload Plugin on Custom Update Center
Deploy Plugin on Masters
Target Masters
Deploy Plugin on Masters
Quick Cluster Operations
Demo time!
Quick Cluster Operations
Quick Cluster Operations
Cluster Operations Ref Card
Master Operation > Ref Card
● Backup master
● Disable plugin
● Execute Groovy Script on Master
● Install plugin
● Prepare Master for shutdown
● Refresh update center metadata
Master Operation > Ref Card
● Reindex for Analytics
● Restart Now
● Safe restart
● Upgrade Jenkins
● Upgrade all plugins
Update Center Operations > Ref Card
● Delete core
● Delete plugin
● Promote core
● Pull Everything
● Pull new versions
● Refresh upstream sources
Update Center Operations > Ref Card
● Track latest core
● Track latest plugin
● Upload core
● Upload plugin
Conclusion
master-a
master-b master-c
Jenkins Operations Center
Jenkins Operations Center
plugin
core
upgrade / restart
backup
CloudBees Analytics
Cluster Operations
CloudBees Analytics
master-a
master-b master-c
Monitor the Jenkins
masters “globally”
Cluster Operations
master-a
master-b master-c
Manage the Jenkins
masters “globally”
plugin
core
upgrade / restart
backup
script
Resources
http://www.slideshare.net/cloudbees/analyze-this-jenkins-cluster-operations-and-analytics
Questions
Appendix
Webinar Invitation
More and more organizations are jumping on the Continuous Delivery bandwagon to remain competitive.
As they do so, they use Jenkins to on-board teams and to orchestrate their continuous delivery pipelines.
Jenkins Operations Center by CloudBees is the tool that helps organizations run their CI infrastructure at
scale.
In this webinar, you will learn about:
● Reference architecture to build resilient Jenkins that onboard teams quickly
● Cluster Operations - helps to manage multiple Jenkins instances simultaneously.
● Want to install a new plugin on a 4 Jenkins masters ? We got that covered!
● CloudBees Analytics - offers insight into build and performance analytics.
● Want to know the number of jobs failing across 4 masters - we've got that covered too!

Analyze This! CloudBees Jenkins Cluster Operations and Analytics