Many companies adopt the DevOps practices, but struggle to realize the impact the DevOps investment is making to improve software delivery. Disconnected teams, tools and increasing complexity leads to no visibility into how and where to optimize the process, deliver value to customers and maximize return on that investment. The session covers industry trends, critical need for measurement and touches on CloudBees DevOptics solution purpose built to provide immediate transparency you need to measure, optimize and improve your software delivery process.
2. Agenda
● Who we are & What we do
● Giveaway - FREE DevOps World | Jenkins World Pass!
● Presentation
○ Measure, Optimize and Accelerate Software Delivery
with CloudBees DevOptics
● Q & A | Feedback | Discussions!
3. 45 of the Fortune 100 trust CloudBees
with their mission critical delivery
pipelines. Our leaders have grown great
ideas into enterprise standards at Splunk,
VMware, Microsoft, SUN, IBM and dozens
of startups.
We’ve been improving modern software
development since 2010. Our founders
are open source veterans from Red Hat
and JBOSS. We recently acquired
CodeShip, a leader in the next generation
of CI/CD as a Service.
We’re the #1 corporate sponsor of
Jenkins. Our CTO, Kohsuke Kawaguchi,
created the project; teams of our
engineers continuously add new code;
testers assure stability and security; and
dozens of our field engineers are certified
Jenkins administrators.
Who We Are
Our mission is to free developers while preserving business peace of mind
3
DevOps & OSS LeadersThe Company Behind Jenkins Enterprise Class
6. Measure, Optimize and Accelerate
Software Delivery with DevOptics
Anand Chauhan | Sr. Solutions Architect | CloudBees
achauhan@cloudbees.com | @anandcpm #learn-share-learn
North Florida
DevOps Meetup
7. What We’ll Learn
● Business & Technical Drivers for DevOps
● Success Patterns of DevOps High Performers
● Recipe: Art of Measuring Success & Failures Learnings
● Getting Started - Envision your own Value Stream with
CloudBees DevOptics!
● Q & A | Feedback | Discussions!
9. Factors driving the need for DevOps today!
❏ Improve Quality?
❏ Increase Velocity?
❏ Reduce Costs?
❏ Reduce Risk?
❏ Moving to Cloud?
❏ Harness Complexity?
❏ Increase Collaboration?
❏ Attract and Retain Talent?
❏ ALL of the above!
15. Barriers to implementing DevOps practices at Scale?
❏ Increasing Complexity?
❏ Lack of Visibility into SDLC?
❏ Mis-aligned Dev & Ops?
❏ Lack of Skills?
❏ Security Risks?
❏ Difficulty Justifying ROI?
❏ Clarity of Budget owner?
❏ No Leadership support?
❏ Disparate Toolchain?
❏ ALL of the above!
17. Reduce Waste
➔ Apply DevOps best practices and
➔ Enable cross-team collaboration
➔ Actionable feedback to refine your
continuous delivery capability.
➔ Get immediate visibility
◆ Bottlenecks,
◆ Wait times
◆ Dependencies
➔ Identify improvements at every
stage of delivery.
Visibility and insights to measure, optimize and accelerate your software delivery
17
Continuously Improve Leverage Best Practices
➔ Access data across teams, tools
and applications
➔ Actionable insights to measure,
manage and optimize DevOps
performance.
Proven Patterns to overcome DevOps Barriers!
18. Recipe for Success: Measure Your DevOps Performance!
Immediate transparency into the end-to-end software delivery process to
eliminate automation constraints, remove blockages and bottlenecks, and improve DevOps performance
18
Real-Time Value
Streams
Industry Standard
DevOps Metrics
CD Platform
Monitoring
19. Recipe for Success: Measure Your DevOps Performance!
Immediate transparency into the end-to-end software delivery process to
eliminate automation constraints, remove blockages and bottlenecks, and improve DevOps performance
19
➔ Track availability & usage
➔ Team engagement of your CD
platforms
➔ Optimally supporting your
software delivery activities.
➔ Measure performance across teams
➔ Leverage best practices
➔ Enable continuous improvement.
➔ Map your software delivery lifecycle
➔ Shared insights into your software delivery.
➔ Identify and remove bottlenecks
➔ Reduce waste.
Real-Time Value Streams Industry Standard DevOps MetricsCD Platform Monitoring
20. Run Insights
● Ensure your CD platform is optimally supporting the
demands of the product teams
21. Correlations
● In this example, we can see correlations between the
number of runs, and the average execution time.
23. BUSINESS CONFIDENTIAL – PROPRIETARY TO CLOUDBEES – DO NOT DISTRIBUTE
Identify Bottlenecks & Wait Time
● The Average Queue Time
● The Average Queue Length
26. Value Stream
● Visual model of the CD process
● Decomposes entire application(s)
● Assembled from multiple pipelines
27. Value Stream: Phases
● Map out different stages in the end to end software
delivery life cycle (SDLC)
28. Value Stream: Gates
● Gates represent individual jobs or pipelines across
any Jenkins instance, often owned by different teams
29. Value Stream: The Industry Standard Metrics
● Mean Lead Time (MLT)
● Deployment Frequency (DF)
● Change Failure Rate (CFR)
● Mean Time to Recovery (MTTR)
30. Value Stream Mapping: Tickets
● Tickets are the issues that describe the work to
deliver the software
31. Visualize Context
● Facilitate root cause analysis
● Dig deeper and easily navigate to
○ tickets in Jira
○ commits in Git
○ builds/jobs/pipelines in Jenkins
SCM
ALM
CI/CD
33. The State of DevOps report is the
industry bible on CD and DevOps
adoption and its correlation to improved
organizational performance.
State of DevOps
These DevOps performance metrics
allow organizations to objectively and
reliably measure and monitor
improvements to their software delivery
capability.
Manage Improvement
Industry Standard DevOps Metrics
Calculates and displays a set of four key
metrics to improve velocity on the basis of
throughput and stability (as popularized in
the Annual State of DevOps Report).
Key Metrics
34. DevOps Performance Metrics
● Organisation wide view of software Value Streams
● Benchmark for continuous improvement
● Improve business outcomes
● Foster increased adoption of best practices
● Demonstrating DevOps-driven improvements
36. *Source:
The Three Ways: The Principles Underpinning DevOps - Gene Kim
Feedback Loop and Measurement - Alan Kent
Recipe for Success: Measure Your DevOps Performance!
37. Recipe for Success: Measure Your DevOps Performance!
Immediate transparency into the end-to-end software delivery process to
eliminate automation constraints, remove blockages and bottlenecks, and improve DevOps performance
Real-Time Value
Streams
Industry Standard
DevOps Metrics
CD Platform
Monitoring
Solution: DevOptics
Replace Connecting teams with CD platform optimization
Devops perfromance is achieve by metrics, value steams remove the bnottlen nexckc
What os done by CD - optmiing the underlying platform - understand availanility
Solution: DevOptics
Replace Connecting teams with CD platform optimization
Devops perfromance is achieve by metrics, value steams remove the bnottlen nexckc
What os done by CD - optmiing the underlying platform - understand availanility
Monitoring and insights of all runs across your CD platform infrastructure
Real-time and historic view of job and pipeline activity
Connect any number of masters for aggregate view across the organisation
Works with heterogeneous mix of CloudBees Core and Jenkins OSS
Metrics viewable over an adjustable time period
The Runs Completed per Day graph and the Average Time to Complete a Run graph are displayed in the same tab because it can be useful to correlate data from both graphs
In this example, we can see correlations between the number of runs, and the average execution time.
This correlation was caused by resource constraints, and eliminating those resource constraints would allow jobs and pipelines running during busy periods to complete more quickly
Combining Active Runs with Runs Waiting to Start allows us to identify time periods where there is typically no or minimal platform activity (running or queued jobs/pipelines)Identify time periods where there is typically no or minimal platform activity (running or queued jobs/pipelines)
This would be a good time for scheduled maintenance or upgrades
High number of executors in use + high queue length suggests supply is out-stripping demand at certain points in the work day
High queue time / high queue length and low average executors in may indicate you have jobs set up using label expressions (e.g. A && B), and the number of nodes that actually satisfy that are low.
I can’t remember where or when I first started using this quote
A series of interconnected gates in multiple phases
Tracks tickets, commits and artifacts across the value stream
---
Allows understanding of where everything is on the journey from commit to production in real-time
Provides cross team visibility and collaboration
Allows detection of stalled and delayed changes
Makes it easy to identify failures and blockages and perform root cause analysis
Provides the visibility and information needed to optimize value flow
Phases map out different stages in the end to end Value Stream
Can contain multiple gates
Provide visibility of the
number of tickets sitting in the gate
state of the gate (passing/failing/running)
Understand how well individual pipelines/teams are performing
Easily adjust the time period for metrics calculation and display
They are assigned to a gate when they are mentioned in a commit
They can be associated with multiple commits
Tickets move from gate to gate as development progresses and artifacts are delivered to or used in later gates
Once a Value Stream has been mapped out, DevOptics provides critical visibility into context between
- Jenkins jobs and pipelines
- Git repositories and commits
- and Jira tickets.
It allows you to drill down into any of these for further detail, while also providing the big picture that helps us visualize entire value streams end to end.
Root cause analysis becomes much simpler when you can see the specific changes that have caused failures, and understand the details of those changes in context of others.
Birds-eye view of the real time pass/fail status of pipelines and jobs within each Value Stream
See and compare key DevOps performance metrics across Value Streams
Easily adjust the time period for metrics calculation and display
---
Remove effort intensive and error-prone manual data collection
Solution: DevOptics
Replace Connecting teams with CD platform optimization
Devops perfromance is achieve by metrics, value steams remove the bnottlen nexckc
What os done by CD - optmiing the underlying platform - understand availanility