The document discusses the evolution and benefits of DevOps practices in IT organizations, highlighting significant improvements in deployment frequency and recovery times. High-performing teams demonstrate agility and reliability, achieving faster deployments and lower change failure rates. Organizational culture, job satisfaction, and strong DevOps practices are identified as key contributors to overall performance and profitability.

1. Nicole Forsgren, PhD
Director of Organizational Performance & Analytics, Chef
Assistant Professor, Utah State University
DevOps and the Bottom Line

7. 10 deploys per day
Dev & ops cooperation at Flickr
John Allspaw & John Hammond
Velocity 2009
That was then…

8. Etsy Code Deployment
What once required 6-14 hours and an “Army”
…Now takes 15
minutes and 1 person
This is now…
2013 Mike Brittain, Continuous Deployment: The Dirty Details
3/2014 Daniel Schauenberg , Qcon London
4/2014 tweet @philkates
30+
Deploys
per day
2013
50
Deploys per day
March 2014
QCon London
80-90
Deploys per day
April 2014
Chef Conf

9. Amazon Deployment Stats
(production & host environments only)
This is now…
1,079Max deploys
In a single hour
Every 11.6 seconds!
10,000Mean # hosts receiving
Deploys simultaneously
30,000Max # hosts receiving
Deploys simultaneously

10. Intuit
“By installing a rampant innovation culture, we performed 165
experiments in the peak three months of tax season.
Our business result? Conversion rate of the website is up
50%. Employee result? Everyone loves it, because their new
ideas can make it to market. ”
- Scott Cook, Intuit founder

11. Devops is good for IT
Measuring DevOps and IT Performance
- Deploy frequency
- Mean Time to Recover (MTTR)
- Lead Time for Changes
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

12. High Performing DevOps teams
More agile
30x
More frequent
deployments
8000x
Faster lead times
than peers
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

13. High Performing DevOps teams
More reliable
2x
Change
Success
Rate
12x
Faster
Mean time to recovery
(MTTR)
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

14. Top 5 predictors of IT performance and DevOps
1. Peer-reviewed change approval process
2. Version control for all production artifacts
3. Proactive monitoring
4. High-trust organizational culture
5. Win-win relationship between Dev and Ops
teams
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

15. Practices correlated with IT Performance (DevOps)
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.
Throughput Metrics Stability Metrics
Deployment Frequency
● Continuous Delivery
● Version Control
Mean Time to Recover (MTTR)
● Version Control
● Monitoring System and Application Health
Lead Time for Changes
● Version Control
● Automated Testing
Change Fail Rate
● Not strongly correlated with specific
practices.
● Significant differences between groups with
high, medium and low change fail rates. High
performing IT orgs have 50% lower change
fail rates than their peers

16. Practices correlated with IT Performance (DevOps)
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.
Throughput Metrics Stability Metrics
Deployment Frequency
● Continuous Delivery
● Version Control
Mean Time to Recover (MTTR)
● Version Control
● Monitoring System and Application Health
Lead Time for Changes
● Version Control
● Automated Testing
Change Fail Rate
● Not strongly correlated with specific
practices.
● Significant differences between groups with
high, medium and low change fail rates. High
performing IT orgs have 50% lower change
fail rates than their peers

17. Practices correlated with IT Performance (DevOps)
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.
Throughput Metrics Stability Metrics
Deployment Frequency
● Continuous Delivery
● Version Control
Mean Time to Recover (MTTR)
● Version Control
● Monitoring System and Application Health
Lead Time for Changes
● Version Control
● Automated Testing
Change Fail Rate
● Not strongly correlated with specific
practices.
● Significant differences between groups with
high, medium and low change fail rates. High
performing IT orgs have 50% lower change
fail rates than their peers

18. Practices correlated with IT Performance (DevOps)
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.
Throughput Metrics Stability Metrics
Deployment Frequency
● Continuous Delivery
● Version Control
Mean Time to Recover (MTTR)
● Version Control
● Monitoring System and Application Health
Lead Time for Changes
● Version Control
● Automated Testing
Change Fail Rate
● Not strongly correlated with specific
practices.
● Significant differences between groups with
high, medium and low change fail rates. High
performing IT orgs have 50% lower change
fail rates than their peers

19. DevOps is good for organizations

20. High Performing IT organizations
2x
More likely to exceed
Profitability,
Market share, and
Productivity goals
50%
Higher market cap
growth over 3 years*
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

21. Three main contributors to organizational
performance
1. IT performance and strong DevOps
practices
2. Organizational culture and climate for
learning
3. Job satisfaction – #1 predictor
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

22. Organizational Culture
15% 52% 33%
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.

23. Job Satisfaction
The 2014 DevOps Survey of Practice and its resulting database are the property of Puppet Labs, Inc. and Gene Kim and Associates, LLC. All rights reserved.
Job satisfaction is the # 1
predictor of organizational
performance!
Top Predictors
of Job Satisfaction
★ High-trust organizational
culture
★ Climate of learning
★ Win-win relationships
between ops, dev and
infosec teams
★ Proactive monitoring and
autoscaling
★ Use of version control for
all production artifacts
★ Automated testing

24. DevOps isn’t just IT. It’s the practice of IT.

26. And look at the larger picture
But let’s step back…

28. My DevOps research in 2015
•What are your pain points?
•What are your big questions?
•I am kicking off exciting projects around DevOps and:
•Security and compliance at velocity
•Continuous integration and continuous delivery
•Executive and organizational support

29. What else can you do?
•Have your voice heard! Take the 2015 State of DevOps
Study
•bit.ly/1E19PP5
•Reach out!
•Amongst yourselves: Form communities of practice here in Brazil
•Amongst other IT Leadership going on the IT performance and
DevOps journey (e.g., attend DevOps Enterprise Summit, Velocity,
etc.)
•To me: Let me know what your ideas and questions are

30. nicole@chef.com
@nicolefv
nicoleforsgren.com
Thank you