DevOps is everywhere, but too often, people think they can buy “DevOps in a box” and sprinkle some tools and automation over a broken or slow (or even super-fast AWS) stack. But we know that software delivery is still difficult. How can you embrace DevOps concepts and take software delivery to that “next level”? In this chalk talk, we discuss some studies that show the outcomes companies care about: driving cultural changes, improving organizational performance, increasing software delivery performance, and ensuring development of high-quality software. We define what DevOps is, measuring it, and how innovative teams and organizations use it to drive performance and quality improvements.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Tools alone won’t fix broken DevOps
William Torrealba
Solutions architect
Amazon Web Services
M A D 2 0 1
Jeet Shangari
Sr. technical account manager
Amazon Web Services

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
Why should I care?
How do I improve performance and quality?
Some conclusions
Some resources

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Common product lifecycle
PMO + finance
Study and
approval
Design and
planning
“Agile” teams
Analysis
DevelopmentTesting
Centralized QA
Integration
and QA
IT operations
Release and
operation

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon May 2011 deployment stats
Considering only production hosts and environments:
• 11.6 seconds mean time between deployments (weekday)
• 1,079 max # of deployments in a single hour
• 10,000 mean # of hosts simultaneously receiving a deployment
• 30,000 max # of hosts simultaneously receiving a deployment
Source:
Jon Jenkins, “Velocity Culture, The Unmet Challenge in Ops” |
bit.ly/1vJo1Ya

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The DevOps movement
DevOps is the combination of cultural philosophies, practices, and tools that
increases an organization’s ability to deliver applications and services at high
velocity: evolving and improving products at a faster pace than organizations using
traditional software development and infrastructure management processes.

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
IT/software delivery performance
High
IT Performers
Medium
IT Performers
Low
IT Performers
Deployment Frequency
For the primary application or service you work on. How often does
your organization deploy code?
On demand, multiple
deployments per day
Between once per week
and once per month
Between once per week and
once per month – closer to
the once per month
Lead Time for changes
For the primary application or service that you work on. How long
does it take to go from code commit to successfully running on
production?
Less than one hour
Between one week and
one month
Between one week and one
month – closer to the one
month
Mean Time To Recover (MTTR)
For the primary application or service that you work on. How long
does it generally take to restore service after and service incident
occurs (e.g. unplanned outage, service impairment)
Less than one hour Less than one day
Between one day and one
week
Change failure rate
For the primary application or service that you work on. What
percentage of changes result either in degraded service or
subsequently requires remediation (e.g. lead to service impairment,
service outage, requires a hotfix, rollback, fix forward, patch)
0-15% 16-31% 31-45%

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How do you progress?
Process CultureTechnology

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The culture
Identity Quality Change management
Dealing with failure Team dynamics and trust Product management

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How to impact and influence culture
“What changed the culture was giving
employees the means by which they
could successfully do their jobs. It was
communicating clearly to employees
what their jobs were and providing the
training and tools to enable them to
perform those jobs successfully.”
John Shook
sloanreview.mit.edu/article/how-to-change-a-culture-lessons-from-nummi/

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Conclusions
We can have it all, or at least tempo and stability.
DevOps culture and practices have a measurable impact on IT and org
performance and quality.
Culture can be measured and changed.
Technology and agility do matter—but that is not enough.

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Resources
AWS DevOps resources:
https://aws.amazon.com/devops/
AWS modern applications
https://aws.amazon.com/modern-apps/
DevOps research
https://devops-research.com/research.html

13. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
William Torrealba
wtorreal@amazon.com
Jeet Shangari
shangari@amazon.com