SlideShare a Scribd company logo
1 of 47
Download to read offline
DevOps: It’s Not Just For WebOps
And We Have The Metrics To Prove It
Gene	
  Kim	
  (IT	
  Revolu0on	
  Press)	
  
Jez	
  Humble	
  (ThoughtWorks)	
  
James	
  Turnbull	
  (Puppet	
  Labs)	
  
John	
  Willis	
  (Enstra0us	
  /	
  Dell)	
  
Presenters
James Turnbull, VP of Community, Evangelism, and Business
Development
•  Prominent voice in DevOps community
•  Author of several technical books including The LogStash
Book
Gene Kim, IT researcher and author
•  Founder and former CTO of Tripwire for 13 years
•  Author "The Phoenix Project: A Novel About IT, DevOps, and
Helping Your Business Win” and “Visible Ops Handbook”
Jez Humble, Principal, ThoughtWorks
•  Co-author of Continuous Delivery
•  Loud mouth on effective practices for software delivery
The Big Why?
• Desire	
  to	
  understand	
  the	
  health	
  and	
  habits	
  of	
  
DevOps	
  community	
  
• Understand	
  the	
  link	
  between	
  behaviors	
  and	
  
performance	
  
• Mi0gate	
  the	
  “echo	
  chamber”	
  effect:	
  what	
  is	
  
the	
  evidence	
  of	
  improved	
  performance	
  
• Prove	
  that	
  DevOps	
  isn’t	
  just	
  for	
  unicorns…	
  	
  it’s	
  
for	
  the	
  horses,	
  too.	
  
Goals For This Presentation
• Show	
  you	
  how	
  to	
  do	
  cross-­‐sec0on	
  popula0on	
  
studies	
  
• Survey	
  Design	
  
• Survey	
  Execu0on	
  
• Survey	
  Analysis	
  
• Share	
  our	
  top	
  findings	
  
• Get	
  your	
  help	
  for	
  our	
  2013-­‐2014	
  study	
  
Where Did The High Performers Come From?
Over Ten Years, We Benchmarked 1500+ IT Orgs
Intuitive Analytical
Academic
Study
Population
Sample
Population
Sample
Academic
Study
Population
Sample
What Is Cross-Section Population Study
Population
Sample
Academic
Study
Population
Study
Benchmark
ROI Story
Best
Practice
Peer
Recommendation
Anecdote
Prior Experience
We Are
Here
Vendors
Consultants
Industry
Analyst
Tradeshows
Industry
Press
Blogshere
High Performing IT Organizations
§  High	
  performers	
  maintain	
  a	
  posture	
  of	
  compliance	
  
§ Fewest	
  number	
  of	
  repeat	
  audit	
  findings	
  
§ One-­‐third	
  amount	
  of	
  audit	
  prepara0on	
  effort	
  
§  High	
  performers	
  find	
  and	
  fix	
  security	
  breaches	
  faster	
  
§ 5	
  /mes	
  more	
  likely	
  to	
  detect	
  breaches	
  by	
  automated	
  control	
  
§ 5	
  /mes	
  less	
  likely	
  to	
  have	
  breaches	
  result	
  in	
  a	
  loss	
  event	
  
§  When	
  high	
  performers	
  implement	
  changes…	
  
§ 14	
  /mes	
  more	
  changes	
  
§ One-­‐half	
  the	
  change	
  failure	
  rate	
  	
  
§ One-­‐quarter	
  the	
  first	
  fix	
  failure	
  rate	
  	
  
§ 10x	
  faster	
  MTTR	
  for	
  Sev	
  1	
  outages	
  
§  When	
  high	
  performers	
  manage	
  IT	
  resources…	
  
§ One-­‐third	
  the	
  amount	
  of	
  unplanned	
  work	
  
§ 8	
  /mes	
  more	
  projects	
  and	
  IT	
  services	
  
§ 6	
  /mes	
  more	
  applica0ons	
  
	
  
Source: IT Process Institute, 2008
Visible Ops: Playbook of High Performers
• The IT Process Institute
has been studying high-
performing organizations
since 1999
• What is common to all the
high performers?
• What is different between
them and average and low
performers?
• How did they become great?
www.ITPI.org
The Story Begins…
Picture credit: Flickr: Floralgal
I Know!
12	
  
Lesson:
You are only as smart as the
average
of the top 5 people you hang out with
13	
  
2012 DevOps Survey
•  Written by Puppet Labs, Gene Kim, and Jez Humble
•  Ran through December of 2012
•  Goal: Get a snapshot of the current state of the health
and habits of the DevOps community
How To Do A Cross Section Population Study
• Survey	
  design	
  
• Survey	
  execu0on	
  
• Survey	
  analysis	
  
The Vision: DevOps Survey Of Practice II
• Performance	
  
• Behaviors	
  
• Demographics	
  
• Psychographics	
  
• Planned	
  target	
  was	
  30	
  ques0ons	
  
• We	
  asked	
  for	
  a	
  budget	
  of	
  8	
  ques0ons	
  
16	
  
Survey Design
In	
  the	
  ideal,	
  we	
  want	
  to	
  be	
  able	
  to	
  say,	
  “the	
  more	
  you	
  do	
  [A,	
  B,	
  
C],	
  the	
  more	
  performance	
  improves”	
  
X axis: independent variables
DevOps behaviors hypothesized to improve performance
Y axis: dependent variables
DevOps performance measures
Y-Axis: What Performance Looks Like
• How	
  ofen	
  do	
  you	
  deploy	
  code?	
  (e.g.,	
  daily,	
  
weekly,	
  monthly,	
  yearly)	
  
• What	
  is	
  the	
  average	
  lead	
  0me	
  of	
  a	
  change?	
  	
  (i.e.,	
  
how	
  long	
  does	
  it	
  take	
  to	
  go	
  from	
  “code	
  
commihed”	
  to	
  “code	
  successfully	
  running	
  in	
  
produc0on?”)	
  	
  
• What	
  percentage	
  of	
  your	
  changes	
  require	
  
rollbacks	
  or	
  hoiixes?	
  
• On	
  average,	
  how	
  long	
  does	
  it	
  take	
  to	
  restore	
  
service	
  when	
  something	
  goes	
  wrong?	
  (e.g.,	
  a	
  day,	
  
a	
  week,	
  a	
  month,	
  a	
  year)	
  
18	
  
X-Axis: What Behaviors Result In Performance
• Are	
  environment	
  and	
  infrastructure	
  changes	
  
(i.e.,	
  everything	
  except	
  for	
  code)	
  checked	
  into	
  
revision	
  control?	
  
• Is	
  there	
  an	
  automated	
  process	
  to	
  deploy	
  
environment	
  and	
  infrastructure	
  changes?	
  
• Who	
  performs	
  code	
  deployments?	
  	
  (e.g.,	
  Dev,	
  
Ops,	
  both)	
  
• Who	
  is	
  on	
  the	
  hook	
  for	
  produc0on	
  support	
  
(e.g.,	
  Dev,	
  Ops,	
  both)	
  
19	
  
Next Step: Survey Execution
•  Once	
  the	
  survey	
  
instrument	
  is	
  ready,	
  then	
  
you	
  need	
  people	
  to	
  take	
  
the	
  survey	
  
•  Michelle	
  Carroll	
  and	
  the	
  
Puppet	
  Labs	
  marke0ng	
  
machine	
  went	
  to	
  work	
  
• Mailing	
  lists	
  
• Twiher	
  
• Reddit	
  
21	
  
The Results
• 4039	
  completed	
  survey	
  responses	
  in	
  30	
  
days!!!	
  
• This	
  is	
  amazing.	
  	
  With	
  a	
  primary	
  research	
  firm,	
  
this	
  type	
  of	
  popula0on	
  size	
  usually	
  would	
  cost	
  
$100-­‐200K!	
  
22	
  
Lesson: Do Not Change Answers Mid-Survey
Uh, Oh… Now what?
Lesson:
Get data analyst on the team BEFORE you
do survey design!
25	
  
Where Do You Find Your Own Wally?
• Steal	
  a	
  consultant	
  ;)	
  
• R	
  User	
  Groups	
  
• University	
  students	
  in	
  search	
  of	
  a	
  thesis	
  
• Economics	
  students	
  a	
  plus	
  (sta0s0cs,	
  applied)	
  
• Ex-­‐Wall	
  Street	
  investors	
  (not	
  recommended)	
  
Wally Zabaglio, Puppet Labs Data Analyst
–  Former specialized analytics consultant at The Nielsen
Company; analyst for the US Department of Energy's
Office of Environmental Management
–  Primary analyst on DevOps survey results
27	
  
Data Cleanup
• Used	
  Google	
  Refine	
  to	
  clean	
  up	
  data	
  and	
  
compensate	
  for	
  “Gene	
  screwup”	
  
• Used	
  R	
  to	
  do	
  analysis	
  
• Look	
  for	
  signal	
  
• Explore	
  data	
  
• Run	
  correla0ons	
  
Key Findings
High Performing DevOps Teams
• They’re	
  more	
  agile	
  
• 30x	
  more	
  frequent	
  deployments	
  
• 8,000x	
  shorter	
  lead	
  0me	
  	
  
(minutes/hours	
  vs.	
  months/quarters)	
  
• They’re	
  more	
  reliable	
  
• 2x	
  the	
  change	
  success	
  rate	
  
• 12x	
  faster	
  MTTR	
  
31
Technical Practices Matter
•  89% are using infrastructure version control
•  82% are using automated code deployments
Deliberate Practice Matters
Organizations that implemented DevOps practices over 12
months ago were 5x more likely to be high performing than
organizations that weren’t implementing DevOps at all.
The Lost Hypotheses *
o  Who performs code deployments?
o  Who is on the hook for production support?
Measuring Culture
“I’ll tell you EXACTLY what devops means.
Devops means giving a shit about your job enough to not pass
the buck. Devops means giving a shit about your job enough to
want to learn all the parts and not just your little world.
Developers need to understand infrastructure. Operations
people need to understand code. People need to fucking work
with each other and not just occupy space next to each other.”
John Vincent | @lusis | http://bit.ly/12DkRhf
Measuring Culture
Trust (and Verify)
Continuous Improvement vs Risk Management Theater
“Human Error”
Heroes / "high performers"
The tribe is operationally strong *
	
  
	
  
70%	
  Opera0ons	
  people	
  
	
  	
  
The tribe is operationally strong
	
  
	
  
This	
  is	
  not	
  a	
  Dev	
  takeover	
  
	
  	
  
The tribe is enterprise too!
	
  
26%	
  -­‐	
  500	
  to	
  9999	
  
16%	
  -­‐	
  10K	
  plus	
  
	
  	
  
Overcoming barriers to DevOps adoption
Biggest barriers were cultural
•  Lack of manager buy-in
•  Lack of team buy-in
•  Value of DevOps not understood outside my
group
What are organizations looking for in DevOps skills?
•  Coding/scripting (84%)
•  People skills (60%)
•  Process re-engineering skills (56%)
•  Experience with specific tools (19%)
Challenges to culture
	
  
It's	
  easier	
  to	
  teach	
  tools	
  
than	
  teach	
  people	
  skills	
  
	
  	
  
Preparing For DevOps Survey 2013-2014
• How	
  do	
  we	
  measure	
  culture?	
  
• High	
  management	
  vs.	
  low	
  trust	
  management	
  
styles	
  (and	
  link	
  to	
  team	
  size)	
  
• Industry	
  code	
  
• Beher	
  define	
  performance	
  variables	
  to	
  enable	
  
regression	
  analysis	
  (Likert-­‐type	
  scale)	
  
• Business	
  cri0cality:	
  system	
  of	
  engagement	
  vs.	
  
system	
  of	
  record	
  
• What	
  else?	
  	
  We	
  want	
  to	
  hear	
  your	
  thoughts!	
  
If you … Then …
… want to learn more about the findings •  Read the full-length report:
http://puppetlabs.com/devops
•  Share the infographic:
http://puppetlabs.com/2013-state-of-devops-
infographic
•  Get these slides:
http://slideshare.net/realgenekim/
DevOpsSurveyOfPractice
… have ideas on the DevOps Survey Of
Practice 2013-2014
•  Come talk with us!
•  Join our Google+ Community:
https://plus.google.com/communities/
104363243715545285555
… share your stories of transformation •  Go to FlowCon! http://flowcon.org
… get a free copy of The Phoenix Project:
A Novel About IT, DevOps, and Helping
Your Business Win
•  Go to the AppFirst booth at 2:40pm. Gene
will be signing books!

More Related Content

What's hot

2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report
2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report
2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience ReportGene Kim
 
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev ops
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev opsKim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev ops
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev opsGene Kim
 
SecureWorld Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6a
SecureWorld   Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6aSecureWorld   Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6a
SecureWorld Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6aGene Kim
 
Leading A DevOps Transformation: Lessons Learned
Leading A DevOps Transformation: Lessons LearnedLeading A DevOps Transformation: Lessons Learned
Leading A DevOps Transformation: Lessons LearnedGene Kim
 
Infosec at Ludicrous Speeds - Rugged DevOps
Infosec at Ludicrous Speeds - Rugged DevOps Infosec at Ludicrous Speeds - Rugged DevOps
Infosec at Ludicrous Speeds - Rugged DevOps Gene Kim
 
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?Gene Kim
 
Keeping The Auditor Away: DevOps Audit Compliance Case Studies
Keeping The Auditor Away: DevOps Audit Compliance Case StudiesKeeping The Auditor Away: DevOps Audit Compliance Case Studies
Keeping The Auditor Away: DevOps Audit Compliance Case StudiesGene Kim
 
DevOps State of the Union 2015
DevOps State of the Union 2015DevOps State of the Union 2015
DevOps State of the Union 2015Ernest Mueller
 
The Unicorn Project and The Five Ideals (Updated Dec 2019)
The Unicorn Project and The Five Ideals (Updated Dec 2019)The Unicorn Project and The Five Ideals (Updated Dec 2019)
The Unicorn Project and The Five Ideals (Updated Dec 2019)Gene Kim
 
2019 Top Lessons Learned Since the Phoenix Project Was Released
2019 Top Lessons Learned Since the Phoenix Project Was Released2019 Top Lessons Learned Since the Phoenix Project Was Released
2019 Top Lessons Learned Since the Phoenix Project Was ReleasedGene Kim
 
When IT Fails The Business Fails...
When IT Fails The Business Fails...When IT Fails The Business Fails...
When IT Fails The Business Fails...Gene Kim
 
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...Gene Kim
 
Limited WIP Meeting presentation - The Phoenix Project book review
Limited WIP Meeting presentation - The Phoenix Project book reviewLimited WIP Meeting presentation - The Phoenix Project book review
Limited WIP Meeting presentation - The Phoenix Project book reviewRudiger Wolf
 
The Unicorn Project and The Five Ideals (older: see notes for newer version)
The Unicorn Project and The Five Ideals (older: see notes for newer version)The Unicorn Project and The Five Ideals (older: see notes for newer version)
The Unicorn Project and The Five Ideals (older: see notes for newer version)Gene Kim
 
SecureWorld - Communicating With Your CFO
SecureWorld - Communicating With Your CFOSecureWorld - Communicating With Your CFO
SecureWorld - Communicating With Your CFOGene Kim
 
Tui the phoenix project book review
Tui the phoenix project book reviewTui the phoenix project book review
Tui the phoenix project book reviewRudiger Wolf
 
2012 05 corp fin 1c
2012 05 corp fin 1c2012 05 corp fin 1c
2012 05 corp fin 1cGene Kim
 
2012 SxSW When IT Says No by Gene Kim
2012 SxSW When IT Says No by Gene Kim2012 SxSW When IT Says No by Gene Kim
2012 SxSW When IT Says No by Gene KimGene Kim
 
SecureWorld: Security is Dead, Rugged DevOps 1f
SecureWorld:  Security is Dead, Rugged DevOps 1fSecureWorld:  Security is Dead, Rugged DevOps 1f
SecureWorld: Security is Dead, Rugged DevOps 1fGene Kim
 
DevOps Kanban Meet Up 3/22/12
DevOps Kanban Meet Up 3/22/12DevOps Kanban Meet Up 3/22/12
DevOps Kanban Meet Up 3/22/12Gene Kim
 

What's hot (20)

2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report
2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report
2019 12 Clojure/conj: Love Letter To Clojure, and A Datomic Experience Report
 
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev ops
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev opsKim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev ops
Kim IT Pro Forum Eugene: IT at Ludicrous Speeds - rugged dev ops
 
SecureWorld Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6a
SecureWorld   Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6aSecureWorld   Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6a
SecureWorld Kim - Infosec at Ludicrous Speeds - Rugged DevOps 6a
 
Leading A DevOps Transformation: Lessons Learned
Leading A DevOps Transformation: Lessons LearnedLeading A DevOps Transformation: Lessons Learned
Leading A DevOps Transformation: Lessons Learned
 
Infosec at Ludicrous Speeds - Rugged DevOps
Infosec at Ludicrous Speeds - Rugged DevOps Infosec at Ludicrous Speeds - Rugged DevOps
Infosec at Ludicrous Speeds - Rugged DevOps
 
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?
DevOps: Who Will Create $2.6 Trillion In Business Value Per Year?
 
Keeping The Auditor Away: DevOps Audit Compliance Case Studies
Keeping The Auditor Away: DevOps Audit Compliance Case StudiesKeeping The Auditor Away: DevOps Audit Compliance Case Studies
Keeping The Auditor Away: DevOps Audit Compliance Case Studies
 
DevOps State of the Union 2015
DevOps State of the Union 2015DevOps State of the Union 2015
DevOps State of the Union 2015
 
The Unicorn Project and The Five Ideals (Updated Dec 2019)
The Unicorn Project and The Five Ideals (Updated Dec 2019)The Unicorn Project and The Five Ideals (Updated Dec 2019)
The Unicorn Project and The Five Ideals (Updated Dec 2019)
 
2019 Top Lessons Learned Since the Phoenix Project Was Released
2019 Top Lessons Learned Since the Phoenix Project Was Released2019 Top Lessons Learned Since the Phoenix Project Was Released
2019 Top Lessons Learned Since the Phoenix Project Was Released
 
When IT Fails The Business Fails...
When IT Fails The Business Fails...When IT Fails The Business Fails...
When IT Fails The Business Fails...
 
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...
GitHub Universe: 2019: Exemplars, Laggards, and Hoarders A Data-driven Look a...
 
Limited WIP Meeting presentation - The Phoenix Project book review
Limited WIP Meeting presentation - The Phoenix Project book reviewLimited WIP Meeting presentation - The Phoenix Project book review
Limited WIP Meeting presentation - The Phoenix Project book review
 
The Unicorn Project and The Five Ideals (older: see notes for newer version)
The Unicorn Project and The Five Ideals (older: see notes for newer version)The Unicorn Project and The Five Ideals (older: see notes for newer version)
The Unicorn Project and The Five Ideals (older: see notes for newer version)
 
SecureWorld - Communicating With Your CFO
SecureWorld - Communicating With Your CFOSecureWorld - Communicating With Your CFO
SecureWorld - Communicating With Your CFO
 
Tui the phoenix project book review
Tui the phoenix project book reviewTui the phoenix project book review
Tui the phoenix project book review
 
2012 05 corp fin 1c
2012 05 corp fin 1c2012 05 corp fin 1c
2012 05 corp fin 1c
 
2012 SxSW When IT Says No by Gene Kim
2012 SxSW When IT Says No by Gene Kim2012 SxSW When IT Says No by Gene Kim
2012 SxSW When IT Says No by Gene Kim
 
SecureWorld: Security is Dead, Rugged DevOps 1f
SecureWorld:  Security is Dead, Rugged DevOps 1fSecureWorld:  Security is Dead, Rugged DevOps 1f
SecureWorld: Security is Dead, Rugged DevOps 1f
 
DevOps Kanban Meet Up 3/22/12
DevOps Kanban Meet Up 3/22/12DevOps Kanban Meet Up 3/22/12
DevOps Kanban Meet Up 3/22/12
 

Viewers also liked

TechTalk: All You Want to Know About Docker and CA Testing Tools.
TechTalk: All You Want to Know About Docker and CA Testing Tools.TechTalk: All You Want to Know About Docker and CA Testing Tools.
TechTalk: All You Want to Know About Docker and CA Testing Tools.CA Technologies
 
CA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsCA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsAlan Baptista
 
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...ServiceVirtualization.Com
 
Pics from Oracle OpenWorld 2012 - CA Service Virtualization
Pics from Oracle OpenWorld 2012 - CA Service VirtualizationPics from Oracle OpenWorld 2012 - CA Service Virtualization
Pics from Oracle OpenWorld 2012 - CA Service VirtualizationServiceVirtualization.Com
 
10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
10+ Deploys Per Day: Dev and Ops Cooperation at Flickr10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
10+ Deploys Per Day: Dev and Ops Cooperation at FlickrJohn Allspaw
 
Byron miller ignite DevOpsDays 2015 - Future Backwards
Byron miller ignite DevOpsDays 2015 - Future BackwardsByron miller ignite DevOpsDays 2015 - Future Backwards
Byron miller ignite DevOpsDays 2015 - Future BackwardsByron Miller
 
Continuous deployment in 15 minutes
Continuous deployment in 15 minutesContinuous deployment in 15 minutes
Continuous deployment in 15 minutesChristophe Marchal
 
Continuous delivery - takeaways
Continuous delivery - takeawaysContinuous delivery - takeaways
Continuous delivery - takeawaysManuela Grindei
 
The Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez HumbleThe Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez HumbleSerena Software
 
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...Voxxed Days Thessaloniki
 
DevOps Metrics - Lies, Damned Lies and Statistics
DevOps Metrics - Lies, Damned Lies and StatisticsDevOps Metrics - Lies, Damned Lies and Statistics
DevOps Metrics - Lies, Damned Lies and StatisticsGaetano Mazzanti
 
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and free
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and freeVoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and free
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and freeyohanbeschi
 
Puppet HackDay/BarCamp New Delhi Exercises
Puppet HackDay/BarCamp New Delhi ExercisesPuppet HackDay/BarCamp New Delhi Exercises
Puppet HackDay/BarCamp New Delhi ExercisesJulie Tsai
 
Considerations for Operating an OpenStack Cloud
Considerations for Operating an OpenStack CloudConsiderations for Operating an OpenStack Cloud
Considerations for Operating an OpenStack CloudAll Things Open
 
OpenStack: Everything You Need to Know To Get Started
OpenStack: Everything You Need to Know To Get StartedOpenStack: Everything You Need to Know To Get Started
OpenStack: Everything You Need to Know To Get StartedAll Things Open
 
How I Learned to Stop Worrying and Love DevOps (March 2014)
How I Learned to Stop Worrying and Love DevOps (March 2014)How I Learned to Stop Worrying and Love DevOps (March 2014)
How I Learned to Stop Worrying and Love DevOps (March 2014)bridgetkromhout
 
State of the Stack April 2013
State of the Stack April 2013State of the Stack April 2013
State of the Stack April 2013Randy Bias
 
Continuous Delivery Distilled
Continuous Delivery DistilledContinuous Delivery Distilled
Continuous Delivery DistilledMatt Callanan
 

Viewers also liked (20)

TechTalk: All You Want to Know About Docker and CA Testing Tools.
TechTalk: All You Want to Know About Docker and CA Testing Tools.TechTalk: All You Want to Know About Docker and CA Testing Tools.
TechTalk: All You Want to Know About Docker and CA Testing Tools.
 
CA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsCA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubs
 
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...
CA John Michelsen - Oracle OpenWorld 2012 - "ServiceVirtualization Reality is...
 
Pics from Oracle OpenWorld 2012 - CA Service Virtualization
Pics from Oracle OpenWorld 2012 - CA Service VirtualizationPics from Oracle OpenWorld 2012 - CA Service Virtualization
Pics from Oracle OpenWorld 2012 - CA Service Virtualization
 
10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
10+ Deploys Per Day: Dev and Ops Cooperation at Flickr10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
10+ Deploys Per Day: Dev and Ops Cooperation at Flickr
 
Lean DevOps Metrics
Lean DevOps MetricsLean DevOps Metrics
Lean DevOps Metrics
 
Byron miller ignite DevOpsDays 2015 - Future Backwards
Byron miller ignite DevOpsDays 2015 - Future BackwardsByron miller ignite DevOpsDays 2015 - Future Backwards
Byron miller ignite DevOpsDays 2015 - Future Backwards
 
Adopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed ITAdopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed IT
 
Continuous deployment in 15 minutes
Continuous deployment in 15 minutesContinuous deployment in 15 minutes
Continuous deployment in 15 minutes
 
Continuous delivery - takeaways
Continuous delivery - takeawaysContinuous delivery - takeaways
Continuous delivery - takeaways
 
The Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez HumbleThe Secrets of High Performance IT, Featuring Jez Humble
The Secrets of High Performance IT, Featuring Jez Humble
 
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
Voxxed Days Thessaloniki 2016 - Continuous Delivery: Jenkins, Docker and Spri...
 
DevOps Metrics - Lies, Damned Lies and Statistics
DevOps Metrics - Lies, Damned Lies and StatisticsDevOps Metrics - Lies, Damned Lies and Statistics
DevOps Metrics - Lies, Damned Lies and Statistics
 
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and free
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and freeVoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and free
VoxxedDays LU 2016 - Thoughtworks Go - Continuous Deployment made easy and free
 
Puppet HackDay/BarCamp New Delhi Exercises
Puppet HackDay/BarCamp New Delhi ExercisesPuppet HackDay/BarCamp New Delhi Exercises
Puppet HackDay/BarCamp New Delhi Exercises
 
Considerations for Operating an OpenStack Cloud
Considerations for Operating an OpenStack CloudConsiderations for Operating an OpenStack Cloud
Considerations for Operating an OpenStack Cloud
 
OpenStack: Everything You Need to Know To Get Started
OpenStack: Everything You Need to Know To Get StartedOpenStack: Everything You Need to Know To Get Started
OpenStack: Everything You Need to Know To Get Started
 
How I Learned to Stop Worrying and Love DevOps (March 2014)
How I Learned to Stop Worrying and Love DevOps (March 2014)How I Learned to Stop Worrying and Love DevOps (March 2014)
How I Learned to Stop Worrying and Love DevOps (March 2014)
 
State of the Stack April 2013
State of the Stack April 2013State of the Stack April 2013
State of the Stack April 2013
 
Continuous Delivery Distilled
Continuous Delivery DistilledContinuous Delivery Distilled
Continuous Delivery Distilled
 

Similar to 2013 Velocity DevOps Metrics -- It's Not Just For WebOps Any More!

DevOps Roadtrip - Denver
DevOps Roadtrip - DenverDevOps Roadtrip - Denver
DevOps Roadtrip - DenverVictorOps
 
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...Puppet
 
The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)dev2ops
 
Java DevOps at Enterprise Scale
Java DevOps at Enterprise ScaleJava DevOps at Enterprise Scale
Java DevOps at Enterprise ScaleRyan McGuinness
 
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...David Walker
 
DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis VictorOps
 
Continuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps AwesomeContinuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps AwesomeNicole Forsgren
 
Building and Scaling High Performing Technology Organizations by Jez Humble a...
Building and Scaling High Performing Technology Organizations by Jez Humble a...Building and Scaling High Performing Technology Organizations by Jez Humble a...
Building and Scaling High Performing Technology Organizations by Jez Humble a...Agile India
 
Meetup DevOps - Accelerate
Meetup DevOps - AccelerateMeetup DevOps - Accelerate
Meetup DevOps - AccelerateDelta-N
 
Turning Human Capital into High Performance Organizational Capital
Turning Human Capital into High Performance Organizational CapitalTurning Human Capital into High Performance Organizational Capital
Turning Human Capital into High Performance Organizational CapitalJohn Willis
 
ASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaAvisi B.V.
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsAmazon Web Services
 
POWRR Tools: Lessons learned from an IMLS National Leadership Grant
POWRR Tools: Lessons learned from an IMLS National Leadership GrantPOWRR Tools: Lessons learned from an IMLS National Leadership Grant
POWRR Tools: Lessons learned from an IMLS National Leadership GrantLynne Thomas
 
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...XebiaLabs
 
The Latest in DevOps: Elite Performance, Productivity, and Scaling - Google
The Latest in DevOps: Elite Performance, Productivity, and Scaling - GoogleThe Latest in DevOps: Elite Performance, Productivity, and Scaling - Google
The Latest in DevOps: Elite Performance, Productivity, and Scaling - GoogleMarilyne Huret
 

Similar to 2013 Velocity DevOps Metrics -- It's Not Just For WebOps Any More! (20)

DevOps
DevOpsDevOps
DevOps
 
DevOps Roadtrip - Denver
DevOps Roadtrip - DenverDevOps Roadtrip - Denver
DevOps Roadtrip - Denver
 
Devops intro
Devops introDevops intro
Devops intro
 
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...
DevOps Means Business - Gene Kim, IT Revolution Press & Nicole Forsgren Velas...
 
Computing DevOp Summit
Computing DevOp SummitComputing DevOp Summit
Computing DevOp Summit
 
The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)The History of DevOps (and what you need to do about it)
The History of DevOps (and what you need to do about it)
 
Java DevOps at Enterprise Scale
Java DevOps at Enterprise ScaleJava DevOps at Enterprise Scale
Java DevOps at Enterprise Scale
 
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...
Devops & Agility - Build the Culture, Get the Tools, Win the Day - Dundee Tec...
 
DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis DevOps Roadtrip Minneapolis
DevOps Roadtrip Minneapolis
 
What is DevOps?
What is DevOps?What is DevOps?
What is DevOps?
 
Continuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps AwesomeContinuous Delivery: Making DevOps Awesome
Continuous Delivery: Making DevOps Awesome
 
Building and Scaling High Performing Technology Organizations by Jez Humble a...
Building and Scaling High Performing Technology Organizations by Jez Humble a...Building and Scaling High Performing Technology Organizations by Jez Humble a...
Building and Scaling High Performing Technology Organizations by Jez Humble a...
 
Meetup DevOps - Accelerate
Meetup DevOps - AccelerateMeetup DevOps - Accelerate
Meetup DevOps - Accelerate
 
Turning Human Capital into High Performance Organizational Capital
Turning Human Capital into High Performance Organizational CapitalTurning Human Capital into High Performance Organizational Capital
Turning Human Capital into High Performance Organizational Capital
 
ASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de MirandaASAS 2015 - Benito de Miranda
ASAS 2015 - Benito de Miranda
 
DEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOpsDEV345_Tools Won’t Fix Your Broken DevOps
DEV345_Tools Won’t Fix Your Broken DevOps
 
POWRR Tools: Lessons learned from an IMLS National Leadership Grant
POWRR Tools: Lessons learned from an IMLS National Leadership GrantPOWRR Tools: Lessons learned from an IMLS National Leadership Grant
POWRR Tools: Lessons learned from an IMLS National Leadership Grant
 
2016 State of DevOps
2016 State of DevOps2016 State of DevOps
2016 State of DevOps
 
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...
DevOps by the Numbers - How to Approach the Measurement and Metrics of Your C...
 
The Latest in DevOps: Elite Performance, Productivity, and Scaling - Google
The Latest in DevOps: Elite Performance, Productivity, and Scaling - GoogleThe Latest in DevOps: Elite Performance, Productivity, and Scaling - Google
The Latest in DevOps: Elite Performance, Productivity, and Scaling - Google
 

More from Gene Kim

Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...
Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...
Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...Gene Kim
 
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology Orgs
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology OrgsWhy Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology Orgs
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology OrgsGene Kim
 
Kevin Behr: Integrating Controls and Process Improvement
Kevin Behr: Integrating Controls and Process ImprovementKevin Behr: Integrating Controls and Process Improvement
Kevin Behr: Integrating Controls and Process ImprovementGene Kim
 
United2012 Rugged DevOps Rocks
United2012 Rugged DevOps RocksUnited2012 Rugged DevOps Rocks
United2012 Rugged DevOps RocksGene Kim
 
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous Speed
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous SpeedSecurity is Dead. Long Live Rugged DevOps: IT at Ludicrous Speed
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous SpeedGene Kim
 
2011 09 19 LSPE Dev Ops Cookbook 1a
2011 09 19 LSPE Dev Ops Cookbook 1a2011 09 19 LSPE Dev Ops Cookbook 1a
2011 09 19 LSPE Dev Ops Cookbook 1aGene Kim
 

More from Gene Kim (6)

Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...
Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...
Speaker Recording Tips For Virtual DevOps Enterprise (And Why We're Pre-Recor...
 
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology Orgs
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology OrgsWhy Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology Orgs
Why Everyone Needs DevOps Now: 15 Year Study Of High Performing Technology Orgs
 
Kevin Behr: Integrating Controls and Process Improvement
Kevin Behr: Integrating Controls and Process ImprovementKevin Behr: Integrating Controls and Process Improvement
Kevin Behr: Integrating Controls and Process Improvement
 
United2012 Rugged DevOps Rocks
United2012 Rugged DevOps RocksUnited2012 Rugged DevOps Rocks
United2012 Rugged DevOps Rocks
 
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous Speed
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous SpeedSecurity is Dead. Long Live Rugged DevOps: IT at Ludicrous Speed
Security is Dead. Long Live Rugged DevOps: IT at Ludicrous Speed
 
2011 09 19 LSPE Dev Ops Cookbook 1a
2011 09 19 LSPE Dev Ops Cookbook 1a2011 09 19 LSPE Dev Ops Cookbook 1a
2011 09 19 LSPE Dev Ops Cookbook 1a
 

Recently uploaded

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 

Recently uploaded (20)

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 

2013 Velocity DevOps Metrics -- It's Not Just For WebOps Any More!

  • 1. DevOps: It’s Not Just For WebOps And We Have The Metrics To Prove It Gene  Kim  (IT  Revolu0on  Press)   Jez  Humble  (ThoughtWorks)   James  Turnbull  (Puppet  Labs)   John  Willis  (Enstra0us  /  Dell)  
  • 2. Presenters James Turnbull, VP of Community, Evangelism, and Business Development •  Prominent voice in DevOps community •  Author of several technical books including The LogStash Book Gene Kim, IT researcher and author •  Founder and former CTO of Tripwire for 13 years •  Author "The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win” and “Visible Ops Handbook” Jez Humble, Principal, ThoughtWorks •  Co-author of Continuous Delivery •  Loud mouth on effective practices for software delivery
  • 3. The Big Why? • Desire  to  understand  the  health  and  habits  of   DevOps  community   • Understand  the  link  between  behaviors  and   performance   • Mi0gate  the  “echo  chamber”  effect:  what  is   the  evidence  of  improved  performance   • Prove  that  DevOps  isn’t  just  for  unicorns…    it’s   for  the  horses,  too.  
  • 4.
  • 5. Goals For This Presentation • Show  you  how  to  do  cross-­‐sec0on  popula0on   studies   • Survey  Design   • Survey  Execu0on   • Survey  Analysis   • Share  our  top  findings   • Get  your  help  for  our  2013-­‐2014  study  
  • 6. Where Did The High Performers Come From?
  • 7. Over Ten Years, We Benchmarked 1500+ IT Orgs
  • 8. Intuitive Analytical Academic Study Population Sample Population Sample Academic Study Population Sample What Is Cross-Section Population Study Population Sample Academic Study Population Study Benchmark ROI Story Best Practice Peer Recommendation Anecdote Prior Experience We Are Here Vendors Consultants Industry Analyst Tradeshows Industry Press Blogshere
  • 9. High Performing IT Organizations §  High  performers  maintain  a  posture  of  compliance   § Fewest  number  of  repeat  audit  findings   § One-­‐third  amount  of  audit  prepara0on  effort   §  High  performers  find  and  fix  security  breaches  faster   § 5  /mes  more  likely  to  detect  breaches  by  automated  control   § 5  /mes  less  likely  to  have  breaches  result  in  a  loss  event   §  When  high  performers  implement  changes…   § 14  /mes  more  changes   § One-­‐half  the  change  failure  rate     § One-­‐quarter  the  first  fix  failure  rate     § 10x  faster  MTTR  for  Sev  1  outages   §  When  high  performers  manage  IT  resources…   § One-­‐third  the  amount  of  unplanned  work   § 8  /mes  more  projects  and  IT  services   § 6  /mes  more  applica0ons     Source: IT Process Institute, 2008
  • 10. Visible Ops: Playbook of High Performers • The IT Process Institute has been studying high- performing organizations since 1999 • What is common to all the high performers? • What is different between them and average and low performers? • How did they become great? www.ITPI.org
  • 11. The Story Begins… Picture credit: Flickr: Floralgal
  • 13. Lesson: You are only as smart as the average of the top 5 people you hang out with 13  
  • 14. 2012 DevOps Survey •  Written by Puppet Labs, Gene Kim, and Jez Humble •  Ran through December of 2012 •  Goal: Get a snapshot of the current state of the health and habits of the DevOps community
  • 15. How To Do A Cross Section Population Study • Survey  design   • Survey  execu0on   • Survey  analysis  
  • 16. The Vision: DevOps Survey Of Practice II • Performance   • Behaviors   • Demographics   • Psychographics   • Planned  target  was  30  ques0ons   • We  asked  for  a  budget  of  8  ques0ons   16  
  • 17. Survey Design In  the  ideal,  we  want  to  be  able  to  say,  “the  more  you  do  [A,  B,   C],  the  more  performance  improves”   X axis: independent variables DevOps behaviors hypothesized to improve performance Y axis: dependent variables DevOps performance measures
  • 18. Y-Axis: What Performance Looks Like • How  ofen  do  you  deploy  code?  (e.g.,  daily,   weekly,  monthly,  yearly)   • What  is  the  average  lead  0me  of  a  change?    (i.e.,   how  long  does  it  take  to  go  from  “code   commihed”  to  “code  successfully  running  in   produc0on?”)     • What  percentage  of  your  changes  require   rollbacks  or  hoiixes?   • On  average,  how  long  does  it  take  to  restore   service  when  something  goes  wrong?  (e.g.,  a  day,   a  week,  a  month,  a  year)   18  
  • 19. X-Axis: What Behaviors Result In Performance • Are  environment  and  infrastructure  changes   (i.e.,  everything  except  for  code)  checked  into   revision  control?   • Is  there  an  automated  process  to  deploy   environment  and  infrastructure  changes?   • Who  performs  code  deployments?    (e.g.,  Dev,   Ops,  both)   • Who  is  on  the  hook  for  produc0on  support   (e.g.,  Dev,  Ops,  both)   19  
  • 20. Next Step: Survey Execution •  Once  the  survey   instrument  is  ready,  then   you  need  people  to  take   the  survey   •  Michelle  Carroll  and  the   Puppet  Labs  marke0ng   machine  went  to  work   • Mailing  lists   • Twiher   • Reddit  
  • 21. 21  
  • 22. The Results • 4039  completed  survey  responses  in  30   days!!!   • This  is  amazing.    With  a  primary  research  firm,   this  type  of  popula0on  size  usually  would  cost   $100-­‐200K!   22  
  • 23. Lesson: Do Not Change Answers Mid-Survey
  • 24. Uh, Oh… Now what?
  • 25. Lesson: Get data analyst on the team BEFORE you do survey design! 25  
  • 26. Where Do You Find Your Own Wally? • Steal  a  consultant  ;)   • R  User  Groups   • University  students  in  search  of  a  thesis   • Economics  students  a  plus  (sta0s0cs,  applied)   • Ex-­‐Wall  Street  investors  (not  recommended)   Wally Zabaglio, Puppet Labs Data Analyst –  Former specialized analytics consultant at The Nielsen Company; analyst for the US Department of Energy's Office of Environmental Management –  Primary analyst on DevOps survey results
  • 27. 27  
  • 28. Data Cleanup • Used  Google  Refine  to  clean  up  data  and   compensate  for  “Gene  screwup”   • Used  R  to  do  analysis   • Look  for  signal   • Explore  data   • Run  correla0ons  
  • 30. High Performing DevOps Teams • They’re  more  agile   • 30x  more  frequent  deployments   • 8,000x  shorter  lead  0me     (minutes/hours  vs.  months/quarters)   • They’re  more  reliable   • 2x  the  change  success  rate   • 12x  faster  MTTR  
  • 31. 31 Technical Practices Matter •  89% are using infrastructure version control •  82% are using automated code deployments
  • 32. Deliberate Practice Matters Organizations that implemented DevOps practices over 12 months ago were 5x more likely to be high performing than organizations that weren’t implementing DevOps at all.
  • 33. The Lost Hypotheses * o  Who performs code deployments? o  Who is on the hook for production support?
  • 34. Measuring Culture “I’ll tell you EXACTLY what devops means. Devops means giving a shit about your job enough to not pass the buck. Devops means giving a shit about your job enough to want to learn all the parts and not just your little world. Developers need to understand infrastructure. Operations people need to understand code. People need to fucking work with each other and not just occupy space next to each other.” John Vincent | @lusis | http://bit.ly/12DkRhf
  • 35. Measuring Culture Trust (and Verify) Continuous Improvement vs Risk Management Theater “Human Error” Heroes / "high performers"
  • 36.
  • 37.
  • 38.
  • 39.
  • 40. The tribe is operationally strong *     70%  Opera0ons  people      
  • 41. The tribe is operationally strong     This  is  not  a  Dev  takeover      
  • 42. The tribe is enterprise too!   26%  -­‐  500  to  9999   16%  -­‐  10K  plus      
  • 43. Overcoming barriers to DevOps adoption Biggest barriers were cultural •  Lack of manager buy-in •  Lack of team buy-in •  Value of DevOps not understood outside my group
  • 44. What are organizations looking for in DevOps skills? •  Coding/scripting (84%) •  People skills (60%) •  Process re-engineering skills (56%) •  Experience with specific tools (19%)
  • 45. Challenges to culture   It's  easier  to  teach  tools   than  teach  people  skills      
  • 46. Preparing For DevOps Survey 2013-2014 • How  do  we  measure  culture?   • High  management  vs.  low  trust  management   styles  (and  link  to  team  size)   • Industry  code   • Beher  define  performance  variables  to  enable   regression  analysis  (Likert-­‐type  scale)   • Business  cri0cality:  system  of  engagement  vs.   system  of  record   • What  else?    We  want  to  hear  your  thoughts!  
  • 47. If you … Then … … want to learn more about the findings •  Read the full-length report: http://puppetlabs.com/devops •  Share the infographic: http://puppetlabs.com/2013-state-of-devops- infographic •  Get these slides: http://slideshare.net/realgenekim/ DevOpsSurveyOfPractice … have ideas on the DevOps Survey Of Practice 2013-2014 •  Come talk with us! •  Join our Google+ Community: https://plus.google.com/communities/ 104363243715545285555 … share your stories of transformation •  Go to FlowCon! http://flowcon.org … get a free copy of The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win •  Go to the AppFirst booth at 2:40pm. Gene will be signing books!