The survey found that high-performing IT organizations deploy code 30 times more frequently and 200 times faster than low performers, with 60% fewer failures and 168 times faster recovery from failures. The use of lean management practices and continuous delivery were found to contribute to both increased throughput and stability. These practices help shift quality improvements earlier in the development process. The survey also found that continuous delivery practices, lean management, and improved IT performance positively impact organizational performance metrics like productivity, market share and profitability.
The document provides an overview and analysis of a survey conducted on DevOps practitioners and leaders. Some key findings include:
- DevOps is generally ill-defined, though most see it as defined, its practices vary widely.
- Top DevOps activities are continuous integration, testing in production, deploying to private cloud, and agile data management.
- For leaders, development drives DevOps more than operations.
- Systems most affected are web applications, relational databases, and real-time applications. Storage and middleware are least affected.
- Top motivations for DevOps are faster software delivery, reduced bugs, and more frequent software delivery.
Everything You Need to Know About the 2019 DORA Accelerate State of DevOps Re...Red Gate Software
Each year, the DevOps Research and Assessment group (DORA) publishes critical research revealing the impact of DevOps on organizations of all sizes. The findings show what makes some teams successful at DevOps, while others fall behind.
Jez Humble, a founding member of DORA well known for his groundbreaking research on IT performance, and Redgate’s Microsoft MVP Steve Jones offer the latest insights from the 2019 Accelerate State of DevOps Report – and what they mean for your organization and career.
ESG and Compliance: Where do we go from here?Nimonik
Environment, Social and Governance (ESG) issues are taking on more and more presence in the corporation's planning and strategy. This presentation discusses emerging trends, potential paths forward and challenges with staying in compliance to the myriad of ESG standards and requirements.
This document provides an overview of DevOps for architects. It defines DevOps as developers and operations teams working collaboratively across the entire software development lifecycle. The document discusses that DevOps aims to help businesses by optimizing collaboration and value delivery through practices like automation, continuous integration and deployment, and emphasizing a culture of communication, shared responsibility, and learning. It also provides perspectives on DevOps from several experts and discusses how architects can approach their work in a DevOps environment.
The purpose of this survey was to collect data from companies from all industries on enabling technology currently used to support key areas of their Quality Management System. Data was collected from the LinkedIn Quality & Regulatory Network group representing over 77,000 professionals worldwide. Over 620 members from multiple industries participated in this survey.
This document discusses using the right tools to avoid culture clashes in DevOps environments. It provides an overview of a webinar on this topic featuring presentations by Dan Twing from EMA and Pat Cameron from HelpSystems. The webinar covered how the pace of code delivery is increasing, that DevOps requires cooperation between development and operations, and that workload automation tools can help coordinate control and enable DevOps success.
SolarWinds IT Trends Report 2015: Business at the Speed of IT (North America)SolarWinds
A look at the current state of significant new technology adoption, barriers to adoption and needs of IT pros tasked with delivering business impact in North America.
The document provides an overview and analysis of a survey conducted on DevOps practitioners and leaders. Some key findings include:
- DevOps is generally ill-defined, though most see it as defined, its practices vary widely.
- Top DevOps activities are continuous integration, testing in production, deploying to private cloud, and agile data management.
- For leaders, development drives DevOps more than operations.
- Systems most affected are web applications, relational databases, and real-time applications. Storage and middleware are least affected.
- Top motivations for DevOps are faster software delivery, reduced bugs, and more frequent software delivery.
Everything You Need to Know About the 2019 DORA Accelerate State of DevOps Re...Red Gate Software
Each year, the DevOps Research and Assessment group (DORA) publishes critical research revealing the impact of DevOps on organizations of all sizes. The findings show what makes some teams successful at DevOps, while others fall behind.
Jez Humble, a founding member of DORA well known for his groundbreaking research on IT performance, and Redgate’s Microsoft MVP Steve Jones offer the latest insights from the 2019 Accelerate State of DevOps Report – and what they mean for your organization and career.
ESG and Compliance: Where do we go from here?Nimonik
Environment, Social and Governance (ESG) issues are taking on more and more presence in the corporation's planning and strategy. This presentation discusses emerging trends, potential paths forward and challenges with staying in compliance to the myriad of ESG standards and requirements.
This document provides an overview of DevOps for architects. It defines DevOps as developers and operations teams working collaboratively across the entire software development lifecycle. The document discusses that DevOps aims to help businesses by optimizing collaboration and value delivery through practices like automation, continuous integration and deployment, and emphasizing a culture of communication, shared responsibility, and learning. It also provides perspectives on DevOps from several experts and discusses how architects can approach their work in a DevOps environment.
The purpose of this survey was to collect data from companies from all industries on enabling technology currently used to support key areas of their Quality Management System. Data was collected from the LinkedIn Quality & Regulatory Network group representing over 77,000 professionals worldwide. Over 620 members from multiple industries participated in this survey.
This document discusses using the right tools to avoid culture clashes in DevOps environments. It provides an overview of a webinar on this topic featuring presentations by Dan Twing from EMA and Pat Cameron from HelpSystems. The webinar covered how the pace of code delivery is increasing, that DevOps requires cooperation between development and operations, and that workload automation tools can help coordinate control and enable DevOps success.
SolarWinds IT Trends Report 2015: Business at the Speed of IT (North America)SolarWinds
A look at the current state of significant new technology adoption, barriers to adoption and needs of IT pros tasked with delivering business impact in North America.
Achieving High Performance DevOps: A Roadmap for Managers and Decision MakersVlado Barun
Is your Org struggling to increase the pace of deploying changes?
Do you feel like you are rolling the dice when deploying changes?
Are you content with the current State of Affairs or do you aspire to raise your game by several levels?
Finally, are you willing to make the required sacrifices to achieve high performance DevOps?
Warning:
This session is NOT about the latest/coolest set of technologies that promise to solve your problem.
This session is NOT about a product you can buy.
This session is about recognizing and understanding the First Order Principles that underlie successful DevOps.
Based on this we are going to develop a set of goals, how to measure them and specific steps on how to achieve them.
Furthermore, we will discuss the pitfalls that derail so many Organizations in this endeavor, how to circumvent them and even turn them into opportunities.
However, be advised, this session is not for those that look for an easy & quick solution.
The session is intended to be interactive, and challenge the way you think.
If you are willing to have an open mind and put up the extra effort, by the end of this session, we are going to have built a roadmap with goals and specific steps that lead to High Performance DevOps.
The 10th annual State of Agile™ survey makes it clear that agile software development has grown increasingly popular over the last decade. Participation in the survey has grown more than three-fold. In 2006, there were fewer than a thousand respondents to the survey, while the latest survey had 3,880.
Agile methodologies are no longer solely the domain of startups and small development shops. In 2006, nearly two-thirds of the survey respondents said they worked in software organizations with fewer than 100 people. By 2015, nearly two-thirds of the respondents said they worked for software organizations with more than 100 people, and 31% said they worked for software organizations with more than 1,000 people.
The number of large enterprises that are embracing agile continues to increase each year. More than 24% of the
respondents worked for organizations with over 20,000 employees, compared to 21% last year.
Agile is going global as the number of enterprises around the world adopt agile. The number of respondents that worked for organizations in Europe increased from 21% to 26%. In addition, 18% of the respondents worked in Asia, South America, Oceania, and Africa.
The pool of talent and agile experience continues to grow annually. Once again there was an increase in the number of respondents who said they were ‘very’ to ‘extremely’ knowledgeable about agile, an increase from 58% in 2014 to 63% in 2015.
While 95% of the respondents said their organizations practice agile, only 1% of the 3,880 respondents said that their agile implementation was unsuccessful.
IDC Study Commissioned by Microsoft Predicts Impact of Artificial Intelligenc...Barrie Sheers
IDC study commissioned by Microsoft predicts Artificial Intelligence (AI) will double the rate of innovation improvements and improve employee productivity gains by 1.5 times in New Zealand by 2021
These slides - based on the webinar featuring Julie Craig, research director from leading IT analyst firm Enterprise Management Associates (EMA) - provide a top five list of hints and tips for you to consider when building your DevOps strategy.
Keynote Evento TestingUY 2018 - The Art of Excellence Adding value as an IT p...TestingUy
Expositor: Derk-Jan De Grood
Resumen: In order to distinguish themselves and meet customer expectations organizations need to embrace change. In his keynote Derk-Jan de Grood will explain how Continuous Delivery, DevOps and Scaling Agile aim to effectively react to disruptive innovations, but introduce new challenges. Organization have a need for Visionary’s, Explorers and Experts to make the transition. Develop yourself and your team in order to keep adding value and embrace the new opportunities that arise.
Doing Analytics Right - Selecting AnalyticsTasktop
This webinar lays out the principles and key concerns for selecting analytics.
It covers:
* The proper purpose of analytics,
* enabling feedback loops to attain your goals such as efficiency and predictability, and
* how to avoid doing more harm than good.
In particular, we will cover: the dimensions of analytics, the key driving principles, analytics maturity, adapting the analytics to your mix of development efforts, and integrating analytics across the levels of the organization.
Summary of Accelerate - 2019 State of Devops report by Google Cloud's DORARagavendra Prasath
A detailed 82 pages report is abridged to 5 pages report. Access DORA report here - https://services.google.com/fh/files/misc/state-of-devops-2019.pdf
Inspiration and Courtesy to the authors.
"How to Guide" to reach a higher degree on organizational agility
Results from analysing 300 European companies clearly shows that a high degree on organizational agility leads to superior financial performance. Based on the analysis of over 70 transformation programs we designed four major agility fitness programs for organizations. There is also the possibility to benchmark the degree on agility and to derive specific actions to move towards a true agile company organism
Highly-innovative and unique introduction to bleeding-edge lean and agile concepts, values, principles, frameworks, models, and practices for organizational change. Learn how to design state-of-the-art 21st century organizations successfully innovate, change, adapt, compete, and achieve sustainability in the new merciless global high-technology landscape. Begins with the impetus for using lean and agile thinking and an overview of why organizational struggle and even so often fail. Provides definition of agile and lean thinking, a quick overview of lean and agile values, principles, behaviors, context, and frameworks. Introduces bleeding-edge lean and agile organizational change models and then dives into a model-by-model explanation, illustration, and overview. Also introduces key metrics, measurements, models, and outcomes, as well as real-world business results and effects at organizational, national, and global landscape. Closes with a summary of key lessons, principles, insights, and critical success factors for achieving global large-scale organizational change and competitiveness (as well as further resources).
Over half of IT professionals feel infrastructure complexity has greatly affected their role in the last 3-5 years. Cloud computing is seen as the most disruptive emerging technology and the most important for investment. While most IT professionals are confident in providing strategic guidance, the majority only get occasional opportunities. To feel more empowered, around half need more training in their areas and a better understanding of the business.
IT Trends Report 2015: Business at the Speed of IT, Public Sector ResultsSolarWinds
IT Trends Report 2015: Business at the Speed of IT
A look at the current state of significant new technology adoption, barriers to adoption and needs of IT pros tasked with delivering organizational impact
(North America, Public Sector)
2019 Global Project Control Survey Report - Launch Event PresentationLogiKal Projects
This year’s project controls report identified some of the key challenges companies are facing and the emerging technologies for the future of project controls.
Accenture sustainability academy_overviewAndy Green
The Sustainability Academy provides online sustainability training to help organizations develop a sustainability mindset among employees. It offers courses, webinars, and articles on topics like economic impacts of sustainability. This flexible learning solution addresses skills challenges through affordable global access. By operating virtually, it also supports sustainability goals through reduced carbon emissions compared to in-person training.
Netadmin and Sysadmin Survey Results - AUSSolarWinds
A wide-ranging survey of Australian network and systems administrators that captures the rapidly evolving nature of these IT Pros’ roles and their thoughts on life inside and outside of the workplace
A wide-ranging survey of US systems administrators that captures the rapidly evolving nature of the sysadmin role and their thoughts on life inside and outside of the workplace in October 2013
Business Productivity Statistics PresentationGordon Rimmer
Working with some of the world’s leading technology innovators, Steljes has developed the Business Productivity Suite to help you change the way you work for real and lasting benefit. The Business Productivity Suite comprises of the cream of today’s productivity technology, under one roof, designed to address five focus areas that businesses tell us they need to make more efficient: meetings, video and data conferencing, workspaces and flexible working, training and marketing and communications.
This document provides an overview and summary of global and local learning and development (L&D) standards and best practices for building a world-class L&D function. It discusses the need for L&D standards, principles of world-class L&D, L&D benchmarking frameworks and metrics, L&D best practices, and an integrated L&D governance model. It also summarizes the findings of an L&D benchmarking study in South Africa, including trends related to training spend, needs analysis, delivery methods, evaluation techniques, and talent management strategies. The document emphasizes the importance of aligning L&D with business strategy and organizational objectives.
This document discusses DevOps and the use of metrics and data in DevOps. It provides perspectives from DevOps leaders on some of the challenges around collecting and using metrics and data in a DevOps environment. Some of the key points made include:
- Collecting too many metrics can create "noise" that obscures useful metrics. Metrics should either inform teams about issues or validate hypotheses.
- Useful metrics indicate anomalies or trends that need investigation and resolution, or provide proof against a hypothesis.
- When determining metrics, understand what information is needed, who needs it, and why, to ensure the metrics will be actionable.
- The volume, variety and velocity of big data can be achieved in Dev
2i recently attended a DevOps Summit in London to learn more about how different companies have implemented DevOps. Read our overview to gain a better understanding of the DevOps operating model.
For years, there have been stories of continuous delivery making teams awesome… but can CD make all teams awesome? And how? Dr. Nicole Forsgren will present data from over 20,000 technical professionals showing the central role that CD plays in software development and delivery. She will show you how doing CD can drive key organizational outcomes like profitability, productivity, and market share. Nicole also presents the key aspects of CD that make your DevOps awesome, like trunk-based development, test data, and test automation, and provides examples of success from teams undergoing their own technology transformations. The presentation also includes other important drivers of DevOps success, like lean product management and team culture. At the end of this talk, you will have the information to help you prove your case (to management or even yourself) about why CD and DevOps are essential to winning, as well as great stories and examples to really bring these concepts to life. You’ll leave with tips you can take back to get started on your own DevOps initiative.
The document is a summary of the 15th State of Agile Report, which highlights increased adoption of Agile practices across organizations. Some key findings include:
- Agile adoption has accelerated, with 86% of teams now using Agile compared to 37% in 2020. Non-IT functions have also seen significant growth in Agile adoption.
- Remote and hybrid workforces are now the norm, with only 3% planning to return to the office full-time. This presents new challenges for distributed teams.
- DevOps transformation and value stream management initiatives are seen as increasingly important to delivering customer value and software quickly.
- The top barriers to adopting Agile remain inconsistent processes, cultural clashes, and resistance to
Achieving High Performance DevOps: A Roadmap for Managers and Decision MakersVlado Barun
Is your Org struggling to increase the pace of deploying changes?
Do you feel like you are rolling the dice when deploying changes?
Are you content with the current State of Affairs or do you aspire to raise your game by several levels?
Finally, are you willing to make the required sacrifices to achieve high performance DevOps?
Warning:
This session is NOT about the latest/coolest set of technologies that promise to solve your problem.
This session is NOT about a product you can buy.
This session is about recognizing and understanding the First Order Principles that underlie successful DevOps.
Based on this we are going to develop a set of goals, how to measure them and specific steps on how to achieve them.
Furthermore, we will discuss the pitfalls that derail so many Organizations in this endeavor, how to circumvent them and even turn them into opportunities.
However, be advised, this session is not for those that look for an easy & quick solution.
The session is intended to be interactive, and challenge the way you think.
If you are willing to have an open mind and put up the extra effort, by the end of this session, we are going to have built a roadmap with goals and specific steps that lead to High Performance DevOps.
The 10th annual State of Agile™ survey makes it clear that agile software development has grown increasingly popular over the last decade. Participation in the survey has grown more than three-fold. In 2006, there were fewer than a thousand respondents to the survey, while the latest survey had 3,880.
Agile methodologies are no longer solely the domain of startups and small development shops. In 2006, nearly two-thirds of the survey respondents said they worked in software organizations with fewer than 100 people. By 2015, nearly two-thirds of the respondents said they worked for software organizations with more than 100 people, and 31% said they worked for software organizations with more than 1,000 people.
The number of large enterprises that are embracing agile continues to increase each year. More than 24% of the
respondents worked for organizations with over 20,000 employees, compared to 21% last year.
Agile is going global as the number of enterprises around the world adopt agile. The number of respondents that worked for organizations in Europe increased from 21% to 26%. In addition, 18% of the respondents worked in Asia, South America, Oceania, and Africa.
The pool of talent and agile experience continues to grow annually. Once again there was an increase in the number of respondents who said they were ‘very’ to ‘extremely’ knowledgeable about agile, an increase from 58% in 2014 to 63% in 2015.
While 95% of the respondents said their organizations practice agile, only 1% of the 3,880 respondents said that their agile implementation was unsuccessful.
IDC Study Commissioned by Microsoft Predicts Impact of Artificial Intelligenc...Barrie Sheers
IDC study commissioned by Microsoft predicts Artificial Intelligence (AI) will double the rate of innovation improvements and improve employee productivity gains by 1.5 times in New Zealand by 2021
These slides - based on the webinar featuring Julie Craig, research director from leading IT analyst firm Enterprise Management Associates (EMA) - provide a top five list of hints and tips for you to consider when building your DevOps strategy.
Keynote Evento TestingUY 2018 - The Art of Excellence Adding value as an IT p...TestingUy
Expositor: Derk-Jan De Grood
Resumen: In order to distinguish themselves and meet customer expectations organizations need to embrace change. In his keynote Derk-Jan de Grood will explain how Continuous Delivery, DevOps and Scaling Agile aim to effectively react to disruptive innovations, but introduce new challenges. Organization have a need for Visionary’s, Explorers and Experts to make the transition. Develop yourself and your team in order to keep adding value and embrace the new opportunities that arise.
Doing Analytics Right - Selecting AnalyticsTasktop
This webinar lays out the principles and key concerns for selecting analytics.
It covers:
* The proper purpose of analytics,
* enabling feedback loops to attain your goals such as efficiency and predictability, and
* how to avoid doing more harm than good.
In particular, we will cover: the dimensions of analytics, the key driving principles, analytics maturity, adapting the analytics to your mix of development efforts, and integrating analytics across the levels of the organization.
Summary of Accelerate - 2019 State of Devops report by Google Cloud's DORARagavendra Prasath
A detailed 82 pages report is abridged to 5 pages report. Access DORA report here - https://services.google.com/fh/files/misc/state-of-devops-2019.pdf
Inspiration and Courtesy to the authors.
"How to Guide" to reach a higher degree on organizational agility
Results from analysing 300 European companies clearly shows that a high degree on organizational agility leads to superior financial performance. Based on the analysis of over 70 transformation programs we designed four major agility fitness programs for organizations. There is also the possibility to benchmark the degree on agility and to derive specific actions to move towards a true agile company organism
Highly-innovative and unique introduction to bleeding-edge lean and agile concepts, values, principles, frameworks, models, and practices for organizational change. Learn how to design state-of-the-art 21st century organizations successfully innovate, change, adapt, compete, and achieve sustainability in the new merciless global high-technology landscape. Begins with the impetus for using lean and agile thinking and an overview of why organizational struggle and even so often fail. Provides definition of agile and lean thinking, a quick overview of lean and agile values, principles, behaviors, context, and frameworks. Introduces bleeding-edge lean and agile organizational change models and then dives into a model-by-model explanation, illustration, and overview. Also introduces key metrics, measurements, models, and outcomes, as well as real-world business results and effects at organizational, national, and global landscape. Closes with a summary of key lessons, principles, insights, and critical success factors for achieving global large-scale organizational change and competitiveness (as well as further resources).
Over half of IT professionals feel infrastructure complexity has greatly affected their role in the last 3-5 years. Cloud computing is seen as the most disruptive emerging technology and the most important for investment. While most IT professionals are confident in providing strategic guidance, the majority only get occasional opportunities. To feel more empowered, around half need more training in their areas and a better understanding of the business.
IT Trends Report 2015: Business at the Speed of IT, Public Sector ResultsSolarWinds
IT Trends Report 2015: Business at the Speed of IT
A look at the current state of significant new technology adoption, barriers to adoption and needs of IT pros tasked with delivering organizational impact
(North America, Public Sector)
2019 Global Project Control Survey Report - Launch Event PresentationLogiKal Projects
This year’s project controls report identified some of the key challenges companies are facing and the emerging technologies for the future of project controls.
Accenture sustainability academy_overviewAndy Green
The Sustainability Academy provides online sustainability training to help organizations develop a sustainability mindset among employees. It offers courses, webinars, and articles on topics like economic impacts of sustainability. This flexible learning solution addresses skills challenges through affordable global access. By operating virtually, it also supports sustainability goals through reduced carbon emissions compared to in-person training.
Netadmin and Sysadmin Survey Results - AUSSolarWinds
A wide-ranging survey of Australian network and systems administrators that captures the rapidly evolving nature of these IT Pros’ roles and their thoughts on life inside and outside of the workplace
A wide-ranging survey of US systems administrators that captures the rapidly evolving nature of the sysadmin role and their thoughts on life inside and outside of the workplace in October 2013
Business Productivity Statistics PresentationGordon Rimmer
Working with some of the world’s leading technology innovators, Steljes has developed the Business Productivity Suite to help you change the way you work for real and lasting benefit. The Business Productivity Suite comprises of the cream of today’s productivity technology, under one roof, designed to address five focus areas that businesses tell us they need to make more efficient: meetings, video and data conferencing, workspaces and flexible working, training and marketing and communications.
This document provides an overview and summary of global and local learning and development (L&D) standards and best practices for building a world-class L&D function. It discusses the need for L&D standards, principles of world-class L&D, L&D benchmarking frameworks and metrics, L&D best practices, and an integrated L&D governance model. It also summarizes the findings of an L&D benchmarking study in South Africa, including trends related to training spend, needs analysis, delivery methods, evaluation techniques, and talent management strategies. The document emphasizes the importance of aligning L&D with business strategy and organizational objectives.
This document discusses DevOps and the use of metrics and data in DevOps. It provides perspectives from DevOps leaders on some of the challenges around collecting and using metrics and data in a DevOps environment. Some of the key points made include:
- Collecting too many metrics can create "noise" that obscures useful metrics. Metrics should either inform teams about issues or validate hypotheses.
- Useful metrics indicate anomalies or trends that need investigation and resolution, or provide proof against a hypothesis.
- When determining metrics, understand what information is needed, who needs it, and why, to ensure the metrics will be actionable.
- The volume, variety and velocity of big data can be achieved in Dev
2i recently attended a DevOps Summit in London to learn more about how different companies have implemented DevOps. Read our overview to gain a better understanding of the DevOps operating model.
For years, there have been stories of continuous delivery making teams awesome… but can CD make all teams awesome? And how? Dr. Nicole Forsgren will present data from over 20,000 technical professionals showing the central role that CD plays in software development and delivery. She will show you how doing CD can drive key organizational outcomes like profitability, productivity, and market share. Nicole also presents the key aspects of CD that make your DevOps awesome, like trunk-based development, test data, and test automation, and provides examples of success from teams undergoing their own technology transformations. The presentation also includes other important drivers of DevOps success, like lean product management and team culture. At the end of this talk, you will have the information to help you prove your case (to management or even yourself) about why CD and DevOps are essential to winning, as well as great stories and examples to really bring these concepts to life. You’ll leave with tips you can take back to get started on your own DevOps initiative.
The document is a summary of the 15th State of Agile Report, which highlights increased adoption of Agile practices across organizations. Some key findings include:
- Agile adoption has accelerated, with 86% of teams now using Agile compared to 37% in 2020. Non-IT functions have also seen significant growth in Agile adoption.
- Remote and hybrid workforces are now the norm, with only 3% planning to return to the office full-time. This presents new challenges for distributed teams.
- DevOps transformation and value stream management initiatives are seen as increasingly important to delivering customer value and software quickly.
- The top barriers to adopting Agile remain inconsistent processes, cultural clashes, and resistance to
DevOps is driven by three factors: technical practices like continuous delivery, management practices like lean principles, and organizational culture and identity. Research shows these factors drive both IT and organizational performance. High performing DevOps teams deploy code more frequently, have faster lead times, lower failure rates, and faster mean time to recovery. This level of reliability and agility benefits organizations through increased market share, productivity, and profitability without traditional tradeoffs.
The Data on DevOps: Making the Case for AwesomeNicole Forsgren
What’s the value proposition of DevOps? Does culture change show up in the bottom line? What practices predict high IT performance? We hear many stories to inspire and inform us, but the plural of anecdote is not data. Let’s dive into the research and find out which DevOps practices drive optimal IT and business outcomes.
The data shows that the best IT performers have the highest throughput and reliability while contributing to organizational profitability, productivity, and market share goals. Industry trends around security, containers, continuous delivery, and lean management relate to IT performance and quality: let’s talk about how.
Management and practitioners alike will leave with a better understanding of how to achieve the best outcomes, while armed with the data they need to make the case for change.
2016 velocity santa clara state of dev ops report deck finalNicole Forsgren
The document summarizes findings from the 2016 State of DevOps Report. It shows that high-performing organizations outperform their peers in terms of throughput and lead time for changes. Employees in high-performing organizations are more likely to recommend their organization as a great place to work. These organizations spend less time fixing security issues by addressing security at every stage of development. The document also discusses how high performers spend more time on new work and less time on unplanned work and rework through the use of continuous delivery practices.
The document is an executive summary from the Accelerate State of DevOps 2021 report. It summarizes the key findings from the report, which are based on data from over 32,000 professionals. The summary highlights that elite performers continue to improve and now make up 26% of teams. It also notes that SRE practices and DevOps are complementary and teams using both perform best. Additionally, it finds that teams leveraging cloud capabilities, integrating security, having good documentation, and possessing a positive culture all see improvements in outcomes.
Improving software quality for the future of connected vehiclesDevon Bleibtrey
In the highly regulated environment of automotive, software quality can be difficult but it doesn't need to be. ESG partners with software teams to improve their team's performance through developer operations. From culture to tool integrations, ESG takes a holistic approach to help teams measurably improve their software development lifecycle and the quality of its output.
Enterprise application integration (EAI) evolved in the early IT industry to allow information exchange between mainframe and minicomputer systems. Common integration methods included file transfers and shared databases. In the 1990s, messaging-oriented middleware (MOM) emerged as a new paradigm, using message queues to enable both real-time and non-real-time integration across unpredictable computer networks. This represented a shift towards loosely-coupled integration using queues rather than tightly-coupled methods like remote procedure calls. Today, service-oriented architectures and microservices are further advancing loosely-coupled integration approaches.
Why Is Supply Chain Planning So Hard? 16 FEB 2016Lora Cecere
RESEARCH OVERVIEW:
Details: The research for this report is based on five surveys fielded during the period of January 2014 – December 2015. The research was a progressive set of studies on supply chain planning. What are the barriers and what drives success. While the path to supply chain planning excellence is fraught with issues, the expected Return on Investment (ROI) for a successful supply chain planning project is nine months. In this report, we share insights on why supply chain planning is so difficult and how to maximize the ROI..
Objective of the report: To share insights with supply chain leaders on how to maximize the value from a supply chain planning implementation. The report shares insights on five barriers and then gives recommendations to overcome the barriers to maximize the ROI.
Highlights: While many approach supply chain planning as a technology project, successrequires companies to rethink how they make operational decisions and plan for future outcomes. The bigger issues in executing a supply chain planning project is how work is organized and how reward systems shape behavior.
A presentation by Lora Cecere, Founder, Supply Chain Insights, USA, delivered during the 38th annual SAPICS event in Sun City, South Africa.
Today, nine out of ten supply chains are stuck in delivering corporate performance objectives of improvements in inventory turns or operating margin, but could this change in the future based on the evolution of technologies and new processes? Join this session to gain insights on how five trends will reshape supply chain thinking: – Predictive to Cognitive Modeling, – Networks of Networks with Interoperability, – Autonomous Supply Chains, Outside-in Processes and Shifts in Analytics.
- Info-Tech Research Group provides IT research and advice to help organizations implement effective service management practices.
- The document discusses common misconceptions around service management and emphasizes the importance of establishing strong foundational elements like culture, governance, and management practices before implementing more advanced service management processes.
- Case studies demonstrate how Info-Tech has helped clients develop customized roadmaps to mature their service management practices by first stabilizing services and focusing on cultural and foundational elements before aiming to become strategic partners.
Many companies have adopted agile for their software development teams. These teams are doing a great job sprinting and building a lot of potentially shippable product increments. The problem is the software is only potentially shippable. The focus on potentially shippable is leading to a “Potentially shippable product Problem” where teams aren’t actually releasing the value they created and are only focused on maintaining or improving their velocity.
This deck is from a session at Agile Camp 2018 in Dallas where we talked about how using Agile and DevOps practices together can solve the potentially shippable product problem and enable teams to not only sprint but also deliver value faster, with higher quality and in more stable environments.
Leveraging Failure to Succeed in DevOpsSteve Brown
DevOps is typically perceived as a way to avoid failure; however, failures are steps in the right direction. Learning from failures and turning the DevOps practice into one that will lead you toward even greater success – better, faster.
The document discusses challenges that organizations face in improving project success rates and adopting agile and DevOps practices. It finds that success rates are at a 4-year low due to issues like unclear requirements and poor business-IT alignment. Additionally, surveys show that organizational agility and the ability to align with business strategy are also low. The document advocates that organizations must improve requirements management, ensure strategic alignment of projects, measure business benefits, and enable agility through their processes and tools in order to successfully adopt agile and DevOps practices at scale. Effective requirements management is highlighted as particularly important through tools that enable collaboration, traceability, process automation and integration across the software development lifecycle.
This document discusses DevOps and continuous delivery. It notes that businesses need to adapt quickly and old ways of working are being replaced by new models like DevOps. DevOps breaks down silos between teams and focuses on customer satisfaction, resilience, speed to market, and efficiency. A key part of DevOps is continuous integration, delivery, testing and deployment through automation. Cultural change and breaking down barriers between teams is important for successful DevOps implementation.
How well is your organization driving software quality and testing compared to other companies today?
-Which areas in Application Lifecycle Management (ALM) pose the greatest challenge to an organization’s success?
-How well do companies follow best practice standards?
-How quickly are companies adopting Agile methods?
-How are virtualized environments changing the way companies test?
-What skills do testers need in increasingly distributed teams?
The 2010-2011 World Quality Report provides insights into these questions and more. This report is based on survey findings from hundreds of testers, business analysts and developers and reveals emerging trends in quality and a forecast of how these trends will shape ALM and associated software in the future.
http://www.capgemini.com/application-lifecycle-services
Your Challenge
Companies understand the importance of business process improvement (BPI) and recognize the touted benefits: cost savings, waste elimination, and process efficiency.
With this said, 70% of companies that embark on process improvement initiatives fail.
The high probability of failure is attributed to a number of factors, including lack of continuous improvement and failing to define measurable outcomes.
Our Advice
Adopt a forward-facing outlook. Don’t focus solely on the current state, set improvement targets upfront to drive the initiative.
Break problems down into root-cause variables. Don’t look at the symptom, dive deeper and alleviate the root cause.
Empower business analysts. Create a practical process improvement methodology that your analysts can follow.
Impact and Result
Kick off process improvement by identifying the goals and defining the improvement targets.
Start by referring to the operating model and identifying level 1, 2, and 3 processes. Once the team understands the relationship between processes, they can begin to map a level 3 process using a standard mapping notation.
Use qualitative and quantitative techniques for analyzing the root cause rather than the symptoms.
Ensure the design is aligned with the initial improvement targets. Focus on value-added activities.
Consistently monitor the process and assess the root-cause variables to gauge the success of the process improvements.
The document summarizes findings from the State of DevOps report on IT performance. It discusses how high-performing IT organizations were twice as likely to exceed goals in areas like profitability and productivity. Key metrics for IT performance included lead time for changes, release frequency, time to restore service, and change fail rate. The document also discusses how surveys and log data were analyzed, with a focus on establishing validity and reliability of measures. Demographics showed little difference among large enterprises. High-performing organizations had significantly better throughput and shorter lead times. Security was also found to be addressed more effectively by high-performing teams.
Monitoring and Managing Anomaly Detection on OpenShift.pdfTosin Akinosho
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfChart Kalyan
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxSitimaJohn
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUpanagenda
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on integration of Salesforce with Bonterra Impact Management.
Interested in deploying an integration with Salesforce for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
OpenID AuthZEN Interop Read Out - AuthorizationDavid Brossard
During Identiverse 2024 and EIC 2024, members of the OpenID AuthZEN WG got together and demoed their authorization endpoints conforming to the AuthZEN API
Building Production Ready Search Pipelines with Spark and MilvusZilliz
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
GraphRAG for Life Science to increase LLM accuracyTomaz Bratanic
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Fueling AI with Great Data with Airbyte WebinarZilliz
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Best 20 SEO Techniques To Improve Website Visibility In SERPPixlogix Infotech
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Webinar: Designing a schema for a Data WarehouseFederico Razzoli
Are you new to data warehouses (DWH)? Do you need to check whether your data warehouse follows the best practices for a good design? In both cases, this webinar is for you.
A data warehouse is a central relational database that contains all measurements about a business or an organisation. This data comes from a variety of heterogeneous data sources, which includes databases of any type that back the applications used by the company, data files exported by some applications, or APIs provided by internal or external services.
But designing a data warehouse correctly is a hard task, which requires gathering information about the business processes that need to be analysed in the first place. These processes must be translated into so-called star schemas, which means, denormalised databases where each table represents a dimension or facts.
We will discuss these topics:
- How to gather information about a business;
- Understanding dictionaries and how to identify business entities;
- Dimensions and facts;
- Setting a table granularity;
- Types of facts;
- Types of dimensions;
- Snowflakes and how to avoid them;
- Expanding existing dimensions and facts.
Driving Business Innovation: Latest Generative AI Advancements & Success StorySafe Software
Are you ready to revolutionize how you handle data? Join us for a webinar where we’ll bring you up to speed with the latest advancements in Generative AI technology and discover how leveraging FME with tools from giants like Google Gemini, Amazon, and Microsoft OpenAI can supercharge your workflow efficiency.
During the hour, we’ll take you through:
Guest Speaker Segment with Hannah Barrington: Dive into the world of dynamic real estate marketing with Hannah, the Marketing Manager at Workspace Group. Hear firsthand how their team generates engaging descriptions for thousands of office units by integrating diverse data sources—from PDF floorplans to web pages—using FME transformers, like OpenAIVisionConnector and AnthropicVisionConnector. This use case will show you how GenAI can streamline content creation for marketing across the board.
Ollama Use Case: Learn how Scenario Specialist Dmitri Bagh has utilized Ollama within FME to input data, create custom models, and enhance security protocols. This segment will include demos to illustrate the full capabilities of FME in AI-driven processes.
Custom AI Models: Discover how to leverage FME to build personalized AI models using your data. Whether it’s populating a model with local data for added security or integrating public AI tools, find out how FME facilitates a versatile and secure approach to AI.
We’ll wrap up with a live Q&A session where you can engage with our experts on your specific use cases, and learn more about optimizing your data workflows with AI.
This webinar is ideal for professionals seeking to harness the power of AI within their data management systems while ensuring high levels of customization and security. Whether you're a novice or an expert, gain actionable insights and strategies to elevate your data processes. Join us to see how FME and AI can revolutionize how you work with data!
2. Chapter 1
Executive Summary
Chapter 2
Who Took the Survey
Chapter 3
IT Performance
Chapter 4
The Impact of Lean Management
& Continuous Delivery
on Culture & Performance
Chapter 5
Application Architecture
& Developer Productivity
Chapter 6
How IT Managers Can Help
Their Teams Win
Chapter 7
Burnout
Chapter 8
Methodology
Table of Contents
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 2Back to Table of Contents
3. 1. Executive Summary
The fourth annual State of DevOps Survey confirms that IT performance provides
real business value. High-performing IT organizations have a strong and positive
impact on the overall performance of the organizations they serve. This year’s
report also tells us:
• High-performing IT organizations deploy 30x more frequently with 200x shorter
lead times; they have 60x fewer failures and recover 168x faster.
• Lean management and continuous delivery practices create the conditions for
delivering value faster, sustainably.
• High performance is achievable whether your apps are greenfield,
brownfield or legacy.
• IT managers play a critical role in any DevOps transformation.
• Diversity matters.
• Deployment pain can tell you a lot about your IT performance.
• Burnout can be prevented, and DevOps can help.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 3Back to Table of Contents
4. This is our fourth annual State of DevOps Report. As in prior years, we have deepened our understanding
of how DevOps enables IT performance and organizational performance, based on responses from more
than 20,000 technical professionals we’ve surveyed over the past four years.
Last year we linked IT performance to organizational performance, proving that IT is not just a cost
center — it provides real business value. We also confirmed that DevOps practices lead to better IT
and organizational performance. This year we were surprised to find that while throughput for the
high-performing group was no different than for last year’s high performers, stability was significantly
better. This supports the widely held belief that DevOps practices equip organizations to embrace more
and more change, rather than to fear it. We also found that lean management and continuous delivery
practices contribute to both throughput and stability. That in turn improves organizational performance.
So how do you actually achieve higher performance? This year’s research shows that IT managers carry
a great deal of responsibility for getting there, especially those in the middle layer who are responsible
for connecting on-the-ground execution to the strategic objectives of the business. This year’s report
provides guidance to IT managers for improving the performance of their teams and leading their
organizations through a DevOps transformation.
Key findings include:
• High-performing IT organizations experience 60 times fewer failures and recover from failure
168 times faster than their lower-performing peers. They also deploy 30 times more frequently
with 200 times shorter lead times. Failures are unavoidable, but how quickly you detect and
recover from failure can mean the difference between leading the market and struggling to catch
up with the competition.
• Lean management and continuous delivery practices create the conditions for delivering value
faster, sustainably. Manufacturing was revolutionized by the application of lean principles in the 1980s.
Today, it’s IT’s turn to go lean. When you apply lean management and continuous delivery practices
to software delivery, you get the same results — higher quality, shorter cycle times with quicker feedback
loops, and lower costs. And the benefits don’t stop there: These practices also contribute to creating
a culture of learning and continuous improvement, lower levels of burnout, and higher organizational
performance overall.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 4Back to Table of Contents
5. • It doesn’t matter if your apps are greenfield, brownfield or legacy — as long as they are architected
with testability and deployability in mind, high performance is achievable. We were surprised
to find that the type of system — whether it was a system of engagement or a system of record, packaged
or custom, legacy or greenfield — is not significant. Continuous delivery can be applied to any system,
provided it is architected correctly. We also found that high performers are more likely to use
a microservices architecture, and less likely to outsource software development or run their software
on mainframes.
• IT managers play a critical role in any DevOps transformation. This year’s report shows us how
IT managers can help their teams win and lead their organizations through a DevOps transformation.
Managers play a critical role in connecting the strategic objectives of the business to the work their
teams do. Managers can do a lot to improve their team’s performance by ensuring work is not wasted
and by investing in developing the capabilities of their people.
• Diversity matters. Research shows that teams with more women members have higher collective
intelligence and achieve better business outcomes. Our survey shows that few teams are truly diverse
with regard to gender. We recommend that teams wanting to achieve high performance do their best
to recruit and retain more women, and improve diversity in other areas, too.
• Deployment pain can tell you a lot about your IT performance. Do you want to know how your team
is doing? All you have to do is ask one simple question: “How painful are deployments?” We found that
where code deployments are most painful, you’ll find the poorest IT performance, organizational
performance and culture.
• Burnout can be prevented, and DevOps can help. Burnout is associated with pathological cultures
and unproductive, wasteful work. The consequences of burnout are huge, both for individuals and
for organizations. Organizations can fix the conditions that lead to burnout by fostering a supportive
work environment and ensuring work is meaningful, and that employees understand how their own
work ties to strategic objectives.
High performance is achievable
if you architect with testability
& deployability in mind.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 5Back to Table of Contents
6. 2. Who Took the Survey
While we saw a similar distribution of respondents by geography, industry,
company size and infrastructure size, compared to last year, we noticed
an increase in responses from people working in DevOps departments.
This year, nearly one in five respondents came from DevOps departments,
compared to fewer than one in six. The proportion of female respondents this year
was, on the other hand, lower than we’d hoped and expected. Why aren’t
organizations working harder to recruit women and people from other
underrepresented groups, especially since research has shown that the presence
of women in leadership positions is correlated to stronger financial performance
and higher levels of group intelligence?
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 6Back to Table of Contents
7. One notable difference this year
was an increase in DevOps
departments. This year, 19 percent
of respondents were part of a DevOps
department, up from 16 percent
last year.
This year, 4,976 respondents completed the 2015 State of DevOps Survey. Compared to last year, we saw similar
distributions across geographies, company size, industries and size of infrastructure.
See page 29 for more about women in tech.
Company Size
Industries
Gender
Geography
Size of Infrastructure
by Number of Servers
Departments
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 7Back to Table of Contents
8. 3. IT Performance
We asked about critical throughput measures — deployment frequency and
deployment lead time — and discovered that high-performing IT teams deploy
code 30 times more frequently than their peers, and 200 times faster (measured
in the time required to go from “code committed” to code successfully running
in production). We also found that high-performing IT teams achieve far better
stability than lower-performing peers, with 60 percent fewer failed deployments
and a mean time to recover (MTTR) that’s 168 times faster. It’s their use of DevOps
practices that sets these top performers apart from the pack.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 8Back to Table of Contents
9. High-performing IT organizations
have 60% fewer failures and
recover 168 times faster.
One of the most exciting outcomes of our research was coming up with a quantitative definition
of IT performance. This breakthrough allowed us to show the relationships between DevOps practices,
IT performance and organizational performance.
We have debunked the myth that we need to choose between speed and reliability. We found that high-
performing IT organizations deploy code 30 times more frequently and 200 times faster (deployment lead
time, defined below) than their lower-performing peers. They also have 60 percent fewer failures and recover
168 times faster. High performers are able to achieve higher levels of both throughput and stability through
the use of DevOps practices — a key reason the movement has gained so much traction.
Our definition of IT performance includes two throughput metrics — deployment frequency and deployment
lead time — and one stability metric, mean time to recover (MTTR).
Throughput Measures
• Deployment frequency. How frequently the organization deploys code.
• Deployment lead time. Time required for changes to go from “code committed” to code successfully
running in production.
Stability Measures
• Mean time to recover (MTTR). Time required to restore service when a service incident
occurs (e.g., unplanned outage, service impairment, etc.).
While change fail rate — the percentage of changes that fail when rolled out — is not part of our
IT performance construct, we did analyze it because it’s such an important measure of IT stability.
We found that high-performing IT organizations have the lowest failure rates when they roll out changes,
and low-performing IT organizations have the highest change failure rates.
We used the same statistical methods as last year to validate IT performance and divide the population into
high, medium and low performers. Surprisingly, for high performers, throughput did not change compared
to last year, but stability increased. There are many possible reasons throughput has not increased,
and some of these may have nothing to do with effective, efficient deployment practices. Business leaders
of the organization may not be able to make decisions about what to deploy any faster than they could
before. Growth projections may not justify further investment in faster change at this point. IT doesn’t exist
in a vacuum, after all; it’s there to serve the business.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 9Back to Table of Contents
10. In some cases, once you’ve reached a certain level
of throughput (including more frequent releases) you’re
going to get more economic benefit from investing
in improved stability. The fact that stability increased in our
high-performing group suggests that quality is shifting to the
left — that is, it’s being built into the software earlier in the
development process. If you think of the software delivery
process as a manufacturing assembly line, the far left is the
developer’s laptop where the code originates, and the far
right is the production environment where this code
eventually ends up. Ensuring that quality is built into each
stage of the process implies:
• Better code quality.
• Better testing.
• Building apps with testability and deployability in mind.
• Creating a culture of continuous improvement.
Quality isn’t just the responsibility of one team; it’s the
shared responsibility of everyone involved in the software
delivery lifecycle. High-performing organizations know this
and build quality into the entire process.
As we discuss in the next section, there’s no secret
to achieving both speed and reliability, and delivering
higher-quality products and services at lower cost. Our
research shows this can be achieved with the right
practices in place.
2015 (Super High vs. Low) 2014 (High vs. Low)
Deployment Frequency 30x 30x
Deployment Lead Time
200x 200x
Mean Time to Recover
(MTTR)
168x 48x
Change Success Rate 60x 3x
Figure 1
Comparison of IT performance metrics between high1
and low performers
1
We used the same hierarchical clustering technique as we did last year, but to dig into the larger high-performing group that emerged this year,
we did additional analyses and discovered a group of super-high performers.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 10Back to Table of Contents
11. Figure 3
Distribution of deployment lead time
by performance cluster
Figure 2
Distribution of deployment frequency
by performance cluster
Figure 4
Distribution of mean time to recover (MTTR)
by performance cluster
The graphs below show the distribution of the IT performance answers, for each of the clusters. Each bar represents 100 percent of the cluster
members — the 50 percent mark represents the median of each group.
DevOps in Practice
“The number of issues we had from production emergencies that were triggered by an ops change essentially
went to zero. Because we were able to roll changes out in an automated fashion, and then test those
changes in the various environments, by the time code got to production, it had been through three other
environments — dev, integration, customer test — before it got to production.”
— Jez Miller
Read the full story >
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 11Back to Table of Contents
12. 4. The Impact of Lean
Management & Continuous
Delivery on Culture
& Performance
Manufacturing was revolutionized by the application of lean principles
in the 1980s. Today, it’s IT’s turn to go lean. When you apply lean management
practices to technology — limiting work in process (WIP); introducing visual
displays to monitor quality, productivity and WIP; and using monitoring data
to help inform decisions — you get results. The culture becomes more generative
and performance-oriented; people experience less stress in the workplace;
and IT performance improves. Our survey analysis shows that both culture
and IT performance predict organizational performance, so improvements
in these areas lead to better outcomes — including higher financial
performance — for the overall organization.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 12Back to Table of Contents
13. In the previous section, we reported that this year’s high-performing group had sig-
nificantly higher stability than last year’s high performers, suggesting that fewer things
break because issues have been resolved earlier in the software development process.
(We talk about this as “shifting left.”)
The reason so many people are interested in continuous delivery is because, executed
well, it does exactly this: It shifts quality to the left. The set of practices associated with
continuous delivery are continuous integration, automated testing, deployment auto-
mation, and version control for all production artifacts. These practices work in concert
with lean management practices, which include limiting work in process (WIP), use of
visual displays, and use of monitoring tools to make business decisions. Used together,
continuous delivery and lean management practices amplify each other, and enable
ever-improving delivery of better and better software.
This year, we created two new theoretical models2
for how continuous delivery and
lean management practices affect IT performance and organizational performance.
As we had hoped and expected, these practices predict IT performance — and IT
performance predicts organizational performance. The more you build quality into the
system — through automation, reducing batch sizes and shortening cycle times — and
the more effectively you manage your team’s workload and visualize work queues,
defects and bottlenecks, the more you increase throughput and stability.
The diagrams on the next page show how these constructs relate to each other.
2
A statistical technique called structural equation modelling (SEM) was used to test the models this year (see Methodology section).
The more you build quality into
systems — through automation
& shorter cycle times — the more
you increase throughput
& stability.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 13Back to Table of Contents
14. Figure 5
Path diagram showing relationships between continuous delivery practices, IT performance,
deployment pain, change failure rate, and organizational performance
Continuous Delivery Practices
We found that the practices that make up continuous delivery — deployment automation and automated
testing, continuous integration, and version control for all production artifacts — have a significant predictive
relationship to deployment pain, IT performance and change fail rate. In turn, IT performance predicts
organizational performance, as measured by productivity, market share and profitability.3
3
In a follow-up survey last year, we gathered stock ticker data and performed additional analysis on responses from just over 1,000 people who volunteered the
names of the companies where they worked, and whose companies are publicly traded. We found that these people were from 355 companies, and they all outper-
formed the S&P 500 over a three-year period. The publicly traded companies that had high-performing IT teams had 50 percent higher market capitalization growth
over three years than those with low-performing IT organizations. This year, we hoped to validate this preliminary finding, but our sample size of stock ticker symbols
was too small to conduct a meaningful analysis. However, we did find that this year’s high performers were 1.5 times more likely than their peers to exceed their
organization’s’ profitability, market share and productivity goals, compared to last year’s high performers, which were 1.9 times more likely to exceed goals.
The practices that make
up continuous delivery have
a significant predictive
relationship to IT performance.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 14Back to Table of Contents
15. Lean Management Practices
This year’s report tackled another question: We wanted to understand the effect of lean management
practices on both organizational culture and performance. This year we used two new constructs
to measure the impact of lean management:
• The ability of teams to limit work in process (WIP) and use these limits to drive process improvement,
which increases throughput.
• The extent to which teams created and maintained visual displays4
showing key quality and productivity
metrics and the current status of work (including defects), and were able to align these metrics with their
operational goals.
We included in this year’s model a construct from last year: the extent to which teams use data from
application performance and infrastructure monitoring tools to make business decisions on a daily basis.
So this year, incorporating our new constructs, the model includes limiting WIP, use of visual displays and use
of monitoring tools to make business decisions. Survey data supports the model, and shows that all of these
practices have an impact on organizational culture, IT performance, and levels of burnout. It’s important
to note that both organizational culture and IT performance are predictive of organizational performance.
Figure 6
Path diagram showing relationships between lean management practices, IT performance, culture,
burnout, and organizational performance
What Is Lean?
Manufacturing was revolutionized
and transformed in the 1980s
by the application of lean principles.
Organizations that reduced batch
sizes, reduced work in process
and shortened and amplified
feedback loops achieved dramatic
increases in plant productivity,
product quality and customer
satisfaction — and success in the
marketplace. One can describe
DevOps as the pattern that emerg-
es when you apply these same lean
principles to technology.
4
Fullerton, R. R., Kennedy, F. A., and Widener, S. K. “Lean manufacturing and firm performance: The incremental contribution of lean management accounting
practices,” Journal of Operations Management 32:7, (2014), 414–428.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 15Back to Table of Contents
16. 5. Application Architecture
& Developer Productivity
Anyone who’s spent time studying or thinking about design won’t be surprised
to hear that architecture has a powerful impact on software quality and
developer productivity. Our survey analysis shows that specific architectural
characteristics correlate with high IT performance: ability to test without
an integrated environment; ability for developers to get comprehensive feedback
from automated tests; ability to deploy an application independent of other
services it depends on; and use of a microservices architecture. These
characteristics are also what we see in enterprise architecture designed
for continuous delivery, so it’s not surprising that architectures like this
deliver better IT performance and more deployments per developer per day.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 16Back to Table of Contents
17. A major criticism of DevOps is that it can be applied only to greenfield
projects. Our research shows it doesn’t matter how old or new your systems
are; high performance can be achieved if the application is architected for
testability and deployability. So if you think you can’t implement DevOps
practices because your app runs on a mainframe, think again. Don’t focus
on the type of system you have: Instead, focus on re-architecting for testability
and deployability.
We found that certain architectural characteristics correlated with high
performance. A larger proportion of high-performing teams answered the
following questions in the affirmative, compared to medium- and low-
performing teams, both for the primary application or service they were
working on and for the services they had to interact with:
• We can do most of our testing without requiring an integrated
environment.
• We can and do deploy/release our application independently
of other applications/services it depends on.
• It is custom software that uses a microservices architecture.
This validates our belief that achieving high levels of throughput and stability
requires an enterprise architecture designed with continuous delivery in mind.
Such an enterprise architecture must be designed to give developers
comprehensive feedback from automated tests without relying on complex,
integrated environments. And it must be possible to deploy systems
independent of any other services they interact with.
Any service-oriented architecture worth its name should have these character-
istics, though sadly, many do not. These requirements have been emphasized
with the recent rise of microservices, and our data indicates that this kind
of architecture is correlated with higher levels of IT performance.
Effective Use of Cloud
& Containers Requires
a Modular Architecture
This finding is of particular
importance for teams that want
to leverage cloud computing and
containers. Effective use of these
technologies requires a modular
architecture consisting of loosely
coupled, well-encapsulated
components with clearly defined
and enforced interfaces.
DevOps in Practice
“Starting our DevOps journey was
largely delayed by the sheer scope
and size of the challenge ahead.
Trying to effect process, people,
technology and cultural changes
across the entire application portfolio,
in a globally dispersed team and
with a lot of associated technical
debt, is an epic challenge. If you think
about deployment, testing, moving
to Agile, spinning up new environ-
ments, instituting new version control
strategies, etc., it’s just too much
to do in one hit.”
— Jonathan Fletcher
Read the full story >
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 17Back to Table of Contents
18. In contrast, low performers were more likely to say that the software they were building — or the set
of services they had to interact with — was “custom software developed by another company
(e.g., an outsourcing partner).” This emphasizes the importance of making IT a strategic, core focus
of your business if you need to move fast while also ensuring stability. Low performers were also more
likely to be working on mainframe systems — although interestingly, having to integrate against
mainframe systems was not a statistically significant indicator of performance.
We also asked about a number of other candidate architectures, and obtained results that were not
statistically significant in terms of performance, regardless of whether you were building or integrating
against them:
• Packaged commercial software / COTS.
• Systems of record (systems that log transaction information and keep information in order).
• Systems of engagement (systems that leverage mobile, social, cloud, and big data to deliver apps
and smart products to end users).
• New, not-yet-deployed systems.
• Software with an embedded component that runs on a manufactured hardware device
(e.g.,, a printer firmware).
• Software requiring a user-installed component that runs on the user’s machine (including mobile apps).
These results were surprising — we had expected teams working on packaged software, systems of record,
or embedded systems to perform worse, and teams working on systems of engagement and greenfield
systems to perform better. This reinforces the importance of focusing on architecture rather than other
characteristics of the systems you work with. Even packaged software and systems of record can
be evolved and operated using DevOps principles and practices, provided sufficient attention has been
paid to their design and to the enterprise architecture of the ecosystem where they live.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 18Back to Table of Contents
19. Results are derived from the question:
For services that your team has to interact with
(new and existing), which of the following architecture
attributes apply? (Select all that apply)
Note: Only items that are significantly different between performance
clusters are shown.
Results are derived from the question:
Which of the following apply to the architecture of the
primary application or service you are working on?
(Select all that apply)
Note: Only items that are significantly different between performance
clusters are shown.
Figure 7
Application architecture by IT performance clusters
Figure 8
Services architecture by IT performance clusters
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 19Back to Table of Contents
20. The orthodox view of scaling software development teams states that
while adding developers to a team may increase overall productivity,
individual developer productivity will in fact decrease due to communication
and integration overheads. A particularly painful case was highlighted
in the famous book by Frederick Brook, Mythical Man-Month.5
When projects
are late, adding more developers not only decreases individual developer
productivity, but also decreases overall productivity.
Given the type of modular architecture described in the previous section
in which developers and operations work together to continuously integrate
and deploy code and environments, checking their changes into source
control trunk at least daily, small changes can quickly be independently
developed, integrated, tested and deployed into production without causing
global chaos and disruption.
As we looked at the data showing that development productivity can scale
as you add more developers, we wondered whether the important variable
was not just “deploys per day,” but rather “deploys per day per developer.”
We tested for this measurement in this year’s survey. The graph below
represents only those respondents who deploy at least once per day. We
were interested in investigating whether these teams exhibited the same
characteristics as large WebOps shops. As the number of developers
increases, we found:
• Low performers (light purple line) deploy with decreasing frequency.
• Medium performers (dark purple line) deploy at a constant frequency.
• High performers (yellow line) deploy at a significantly increasing frequency. In other words, to scale deployments per day per developer, we need to
focus on all the factors that predict high IT performance: a goal-oriented
generative culture, a modular architecture, the engineering practices that
enable continuous delivery, and effective leadership.
The Link Between Architecture & Developer Productivity
Deploy/Day/Dev
Figure 9
Number of deployments per day per developer
5
Parts of this section are excerpted from the upcoming DevOps Cookbook by Gene Kim, Patrick Debois, John Willis, and Jez Humble, (IT Revolution, 2015).
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 20Back to Table of Contents
21. 6. How IT Managers Can
Help Their Teams Win
This year’s survey results show that the top three predictors of organizational
performance are culture, investment in DevOps and IT performance. All of these
affect each other, too. IT leaders can do a lot to improve their organization’s
performance by paying attention to all three of these areas. When it comes
to culture, leaders can improve matters by enabling specific DevOps practices
and by visibly investing in DevOps and in their employees’ professional
development. Managers can also facilitate big improvements in IT performance
by taking measures to make deployments less painful. Last but not least,
IT managers should make performance metrics visible and take pains to align
these with organizational goals, and should delegate more authority to their
employees. Knowledge is power, and you should give power to those who have
the knowledge.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 21Back to Table of Contents
22. Why Culture Matters
Almost everyone agrees that culture is the most important ingredient
of DevOps. The challenge for most IT leaders is defining and communicating
a vision of beneficial culture for their organizations, and then facilitating the
changes needed to achieve that.
Because culture is hard to define, measure and discuss, let alone change,
many organizations instead default to implementing frameworks such
as ITIL and COBIT, and adopting the tools that are buzzword-compliant with
those frameworks. But adopting a framework wholesale, without reference
to the particular issues of the workplace, often makes life more difficult
for everyone. The pace of throughput slows down, productivity declines,
and the morale of the team is undermined.
We felt there must be a better way, so in last year’s report we measured
both culture and organizational performance, and demonstrated a strong
link between the two. In order to measure culture, we used a model
developed by Dr. Ron Westrum, a sociologist who studied the effects
of organizational culture on safety in healthcare and aviation. Westrum
defines culture thusly:
The organisation’s pattern of response to the problems and opportunities
it encounters. Three dominant types — pathological, bureaucratic, and
generative — are described. These types are shaped by the preoccupations
of the unit’s leaders. The workforce then responds to these priorities,
creating the culture.
In other words, team leaders shape the culture according to their own
proclivities, by creating incentive structures that reward certain behaviors.
These incentive structures also affect how team members process and
share information, cooperate and collaborate.
Figure 10
Typology of Organizational Culture (Westrum, 1994)
Pathological
Power-oriented
Bureaucratic
Rule-oriented
Generative
Performance-oriented
Low cooperation Modest cooperation High cooperation
Messengers shot
Messengers
neglected
Messengers trained
Responsibility shirked
Narrow
responsibilities
Risks are shared
Bridging discouraged Bridging tolerated Bridging encouraged
Failure leads
to scapegoating
Failure leads
to justice
Failure leads
to inquiry
Novelty crushed
Novelty leads
to problems
Novelty implemented
Westrum’s model doesn’t deal with all aspects of culture; it is limited
to factors that influence the flow of information through the organization.
The table below shows the three types of organizations.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 22Back to Table of Contents
23. Figure 11
How to create a generative culture
Characteristics
of a Generative Culture
DevOps Practices
High cooperation
Cross-functional teams. Many organizations create cross-functional teams that include representatives from each functional
area of the software delivery process (business analysts, developers, quality engineers, ops, security, etc.). This allows everyone
to share the responsibility for building, deploying and maintaining a product.
Messengers trained
Blameless postmortems. By removing blame, you remove fear; and by removing fear, you enable teams to more effectively
surface problems and solve them. Mistakes happen. Holding blameless postmortems is a valuable way to learn from mistakes.
Risks are shared
Shared responsibilities. Quality, availability, reliability and security are everyone’s job. One way to improve the quality of your
services is to ensure that devs share responsibility for maintaining their code in production. The improvement in collaboration that
comes from sharing responsibility inherently reduces risk: With more eyes on the software delivery process, it’s a given that some
errors in process or planning will be avoided. Automation also reduces risk, and with the right tool choice, can enable collaboration.
Bridging encouraged
Breaking down silos. In addition to creating cross-functional teams, techniques for breaking down silos can include co-locating
ops with the dev team; including ops in planning throughout the software delivery lifecycle; and implementing ChatOps.6
Failure leads to inquiry
Blameless postmortems. Our response to failure shapes the culture of an organization. The more you focus on the conditions
in which failures happen, as opposed to blaming individuals for failures, the closer you’ll get to creating a generative culture.
Novelty implemented
Experimentation time. Giving employees freedom to explore new ideas can lead to great outcomes. Some companies give
engineers time each week for experimentation. Others host internal hack days or mini-conferences to share ideas and
collaborate. This is how many new features and products have originated, and it shows how much value employees can generate
for an organization when they’re released from habitual pathways and repetitive tasks.
6
Newland, Jessie. “ChatOps at GitHub,” Rubyfuza presentation, March 16, 2013, https://www.youtube.com/watch?v=NST3u-GjjFw.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 23Back to Table of Contents
24. Westrum’s model gives us the language to define and measure culture.
Perhaps most interesting, Westrum’s model also predicts IT performance.
This shows that information flow isn’t just essential to safety, it’s also a critical
success factor for rapidly building and evolving resilient systems at scale.
Building on last year’s findings, this year we wanted to investigate how
organizations can move towards a high-performance, generative
culture — especially large, regulated, slow-moving organizations that
have complex, heterogeneous systems.
We discovered the top seven measures with the strongest correlation
to organizational culture are:
1. Organizational investment in DevOps.
2. The experience and effectiveness of team leaders.
3. Continuous delivery practices.
4. The ability of development, operations, and infosec teams to achieve
win-win outcomes.
5. Organizational performance.
6. Deployment pain.
7. Lean management practices (see previous section).
This list contains several constructs that are new in this year’s survey:
organizational investment in DevOps, effective leadership, deployment
pain, and lean management practices. We’ll discuss these constructs and
their impact on organizational culture and performance in the rest
of this section.
DevOps in Practice
“Our brand of DevOps meshes with
the collaborative culture of the
company. [Our] culture is all about
candor, collaboration, creative
challenges, and courage to move
the needle. It’s about initiating new
concepts, new ideas, and new
compelling stories we want to tell…
We have to promote positive
disruption, so our business doesn’t
get stuck, and can move into
the future.”
— Jason Cox
Read the full story >
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 24Back to Table of Contents
25. Organizational Investment in DevOps
One of the factors we wanted to understand was the
level and type of investment in DevOps happening
in organizations, and how that was related to the
success and impact of DevOps practices. Organiza-
tional investment was measured based on answers
to the following items:
• We plan to invest in tools that support
DevOps initiatives.
• We plan to invest in training and development
for technical staff.
• We already have training available for technical staff.
• DevOps is a high priority in my organization.
These statements may sound somewhat general,
but the data shows they are surprisingly important.
In fact, even plans to invest in DevOps can send
a strong signal to teams throughout an organization.
We found that organizational investment in DevOps
is strongly correlated with organizational culture;
the ability of development, operations, and infosec
teams to achieve win-win outcomes; lower levels
of burnout; more effective leadership; and effective
implementation of both continuous delivery
and lean management practices. Organizational
investment in DevOps is also predictive of organiza-
tional performance.
Why does organizational investment have such
an outsize impact on outcomes? First of all, simply
making an initiative high priority and communicating
that fact to the organization is already a big deal.
In organizational change expert John Kotter’s book,
Leading Change, he lists “establishing a sense
of urgency” as the first and most important of eight
steps required to create effective, lasting change.
Second, it’s unrealistic to expect people to
change they way they work without organizational
support — and budget. Today, many organizations
expect people to acquire new skills and adopt new
tools without adequate funding, and even without
allowing for any extra time, all while continuing
to be productive.
In contrast, high-performing organizations commit
to investments in training and development,
in addition to tools. Our data shows these
organizations are more likely to have a generative
culture and achieve better outcomes.
There are a number of ways IT leaders can invest in their teams:
• Establish a dedicated training budget and make sure people
know about it. Also, give your staff the latitude to choose
training that interests them.
• Encourage staff to attend technical conferences at least once
a year and summarize what they learned for the entire team.
• Set up internal hack days, where cross-functional teams
can get together to work on a project.
• Hold regular internal DevOps mini-conferences.
• Give staff dedicated time, such as 20-percent time or several
days after a release, to experiment with new tools and technolo-
gies. Allocate budget and infrastructure for special projects.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 25Back to Table of Contents
26. Deployment Pain
Do you and your staff dread deployments? Are you afraid changes will
break everything, taking your services down, forcing people to work
overtime, and attracting unwelcome attention from upper management?
You aren’t alone. With traditional methods of software development,
deployments are often infrequent, painful, and disruptive events.
In organizations practicing DevOps, deployments are regular, pain-free
and dependable. We wanted to understand how you could go from one
extreme to the other, so we created a new construct called deployment
pain, which consists of three items:
• Code deployments are not feared.
• Code deployments are extremely disruptive and my team
and I fear them.7
• Code deployments are relatively pain-free.
Statistical analysis revealed a high correlation between IT performance and
deployment pain: The more painful code deployments are, the poorer
the IT performance, organizational performance and culture. The data
also tells us that painful deployments result in higher change fail rates.
It was gratifying, though unsurprising, to find that deployment pain was
predicted by whether the key continuous delivery practices had been
implemented: comprehensive test and deployment automation, the
use of continuous integration including trunk-based development, and
version control of everything required to reproduce production environ-
ments. A generative organizational culture was also highly correlated with
low deployment pain.
Quick temperature gauge: How painful are your deployments?
If you want to know how your team is doing, all you have to do is ask
your team how painful deployments are and what specific things are
causing that pain.
Common problems include:
• Changes that often result in failures and are difficult
to diagnose and fix.
• Dev, test, and staging environments that are different from
production environments, causing failures when builds are
promoted across environments.
• Lots of manual work required to deploy.
• Lots of handoffs between teams, resulting in slow,
inefficient deployments.
The countermeasures that should be implemented include:
• Do smaller deployments more frequently (i.e., decrease batch sizes).
• Automate more of the deployment steps.
• Treat your infrastructure as code, using a standard configuration
management tool.
• Implement version control for all production artifacts.
• Implement automated testing for code and environments.
• Create common build mechanisms to build dev, test and
production environments.
7
This item was reverse coded for statistical analysis.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 26Back to Table of Contents
27. Create Leaders & Delegate Authority
Effective leadership plays a critical role in shaping the cultural environment of any organization. Respondents
who reported strong agreement with the following statements also reported a generative organizational culture
(according to Westrum’s model, see Figure 11):
• My team leader is effective at what they do.
• My team leader has significant experience in the work my team does.
• My team leader is a recognized expert on the team.
• My team leader has led similar efforts in the past.
Effective leadership was also strongly correlated with:
• Helping teams achieve win-win outcomes. One common source of adversarial relationships between
departments is when they are measured in ways that encourage them to focus on team-level goals — for
example, “How fast can I declare my code dev complete?” — rather than organization-level or customer-focused
goals such as, “How fast can we successfully resolve bugs?”
• Creating feedback loops. Teams with effective leadership use data from application and infrastructure
monitoring tools to make business decisions daily. Looping from production back into what teams work
on is critical to creating high-performance teams.
• The use of key continuous delivery practices. Continuous integration and the use of comprehensive
configuration management and test automation were also highly correlated with effective leadership. That’s
consistent with our hypothesis that effective leaders encourage their teams to invest in ongoing improvement
work. Effective leaders are those who demonstrate by their actions that the improvement of daily work is more
important than the daily work.
Effective leaders encourage
their teams to invest in ongoing
improvement work.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 27Back to Table of Contents
28. Leadership, like culture, is also hard to define and measure. David Marquet,
former U.S. Navy captain and author of Turn the Ship Around!, gives us this
remarkable definition of leadership:
Leadership (n): Embedding the capacity for greatness in the people and practices
of an organization, and decoupling it from the personality of the leader.
The secret to his methodology is simple: “Move the authority to where the
information is.” This is absolutely critical if you want to scale. People must
have the authority to act, and they can act wisely only if they have the
information they need to do so. In fact, it’s the people on the ground who
really know what needs to be done. The role of the leader should be
to trust and enable those who know what needs to be done.
Here are some ways to delegate authority to where the information is:
• Make metrics visible and actionable. Many organizations claim
to be data-driven, meaning they collect a lot of data, but very few
actually make decisions based on that data. Do you regularly review
metrics and take action on them, or are they primarily vanity metrics?
To achieve organizational clarity, you need to do two things:
• Make sure performance metrics are aligned with organizational
goals, rather than team or functional goals.
• Turn data into actionable, visible information that provides teams
with feedback on key quality, performance, and productivity metrics.
• Manage work in process. Give teams control over their work
in process, and the authority to limit it so they are not overburdened
and can get work completed quickly and sustainably.
• Support employees. Effective leaders help people grow and learn
as part of their work, and support their decisions even when they
produce poor outcomes — so long as they learn from them.
DevOps in Practice
“Everyone is responsible for quality and we’re all trying to deliver the best solution for our customers… Constant discussion between
software and infrastructure teams really helps us proactively find issues before deploying to production. We all benefit from
working together more efficiently. Everyone is interested in making our services better, and everyone is thinking bigger scale.
We’re encouraging people to ask the right questions to understand what we need to deliver for the future. That’s a big win for me.”
— Reena Mathew
Read the full story >
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 28Back to Table of Contents
29. #WomenInTech
We introduced a few new questions on gender, which sparked some lively discussion
in social media on the topic of women in tech. We heard everything from wholehearted
support from many women and men in the DevOps community, to questions about
why gender diversity in tech matters. Of the total respondents, 5 percent self-identified
as female. This was much lower than we expected, given that women make up about
13 percent in systems administration8
and 27 percent in computer and information
management9
. We were hoping to find more reassuring numbers of women working
on technical teams, but we didn’t. Among survey respondents:
• 33 percent report working on teams with no women.
• 56 percent report working on teams that are less than 10 percent female
• 81 percent report working on teams that are less than 25 percent female.
There’s plenty of research linking the presence of women in leadership positions
to higher financial performance,10
stock market performance,11
and hedge fund
returns.12
Furthermore, a study conducted by Anita Woolley and Thomas W. Malone
measured group intelligence and found that teams with more women tended
to fall above average on the collective intelligence scale.13
Despite all of these clear
advantages, organizations are failing to recruit and retain women in technical fields.
If there are no significant differences between men and women in terms of ability
or aptitude in STEM (Science, Technology, Engineering and Mathematics) fields, what’s
keeping women and other underrepresented groups out of tech? Nothing more than
the pervasive belief that some men are naturally more suited to technical work because
they possess innate brilliance.14
We can do better. It’s up to all of us to prioritize diversity and promote inclusive
environments. It’s good for your team and it’s good for the business. Here are
some resources to help you get started:
• Ada Initiative. Provides Allies Workshops, codes of conduct, and
anti-harassment policies.
• Anita Borg Institute. Excellent tools for advancing women in technology.
• Geek Feminism. Great resources for supporting women in geek communities.
One third report working
on teams with no women.
More than half report working
on teams that are less than
10% female.
8
SAGE Annual Salary Survey for 2007, The USENIX Association, https://www.
usenix.org/system/files/lisa/surveys/sal2007_0.pdf.
9
Diaz, Von and King, Jamilah. “How Tech Stays White,” Colorlines, Oct 22, 2013,
http://www.colorlines.com/articles/how-tech-stays-white.
10
McGregor, Jena. “More women at the top, higher returns,” The Washington Post,
September 24, 2014, http://www.washingtonpost.com/blogs/on-leadership/
wp/2014/09/24/more-women-at-the-top-higher-returns/.
11
Covert, Bryce. “Companies With Female CEOs Beat The Stock Market,”
ThinkProgress, July 8, 2014, http://thinkprogress.org/econo-
my/2014/07/08/3457859/women-ceos-beat-stock-market/.
12
Covert, Bryce. “Returns for Women Hedge Fund Managers Beat Everyone
Else’s,” ThinkProgress, January 15, 2014, http://thinkprogress.org/econo-
my/2014/01/15/3168521/women-hedge-funds-returns/.
13
Woolley, Anita and Malone, Thomas W. “Defend Your Research: What Makes
a Team Smarter? More Women,” Harvard Business Review, June 2011, https://hbr.
org/2011/06/defend-your-research-what-makes-a-team-smarter-more-women.
14
Leslie, Sarah-Jane, et al. “Expectations of brilliance underlie gender distri-
butions across academic disciplines,” Science 347:6219, (January 16, 2015),
262–265.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 29Back to Table of Contents
30. 7. Burnout
Just as in any industry where the work is high tempo and high consequence,
IT is plagued by employee burnout. IT managers, like so many other managers,
often try to fix the person while ignoring the work environment, even though
changing the environment is far more vital for long-term success. Managers
who want to avert employee burnout should concentrate their attention and
efforts on fostering a respectful, supportive work environment that emphasizes
learning from failures rather than blaming; communicating a strong sense
of purpose; investing in DevOps and employee development; asking employees
what causes deployment pain and then fixing those things; and giving employees
time and space to experiment and learn. Last but not least, employees must
be given the authority to make decisions that affect their work and their jobs.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 30Back to Table of Contents
31. As in other high-tempo, high-consequence work, burnout is an important issue in IT, with serious
repercussions for the mental and physical health of practitioners. Research shows that stressful jobs can
be as bad for physical health as smoking and obesity. Symptoms of burnout include feeling exhausted,
cynical or ineffective; feeling little or no sense of accomplishment in your work; and feelings about your
work negatively affecting the rest of your life. In extreme cases, burnout can lead to family issues, severe
clinical depression and even suicide.
Job stress also affects employers, costing the U.S. economy $300 billion per year in sick time, long-term
disability and excessive job turnover.15
Thus, employers have both a duty of care towards employees and
a fiduciary obligation to ensure staff do not become burned out.
Christina Maslach, professor of psychology at the University of California at Berkeley and a pioneering
researcher on job burnout, found six organizational risk factors that predict burnout:16
• Work overload. Job demands exceed human limits.
• Lack of control. Inability to influence decisions that affect your job.
• Insufficient rewards. Insufficient financial, institutional or social rewards.
• Breakdown of community. Unsupportive workplace environment.
• Absence of fairness. Lack of fairness in decision-making processes.
• Value conflicts. Mismatch in organizational values and the individual’s values.
Maslach found that most organizations try to fix the person and ignore the work environment, even though
data shows that fixing the environment has a higher likelihood of success. All of the risk factors above are
things management has the power to change.
15
Maslach, Christina. “Understanding Burnout,” Thriving in Science Lecture, December 10, 2014, https://www.youtube.com/watch?v=4kLPyV8lBbs.
16
Maslach, Christina and Leiter, Michael P. “Early predictors of job burnout and engagement,” Journal of Applied Psychology 93:3, (2008), 498–512.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 31Back to Table of Contents
32. Our research also tells us which organizational factors are most strongly correlated with high levels
of burnout, and suggests where to look for solutions. The five most highly correlated factors are:
• Organizational culture. Strong feelings of burnout are found in organizations with a pathological,
power-oriented culture. Managers are ultimately responsible for fostering a supportive and respectful
work environment, and they can do so by creating a blame-free environment, striving to learn from
failures, and communicating a shared sense of purpose.
• Deployment pain. Unplanned work and constant firefighting contribute to high stress and feelings
of lack of control. With the right practices in place, deployments don’t have to be painful events. Managers
should be asking their teams how painful their deployments are, and fixing the things that hurt the most.
• Effectiveness of team leader. Responsibilities of a team leader include limiting work in process
and eliminating roadblocks for the team so they can get their work done. It’s not surprising that
respondents with effective team leaders reported lower levels of burnout.
• Organizational investment in DevOps. Organizations that invest in developing the capabilities
of their teams get better outcomes. Investing in training and providing people with the necessary
support and resources (including time) to acquire new skills are critical to the successful adoption
of DevOps.
• Organizational performance. Our data shows that lean management and continuous delivery practices
predict IT performance, which in turn predicts organizational performance. At the heart of lean
management is giving employees the necessary time and resources to improve their own work.
This means creating a work environment that supports both experimentation and failure, and allowing
employees to make decisions that affect their jobs.
Unplanned work & constant
firefighting contribute
to high stress & feelings
of lack of control.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 32Back to Table of Contents
33. 8. Methodology
The State of DevOps Survey has evolved over the past four years. Our current
rigorous methodology was established last year,and has given us a rich data set
that tells us a great deal about the relationships between IT performance,
organizational performance, DevOps and lean practices. In this section,
we describe how we enlisted survey respondents — a mix of IT practitioners
and managers, developers and testers — how we designed our questions,
models and constructs, and our analysis methods. We welcome any questions
about our survey methodology, so please feel free to get in touch:
devopssurvey@puppetlabs.com.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 33Back to Table of Contents
34. Target Population & Sampling Method
Our target population for this survey was practitioners and leaders working in (or closely with) IT, and
especially those familiar with DevOps. Because we don’t have a master list of these people — we can
describe them, but we don’t know exactly where they are, how to find them and how many of them
exist — we used snowball sampling to obtain respondents. This means we promoted the survey via email
lists, online promotions and social media, and also asked people to share with their networks, growing the
sample like a snowball. Our sample is likely limited to organizations and teams that are familiar with DevOps,
and as such, may be using some DevOps practices.
Creating Latent Constructs
Once the target population and sampling method were determined, we began the difficult work
of determining which questions to include in the survey. To do that, we first had to figure out which
hypotheses we wanted to test.
To add to the rigor of our study, we referenced existing research and theories. We formulated our
hypotheses and constructs, using previously validated constructs wherever possible. When we needed
to create new constructs, we wrote them very carefully based on theory, definitions and expert input.
We then took additional steps to clarify intent and wording to ensure that data collected from the final
survey would have a high likelihood of being reliable and valid.17
To create constructs, we used Likert-type18
questions, which provided shades of gray, rather than black-and-white, yes-or-no, true-or-false questions.
Likert-type questions also make it possible to perform more advanced analysis.
17
We used Churchill’s methodology: Churchill Jr, G. A. “A paradigm for developing better measures of marketing constructs,” Journal of Marketing Research 16:1,
(1979), 64–73.
18
“Likert scale,” Wikipedia, last modified June 25, 2015, https://en.wikipedia.org/wiki/Likert_scale.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 34Back to Table of Contents
35. Methods
• Measurement Model. Prior to conducting any analysis using constructs — including correlations,
regressions, and partial least squares (PLS)19
analysis — the constructs were tested for validity and reliabili-
ty. The constructs passed checks for convergent validity20
, discriminant validity21
, and reliability, therefore
exhibiting good psychometric22
properties.
• Regression Analysis. When predictions or impacts are cited and PLS is not explicitly mentioned,
a simple linearregression23
was used.
• Structured Equation Modeling. The structured equation models (SEMs)24
were tested using PLS analysis,
which is a correlation-based SEM well-suited to exploratory analysis. SmartPLS 3.2.0 was used. All paths
shown in figures 5 and 6 are p < .001.
• Study Design. This study employs a cross-sectional, theory-based design.
19
“Partial least squares regression,” Wikipedia, last modified May 26, 2015, https://en.wikipedia.org/wiki/Partial_least_squares_regression.
20
“Convergent validity,” Wikipedia, last modified January 7, 2015, https://en.wikipedia.org/wiki/Convergent_validity.
21
“Discriminant validity,” Wikipedia, last modified June, 22, 2015, https://en.wikipedia.org/wiki/Discriminant_validity.
22
“Psychometrics,” Wikipedia, last modified June, 27, 2015, https://en.wikipedia.org/wiki/Psychometrics.
23
“Linear regression,” Wikipedia, last modified July 3, 2015, https://en.wikipedia.org/wiki/Linear_regression.
24
“Structural equation modeling,” Wikipedia, last modified May 26, 2015, https://en.wikipedia.org/wiki/Structural_equation_modeling.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC 35Back to Table of Contents
36. Say helloAbout Puppet Labs
Puppet Labs, Inc. is the leader in IT automation. Puppet Labs software provides system
administrators the operational agility, efficiency and insight they need to proactively
manage dynamic infrastructure, scaling from tens of servers to thousands, both
on premise and in the cloud. Thousands of the world’s leading organizations use
Puppet Labs software to configure and manage their IT infrastructure. Learn more
about Puppet Labs at www.puppetlabs.com.
Be the DevOps you want
to see in the world.
Thanks to all of the Puppet Labs employees
whose photos are featured in this report.
All photos were taken at our headquarters
in Portland, OR.
About IT Revolution
IT Revolution assembles technology leaders and practitioners through publishing,
events, and research. Our goal is to elevate the state of technology work, quantify
the economic and human costs associated with suboptimal IT performance, and
to improve the lives of 1 million IT professionals by 2017. Learn more about IT
Revolution at www.itrevolution.com.
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC Back to Table of Contents
37. About PwC
PwC US helps organizations and individuals create the value they’re looking for. We’re a member
of the PwC network of firms, which has firms in 157 countries with more than 195,000 people.
We’re committed to delivering quality in assurance, tax and advisory services. Find out more
and tell us what matters to you by visiting us at www.pwc.com/us/highvelocityit.
Be the DevOps you want
to see in the world.
Sponsored by
Puppet Labs 2015 State of DevOps Report | In partnership with IT Revolution | Sponsored by PwC Back to Table of Contents