This document discusses agile metrics for measuring value, flow, quality, and culture. It presents common metrics used by Scrum teams like velocity, burnup/burndown, lead time, and defects. Flow-related metrics across the development lifecycle are explained, including the differences between cycle time and lead time. The document also discusses measuring value, happiness, culture, and frameworks for metrics like SAFe. Key takeaways are that outcomes rather than activity should be measured, and that culture, collaboration, and safety are important but difficult to measure metrics.
Presenter:
Dr. Gail Ferreira, Agile Practice Leader, MATRIX Resources, San Francisco Center of Excellence
Rapid scale directly impacts all levels of decision-making, planning, execution, culture, and communications for executives in hypergrowth companies. In this session, we will discuss how to organize, support, and tailor agile practices for teams and sub-teams in companies with a rapid growth cycle. We will share contemporary case studies of hypergrowth companies who have delivered agile at scale.
Topics will include:
• Basic agile and lean methods
• Scrum of Scrums
• SAFe
• Disciplined Agile Delivery (DAD)
• Agility at Scale (Ambler/Lines)
• Spotify model (Tribes, Squads, Chapters & Guilds, DSDM).
Agile IT Operatinos - Getting to Daily ReleasesLeadingAgile
Getting to Daily Releases with Agile IT Operations. Devin Hedge, Enterprise Transformation Consultant talks to a group at Triagile about the Six Key Areas to focus on when attempting to transform IT Operations with Lean and Agile principles. The talk covers Service Engineering, IT Operations, and the Tier 1 Support/NOC organizations. Kanban, Service Management (ITSM), and what it means to have a DevOps orientation.
Learn more about the scaled Agile Framework + scaling Agile. After a short introduction to several frameworks that aim to support the scaling of Agile (DAD, LeSS, SAFe®), this power point presentation from our webinar dives deeper into the details of the Scaled Agile Framework (SAFe®). Find the truth behind the often cited sentence “As Scrum is to the Agile team, SAFe® is to the Agile enterprise.”
10 steps to a successsful enterprise agile transformation global scrum 2018Agile Velocity
Presented at Scrum Gathering Minneapolis, Senior Agile Coach and Trainer Mike Hall provides leaders and managers 10 steps to a successful enterprise Agile transformation.
Presenter:
Dr. Gail Ferreira, Agile Practice Leader, MATRIX Resources, San Francisco Center of Excellence
Rapid scale directly impacts all levels of decision-making, planning, execution, culture, and communications for executives in hypergrowth companies. In this session, we will discuss how to organize, support, and tailor agile practices for teams and sub-teams in companies with a rapid growth cycle. We will share contemporary case studies of hypergrowth companies who have delivered agile at scale.
Topics will include:
• Basic agile and lean methods
• Scrum of Scrums
• SAFe
• Disciplined Agile Delivery (DAD)
• Agility at Scale (Ambler/Lines)
• Spotify model (Tribes, Squads, Chapters & Guilds, DSDM).
Agile IT Operatinos - Getting to Daily ReleasesLeadingAgile
Getting to Daily Releases with Agile IT Operations. Devin Hedge, Enterprise Transformation Consultant talks to a group at Triagile about the Six Key Areas to focus on when attempting to transform IT Operations with Lean and Agile principles. The talk covers Service Engineering, IT Operations, and the Tier 1 Support/NOC organizations. Kanban, Service Management (ITSM), and what it means to have a DevOps orientation.
Learn more about the scaled Agile Framework + scaling Agile. After a short introduction to several frameworks that aim to support the scaling of Agile (DAD, LeSS, SAFe®), this power point presentation from our webinar dives deeper into the details of the Scaled Agile Framework (SAFe®). Find the truth behind the often cited sentence “As Scrum is to the Agile team, SAFe® is to the Agile enterprise.”
10 steps to a successsful enterprise agile transformation global scrum 2018Agile Velocity
Presented at Scrum Gathering Minneapolis, Senior Agile Coach and Trainer Mike Hall provides leaders and managers 10 steps to a successful enterprise Agile transformation.
Why transform to Agile? What are the impediments to Agile Transformation? How to plan the Agile transformation? How to accelerate and sustain the Agile Transformation.
Leading a large-scale agile transformation isn’t about adopting a new set of attitudes, processes, and behaviors at the team level… it’s about helping your company deliver faster to market, and developing the ability to respond to a rapidly-changing competitive landscape. First and foremost, it’s about achieving business agility. Business agility comes from people having clarity of purpose, a willingness to be held accountable, and the ability to achieve measurable outcomes. Unfortunately, almost everything in modern organizations gets in the way of teams acting with any sort of autonomy. In most companies, achieving business agility requires significant organizational change.
Agile transformation necessitates a fundamental rethinking of how your company organizes for delivery, how it delivers value to its customers, and how it plans and measures outcomes. Agile transformation is about building enabling structures, aligning the flow of work, and measuring for outcomes based progress. It's about breaking dependencies. The reality is that this kind of change can only be led from the top. This talk will explore how executives can define an idealized end-state for the transformation, build a fiscally responsible iterative and incremental plan to realize that end-state, as well as techniques for tracking progress and managing change.
Leading a large-scale agile transformation isn’t about adopting a new set of attitudes, processes, and behaviors at the team level… it’s about helping your company deliver faster to market, and developing the ability to respond to a rapidly-changing competitive landscape. First and foremost, it’s about achieving business agility. Business agility comes from people having clarity of purpose, a willingness to be held accountable, and the ability to achieve measurable outcomes. Unfortunately, almost everything in modern organizations gets in the way of teams acting with any sort of autonomy. In most companies, achieving business agility requires significant organizational change. Join @Mike Cottmeyer live from #Agile2017 during this workshop.
Introduction to SAFe, the Scaled Agile Frameworksrondal
Sans doute vous identifiez vous dans une ou plusieurs des situations suivantes:
- plusieurs équipes Scrum travaillent dans votre entreprise, parfois sur un même projet ou des projets connexes
- la coordination entre équipes Scrum n'est pas optimale
- vous-même, ou certains stakeholders, ont besoin d'une vue plus long terme sur vos projets Agile, plus que "juste le prochain sprint"
- sur base du succès de Scrum dans votre entreprise, vous voulez allez plus loin et vous voulez rendre plus agile l'entièreté de votre entreprise
Si c'est le cas, venez découvrir le framework SAFe.
Après une présentation du framework et de ses fondements, vous serez en mesure de mieux le comprendre, et de voir ce qu'il peut apporter ou non à votre entreprise.
My keynote talk at Agile of the East, Kolkata on 11-Nov. In this talk, I have shared a perspective on what an agile transformation could bring, and some anti-patterns
Water-Scrum-Fall: The Good, the Bad, and the [Scrum]Butt-UglyBrad Appleton
by Brad Appleton, September 2019.
Learning Objectives:
- Know the different development lifecycles on the journey from Fragile/Wagile to Agile;
- Recognize the key differences and how - they harm, hinder or help;
- Learn the key challenges, stepping stones, and techniques for addressing them;
- Recognize the dangers of using them as long-term solutions instead of short-term workarounds.
Keywords: Wagile, Water-Scrum,. AgileFall/ScrumFall, Water-Scrum-Fall, Iterative, Incremental, Iterations, Sprint 0, Hardening Sprints, Buffer Sprint,
Presentation to OU Agile special interest group 25 January 2017. Agile basics, Agile myths, and stories of breakthroughs and breakdowns in Agile adoption in learning design and course production.
Scaled Agile, Inc., is the provider of SAFe®, the world’s leading framework for business agility. Through learning and certification, a global partner network, and a growing community of over 800,000 trained professionals, Scaled Agile helps enterprises build agility into their culture so they can quickly identify and deliver customer value, capitalize on emerging opportunities, and improve business outcomes. Learn more at scaledagile.com.
Agile Transformation consists of a group of professional change agents specializing in process improvement and organizational transformation. We are experts in Agile, Lean and organizational transformation methods applied to Technology and Business.
Scrum vs SAFe | Differences Between Scrum and Scaled Agile Framework | EdurekaEdureka!
YouTube Link: https://youtu.be/c2e0BchglOc
** Certified Scrum Master Training: https://www.edureka.co/certified-scrum-master-certification-training **
This Edureka PPT on "Scrum vs SAFe" video will help you understand the key differences between the two most popular frameworks Scrum and Scaled Agile Framework (SAFe). The topics discussed in this course are listed below:
What is Scrum?
What is SAFe?
Major Differences Between Scrum and SAFe
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
Scaling Agile With SAFe (Scaled Agile Framework)Andreano Lanusse
Apresentação feita no Agile in Rio, mostrando como um conjunto de 5 à 10 equipes ágeis podem entregar objetivos em comum usando Scaled Agile Framework® ou SAFe, e como iniciar o lançamento de um Agile Release Train.
Being Agile, Doing Agile and Agile in Crisis: We have the Agile Industrial Complex, Dark Agile, Faux/Fake Agile, Zombie Scrum, Flaccid Scrum, CrAgile, FrAgile, WAgile, and more. What do they all mean, and how do we know if we are doing them instead of "Being Agile"
Why transform to Agile? What are the impediments to Agile Transformation? How to plan the Agile transformation? How to accelerate and sustain the Agile Transformation.
Leading a large-scale agile transformation isn’t about adopting a new set of attitudes, processes, and behaviors at the team level… it’s about helping your company deliver faster to market, and developing the ability to respond to a rapidly-changing competitive landscape. First and foremost, it’s about achieving business agility. Business agility comes from people having clarity of purpose, a willingness to be held accountable, and the ability to achieve measurable outcomes. Unfortunately, almost everything in modern organizations gets in the way of teams acting with any sort of autonomy. In most companies, achieving business agility requires significant organizational change.
Agile transformation necessitates a fundamental rethinking of how your company organizes for delivery, how it delivers value to its customers, and how it plans and measures outcomes. Agile transformation is about building enabling structures, aligning the flow of work, and measuring for outcomes based progress. It's about breaking dependencies. The reality is that this kind of change can only be led from the top. This talk will explore how executives can define an idealized end-state for the transformation, build a fiscally responsible iterative and incremental plan to realize that end-state, as well as techniques for tracking progress and managing change.
Leading a large-scale agile transformation isn’t about adopting a new set of attitudes, processes, and behaviors at the team level… it’s about helping your company deliver faster to market, and developing the ability to respond to a rapidly-changing competitive landscape. First and foremost, it’s about achieving business agility. Business agility comes from people having clarity of purpose, a willingness to be held accountable, and the ability to achieve measurable outcomes. Unfortunately, almost everything in modern organizations gets in the way of teams acting with any sort of autonomy. In most companies, achieving business agility requires significant organizational change. Join @Mike Cottmeyer live from #Agile2017 during this workshop.
Introduction to SAFe, the Scaled Agile Frameworksrondal
Sans doute vous identifiez vous dans une ou plusieurs des situations suivantes:
- plusieurs équipes Scrum travaillent dans votre entreprise, parfois sur un même projet ou des projets connexes
- la coordination entre équipes Scrum n'est pas optimale
- vous-même, ou certains stakeholders, ont besoin d'une vue plus long terme sur vos projets Agile, plus que "juste le prochain sprint"
- sur base du succès de Scrum dans votre entreprise, vous voulez allez plus loin et vous voulez rendre plus agile l'entièreté de votre entreprise
Si c'est le cas, venez découvrir le framework SAFe.
Après une présentation du framework et de ses fondements, vous serez en mesure de mieux le comprendre, et de voir ce qu'il peut apporter ou non à votre entreprise.
My keynote talk at Agile of the East, Kolkata on 11-Nov. In this talk, I have shared a perspective on what an agile transformation could bring, and some anti-patterns
Water-Scrum-Fall: The Good, the Bad, and the [Scrum]Butt-UglyBrad Appleton
by Brad Appleton, September 2019.
Learning Objectives:
- Know the different development lifecycles on the journey from Fragile/Wagile to Agile;
- Recognize the key differences and how - they harm, hinder or help;
- Learn the key challenges, stepping stones, and techniques for addressing them;
- Recognize the dangers of using them as long-term solutions instead of short-term workarounds.
Keywords: Wagile, Water-Scrum,. AgileFall/ScrumFall, Water-Scrum-Fall, Iterative, Incremental, Iterations, Sprint 0, Hardening Sprints, Buffer Sprint,
Presentation to OU Agile special interest group 25 January 2017. Agile basics, Agile myths, and stories of breakthroughs and breakdowns in Agile adoption in learning design and course production.
Scaled Agile, Inc., is the provider of SAFe®, the world’s leading framework for business agility. Through learning and certification, a global partner network, and a growing community of over 800,000 trained professionals, Scaled Agile helps enterprises build agility into their culture so they can quickly identify and deliver customer value, capitalize on emerging opportunities, and improve business outcomes. Learn more at scaledagile.com.
Agile Transformation consists of a group of professional change agents specializing in process improvement and organizational transformation. We are experts in Agile, Lean and organizational transformation methods applied to Technology and Business.
Scrum vs SAFe | Differences Between Scrum and Scaled Agile Framework | EdurekaEdureka!
YouTube Link: https://youtu.be/c2e0BchglOc
** Certified Scrum Master Training: https://www.edureka.co/certified-scrum-master-certification-training **
This Edureka PPT on "Scrum vs SAFe" video will help you understand the key differences between the two most popular frameworks Scrum and Scaled Agile Framework (SAFe). The topics discussed in this course are listed below:
What is Scrum?
What is SAFe?
Major Differences Between Scrum and SAFe
Follow us to never miss an update in the future.
YouTube: https://www.youtube.com/user/edurekaIN
Instagram: https://www.instagram.com/edureka_learning/
Facebook: https://www.facebook.com/edurekaIN/
Twitter: https://twitter.com/edurekain
LinkedIn: https://www.linkedin.com/company/edureka
Castbox: https://castbox.fm/networks/505?country=in
Scaling Agile With SAFe (Scaled Agile Framework)Andreano Lanusse
Apresentação feita no Agile in Rio, mostrando como um conjunto de 5 à 10 equipes ágeis podem entregar objetivos em comum usando Scaled Agile Framework® ou SAFe, e como iniciar o lançamento de um Agile Release Train.
Being Agile, Doing Agile and Agile in Crisis: We have the Agile Industrial Complex, Dark Agile, Faux/Fake Agile, Zombie Scrum, Flaccid Scrum, CrAgile, FrAgile, WAgile, and more. What do they all mean, and how do we know if we are doing them instead of "Being Agile"
Workshop delivered by Craig Smith and Julian Smith at DTA Digital Summit 2020 on 17 November 2020.
Today 'agile' is no longer just a buzzword. From building spacecraft to manufacturing, some of the most complex and largest organisations in the world are using agile ways of working to deliver better outcomes, respond to change, improve quality, foster more productive and happier teams, and reduce risk.
This hands-on and interactive session is aimed at helping public sector organisations build capability to support agile ways of working, from policy development through to service design and delivery.
How to become a great DevOps Leader, an ITSM Academy WebinarITSM Academy, Inc.
Presenter: Mustafa Kapadia, Service Line Leader, IBM
The ideal DevOps Leader is a tactical or strategic individual who helps design, influence, implement or motivate the cultural transformation proven to be a critical success factor in DevOps adoption. The most successful DevOps leaders understand the human dynamics of cultural change and are equipped with practices, methods, and tools to engage people across the DevOps spectrum. We will explore the role of the DevOps Leader in more detail.
DOES15 - Ramona Jackson and Aji Rajappan - Continuous Delivery at Cisco ITGene Kim
Ramona Jackson, Director IT, Cisco
Aji Rajappan, Manager IT, Cisco
Continuous Delivery (CD), a key initiative for Cisco IT in FY15, is a set of principles and practices to truly transform IT end-to-end. It extends from how IT partners with the business, prioritizes a backlog of requirements, aggressively develops, and eventually delivers the prioritized capabilities; all with the view of achieving common business outcomes.
Building upon some of the earlier work in the IaaS and PaaS space (Infrastructure and Platform as a Service), the Continuous Delivery Platform track launched an offering called Software Delivery as a Service (SDaaS) to truly transform the life of an IT developer – end-to-end. Solution set were created for both front-end custom web-app development, as well as for Oracle database back-end and ERP. Continuous delivery builds upon and extends Agile, continuous integration, and DevOps practices and tools to transform the way software and applications are deployed and delivered. Cisco IT’s journey to continuous delivery is fueled by three main objectives: 1. Accelerate time to capability, 2. Improve software quality, 3. Optimize cost of delivery.
A successful continuous delivery model requires culture and mindset shifts across all of IT and the business. Continuous delivery shatters the phase-based, sequential approach to application development, where specialized groups complete the work in phases. Each phase is added sequentially and depends on the one that came before it. Groups work in silos, and there is little communication between them. What’s more, this approach assumes that every business requirement can be identified before any design or coding occurs.
For a successful continuous delivery model, early engagement by business stakeholders is vital. Discussions shouldn’t focus on what IT can deliver but on what business outcomes will be achieved. The business should be treated as a member of the development team, actively involved along with IT as capabilities grow from prototype to limited availability to full-blown adoption. Business stakeholders have a high degree of oversight and control over what our services are delivering. Feedback loops at regular intervals enable tweaks to be made in real time as business, market, and end-user requirements change.
Personally designed (content + graphics design), officially accredited AgilePM® (Agile Project Management) Foundation courseware.
AgilePM® is a Registered Trade Mark of Dynamic Systems Development Method Limited.
Trademarks are properties of the holders, who are not affiliated with courseware author.
Governing Agile Teams: Disciplined Strategies to Increase Agile EffectivenessTechWell
Many organizations have successfully adopted agile on a subset of their projects, while, at the same time, struggled to do so across entire departments. A common challenge is the need to overhaul the IT governance strategy so that it will work with agile teams. This is a serious issue for governance bodies with little or no practical agile experience, particularly when experience shows that traditional governance strategies increase the risk of failure on agile projects. Scott Ambler introduces The Disciplined Agile Delivery framework for managing and monitoring enterprise agile teams. This framework goes beyond offering an IT governance strategy to provide advanced strategies such as development intelligence and the goal-question-metric measurement approach. Learn the do’s and don’ts of governing agile teams, how governance fits in and enhances the agile project lifecycle, how to measure agile teams, and most importantly, why teams should demand good governance.
Rich Mironov's keynote for one-day agile workshop. Intro to agile development and agile organizations, tools, impact on whole organization, product management and product planning. Co-sponsored by AccuRev, Coverity, Electric Cloud, Enthiosys, Rally and Agile Journal.
Assurance of Agile Delivery - Wellingtone | FuturePMOWellingtone
In today’s fast-paced and ever-changing business landscape, organisations are increasingly turning to Agile methodologies to enhance their project delivery capabilities. Agile offers flexibility, adaptability, and customer-centricity, but ensuring the successful delivery of Agile projects requires a unique set of strategies and practices.
This session will uncover what is unique about assurance of Agile Delivery, and come find out why to assure, what to assure, when and how. Trust us, Agile delivery needs assurance, too!
This was presented by Marisa Silva, Senior Consultant from
Wellingtone at FuturePMO, on the 26th of October.
FuturePMO is a 1-day PMO event for practitioners at all levels. The conference brings extraordinary speakers from across industries to challenge your PMO and PPM thinking, helping you work smarter.
The next one takes place on the 3rd of October 2024 in London. To learn more and book on to the next conference, visit www.FuturePMO.com
LinkedIn - https://www.linkedin.com/showcase/11120292
Twitter - https://twitter.com/FuturePMO
Facebook - https://www.facebook.com/futurepmoevent/
YouTube - https://www.youtube.com/channel/UCHi8w5ACqsloXxBEA9t9pfA
Emotional Intelligence in Agile Leadership and TransformationBrad Appleton
What is Emotional Intelligence (EQ)? What is the relationship between EQ and Agile Leadership, and what role does it play in Agile Transformation? Come explore these concepts with us and learn how they might be applied and leveraged to identify and coach for team and leadership behaviors. Participate in some real-world scenarios and develop actionable takeaways for your own teams/organization.
DevOps - an Agile Perspective (at Scale)Brad Appleton
by Brad Appleton, Agile Day Chicago 2018, October 26 2018;
This presentation gives a comprehensive introduction to DevOps, for Agile development practitioners. In 2018, there are many misunderstandings about Agile & DevOps and how they relate to one another. Too many think of Agile (development) as primarily "Scrum", and that DevOps is Continuous Integration & Delivery (both of which are wrong). This presentation describes the meaning, origin & history of DevOps from an Agile development perspective.
Continuous Delivery of Agile ArchitectureBrad Appleton
by Brad Appleton, APLN Chicago 2018 Conference, April 2018,
Agile Development & DevOps have necessitated revisititing how architecture changes over time: collaboration, design thinking, technical debt, emergent design, evolutionary architecture, agile infrastructure, and continuous delivery have all played a key role in how we can integrate architecture into agile delivery methods.
This presentation explores proven ways to continuously plan, build & evolve software architectures to support continual change as part of the continuous value-delivery pipeline.
by Brad Appleton, March 2004 Chicago Software Process Improvement Network (C-SPIN) -- an earlier version was presented at the Summer 2003 Midwest Software Engineering Conference, held at DePaul University
WANTED: Seeking Single Agile Knowledge Development Tool-setBrad Appleton
by Brad Appleton,
Presented August 2009 at at Agile 2009 Conference; Chicago, IL USA
What tools and capabilities are necessary to apply Agile development concepts+practices (such as refactoring, TDD, CI, etc.) to all knowledge-artifacts? (not just source-code).
by Brad Appleton,
Presented August 2006 at Architecture & Design World 2006; Chicago, IL USA
Software Configuration Management Patterns for Agile Software Architectures.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfJay Das
With the advent of artificial intelligence or AI tools, project management processes are undergoing a transformative shift. By using tools like ChatGPT, and Bard organizations can empower their leaders and managers to plan, execute, and monitor projects more effectively.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...informapgpstrackings
Keep tabs on your field staff effortlessly with Informap Technology Centre LLC. Real-time tracking, task assignment, and smart features for efficient management. Request a live demo today!
For more details, visit us : https://informapuae.com/field-staff-tracking/
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
1. Agile Metrics:
Value, Flow, Quality, Culture
by Brad Appleton & Mahul Patel
27 October 2020
Delivery Frequency
Value Quality
Culture
(Social)
Flow
(Delivery)
Improve
2. About the Presenters
● Currently working as Agile/Scrum Transformation
Leader since 02/2020 at Discover
● Managed several technology initiatives as a IT
Management Leader for fortune 500 companies
● Lean Six Sigma leader experience with diverse
global groups to increase operational efficiencies
● Agile/DevOps Leader & Coach
● Leading Agile adoption & scaling for teams and
organizations since 2000.
● DevOps/ALM/SCM Solution Architect
● Publications
» Software Configuration Management Patterns
(Addison-Wesley, 2002)
» Agile CM Environments column & blog (AgileConnection
& CMCrossRoads, 2003-2014)
Suburban Agilists – 27 October 2020 2
Brad Appleton
Agile/DevOps Leader
<brad@bradapp.net>
Mahul Patel
Agile/Scrum Leader
<patelmahul@yahoo.com>
3. Outline & Contents
1. Introduction [5min]
▪ Metrics – Motivation & Goals
▪ Focus on Agile or Agility?
▪ Kinds of Metrics (Categories, Scope/Scale)
2. Poll – What Kinds of Metrics Have You Used? [10min]
3. What are the Metrics that Matter (Most) [25min]
▪ Value, Flow, Quality, Culture
▪ Collaboration/Culture, Happiness & Psychological Safety
▪ Examples: Flow Framework, SAFe, Agility Health Radars
4. Quiz [5min]
▪ General quiz on what we covered
5. Q&A and Concluding Thoughts [5-10min]
6. References & Additional Material
Suburban Agilists – 27 October 2020 3
Happy Halloween!
4. Metrics - Motivation & Goals
Suburban Agilists – 27 October 2020 4
New threats continue to put pressure on Business’ need to deliver quickly and accelerate change
We want to gauge how our ways of working & interacting affect business outcomes
● Do we have the insights to outpace our competitors and pursue the most impactful opportunities?
● Do we have strong feedback loops?
Various Transformation Initiatives are also “on the rise” (Digital, Lean/Agile, DevOps, Business Agility)
● Often using “frameworks” and stages/levels of maturity, mastery or “improvement targets”
● To gauge (even compare) “progress” over the course of our (continuous) improvement journeys
Improve
Product Health
Reduce Failure
Rates
Improve
Predictability
Reduce Time
to Market
Execute
Capability
Improvement
Plans
Measure
& Report
Outcomes
Review
Dashboards
& Insights
5. Measure Agile or Agility?
Suburban Agilists – 27 October 2020 5
Defined by
Values
Guided by
Principles
Manifested thru
many different
Practices (and Numerous
Frameworks)
Agile is a
Mindset
For Business Outcomes
Time to Market
Predictability
Customer Satisfaction
Employee Satisfaction
Reliability
Resilience
Enabling Agility
… the Capability to
Create & Adapt to Change
for Competitive Advantage
in a VUCA Environment
Being Agile Doing Agile
6. What Kind of Metrics Matter?
Measure/Improve …
● Product? | Project?
● Process? | People?
● Environment? | Evolution?
Scope/Scale …
● Unitary | Individual | Personal
● Team | Application | Service
● Organization | Product | Stream
● Program | Market | System
● Enterprise | Portfolio | Business
Suburban Agilists – 27 October 2020 6
Satisfy the Customer
Valuable Software
Early & Continuous
Welcome Changing Requirements
Frequently (Sooner)
Sustainable Pace
Servant-Leadership
Self-Organization
Face-to-Face
Motivated
Work Together Daily
Working
Software
Simplicity
Technical Excellence
Continuous
Improvement
(Inspect & Adapt)
Should They Align with Agile Values+Principles? Outcomes?
Better
Safer/Happier
Sooner
7. What are the Metrics that Matter?
Measure/Improve …
● Product? | Project?
● Process? | People?
● Environment? | Evolution?
Scope/Scale …
● Unitary | Individual | Personal
● Team | Application | Service
● Organization | Product | Stream
● Program | Market | System
● Enterprise | Portfolio | Business
Suburban Agilists – 27 October 2020 7
Culture (Social)
Value
Flow (Delivery)
Quality
Continuous
Improvement
(Inspect & Adapt)
Are we realizing
anticipated value?
(benefits, impact, revenue)
Are we building passionate,
engaged teams & learning
organizations with happy
stakeholders?
How are we improving our
capability to sense, respond
to, and deliver (valued)
changes to production?
Are we building quality in
(and “shifting left”) with
minimal waste/rework?
Should They Align with Agile Values+Principles? Outcomes?
8. Suburban Agilists – 27 October 2020 8
Interactive Poll:
What Metrics Have You Seen?
Value
(Customer) Valuable
Quality
Working Software
Simplicity
Technical Excellence
Culture (Social)
Sustainable Pace
Servant-Leadership
Self-Organization
Face-to-Face
Motivated
Work Together Daily
Safer/Happier
Flow (Delivery)
Early & Continuous
Welcome Changing Requirements
Frequently Sooner
Continuous
Improvement
Better
Delivery Frequency
9. What are the Metrics that Matter?
Suburban Agilists – 27 October 2020 9
Culture (Social)
Value
Flow (Delivery)
Quality
Defects (by Severity)
Defect Arrival/Closure/Repair Rate
DefectVolume/Density
Test Coverage / %Automation
Passed/Failed/Blocked/Waived
Technical Debt (SQALE)
Change Failure Rate/Percentage
Uptime/Down-time
Collaboration (Cross Functional)
Team Mood/Morale/Coherence
Happiness / Pain
Experimentation (Learning / Innovation)
Psychological Safety
Employee Engagement/eNPS
Culture (Westrum | LaLoux)
Lead-Time/Cycle-Time
Burnup/Burndown
Work-in-Process (WIP)
Throughput/
Commit/Build/Int/Deploy Frequency
Mean-Time To Repair/Recover/Remediate
Flow Efficiency
Wait/Delay (w/Value-Stream Mapping)
Cost (e.g., per service/unit/release/transaction)
Cost of Delay, Downtime
Customer Value
Customer Satisfaction
Net Promoter Score (NPS)
ROI | NPV | CapEx | OpEx
AARRR (Pirate Metrics)
– Acquisition, Activation, Revenue, Retention, Referral Transformation
Mastery/Maturity
To Scale/Scope
10. Most Common Agile & DevOps Metrics Used
Common Scrum Team Metrics:
● Velocity / Capacity
● Burnup / Burndown
● Cycle-Time / WIP
● Open Defects / Arrival-vs-Closure
● Test Coverage, %Passed/Failed/Blocked/Waived
Common DevOps Metrics:
● Deployment Frequency
● Lead-time for Change
● Change Failure Rate
● MTTR (Mean-Time To Restore/Recover/Repair)
Suburban Agilists – 27 October 2020 10
“Baker’s Dozen” Top Agile/DevOps Metrics
1. Velocity/Capacity
2. Burnup/Burndown
3. WIP | Cumulative Flow
4. Change Lead-Time
5. Delivery Frequency
6. Change Volume/Throughput
7. Delivery Success/Failure %
8. Mean-Time to Repair/Resolve/Recover/Restore
9. Availability/Uptime
10. Defect Density/Volume/Leakage
11. Downtime/Outages/MTBF
12. Culture/Collaboration/Experimentation
13. Customer/Employee Satisfaction
11. Flow & Quality: What Behaviors are we trying to Drive?
Suburban Agilists – 27 October 2020 11
Focus on regular flow of features/changes through the delivery pipeline
Shorten cycle-times & feedback-loops
Reduce size of features/work-packages and the number in-progress
Increase frequency of feedback on quality (and from stakeholders)
Increase cross-lifecycle collaboration & breakdown silos
Identify and remove dependencies, inconsistencies & delays
Reduce likelihood of quality problems and failed deliveries/builds
Improve resilience to change, and time to respond/repair/resolve
12. Flow-related Metrics across Development Lifecycle
Suburban Agilists – 27 October 2020 12
Application/Service Delivery Pipeline
Defects/FixesUser Stories Enhancements/
Change-RequestsFeatures
Test Stage ProdDeliverReady SCM
</>
Development
</>
Commit
Build
Demand
Package
. . .
Continuous
Deployment
Continuous
Integration
Agile/
Iterative
Continuous
Delivery
Feedback
Program/
Initiative
Response-Time
Development Cycle-Time (for an enhancement/story/change)
Wait-Time
Deployment
Time
Deployment Latency
Open Analysis Code &
Unit-Test
Integration
Build+Test Test Accept DeployReady
for Dev
. . .
Closed
Lead-time for Change (from code-commit to production-deployment)
(Feature/Story) Lead-time to Market/Value
Defect Resolution-Time
13. Lead-Time vs Cycle-Time (What’s the Difference?)
Suburban Agilists – 27 October 2020 13
http://www.full-stackagile.com/2016/04/03/improve-work-process-whats-cycle-time/
https://stefanroock.wordpress.com/2010/03/02/kanban-definition-of-lead-time-and-cycle-time/
Cycle Time
Order
Requested
Work
Started
Work
Completed End-Result Received
(in Production)
Prioritized
& Ready
Response Time
Wait Time
Lead Time
[a.k.a. Resolution Time]
16. Value Metrics
Suburban Agilists – 27 October 2020 16
www.scrum.org/resources/evidence-based-management
www.slideshare.net/rsrivastava91/agile-metrics-v6
NPS
17. Happiness / Team Morale / Nico Nico
Suburban Agilists – 27 October 2020 17
Niki Niko Chart
Source: https://www.plays-in-business.com/happiness-index-how-to-measure-something-so-difficult-to-catch/
18. Culture, Psychological Safety
Suburban Agilists – 27 October 2020 18
Source: https://risk-engineering.org/concept/safety-culture
Schein’s “onion layer” model of organizational culture
Westrum Culture Survey
Respect
19. The Dangers of Velocity
DO NOT Equate Velocity with Productivity or Performance!
And DO NOT compare velocity across teams or organizations
Suburban Agilists – 27 October 2020 19
Why Agile Velocity is the Most Dangerous Metric for Software Dev Teams: linearb.io/blog/why-agile-velocity-is-the-most-dangerous-metric-for-software-development-teams
20. Observations from Prior Metrics Collection Efforts
Suburban Agilists – 27 October 2020 20
• Shared responsibility in reporting (across development, release-management,
QA, and operations) vs. a single point-person had the most success quickly
determining how best to collect & report the right data
Collective
Ownership
• Siloed data across multiple tools/repositories (often from working in silos)
• Inconsistent naming & usage of workflow states and data across organizations
• Incorrect execution of transitions (skipped and/or late) create inaccurate data
Inconsistent
Usage
• Using a tool to track all work-items was more efficient & effective for reporting
• Using the tool to track backlog-items + defects + incidents made it easier to
report quality & flow than those using no/separate/loosely-integrated tools
• Teams that manage and perform their work as individual changes across the
entire AppDev Delivery pipeline, tend to report better cycle-times
• They are also more able to easily capture and report lead-time to production
Workflow
across the
Pipeline
Work-item
tracking
23. EXAMPLE: Agility Health Radars (agilityhealthradar.com/radars/ )
Suburban Agilists – 27 October 2020 23
24. Suburban Agilists – 27 October 2020 24
Interactive Quiz:
What Did We Learn?
Delivery Frequency
Value Quality
Working Software
Simplicity
Technical Excellence
Culture (Social)
Sustainable Pace
Servant-Leadership
Self-Organization
Face-to-Face
Motivated
Work Together Daily
Safer/Happier
Flow (Delivery)
Early & Continuous
Welcome Changing Requirements
Frequently Sooner
Continuous
Improvement
Better
Satisfy the Customer
Valuable Software
25. Enquiry: Is it ALL/EVERYTHING about Flow?
Suburban Agilists – 27 October 2020 25
Feelings?
Value
Form/Function?
Failure?
Flow of
Improvement
& Learning?
Flow of ???
Social/Emotional
Flow?
Flow of
Features/Changes?
Flow of “waste” &
waste removal?
References: Thermodynamics of Emotion [1], [2], [3], [4]
27. Cautions, Caveats & Pitfalls
Comparing metrics across teams: Cross team comparisons inhibit safety & learning. (“Fear is
the mindkiller!”)
Focusing on lagging over leading Indicators: Too late for meaningful, impactful action!
Vanity Metrics: Good for feeling awesome, but bad for taking action.
Ignoring companion measures: Measure holistically, so you see the tradeoffs.
Hawthorne Effect: Individuals modify their behavior in response to their awareness of being
observed.
Friedman’s Thermostat: Correlation does not mean causation, but it sure can be a clue.
Campbell’s Law: The more any quantitative social indicator is used for social decision-making,
the more subject it will be to corruption pressures and the more apt it will be to distort and
corrupt the social processes it is intended to monitor.
Goodhart’s Law: Once a measure becomes a target, it ceases to be a good measure.
Suburban Agilists – 27 October 2020 27
Source: https://agilevelocity.com/article-metrics-in-agile-how-to-measure-transformation/
28. Summary / Conclusions / Key Take-aways
Measure Outcomes / Systems (not activity/busy-ness of people)
Steer Clear of Velocity / Productivity (prefer Flow instead)
Culture, Collaboration & Safety are Important (and also harder to measure)
Watch out for Survey Fatigue for soft/manual Metrics collection
Tools/Dashboards/Automation are helpful (IF measure the right things / right way / Right Time)
Measuring People / Teams can be very tricky (Easily Gamed, Campbell+Goodhart, Hawthorne)
“People with targets and jobs dependent upon meeting them will probably meet the
targets – even if they have to destroy the enterprise to do it.” -- W. Edwards Deming
“Tell me how you measure me, and I will tell you how I will behave!” --E.M. Goldratt
Suburban Agilists – 27 October 2020 28
30. Some Recommended Books [Each image is a hyperlink]
Suburban Agilists – 27 October 2020 30
31. More Agile Metrics Resources
● InfoQ.com/Metrics | AgileAlliance.org/?s=Agile+Metrics (List of Metrics-related articles)
● Appropriate Use of Metrics for Agile (Martin Fowler)
● Measuring Agile: A Disciplined Approach to Metrics (Scott Ambler)
● Understanding Agile Team Metrics and 30+ Metrics for Agile Teams (Andy Clef)
● Agile Metrics: The Ultimate Guide (Extreme Uncertainty) | Definitive List of Agile Metrics (HotPMO.com)
● Agile Metrics: The 15 That Actually Matter for Success (Plutora.com)
● 10 Powerful Agile Metrics – and 1 Missing Metric (Sealights.io)
● 17 Agile Metrics Your Team Should Care About, including “Vorticity” (LearningHub)
● Agile Metrics: The Good, The Bad, and the Ugly (Stefan Wolpers)
● Determining Agile Metrics (Globant) | Understanding Agile Metrics (Eliassen)
● Definitive Software Quality Metrics for Agile+DevOps (Forrester-Tricentis)
● Agile Measurement & Metrics for Accountability (ValTech)
● Aligning Agile Metrics to your Vision [PDF: How Good? How Much? How Fast? How Happy?]
Suburban Agilists – 27 October 2020 31
32. The Dangers of Velocity
References:
● Why Agile Velocity is the Most Dangerous Metric for Software Dev Teams
● Velocity: the Killer of Agile Teams, by Tomas Kejzlar (Skeptical Agile)
● Agile Metrics: Velocity is NOT the Goal (AgileAlliance)
● Why Not Use Velocity as a Metric? (Esther Derby) | Moving Beyond Velocity (DZone.com)
● Velocity is a rubbish metric. (Fight me.) (DevBridge) | The Problem with Velocity (SolutionsIQ)
● Scrum Velocity: 5 Things that can Go Wrong (SeaLights)
Suburban Agilists – 27 October 2020 32
blog.axosoft.com/measure-agile-metrics-that-work
33. Resources: Flow Metrics & Framework
FlowFramework.org | ProjectToProduct.org
● willys-cave.ghost.io/project-to-product-value-stream-metrics/
● uxdesign.cc/flow-framework-a-fad-or-here-to-stay-3a26ce99d48d
● medium.com/@Tasktop/moving-from-project-to-product-with-flow-metrics-what-are-they-and-why-should-you-care-
24346a9c1403
● www.tasktop.com/blog/how-the-flow-framework-maximizes-your-wins-from-safe/
● projecttoproduct.org/wp-content/uploads/2020/10/Getting-Insight-into-Flow-with-Tasktop-Flow-Metrics-1.pdf
Flow Thinking / Flow System
● https://www.infoq.com/articles/the-flow-system/
● The Flow System: The Evolution of Agile and Lean Thinking in an Age of Complexity
● https://flowguides.org/guide.php
Suburban Agilists – 27 October 2020 33
35. Resources: Culture & Transformation
● Measuring Culture In Leading Companies (MIT Sloan Review) | The New Analytics of Culture (HBR)
● How To Measure Organizational Culture & Values (SurveyAnyPlace)
● 8 Ways to Measure Company Culture (Interact/Medium)
● How the Best Organizations Measure Culture (CultureAmp)
● How to Measure Organizational Culture Change? (MyHRFuture)
● The 10 Company Culture Metrics You Should Be Tracking Right Now (Entreprenuer.com)
● Measuring Agile Culture with Agile IQ (ZenExMachina)
● Westrum Typeology for Agile/DevOps Organizational Culture (Google, also Andy Kelk)
● LaLoux Culture Model (slides): BeyondTeal Readiness Assessment | Reinventing Organizations Map
Transformation
● How to Effectively Measure Your Agile Transformation Journey (AgileVelocity)
● 5 Agile KPIs for Measuring Success (NetMind)
● Agile Transformation Metrics (Dan Fuller & Chris Waggoner)
Suburban Agilists – 27 October 2020 35
36. Resources: Collaboration & Safety
Measuring Collaboration
● Guide to Measuring Impact with Agile Metrics (Excella)
● Review & Collaboration Metrics Overview (PluralSight)
● 16 metrics for tracking Collaborative Innovation performance (CustomerThink)
● Social-Coding Collaboration Strength Metrics & Analyses on GitHub (Batista & Brandão et.al.)
● Measuring Collaboration in Modern Organizations (Harvard Business School)
● Developing a Framework of Metrics to Assess Collaboration in Integrated Project Delivery (ASCIC2014)
Measuring Psychological Safety
● Measuring Psychological Safety (Richard McLean)
● The 4 Stages of Psychological Safety Behavioral Guide (LeaderFactor)
● How to Measure Psychological Safety at Your Company (PredictiveIndex)
● Understanding Team Effectiveness: Foster Psychological Safety (re:Work Guide)
● Chasing Psychological Safety (Duena Blomstrom)
Suburban Agilists – 27 October 2020 36
37. Other Resources
● Agile Performance Chains, Metrics, & Continuous Improvement (SolutionsIQ)
● Measuring Social Value and Measuring Social ROI [PDFs]
● Evidence Based Management (EBM) - Measuring value to enable improvement and agility | cebma.org
● AARRR Framework- Metrics That Let Your StartUp Sound Like A Pirate Ship | piratemetrics.com
● Innovation Measures : Pipeline ECV | Dev Cycle Time | R&D Growth Effectiveness | R&D Effectiveness Index
▪ Forecast Degradation | Resource Productivity | Innovation Vitality Index | Incremental Sales
SAFe Metrics:
● www.scaledagileframework.com/metrics/
● www.scaledagileframework.com/measure-and-grow/
● v46.scaledagileframework.com/metrics/
Suburban Agilists – 27 October 2020 37
38. 12 Rules for Metrics
Suburban Agilists – 27 October 2020 38
Source: https://stayrelevant.globant.com/en/determining-agile-metrics/
39. DevOps Metrics across Industry (2016-2018)
Suburban Agilists – 27 October 2020 39
Companies at all levels of mastery/maturity are working to advance
their capability to deliver products and services to market faster
Deployment Frequency
Lead time for changes
Mean time to recover (MTTR)
Change failure rate
Configuration
Management
28% 46%
Testing 35% 49%
Deployments 26% 43%
Change Approval
Process
48% 59%
200x more frequent
2,555x faster
46x more frequent
440x faster
96x faster
5x lower (1/5 as likely)3x lower (1/3 as likely)
24x faster
IT Metrics - Comparing High vs. Low Performers 2016 2017
% of Manual Work High Performers Low Performers
Source: 2017 State of DevOps Report | by Puppet +DORA
40. DevOps Usage Metrics across Industry (2016-2018)
Suburban Agilists – 27 October 2020 40
DevOps Metrics Sources
State of DevOps 2016 - Puppet Labs
DevOps Guys - May 2016
IBM Interconnect - Feb 2016
Datamation - Oct 2016 (ROI)
IntelliTect - DevOps 2015
XebiaLabs - July 2016
Pager Duty - June 2015
HPE - Aug 2015
DevOps Scorecard - Nov 2014
Datical - 2016
Nonlinear Digital - March 2015
Lowe - Thoughtworks
DOES Metrics Forum - 2015
O’Reilly DevOps Playbook – Oct 2016
Forrester - Aug 2016
Gartner - Sept 2015
CollabNet - Jan 2015
Gruver & Humble - Nov 2016
DevOps for Digital Leaders - Nov 2016
Top 10 DevOps Metrics
1. Change Lead-Time/Cycle-Time
2. Delivery Frequency
3. Change Volume/Throughput
4. Delivery Success/Failure %
5. Mean-Time to Repair/Resolve/Recover/Restore
6. Availability/Uptime
7. Defect Volume/Leakage
8. Downtime/Outages/MTBF
9. Culture/Collaboration/Experimentation
10. Customer/Employee Satisfaction
[NOTE: Source-links are 3+ years old]
41. DevOps Flow Metrics
Suburban Agilists – 27 October 2020 41
Velocity KPIs Quality KPIs
MLT (Mean Lead Time)
how long does it take for a bit of code to get built, tested and
deployed.
BFR (Build Failure Rate)
% of failed builds
DCR (Daily Change Rate)
number of changes getting committed to mainline and tested
per day.
DFR (Deployment Failure Rate)
% of failed deployments
MTTE (Mean Time To Environment)
how much time it takes developers/testers to bring up a testing
environment for verifying each delivered change.
IRFR (Infrastructure-Related Failure Rate)
% of build/deployment failures related to
infrastructure issues
MTTD (Mean Time to Detect)
how much time passes since the original commit of code until
the bug it introduces gets detected.
RWR (Rework Rate)
% of tickets being reopened
MTTR (Mean Time To Resolve)
how much time it takes to resolve an issue after it’s detected
ADR (Automated Detection Rate)
% of defects being detected by automated testing
cycles
MTTA (MeanTime To Approve)
how much time it takes to approve and verify a release.
(Measured from the moment all release content has been
delivered and until the release has passed all the defined test
and verification cycles)
UWR (Unplanned Work Rate)
% of unplanned issues
Source: http://devopsflowmetrics.org/
42. Gartner’s DevOps Metrics that Matter (2015)
Suburban Agilists – 27 October 2020 42
Business
Performance
Organizational
Effectiveness
Customer
Value
Operational
Efficiency
Service
Quality
Service
Velocity
Earnings
Cash Flow
Market Share
New Business Service Enablement
User Satisfaction
Response Time
Net Promoter Score
Mentoring
Sharing
Collaboration
MTTRS
Cycle Time
Deployment Frequency
Users/FTE
Servers/FTE
Lead Time
Epics Delivered
Releases per Month
Retention
Motivation/Morale
Responsiveness to Change
Production Support
Deployment Success Rate
Cost per Transaction
Cost of Change/Release
Gartner Inc., Data-Driven DevOps: User Metrics to Help Guide Your Journey, 9 Sept 2015 G00264319, Analyst(s): Cameron Haight, Tapati Bandopadhay
43. Comparison of Lifecycle-Models with Change-Workflows
Suburban Agilists – 27 October 2020 43
43
Waterfall
(phases)
DeployDefinition Analysis
Design,
Code &
Unit-Test
Integration
Build+Test
Test Accept
Iterative
(iterations)
Continuous
Delivery
Incremental
(integrations)
Agile
(sprints)
Continuous
Deployment
Hybrid
(Water-
Scrum-
Fall)