Successfully reported this slideshow.
Your SlideShare is downloading. ×

Metrics that Matters in Software Engineering

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Upcoming SlideShare
Technical Debt.pptx
Technical Debt.pptx
Loading in …3
×

Check these out next

1 of 24 Ad
Advertisement

More Related Content

Advertisement
Advertisement

Metrics that Matters in Software Engineering

  1. 1. Metrics that Matters 📈🚀 6 September 2022 - Panji Gautama
  2. 2. Metrics that Matters 📈🚀 1. what are Engineering Metrics and why it Matters 1 1. Tracking & Managing Metrics 2 1. Instilling Metrics & Operational Discipline to your Team 3
  3. 3. How I honed my metrics tracking skills Panji Gautama github.com/rhapsodixx
  4. 4. One-Stop Platform for Content Creators Seluruh informasi yang tertulis di presentasi ini bersifat privat, konfidensial dan sepenuhnya adalah milik PT TipTip Network Indonesia.
  5. 5. Information on this deck based on bunch of articles, experience, and .. 📖 Books
  6. 6. what are Engineering Metrics and why it Matters What are engineering metrics? quantitative measurements for a software product, project and team as indicator for many uses
  7. 7. what are Engineering Metrics and why it Matters Why is it Important? ● Engineering is Black Box - Metrics as Alignment to Build & Maintain Trust ● Disciplined Approach to Understand Performance & Productivity ● Efficiently Improve at Scale ● Tangible Achievement to the Engineering Team ● Helps to Predict on Effort & Budget of the Project to the Desired Outcome
  8. 8. what are Engineering Metrics and why it Matters What are engineering metrics are NOT? ● Don’t guarantee Product Business Success ● Not a Silver Bullet of Engineering Excellence
  9. 9. Tracking & Managing Metrics Categories of Engineering Metrics 🚀 Performance Availability Throughput Latency DORA Metrics Sprint Velocity Open Bug & Vulnerabilities 󰞦 Team Engagement Attrition Code Quality Documentation Quality 🥇 Business Product Metrics Failure & Success Rate Customer Satisfaction Bug & Vulnerabilities SLA
  10. 10. Tracking & Managing Metrics DevOps Research and Assessment (DORA) Metrics google cloud dora 2021 report
  11. 11. Tracking & Managing Metrics DevOps Research and Assessment (DORA) Metrics 🚨DORA metrics aren’t intended to measure the productivity of teams 🚨
  12. 12. Tracking & Managing Metrics 4 SRE Golden Signals
  13. 13. Tracking & Managing Metrics 4 SRE Golden Signals 🚨Golden Signals are not enough to achieve optimal observability outcomes 🚨
  14. 14. Tracking & Managing Metrics Mobile Vitals ● Crash-Free Users and Sessions ● Cold and Warm App Start Times ● Slow and Frozen Frames
  15. 15. Tracking & Managing Metrics Mobile Vitals
  16. 16. Tracking & Managing Metrics Web Vitals
  17. 17. Tracking & Managing Metrics Web Vitals 🚨App Vitals also not enough to achieve optimal observability outcomes 🚨
  18. 18. Tracking & Managing Metrics User Satisfaction based on Threshold 🙁 User Misery User-weighted Performance metric to assess the relative magnitude of application performance typically based on transaction level ✅ Apdex Simplified Service Level Agreement (SLA) typically based on Latency Range 0.0 - 1.0
  19. 19. Instilling Metrics & Operational Discipline to your Team Engineering North Star Metrics Objective Key Results Tech & Infrastructure Improve and maintain System Availability and Reliability People & Organization Improve Employee Engagement & Reduce Attrition Observability & Security Increase observability on monitoring (Dashboard), alerting (Business and Engineering Metrics), and protect customers from security vulnerabilities (Security Tickets) Productivity Improve and maintain predictability on the sprint (Sprint Velocity) and product quality (number of Bugs)
  20. 20. Instilling Metrics & Operational Discipline to your Team What does good look like?
  21. 21. Instilling Metrics & Operational Discipline to your Team Key Points ● Minimize top level Engineering performance metrics that are viewed at the Stakeholder Level ● Many metrics regarding product quality, stability, reliability and performance may be owned by Engineering but they should be shared with Product Management ● Identify Leading & Lagging Indicator ● Metrics should always tie back strongly to an important Business outcome ● Stakeholder report is a small subset of what metrics engineering is measuring on a regular basis overall. Engineering teams should conduct regular operational reviews for the expanded list of metrics
  22. 22. Bonus Metrics SPACE Framework
  23. 23. thank you linkedin.com/in/panjigautama
  24. 24. ● https://panjigautama.com/engineering-north-star-metrics/ ● https://newsletter.pragmaticengineer.com/p/engineering-productivity ● https://newsletter.pragmaticengineer.com/p/community-thread-3 ● https://refactoring.fm/p/life-of-a-cto ● https://akfpartners.com/growth-blog/ceo-guide-to-measuring-engineering-team-performance ● https://fellow.app/blog/productivity/engineering-metrics-what-they-are-ways-to-measure-them/ ● https://venturebeat.com/enterprise/use-these-metrics-to-get-the-most-out-of-your-engineering-team/ ● https://www.sealights.io/software-development-metrics/top-5-software-metrics-to-manage-development-projects- effectively/ ● https://cloud.google.com/blog/products/devops-sre/announcing-dora-2021-accelerate-state-of-devops-report ● https://sre.google/sre-book/monitoring-distributed-systems/ ● https://web.dev/vitals/ ● https://akfpartners.com/growth-blog/ceo-guide-to-measuring-engineering-team-performance ● https://queue.acm.org/detail.cfm?id=3454124 References

×