Agile Gurugram 2023

1. Manoj Jain
Senior Director – Software Engineering
Dec 9, 2023
Engineering
Metrics
CORNERSTONE FOR BUILDING HIGH QUALITY
PRODUCTS

2. 2
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
About me
• Passionate about building high quality
products since 1999
• Part of Axtria’s global R&D Team
• Previously worked with Mezocliq, Oracle,
MakeMyTrip, CA Technologies, Nucleus
Software & Newgen Software
• Speaker & author
• Cyclist
• Philanthropist
Manoj.jain@axtria.com
manojjain99@yahoo.com
https://www.linkedin.com/in/manojjain/
https://twitter.com/manojjain99

3. 3
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Axtria – Driving Life Sciences Industry performance
Through unique LS-focused combination of decision Science, commercial excellence & data management
Employees
Worldwide
2,900+
Principals
with 20+ years of Life
Sciences experience
Locations
Global Delivery
and Data Centers
80+
19
• Enterprise Technology Platform
• Cloud-based Configurable IP
• Deep Pharma experience
• Strategic & Operational Expertise
• Cloud Data Management
• Cloud BI & Insights
• Cloud MDM
• Big Data
• Territory Alignment
• Call Planning
• Incentive Compensation
• Field Reporting
• Sales & Marketing Analytics
• OTC Analytics
• Patient Analytics
• Digital Analytics
• NBA
• Omnichannel
Orchestration
• Customer Journey
DECISION
SCIENCE
&
COMMERCIAL
EXCELLENCE
PHARMA DATA
MANAGEMENT
& TECHNOLOGY
Clients including
8 of Top 10 Pharma &
15 of Top 20 Pharma
Commercial Ops sales
reps on Axtria’s platform
100+ 100,000+
Driving PERFORMANCE for our Clients
Through Transformational DECISION SCIENCE & COMMERCIAL EXCELLENCE
Powered by Extensive Pharma DATA MANAGEMENT & TECHNOLOGY Expertise
Global Presence

4. 4
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Why do we aspire for building high quality products?

5. 5
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Common challenges across organizations…
Subtitle Goes Here
And many-more…

6. 6
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted

7. 7
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted

8. How did we go about it?

9. 9
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Metrics
Subtitle Goes Here

10. 10
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Who all should be covered while considering metrics?
Subtitle Goes Here
Engineering
Metrics
Dev
QE
Support
PO
Team

11. 11
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Engineering Metrics
Subtitle Goes Here
Function Metrics Target How to track?
Development Automated unit test coverage 80%+ Via CI/CD pipeline
Development Security Assessment No Open C+H Via CI/CD pipeline
Development Static Code Analysis No Open C+H Via CI/CD pipeline
Development Defects Density TBD Total defects /KLOC
Development Defects leaked by Dev (C+ H) <=10% Defects (C+H)/Total Defects * 100
QE Automated functional tests 80%+ Qmetry
QE Defect Escape Rate <=5% Prod. Defects /(Prod. defects + QE defects)*100
QE Performance Assessment (Key Scenarios) <3sec Performance test results
Support Average Ageing - Bugs (Critical) 15 days JIRA ServiceDesk
Support Average Ageing - Bugs (Overall) 120 days JIRA ServiceDesk
Product Mgmt. SLA for review for improvements 30 days JIRA ServiceDesk
Product Sprint Velocity (Throughput) 80%+ Product JIRA
Product Release Throughput 80%+ Product JIRA

12. 12
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Executive Summary View

13. 13
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Detailed View (Product Wise)

14. 14
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Online dashboard using ELK

15. 15
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Notifications using MS Teams

16. 16
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Outcome?
• Improvement in quality of stories
• Improvement in sprint throughputs
• Improved CSAT & NPS
• Any many more…
Teams are well aware about focus areas which help in achieving enterprise excellence!!!

17. Tips and Key Takeaways

18. 18
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted

19. 19
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
WHY MOST OF INITIATIVES STRUGGLE?

20. 20
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Communication

21. 21
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Top 3 key takeaways
1. Don’t look for a perfect start and
just start measuring
2. Don’t look at snapshots but have
trends to identify patterns &
outliers
3. While you may start with manual
measurements, get to automation
at the earliest

22. 22
Copyright © 2023 Axtria and/or its affiliates. All rights reserved. | Axtria Confidential – Internal/Restricted/Highly Restricted
Questions
Manoj.jain@axtria.com
manojjain99@yahoo.com
https://www.linkedin.com/in/manojjain/
https://twitter.com/manojjain99

23. Do you have a question for
us?