The document outlines key strategies for successful test automation, emphasizing the importance of measuring progress, effective resource utilization, and team performance monitoring. It presents insights from QASource, which boasts extensive experience and capabilities in automation, including over 100,000 automated test cases and 500 engineers. The content also highlights budgeting for automation and delivering measurable value to optimize efforts and support management decisions.

1. Measuring Your Way to
Successful Automation
Brought To You By:

2. QASource Confidential
§ Over 500 engineers
§ 500+ years collective automation experience
§ 100,000+ automated test cases
§ 100+ automation frameworks
§ 100s of successful engagements
QASource: Automation Experts
Over 500 engineers
100+ automation frameworks
500+ years collective automation experience
100,000+ automated test cases
100s of successful engagements

3. QASource Confidential
Q1. How large is your QA team?
<5 Engineers
Attendee’s Poll
5-10 Engineers 11-25 Engineers >25 Engineers
Q2. What is the main reason you want to measure your test automation?
Track Progress Utilize Resources
Effectively
Plan & Budget for
Future
Detect Performers
vs Non-performers
Q3. How would you rate your current automation metrics?
Top Notch:
Many metrics that
measure resource
utilization, track
progress and show
value
Pretty Good:
Basic & consistent
metrics
Needs
Improvement:
Some metrics, but
they keep changing
No Metrics
at All

4. QASource Confidential
Co-Founder of QASource
20+ Years Experience in QARajeev Rai,
CEO, QASource
QASource Confidential

5. QASource ConfidentialQASource Confidential
Your challenges, if you
let them, become your
greatest allies.
– Richard Paul Evans
““

6. QASource ConfidentialQASource Confidential
Measuring Your Way To
Successful Automation

7. QASource ConfidentialQASource Confidential
What You Will Learn
How to get a
BUDGET for automation
How to demonstrate
VALUE of automation
How to monitor team performance to
OPTIMIZE your automation efforts

8. QASource ConfidentialQASource Confidential
Budget
Automation
For
QASource Confidential

9. QASource Confidential
Breakeven in Automation
300
Hours of
Manual Effort
Saved

10. QASource ConfidentialQASource Confidential
Effort
Optimization

11. QASource Confidential
Effort Optimization
1000
1050
1150
1300
150
350
47014%
30%
36%
0%
5%
10%
15%
20%
25%
30%
35%
40%
0
200
400
600
800
1000
1200
1400
1600
Sprint 1 Sprint 2 Sprint 3 Sprint 4
PercentageofManualEffortsSaved
TestCases
Sprint Cycles
Test Cases Automated Manual Effort SavedTotal Test Cases Test Cases Automated Manual Effort Saved

12. QASource ConfidentialQASource Confidential
Task
Distribution

13. QASource Confidential
Task Distribution: Sprint 4

14. QASource Confidential
Task Distribution: Sprint 4 (Drilldown)

15. QASource ConfidentialQASource Confidential
Team
Velocity
Test Case Automation

16. QASource Confidential
Team Test Case Automation Velocity
30
32
34
36
38
40
42
44
46
48
50
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
TestCases
Week
Expected maximum Expected minimum
36
45
49
Expected Maximum Expected Minimum Test Cases Automated

17. QASource ConfidentialQASource Confidential
Team Effort
Distribution

18. QASource Confidential
Team Effort Distribution
Execution Analysis
Review & Fixing
Test Case
Automation
Framework
Development
Test Suite
Maintenance
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
PercentageEffort
Week

19. QASource ConfidentialQASource Confidential
Engineer
Velocity
Test Case Automation

20. QASource Confidential
Engineer Test Case Automation Velocity
8
9
10
11
12
13
14
15
16
17
18
19
20
Week 1 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8
TestCases
Week
Kevin Kamet John Expected Maximum Expected Minimum
11
18
19

21. QASource ConfidentialQASource Confidential
Engineer Effort
Distribution

22. QASource Confidential
Engineer Effort Distribution
0% 5% 10% 15% 20% 25% 30% 35% 40% 45% 50% 55% 60%
Execution
Analysis
Review &
Fixing
Test Case
Automation
Framework
Development
Test Suite
Maintenance
Percentage Effort
Tasks
Kevin Kamet John

23. QASource ConfidentialQASource Confidential
Recap
Breakeven in
Automation
Effort Optimization Task Distribution:
Sprint 4
Task Distribution:
Sprint 4 (Drilldown)
Team Test Case
Automation Velocity
Team Effort
Distribution
Engineer Test Case
Automation Velocity
Engineer Effort
Distribution

24. QASource ConfidentialQASource Confidential
Key Learnings
How to get a
BUDGET for automation
How to demonstrate
VALUE of automation
How to monitor team performance to
OPTIMIZE your automation efforts

25. QASource Confidential
Q & A

26. QASource Confidential
FREE Whitepaper
Want To Learn More About QA Automation?
Visit us at QASOURCE.COM
qasource.com/20-metrics

27. QASource Confidential