Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Experiences with TMMi:
facts and figures
Jan Jaap Cannegieter
Vice President SYSQA B.V.
©SYSQAAlmere
2
Agenda
0
10
20
30
40
50
60
70
80
90
100
What is
A maturity model
and
an assessment model
©SYSQAAlmere
4
Test Maturity Model integration
©SYSQAAlmere
5
TMMi levels
1. Initial
2. Managed
Test Policy and Strategy
Test Planning
Test Monitoring and Control
Test D...
©SYSQAAlmere
6
©SYSQAAlmere
9
Assessment type: Quick Scan
Test
manager 1
Tester 1
QA
manager
Test
environment
administrator
Test
manager ...
©SYSQAAlmere
10
The tool
©SYSQAAlmere
11
Time
Start
I I I
QS QS QS QS QS
F
QS
Assessments and TMMi implementations
Level 2
©SYSQAAlmere
12
Assessment types compared
0 100
Formal Informal Quick scan
Accuracy
Costs
100% Use at
SYSQA
©SYSQAAlmere
13
TMMi today
http://www.tmmi.org/
The maturity of testing in
The Netherlands
©SYSQAAlmere
15
TMMi levels
1. Initial
2. Managed
Test Policy and Strategy
Test Planning
Test Monitoring and Control
Test ...
©SYSQAAlmere
16
How I got my data
• Goals
• 20 organizations
• Telecommunication: 2
• Government: 7
• Financial services: ...
©SYSQAAlmere
17
Test policy and strategy - goals
• Establish a test policy
• Establish a test strategy
• Establish test pe...
©SYSQAAlmere
18
Test policy and strategy: A: 30% V: 14%
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13 14 ...
©SYSQAAlmere
19
Test planning - goals
• Perform a product risk assessment
• Establish a test approach
• Establish test est...
©SYSQAAlmere
20
Test planning: A: 41%, V: 13%
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 1...
©SYSQAAlmere
21
Test monitoring and control - goals
• Monitor test progress against plan
• Monitor product quality against...
©SYSQAAlmere
22
Test monitoring and control: A: 47%, V: 15%
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13...
©SYSQAAlmere
23
Test design and execution - goals
• Perform test analysis and design using test design
techniques
• Perfor...
©SYSQAAlmere
24
Test design and execution: A: 60%, V: 8%
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13 14...
©SYSQAAlmere
25
Test environment - goals
• Develop test environment requirements
• Perform test environment implementation...
©SYSQAAlmere
26
Test environment: A: 59%, V: 9%
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17...
©SYSQAAlmere
27
Overview
0
10
20
30
40
50
60
70
80
90
100
Per process area
©SYSQAAlmere
28
My conclusion
60%: Test design and execution
30%: Test policy and strategy
41%: Test planning
47%: Test mo...
What about Romanian testers;
should they care about TMMi?
©SYSQAAlmere
30
Reasons to care about TMMi
©SYSQAAlmere
31
Outsourcing and the Allen curve
‘The distance between engineers’ offices affected the frequency of their c...
©SYSQAAlmere
32
8 meters
©SYSQAAlmere
33
16 meters
©SYSQAAlmere
34
80 kilometers
©SYSQAAlmere
35
1600 kilometers
©SYSQAAlmere
36
©SYSQAAlmere
37
Email for questions, the documents I
showed you or additional information:
jcannegieter@sysqa.nl
Upcoming SlideShare
Loading in …5
×

Experiences with TMMi facts and figures - Romanian Testing Conference 2014

554 views

Published on

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

Experiences with TMMi facts and figures - Romanian Testing Conference 2014

  1. 1. Experiences with TMMi: facts and figures Jan Jaap Cannegieter Vice President SYSQA B.V.
  2. 2. ©SYSQAAlmere 2 Agenda 0 10 20 30 40 50 60 70 80 90 100
  3. 3. What is A maturity model and an assessment model
  4. 4. ©SYSQAAlmere 4 Test Maturity Model integration
  5. 5. ©SYSQAAlmere 5 TMMi levels 1. Initial 2. Managed Test Policy and Strategy Test Planning Test Monitoring and Control Test Design and Execution Test Environment 3. Defined Test Organization Test Training Program Test Life Cycle and Integration Non-Functional Testing Peer Reviews 4. Management and Measurement Test Measurement Software Quality Evaluation Advanced Peer Reviews 5. Optimization Defect Prevention Test Process Optimization Quality Control
  6. 6. ©SYSQAAlmere 6
  7. 7. ©SYSQAAlmere 9 Assessment type: Quick Scan Test manager 1 Tester 1 QA manager Test environment administrator Test manager 2 Tester 2 Project manager You 8.30 Opening & TMMi 9.00 Rating PA’s level 2 12.00 Lunch 13.00 Rating PA’s 14.00 Conclusions 14.30 Determine improvement actions 16.00 Making action plan 16.30 Evaluation (20.30 On the couch watching TV)
  8. 8. ©SYSQAAlmere 10 The tool
  9. 9. ©SYSQAAlmere 11 Time Start I I I QS QS QS QS QS F QS Assessments and TMMi implementations Level 2
  10. 10. ©SYSQAAlmere 12 Assessment types compared 0 100 Formal Informal Quick scan Accuracy Costs 100% Use at SYSQA
  11. 11. ©SYSQAAlmere 13 TMMi today http://www.tmmi.org/
  12. 12. The maturity of testing in The Netherlands
  13. 13. ©SYSQAAlmere 15 TMMi levels 1. Initial 2. Managed Test Policy and Strategy Test Planning Test Monitoring and Control Test Design and Execution Test Environment 3. Defined Test Organization Test Training Program Test Life Cycle and Integration Non-Functional Testing Peer Reviews 4. Management and Measurement Test Measurement Software Quality Evaluation Advanced Peer Reviews 5. Optimization Defect Prevention Test Process Optimization Quality Control
  14. 14. ©SYSQAAlmere 16 How I got my data • Goals • 20 organizations • Telecommunication: 2 • Government: 7 • Financial services: 9 • Industry: 2 • Approach assessments: quick scans • Analysis
  15. 15. ©SYSQAAlmere 17 Test policy and strategy - goals • Establish a test policy • Establish a test strategy • Establish test performance indicators
  16. 16. ©SYSQAAlmere 18 Test policy and strategy: A: 30% V: 14% 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Test policy and strategy Organizations Percentageofspecificgoalsmet
  17. 17. ©SYSQAAlmere 19 Test planning - goals • Perform a product risk assessment • Establish a test approach • Establish test estimates • Develop a test plan • Obtain commitment to the test plan
  18. 18. ©SYSQAAlmere 20 Test planning: A: 41%, V: 13% 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Test planning Organizations Percentageofspecificgoalsmet
  19. 19. ©SYSQAAlmere 21 Test monitoring and control - goals • Monitor test progress against plan • Monitor product quality against plan and expectations • Manage corrective action to closure
  20. 20. ©SYSQAAlmere 22 Test monitoring and control: A: 47%, V: 15% 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Test monitoring and control Organizations Percentageofspecificgoalsmet
  21. 21. ©SYSQAAlmere 23 Test design and execution - goals • Perform test analysis and design using test design techniques • Perform test implementation • Perform test execution • Manage test incidents to closure
  22. 22. ©SYSQAAlmere 24 Test design and execution: A: 60%, V: 8% 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Test design and execution Organizations Percentageofspecificgoalsmet
  23. 23. ©SYSQAAlmere 25 Test environment - goals • Develop test environment requirements • Perform test environment implementation • Manage and control test environments
  24. 24. ©SYSQAAlmere 26 Test environment: A: 59%, V: 9% 0 10 20 30 40 50 60 70 80 90 100 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Test environment Organizations Percentageofspecificgoalsmet
  25. 25. ©SYSQAAlmere 27 Overview 0 10 20 30 40 50 60 70 80 90 100 Per process area
  26. 26. ©SYSQAAlmere 28 My conclusion 60%: Test design and execution 30%: Test policy and strategy 41%: Test planning 47%: Test monitoring and control 59%: Test environment Inside Outside
  27. 27. What about Romanian testers; should they care about TMMi?
  28. 28. ©SYSQAAlmere 30 Reasons to care about TMMi
  29. 29. ©SYSQAAlmere 31 Outsourcing and the Allen curve ‘The distance between engineers’ offices affected the frequency of their communication’ – Prof. Thomas Allen MIT
  30. 30. ©SYSQAAlmere 32 8 meters
  31. 31. ©SYSQAAlmere 33 16 meters
  32. 32. ©SYSQAAlmere 34 80 kilometers
  33. 33. ©SYSQAAlmere 35 1600 kilometers
  34. 34. ©SYSQAAlmere 36
  35. 35. ©SYSQAAlmere 37 Email for questions, the documents I showed you or additional information: jcannegieter@sysqa.nl

×