0
Tester, get out of your cave!Jan Jaap CannegieterVice President SYSQA B.V.
©SYSQAAlmere2
©SYSQAAlmere3Why are we here?
©SYSQAAlmere4Agenda• TMMi in under 10 minutes• Data from 20 TMMi workshops• Conclusions• How to get out of your cave
©SYSQAAlmere6TMMi – essentials• Test maturity framework• Benchmark model for assessments• 5 levels• Based on:• TMM• Evolut...
©SYSQAAlmere7TMMi levels1. Initial2. ManagedTest Policy and StrategyTest PlanningTest Monitoring and ControlTest Design an...
©SYSQAAlmere8How I got my data• Goals• Learn• Presales• Assignments• 20 organizations• Telecommunication: 2• Government: 7...
©SYSQAAlmere9Quick scans – a demo
ResultsFasten your seatbelts
©SYSQAAlmere11Test policy and strategy - goals• Establish a test policy• Establish a test strategy• Establish test perform...
©SYSQAAlmere12Test policy and strategy: A: 30% V: 14%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19...
©SYSQAAlmere13Test planning - goals• Perform a product risk assessment• Establish a test approach• Establish test estimate...
©SYSQAAlmere14Test planning: A: 41%, V: 13%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20Test pl...
©SYSQAAlmere15Test monitoring and control - goals• Monitor test progress against plan• Monitor product quality against pla...
©SYSQAAlmere16Test monitoring and control: A: 47%, V: 15%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 1...
©SYSQAAlmere17Test design and execution - goals• Perform test analysis and design using test designtechniques• Perform tes...
©SYSQAAlmere18Test design and execution: A: 60%, V: 8%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 1...
©SYSQAAlmere19Test environment - goals• Develop test environment requirements• Perform test environment implementation• Ma...
©SYSQAAlmere20Test environment: A: 59%, V: 9%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19Test env...
©SYSQAAlmere21Overview0102030405060708090100Per process area
©SYSQAAlmere22My conclusion60%: Test design and execution30%: Test policy and strategy41%: Test planning47%: Test monitori...
©SYSQAAlmere23We are in a cave!
©SYSQAAlmere24
©SYSQAAlmere25In case you disagree…
©SYSQAAlmere26Best practices ‘outside of your cave’• Perform a product risk assessment and establish a testapproach with r...
Stakeholder management27The basics
©SYSQAAlmere28StakeholderA person or group of persons who will be involved in oreffected by your test project or improveme...
©SYSQAAlmere29Stakeholder management• Stakeholder identification• Stakeholder analysis• Stakeholder involvement
©SYSQAAlmere30Stakeholder aspects• Organizational level• Power• Business interest• Mindset• Ambition• Behavioral style• St...
©SYSQAAlmere31Type of stakeholdersDemanding DiscretionarySleepingDependentDangerous DominantDefinitiveUrgency LegitimacyPo...
©SYSQAAlmere32Stakeholdercard – an example
Please think this overI’ll turn on some inspiring music
©SYSQAAlmere34
©SYSQAAlmere35
©SYSQAAlmere36Stuart Reid’s test competence model fortestersTest skillsIT skillsDomainknowledgeSoft skills
©SYSQAAlmere37My test competence model for testconsultantsTest skillsIT skillsDomainknowledgeSoft skillsPoliticalskills
©SYSQAAlmere38
©SYSQAAlmere40Email for the stakeholder card:jcannegieter@sysqa.nl
©SYSQAAlmere41
'Tester: Get Out Of Your Cave!' by Jan Jaap Cannegieter
Upcoming SlideShare
Loading in...5
×

'Tester: Get Out Of Your Cave!' by Jan Jaap Cannegieter

318

Published on

The levels 2 and 3 of TMMi, the successor of TMM, are launched in 2008. By now, the company of the presenter performed almost 20 assessments, most informal assessments. Assessments where performed in telecom, utilities, financial services and (semi) government. The first conclusions about the maturity of testing (in the Netherlands) can be drawn.



In the presentation the structure of TMMi will be introduced briefly, as well as the way the assessments where done. Then the results will be presented, as well as the conclusion. The overall picture is that test process improvement is something testers do in there cave. To improve testing rigorous we have to get out of our cave. At the end of the presentation instructions are given how to do this.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
318
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "'Tester: Get Out Of Your Cave!' by Jan Jaap Cannegieter"

  1. 1. Tester, get out of your cave!Jan Jaap CannegieterVice President SYSQA B.V.
  2. 2. ©SYSQAAlmere2
  3. 3. ©SYSQAAlmere3Why are we here?
  4. 4. ©SYSQAAlmere4Agenda• TMMi in under 10 minutes• Data from 20 TMMi workshops• Conclusions• How to get out of your cave
  5. 5. ©SYSQAAlmere6TMMi – essentials• Test maturity framework• Benchmark model for assessments• 5 levels• Based on:• TMM• Evolutionary Testmodel (Gelperin / Hetzel)• CMMI for Development• In line with ISTQB terminology• Developed by the TMMi-foundation• Public domain• www.tmmifoundation.org
  6. 6. ©SYSQAAlmere7TMMi levels1. Initial2. ManagedTest Policy and StrategyTest PlanningTest Monitoring and ControlTest Design and ExecutionTest Environment3. DefinedTest OrganizationTest Training ProgramTest Life Cycle and IntegrationNon-Functional TestingPeer Reviews4. Managementand MeasurementTest MeasurementSoftware Quality EvaluationAdvanced Peer Reviews5. OptimizationDefect PreventionTest Process OptimizationQuality Control
  7. 7. ©SYSQAAlmere8How I got my data• Goals• Learn• Presales• Assignments• 20 organizations• Telecommunication: 2• Government: 7• Financial services: 9• Industry: 2• Analysis
  8. 8. ©SYSQAAlmere9Quick scans – a demo
  9. 9. ResultsFasten your seatbelts
  10. 10. ©SYSQAAlmere11Test policy and strategy - goals• Establish a test policy• Establish a test strategy• Establish test performance indicators
  11. 11. ©SYSQAAlmere12Test policy and strategy: A: 30% V: 14%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20Test policy and strategyOrganizationsPercentageofspecificgoalsmet
  12. 12. ©SYSQAAlmere13Test planning - goals• Perform a product risk assessment• Establish a test approach• Establish test estimates• Develop a test plan• Obtain commitment to the test plan
  13. 13. ©SYSQAAlmere14Test planning: A: 41%, V: 13%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20Test planningOrganizationsPercentageofspecificgoalsmet
  14. 14. ©SYSQAAlmere15Test monitoring and control - goals• Monitor test progress against plan• Monitor product quality against plan andexpectations• Manage corrective action to closure
  15. 15. ©SYSQAAlmere16Test monitoring and control: A: 47%, V: 15%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20Test monitoring and controlOrganizationsPercentageofspecificgoalsmet
  16. 16. ©SYSQAAlmere17Test design and execution - goals• Perform test analysis and design using test designtechniques• Perform test implementation• Perform test execution• Manage test incidents to closure
  17. 17. ©SYSQAAlmere18Test design and execution: A: 60%, V: 8%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20Test design and executionOrganizationsPercentageofspecificgoalsmet
  18. 18. ©SYSQAAlmere19Test environment - goals• Develop test environment requirements• Perform test environment implementation• Manage and control test environments
  19. 19. ©SYSQAAlmere20Test environment: A: 59%, V: 9%01020304050607080901001 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19Test environmentOrganizationsPercentageofspecificgoalsmet
  20. 20. ©SYSQAAlmere21Overview0102030405060708090100Per process area
  21. 21. ©SYSQAAlmere22My conclusion60%: Test design and execution30%: Test policy and strategy41%: Test planning47%: Test monitoring and control59%: Test environmentInsideOutside
  22. 22. ©SYSQAAlmere23We are in a cave!
  23. 23. ©SYSQAAlmere24
  24. 24. ©SYSQAAlmere25In case you disagree…
  25. 25. ©SYSQAAlmere26Best practices ‘outside of your cave’• Perform a product risk assessment and establish a testapproach with relevant stakeholders• Obtain commitment for your plan from relevant stakeholders• Plan stakeholder involvement in your project• Monitor stakeholder involvement in your project• Make release advice with people outside of testing• Establish and maintain a test strategy with relevantmanagement• Define, measure and report test performance indicators torelevant stakeholders• Establish and maintain a test policy with higher management(business and IT)
  26. 26. Stakeholder management27The basics
  27. 27. ©SYSQAAlmere28StakeholderA person or group of persons who will be involved in oreffected by your test project or improvement project
  28. 28. ©SYSQAAlmere29Stakeholder management• Stakeholder identification• Stakeholder analysis• Stakeholder involvement
  29. 29. ©SYSQAAlmere30Stakeholder aspects• Organizational level• Power• Business interest• Mindset• Ambition• Behavioral style• Stakeholder type
  30. 30. ©SYSQAAlmere31Type of stakeholdersDemanding DiscretionarySleepingDependentDangerous DominantDefinitiveUrgency LegitimacyPowerMitchell, Agle, Wood, 1997
  31. 31. ©SYSQAAlmere32Stakeholdercard – an example
  32. 32. Please think this overI’ll turn on some inspiring music
  33. 33. ©SYSQAAlmere34
  34. 34. ©SYSQAAlmere35
  35. 35. ©SYSQAAlmere36Stuart Reid’s test competence model fortestersTest skillsIT skillsDomainknowledgeSoft skills
  36. 36. ©SYSQAAlmere37My test competence model for testconsultantsTest skillsIT skillsDomainknowledgeSoft skillsPoliticalskills
  37. 37. ©SYSQAAlmere38
  38. 38. ©SYSQAAlmere40Email for the stakeholder card:jcannegieter@sysqa.nl
  39. 39. ©SYSQAAlmere41
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×