The document provides guidance on completing an e-survey to assess an organization's test maturity based on the Test Maturity Model integration (TMMi) framework. The TMMi model defines 5 levels of test process maturity. The e-survey collects responses to statements about each TMMi process area and ratings of how well the organization has defined, deployed, and achieved results for each process. It also includes sections on testing trends and non-TMMi factors. The responses are confidential and intended to provide an individual perspective rather than a consensus view. Upon completion, the assessment team will analyze the results and provide a findings report to the sponsoring organization.

1. Test Maturity Model integration (TMMi) e-Survey
Listen | Challenge | Understand | Interpret | Create
Private & Confidential Experimentus Ltd 17a Dorset Square London NW1 6QB T: +44 (0)207 871 2300 www.experimentus.com v0.4

2. Content
 About TMMi
 TMMi Structure
 TMMi Levels
 e-Survey guidance
Copyright © 2012 Experimentus Ltd 2

3. Test Maturity Model Integration
 Developed by the TMMi Foundation (http://www.tmmifoundation.org/)
 Based on a wide variety of public domain industry sources
– including the TMM framework originally developed by Illinois Institute of
Technology
 5 levels of test maturity (staged model)
– Complements the existing CMMI framework
 Empirically validated
 The worlds only independent test process measurement method
 Describes the processes needed to ensure a well planned and
controlled test organisation
Copyright © 2012 Experimentus Ltd 3

4. TMMi Structure
Maturity
Level
indicates contains
Testing Process Process
capability Areas
achieves contains
Goals Specific &
Generic Practices
describes
Implementation
Copyright © 2012 Experimentus Ltd 4

5. TMMi Maturity Levels
5 - Optimizing
4–
Quantitatively
3 – Defined Managed
5 - Optimisation
• Defect Prevention
2 – Managed • Test Process
4 – Management Optimisation
and Measurement • Quality Control
1 – Initial • Test Measurement
3 – Defined • Product Quality
• Test Organisation Evaluation
• Test Training • Advanced Reviews
2 – Managed Programme
• Test Policy & Strategy • Test Life Cycle &
Integration
• Test Planning
1 – Initial • Test Monitoring &
• Non-Functional Testing
Control • Peer Reviews
• Test Design & Execution
• Test Environment
5
Copyright © 2012 Experimentus Ltd

6. Level 2 - Managed
 The status of the work products Process Areas
and the delivery of testing  2.1 Test Policy & Strategy
services are visible to
management, however testing  2.2 Test Planning
may still start relatively late in  2.3 Test Monitoring & Control
the development life cycle
 2.4 Test Design & Execution
 Testing is multileveled, i.e. there
are unit, integration, system and  2.5 Test Environments
acceptance test levels
 The main objective of testing in
a TMMi level 2 organisation is to
verify that the product satisfies
the specified requirements
Copyright © 2012 Experimentus Ltd 6

7. Level 3 - Defined
 Testing is fully integrated into Process Areas
the development life cycle  3.1 Test Organisation
 The organisations test  3.2 Test Training Program
standards are established and
improved over time and test  3.3 Test Lifecycle & Integration
process improvement is fully  3.4 Non Functional Testing
institutionalised
 3.5 Peer Reviews
 A specific organisation test
training programme exists and
testing is perceived as being a
profession and test
professionals are involved with
reviews of requirements
Copyright © 2012 Experimentus Ltd 7

8. TMMi Reference Material
 For more information on TMMi, visit the TMMi foundation website
www.tmmifoundation.org
8
Copyright © 2012 Experimentus Ltd

9. The TMMi e-Survey
9
Copyright © 2012 Experimentus Ltd

10. The e-Survey
 Browser based
 Sections:
1. Testing trends &
non-TMMi
2. TMMi Process Area
rating
3. Optional Comments
 Features
– Simple scoring
method
– Focuses on areas
pertinent to your role
– “Save & Continue
Survey Later”
10
Copyright © 2012 Experimentus Ltd

11. Completing the e-Survey
 Should take between 30 mins
and 1 hour to complete
 Process areas presented based
on your role in the organisation
– You can select to complete all
process areas if you like
 For each process area there
are two elements:
1. Statement scores against the
model
2. Process implementation
effectiveness
11
Copyright © 2012 Experimentus Ltd

12. Completing the e-Survey
 Statement scores against the model
– Review each statement, then select a score between 0 and 10 based on
how much you agree that the statement is true for your organisation
– If you don’t have an opinion, please leave the score blank
12
Copyright © 2012 Experimentus Ltd

13. Completing the e-Survey
 Process implementation effectiveness
– For each process area, select a star ranking for:
 How well you feel the organisation has approached the definition of the
process area
 How well you feel the organisation has deployed changes in the process
area
 How good you think the results of deployed process changes for the
process area are
13
Copyright © 2012 Experimentus Ltd

14. Completing the e-Survey
 Testing Trends and non-TMMi section
– Obtains a personal view of testing progress in your organisation over the last 2
years
– Contains statements on areas outside of TMMi that may still impact your
organisations test process effectiveness
14
Copyright © 2012 Experimentus Ltd

15. Completing the e-Survey
 Your views are important: please answer honestly
 No preparation is required
 Do not use reference material to help you answer questions
 Your first answer is most often the right answer
15
Copyright © 2012 Experimentus Ltd

16. “Save and continue survey later”
 Use this if you can’t complete the e-Survey in one session
 Allows you to save what you have entered and return later
 Only saves data entered on submitted pages
16
Copyright © 2012 Experimentus Ltd

17. Things to note
 Responses are completely confidential
 Assessment Team only will see individual data
 Important: this should be a personal perspective:
– Please do not collaborate with colleagues or management
– Responses should be based on experience, not research
– Do not spend too much time trying find the “right” response
– Your first answer is generally the best answer
17
Copyright © 2012 Experimentus Ltd

18. Next steps
18
Copyright © 2012 Experimentus Ltd

19. Wrap-up and Next steps
 The survey must be completed
within the requested time frame
 Results will be consolidated,
analysed and summarised
 The final findings analysis is
presented back to the sponsor
19
Copyright © 2012 Experimentus Ltd

20. Questions & Concerns
 For queries, please contact the Assessment Team Lead
 Alternatively, contact your TMMi assessment contact
 Details for both are provided in the invitation email
20
Copyright © 2012 Experimentus Ltd

21. Thank you
www.experimentus.com
+44 (0) 207 871 2300
info@experimentus.com : @experimentus
21
Copyright © 2012 Experimentus Ltd