Importance of test coverage

2,124 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,124
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
45
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Importance of test coverage

  1. 1. Significance of Test Coverage<br />Sep 2011<br />
  2. 2. Contents<br />Meaning of test coverage<br />Business importance for test coverage<br />Types of test coverage<br />Tools for test coverage<br />Test coverage in Agile<br />Test coverage in Risk based testing<br />Test coverage and Regression test decisions<br />Interpretation of test coverage numbers<br />
  3. 3. Meaning of test coverage<br />Total number of requirements tested against the total number of requirements in scope<br />
  4. 4. Business importance of test coverage<br /><ul><li>Test coverage is the direct indicator of the unknown risks
  5. 5. Sometimes it is a contractual requirement to show 100% test coverage
  6. 6. Effectiveness of other defect metrics depends on test coverage
  7. 7. Many times 100% test coverage from SIT is the entry criteria for UAT and for Go-live</li></li></ul><li>Types of test coverage<br />Test coverage<br />Project<br />Release<br />Design<br />Execution<br />
  8. 8. Tools for test coverage<br />Requirement traceability matrix<br />
  9. 9. Test coverage in Agile<br />Sprint 2<br />Sprint n<br />Sprint 3<br />Sprint 1<br />Reg Test coverage <br />0%<br />Reg Test coverage <br />65%<br />RegTest coverage <br />85%<br />Reg Test coverage <br />70%<br />Release X<br />Reg Test coverage <br />100%<br />
  10. 10. Test coverage in Risk based testing<br /><ul><li>Risk based testing is conscious decision to reduce testing time
  11. 11. In this case test coverage cannot be 100%
  12. 12. For such situations, we need to calculate & ensure “Critical” and “High” complexity scenario coverage separately
  13. 13. Need to intimate customer upfront about the test coverage</li></li></ul><li>Test coverage and Regression test decisions<br /><ul><li>We need two matrices to decide regression test scenarios
  14. 14. 100% regression testing for all cycles is impractical
  15. 15. We need functional dependency matrix to do impact analysis
  16. 16. Further we need Req Traceability matrix to decide the test scenarios</li></ul>Requirement Traceability Matrix<br />Functional Dependency Matrix<br />
  17. 17. Interpretation of test coverageDSI trend Vs Test coverage<br />Project A – DSI increases along with test coverage in cycle 3<br />Project B – DSI decreases over cycle after cycle even if the coverage is increased in the regression test<br />
  18. 18. Thank You<br />

×