Test Reports


Published on

Published in: Business
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Test Reports

  1. 1. Test Reporting
  2. 2. Test Tools To Build Test Reports
  3. 3. Test Tools <ul><li>Testers use many different tools to help in analyzing the results of testing and to create the information contained in the test reports. </li></ul>
  4. 4. Test Tools <ul><li>Pareto Charts </li></ul><ul><li>Cause Effect Diagram </li></ul><ul><li>Check Sheet </li></ul>
  5. 5. Pareto Charts <ul><li>Type of Bar chart to view the causes in order of priority from largest to smallest </li></ul><ul><li>The Pareto chart provides an effective tool to graphically show where significant problems and causes are in a process </li></ul>
  6. 6. Pareto Chart
  7. 7. Cause Effect Diagram <ul><li>A team tool used to help identify the causes of problems related to processes, products and </li></ul><ul><li>services. This technique keeps teams focused on a problem and potential causes. By better </li></ul><ul><li>understanding problems within the work processes, teams can reach probable and root causes of a problem. </li></ul>
  8. 8. Cause Effect Diagram(Fishbone Diagram)
  9. 9. Check Sheet <ul><li>A check sheet is a technique or tool to record the number of occurrences over a specified interval of time; a data sample to determine the frequency of an event. The recording of data, survey, or sample is to support or validate objectively the significance of the event. This usually follows the Pareto analysis and cause and effect diagram to validate and verify a problem or cause. </li></ul>
  10. 10. Sample Check Sheet
  11. 11. Reporting Test Results
  12. 12. Eight Interim Reports: <ul><li>Functional Testing Status  </li></ul><ul><li>Functions Working Timeline </li></ul><ul><li>Expected verses Actual Defects Uncovered Timeline </li></ul><ul><li>Defects Uncovered verses Corrected Gap Timeline </li></ul><ul><li>Average Age of Uncorrected Defects by Type </li></ul><ul><li>Defect Distribution </li></ul><ul><li>Relative Defect Distribution </li></ul><ul><li>Testing Action </li></ul>
  13. 13. Functional Testing Status Report <ul><li>This report will show percentages of the functions which have been: </li></ul><ul><li>Fully Tested </li></ul><ul><li>Tested With Open Defects </li></ul><ul><li>Not Tested </li></ul>
  14. 14. Functional Testing Status Report 40 30 20 10 Fully Tested Not Tested with open defects Tested
  15. 15. Functions Working Timeline <ul><li>This report will show the actual plan to have all functions working verses the current status of functions working. </li></ul><ul><li>An ideal format could be a line graph. </li></ul>
  16. 16. 40 30 20 10 Functions Working Timeline Jan Feb Mar Timeline Actual Status Current Status
  17. 17. Expected verses Actual Defects Detected <ul><li>This report will provide an analysis between the number of defects being generated against the expected number of defects expected from the planning stage. </li></ul>
  18. 18. Expected Versus Actual Defects Detected 40 30 20 10 M1 M2 M3 Expected defects Actual defects
  19. 19. Defects Detected verses Corrected Gap <ul><li>This report, ideally in a line graph format, will show the number of defects uncovered verses the number of defects being corrected and accepted by the testing group. </li></ul><ul><li>If the gap grows too large, the project may not be ready when originally planned. </li></ul>
  20. 20. 40 30 20 10 Defect Detected Versus Corrected Gap Module Detected Corrected No Of D E F E C T S Gap
  21. 21. Average Age Uncorrected Defects by Type <ul><li>This report will show the average days of outstanding defects by type (Sev 1, Sev 2, etc.). </li></ul><ul><li>In the planning stage, it is beneficial to determine the acceptable open days by defect type. </li></ul>
  22. 22. Average Age UnCorrected Vs Defects By Type 20 10 5 0 Critical Major Minor No Of D A Y S
  23. 23. Defect Distribution <ul><li>This report will show the defect distribution by function or module. It can also show items such as numbers of tests completed. </li></ul>
  24. 24. Defect Distribution 40 30 20 10 M1 M2 M3 No Of D E F E C T S 15 30 20
  25. 25. Relative Defect Distribution <ul><li>This report will take the previous report (Defect Distribution) and normalize the level of defects. </li></ul><ul><li>  </li></ul><ul><li>An example would be one application might be more in depth than another, and would probably have a higher level of defects. </li></ul><ul><li>However, when normalized over the number of functions or lines of code, would show a more accurate level of defects. </li></ul>
  26. 26. Testing Action <ul><li>This report can show many different things, including possible shortfalls in testing. </li></ul><ul><li>  </li></ul><ul><li>Examples of data to show might be number of Sev 1 defects, tests that are behind schedule, and other information that would present an accurate testing picture. </li></ul>
  27. 27. Final Test Report s <ul><li>Test reports should be prepared at the conclusion of each level of testing. This might include: </li></ul><ul><li>Unit Test Report </li></ul><ul><li>Integration Test Report </li></ul><ul><li>System Test Report </li></ul><ul><li>Acceptance Test Report </li></ul><ul><li>  </li></ul>
  28. 28. Unit Test Report
  29. 29. Integration Test Report
  30. 30. Contents of System Test Report <ul><li>General Information </li></ul><ul><li>Test Results and Findings </li></ul><ul><li>Software Function and Findings </li></ul>