1. Software Metrics –Overview Blackboard by Sirisha N

9. … ..What to Measure ? Software Test Metrics Product Metrics Process Metrics Project Metrics Quality Metrics 1. Size Variation 2. Defect density 3. Code coverage 4. MTBF 1. TCA Productivity 2. TCR Productivity 3. TCE Productivity 4. Test Case challenged percentage 1. Effort variation 2. Schedule Variation 3. Schedule Compliance 4. Staff Utilization 1. Adhoc Bug % 2. Challenged Bug % 3. Rejected Bug % 4. Customer satisfaction Index

10. Data Collection Strategy WBS (.XLS) Time Sheet (.XLS) Estimation Sheet (.XLT) Estimation Methodology DTS (.XLS) RL (.XLS) Data Collected in PROJECT DATA COLLECTION EQA 2.0 D1.XLS PROJECT WBS EQA 1.0 D1.XLS Resource Name, Project Name, Build Name, Planned Tasks, Unplanned Tasks, Time spent Testing Defects, Customer identified defects (CID) Review Errors & Defects Test Report (.XLS) Guidelines, Templates Planned Effort, Actual Effort, Planned Start date, Planned Finish date, Interim Start date, Interim Finish date, Actual Start date, Actual Finish date, Estimated Size, Estimated Effort, Estimated Resource Count, CID Report (.XLS) Defect ID, Description, Source / Location, Identified date / by, Defect Type / Class, Detected in Phase, Injected in Phase, Defect Severity, Defect Status Error / Defect ID, Description, Source / Location, Identified date / by, Error/Defect Status Derived Metrics: 1. Effort Variation 2. Schedule Variation 3. TCA productivity 4. TCR productivity 5. TCE productivity 6. Challenged TC % 7. Adhoc Bug % 8. Challenged Bug % 9. Rejected Bug % Test Case ID, Executed by, Execution date, Test procedure, Expected results, Actual results, Execution status, Defect description Defect description Identified by, Identified date, Defect Type, Defect priority,

14. Effort Variation Effort can be derived from Size, if Productivity factor is known.. Effort (PH) = {Size (# TC) x 1000} / Productivity (TCA or TCR or TCE /Hr.) Data Collection Sheet for Effort Variation -Phase Wise Artifact : Project WBS EQA 1.0 D1.xls % Variation Actual Effort (in person hrs) Planned Effort (in person hrs) Activity Phase Modules Build Product Activity Code

18. Schedule Variation Data Collection Sheet for Schedule Variation - Phase Wise Artifact : Project WBS EQA 1.0 D1.xls % Comp lete % Varia tion Actual Finish Date Actual Start Date Actual Duration (cal. days) Plan Finish Date Plan Start Date Plan Duration (cal. days) Activity Phase Modules Build Product Act. Code

22. Productivity Artifact : Project Data Collection EQA 2.0 D1.xls Data Collection Sheet for Test Case Productivity TC Execution Effort # TC Executed TC Reviewing Effort # TC Reviewed TC Authoring Effort # TC Authored Module Build Product Resource ID Date

26. Adhoc/Challenged/Rejected Bug % Data Collection Sheet for Bug Details Artifact : Project Data Collection EQA 2.0 D1.xls # Invalid Bugs # Redundant Bugs # Challenged Bugs # Enhance ments # Bugs Posted Bugs by Testing Type Module Build Product Resource ID Date

29. Metrics based Project Mgmt.

30. Metrics based Project Mgmt.

31. Metrics based Project Mgmt.

32. Q Thank