Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Software test management overview for managers


Published on

Software test management presentation given to the senior management of several Fortune 100 companies to aid them in planning their software development management efforts.

Published in: Business, Technology
  • exceptional demonstration..convinced me to have a hardlook at my business model..amazing
    Are you sure you want to  Yes  No
    Your message goes here
  • great presentation for new test managers and lead
    Are you sure you want to  Yes  No
    Your message goes here

Software test management overview for managers

  1. 1. Test Concepts and Practices From Concept to Deliverable Presented by T. James LeDoux, Test Management Consultant 1 An Executive-level overview of quality assurance and test management practices and considerations
  2. 2. Topics <ul><li>Differences between QA and Test </li></ul><ul><li>Goals of Testing </li></ul><ul><li>Phases / Levels of Testing </li></ul><ul><li>Types of Testing </li></ul><ul><li>Basic Concepts of Test Planning and Creation </li></ul><ul><li>Pass/Fail Criteria (Discussion) </li></ul><ul><li>Traps and Pitfalls (Discussion) </li></ul><ul><li>Successful Completion (Discussion) </li></ul>2
  3. 3. Differences Between QA and Test <ul><li>QA </li></ul><ul><ul><li>Focused on managing organization-wide process for acceptance of upgrade </li></ul></ul><ul><ul><li>Targets affected system </li></ul></ul><ul><ul><li>Performs by developing management processes </li></ul></ul><ul><ul><li>Involves Quality Manager, Quality Director or QA Manager </li></ul></ul><ul><li>Test </li></ul><ul><ul><li>Focused on validating level of confidence in upgrade </li></ul></ul><ul><ul><li>Targets a Release </li></ul></ul><ul><ul><li>Performs from planned script </li></ul></ul><ul><ul><li>Involves Test Engineer or Test Manager </li></ul></ul>3
  4. 4. Goals of Testing <ul><li>Increase Quality of the Upgrade </li></ul><ul><ul><li>Quality = Confidence </li></ul></ul><ul><li>Reduce risks to the system or business </li></ul><ul><li>Stabilize the system </li></ul><ul><li>Meet the needs of the Users </li></ul><ul><li>Determine capability of the system </li></ul><ul><li>Define monitoring requirement in production </li></ul>4
  5. 5. Phases / Levels of Testing Requirements Unit Tests Test Plan Test Scenarios Performance Tests String Tests System Tests UAT Tests Integration Tests Staging Tests 5
  6. 6. Types of Testing <ul><li>Functional </li></ul><ul><li>Security </li></ul><ul><li>User </li></ul><ul><li>Exception </li></ul><ul><li>Etc. </li></ul>6
  7. 7. System Tests Unit Tests String Tests System Tests Integration Tests Functional Tests Security Tests Exception Tests Developer System Testing Test Group System Testing 7
  8. 8. Performance Tests Performance Tests System Tests UAT Tests Staging Tests Throughput Tests Stress Tests Benchmark Tests Load Tests 8
  9. 9. User Tests Performance Tests System Tests UAT Tests Staging Tests User Acceptance Tests Business Exception Tests 9
  10. 10. Deployment Tests Performance Tests System Tests UAT Tests Staging Tests Deployment Tests Release Notes Test 10
  11. 11. The Test Harness <ul><li>Acts as the initiator of the object’s task </li></ul><ul><li>Typically structured with three parts: </li></ul><ul><ul><li>Input data and form </li></ul></ul><ul><ul><li>Setup process </li></ul></ul><ul><ul><li>Output data handler </li></ul></ul><ul><li>Must also be capable of creating and determining exception responses </li></ul>11
  12. 12. Test Harness Example Arithmetic Adder A + B = C Method ARADD (A,B,C) Input data Iteration A B 1 2 3 4 5 Except 6 Except 7 1 2 4 5 7 21 S 1 3 7 8 12 K 8 Expected data Iteration C P/F 1 2 3 4 5 Except 6 Except 7 2 5 11 13 19 Error Error P P P P P F F 12
  13. 13. Test Plan Page 1 Describes purpose. Example: One of the primary goals of the Web To Compass project at Compassion International is to streamline the process of getting a web transaction from the web site ( to the Compass database. Currently, the web site and Compass are disconnected, and a series of manual and semi-automated processes are in place to facilitate this work. 1. Introduction 1.1 Purpose 1.2 Goals <ul><li>Describes the goals of the testing. </li></ul><ul><li>Example: </li></ul><ul><li>This Test Plan for the Compassion W2C Release supports the following Goals: </li></ul><ul><li>Defines the activities required to prepare for and conduct Unit, System, Load, and Performance Testing. </li></ul><ul><li>Communicates to all responsible parties the testing strategy. </li></ul>1.3 Test Scope Describes scope of testing. Example: Testing encompasses System, Load and Regression testing under a manual test process. 1.4 System Overview Describes the system layout along with a diagram 13
  14. 14. Example of a System Overview Diagram 14
  15. 15. Test Plan Page 2 2.0 Test Strategy Overview (From Test Strategy document) 15 2.1 Purpose, 2.2 Approach 2.3 Validation
  16. 16. Test Plan Page 3 3.1 Unit/String Testing <ul><li>Unit/String Testing Environment </li></ul><ul><li>Test Data </li></ul><ul><li>Installation, Verification and Control </li></ul><ul><li>Unit/String Test to be Performed </li></ul><ul><li>Unit/String Test Logging and Reporting </li></ul>3.1 Integration Testing <ul><li>Integration Environment </li></ul><ul><li>Test Data </li></ul><ul><li>Installation, Verification and Control </li></ul><ul><li>Test Team Logistics </li></ul><ul><li>Logging and Reporting </li></ul>3.0 Test Levels
  17. 17. Test Plan Page 4 <ul><li>System Test Environment </li></ul><ul><li>Test Data </li></ul><ul><li>Installation, Verification and Control </li></ul><ul><li>Test Team Logistics </li></ul><ul><li>System Test to be Performed </li></ul><ul><li>System Test Logging and Reporting </li></ul><ul><li>Defect Management </li></ul><ul><li>Quality Requirements and Metrics (see next slide) </li></ul><ul><li>Roles and Responsibilities </li></ul>16 3.2 System Test 3.3 Performance Test
  18. 18. Quality Requirements and Metrics Section Entrance Criteria <ul><li>Test Plan complete </li></ul><ul><ul><li>Test Cases complete </li></ul></ul><ul><ul><li>Test Procedures complete </li></ul></ul><ul><ul><li>Test Scenarios complete </li></ul></ul><ul><ul><li>Execution Schedule complete </li></ul></ul><ul><ul><li>Test data acquired </li></ul></ul><ul><ul><li>User names, passwords and </li></ul></ul><ul><ul><li>access rights issued </li></ul></ul><ul><li>Test environment ready </li></ul>Exit Criteria <ul><li>Testing completed </li></ul><ul><li>Test results complete </li></ul><ul><li>Screen captures complete </li></ul><ul><li>Test logs up to date </li></ul><ul><li>Defects identified and reported or </li></ul><ul><li>fixed </li></ul>17
  19. 19. Test Plan Page 5 4.0 Test Identification and Definition 18 <ul><li>Requirements Testability Matrix </li></ul><ul><li>Functional Scenarios </li></ul><ul><li>Exception Scenarios </li></ul><ul><li>End-To-End </li></ul><ul><li>Functional Test Cases </li></ul><ul><li>Test Cases not associated with a </li></ul><ul><li>Use Case </li></ul><ul><li>Exception Tests </li></ul><ul><li>End-To-End </li></ul>4.1 Test Scenarios
  20. 20. Test Plan Page 6 4.2 Performance Test Scenarios 4.3 Regression Test Scenarios 4.4 Test Procedures 19 <ul><li>Unit/String Test Schedule </li></ul><ul><li>Integration Test Schedule </li></ul><ul><li>System Test Schedule </li></ul><ul><li>Performance Test Schedule </li></ul><ul><li>Manual Test Procedures </li></ul><ul><li>Automated Test Procedures </li></ul>5.0 Test Schedule
  21. 21. Test Case Example 20 Section Description   Procedure Name ABC1-TC100.0 Use Case 1 Happy Path Procedure Overview This test covers the 2 steps of the UC1 happy path; 1. Tester confirms no web comments 2. Tester logs into system and navigates to the constituent screen and enters the constituent number Procedure Dependencies 1.         Records have been properly created for the constituents being pulled up. Functional Requirements 1.         No web comments are placed in the comments fields in the database 2.         The IIS is properly set up. Procedure Test Data Test Database Image Suite TDB100.0 Test Procedure Conducted by __________________________________ Date Conducted ________________________ Build Label/Version   Pre-Amble Instructions All databases need to be initialized to a known condition. This is typically done by copying the golden database images to their respective databases. Note that for Release 1, the databases will be small and the restoration of the databases will be more manual than is typical with a golden database environment. Procedure Instructions   Steps Passed/Fail Data Input Results Comments Setup steps         Step 1 – Tester confirms no web comments       Step 2 – Tester logs into the system       Post-Amble Instructions Do not restore the golden database to this environment after this test. Selected constituents in the database are set up for each test scenario to reduce the need to restore the database.
  22. 22. Summary <ul><li>QA is organization-wide; Test is Project-wide </li></ul><ul><li>QA requires that testing be performed at the development, validation and deployment phases </li></ul><ul><li>The Test Strategy defines the validation approach (test, acceptance process) for the business need </li></ul><ul><li>The Test Plan defines how testing is managed </li></ul><ul><li>The Test Cases define how testing is executed </li></ul>21