Published on

1 Comment
  • This presentation has been uploaded to this account with approval. Please remove it immediately.
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • BS 7925-2 is a component testing standard, thus it was written from the perspective of unit level testing, and does not cover higher level testing techniques BS 7925-1 (software testing vocabulary) was originally written to support BS 7925-2, thus it is focussed only on unit testing, so it does not cover the entire STLC Potential conflict example: IEEE 1008-1987 & BS 7925-2 both cover Unit Testing, IEEE standard is an overview of the unit testing process, whereas BS standard describes actual testing methods, but potential for conflict in vocabulary used Note that the prices are approximations only
  • Joint project between British Standards Institute, IEEE, ISO & other software testing specialist organisations – including KJRA
  • BS standards developed by BCS SIGiST (British Computer Society Specialist Interest Group in Software Testing)
  • Overview of testing principles and practices
  • Test management and test processes
  • presentation

    1. 1. ISO/IEC 29119: Software Testing Standard Test Automation Workshop August 2007 Ms. Tafline Murnane K. J. Ross & Associates Pty. Ltd. PO Box 131, West Burleigh, 4219 Ph: 07 5522 5131 Fax: 07 5522 5232
    2. 2. Overview <ul><li>Motivation </li></ul><ul><li>Goals & contributions </li></ul><ul><li>Overview of standard </li></ul><ul><li>Test processes </li></ul><ul><li>Test activity descriptions - example </li></ul><ul><li>Current progress </li></ul><ul><li>Summary </li></ul>
    3. 3. Motivation <ul><li>Existing standards do not cover all aspects of STLC </li></ul><ul><ul><li>Techniques in BS 7925-2 only cover unit testing </li></ul></ul><ul><ul><li>BS 7925-1 testing vocabulary written for BS 7925-2 </li></ul></ul><ul><ul><li>Missing higher level methods such as Use Case Testing and non-functional testing approaches such as & Performance Testing, Security Testing, etc. </li></ul></ul><ul><ul><li>Risk-based testing and test strategy development not covered </li></ul></ul><ul><ul><li>Static Testing not covered </li></ul></ul><ul><li>Potential conflict in definitions, processes & procedures </li></ul><ul><li>Practitioners may not know which standard to follow </li></ul>
    4. 4. Goals & Contributions <ul><li>“ The purpose is to produce an integrated set of international standards to cover the software testing process throughout the development and maintenance of a software product or system.” W. Suryn, 2007 </li></ul><ul><li>ISO/IEC JTC1/SC7 – working group 26 </li></ul><ul><ul><li>Dr. Stuart Reid, representing British Computer Society (UK) </li></ul></ul><ul><ul><li>Ms. Ursula Parker, representing IEEE (USA) </li></ul></ul><ul><ul><li>Ms. Tafline Murnane (Australia) </li></ul></ul><ul><ul><li>Mr. Alphonse Philippe (France) </li></ul></ul><ul><ul><li>Dr. Alastair Walker (South Africa) </li></ul></ul><ul><li>Contributions/reviews from industry & academia are invited </li></ul>
    5. 5. Overview of Standard Part 1 Concepts & Vocabulary Part 2 Strategy & Process Part 3 Documentation Part 4 Techniques ISO 25051:6 ISO 25051:7 IEEE 1008 BSI 7925-2 IEEE 829:2007 BSI 7925-1 e.g. Maintenance.. e.g. Acceptance… e.g. System… e.g. Integration… e.g. Unit…. Appendices Normative (Generic) … … Technique 2 Maintenance e.g. technique 1 Acceptance e.g. technique 1 System e.g. technique 1 Integration e.g. technique 1 Unit e.g. technique 1 Technique 1 Appendices Level Normative (Generic)
    6. 6. Part 1 Concepts & Vocabulary <ul><li>Topics included: </li></ul><ul><ul><li>Software testing concepts </li></ul></ul><ul><ul><li>Introduction to software testing </li></ul></ul><ul><ul><li>Relationship between testing, development & maintenance </li></ul></ul><ul><ul><li>Implications of lifecycle models </li></ul></ul><ul><ul><li>Types of testing </li></ul></ul><ul><ul><li>Testing vocabulary </li></ul></ul><ul><ul><li>… etc </li></ul></ul>
    7. 7. Part 2 Testing Process <ul><li>Topics included: </li></ul><ul><ul><li>Test management process </li></ul></ul><ul><ul><ul><li>Test strategy </li></ul></ul></ul><ul><ul><ul><li>Test process monitoring </li></ul></ul></ul><ul><ul><ul><li>Test project completion </li></ul></ul></ul><ul><ul><li>Test process </li></ul></ul><ul><ul><ul><li>Test planning </li></ul></ul></ul><ul><ul><ul><li>Test design </li></ul></ul></ul><ul><ul><ul><li>Test execution </li></ul></ul></ul><ul><ul><ul><li>Anomaly reporting </li></ul></ul></ul><ul><ul><ul><li>Test completion </li></ul></ul></ul><ul><ul><li>Reporting </li></ul></ul><ul><ul><ul><li>Status </li></ul></ul></ul><ul><ul><ul><li>Project </li></ul></ul></ul><ul><ul><li>Test environment support </li></ul></ul><ul><ul><li>Appendices: </li></ul></ul><ul><ul><ul><li>Examples of these processes, at each level of testing & for various lifecycle models </li></ul></ul></ul><ul><ul><ul><li>Mappings to existing standards </li></ul></ul></ul>
    8. 8. Part 3 Documentation <ul><li>Topics included: </li></ul><ul><ul><li>Test management documentation </li></ul></ul><ul><ul><ul><li>Test strategy </li></ul></ul></ul><ul><ul><ul><li>Test project completion report </li></ul></ul></ul><ul><ul><li>Test documentation </li></ul></ul><ul><ul><ul><li>Test plan </li></ul></ul></ul><ul><ul><ul><li>Test specification </li></ul></ul></ul><ul><ul><ul><li>Test results </li></ul></ul></ul><ul><ul><ul><li>Anomaly reports </li></ul></ul></ul><ul><ul><ul><li>Test level completion report </li></ul></ul></ul><ul><ul><li>Interim status reporting </li></ul></ul><ul><ul><ul><li>Interim test status report </li></ul></ul></ul><ul><ul><ul><li>Interim test level status report </li></ul></ul></ul><ul><ul><li>Test environment report </li></ul></ul><ul><ul><li>Appendices – examples of each report, at each level of testing </li></ul></ul>
    9. 9. Part 4 Techniques <ul><li>Topics included: </li></ul><ul><ul><li>Test case design techniques </li></ul></ul><ul><ul><ul><li>Static testing techniques </li></ul></ul></ul><ul><ul><ul><ul><li>Inspections & walkthroughs, etc. </li></ul></ul></ul></ul><ul><ul><ul><li>Dynamic testing techniques </li></ul></ul></ul><ul><ul><ul><ul><li>Black-box, white-box, etc </li></ul></ul></ul></ul><ul><ul><ul><li>Non-functional testing techniques </li></ul></ul></ul><ul><ul><ul><ul><li>Security, performance, etc. </li></ul></ul></ul></ul><ul><ul><li>Test measurement techniques </li></ul></ul><ul><ul><li>Appendices </li></ul></ul><ul><ul><ul><li>Examples of each technique, at each level of testing </li></ul></ul></ul><ul><ul><ul><li>Test technique effectiveness </li></ul></ul></ul><ul><ul><ul><li>Mappings to existing standards </li></ul></ul></ul>
    10. 10. Part 2 – Testing Processes Test Project Completion Report [Test completion criterion not met] Test Level Completion Report Test Planning (TP1) Test Execution (TP3) Anomaly Reporting (TP4) Test Plan Test Spec Test Results [Issue noticed] [No issues noticed] Anomaly Report [Test completion criterion met] Design & Build Test(s) (TP2) Write/Update & Initiate Test Strategy (TMP1) Monitor/Update Test Process (TMP2) Test Completion (TMP3) Test Process Test Management Process Test Strategy Interim Test Status Reports Test Strategy Updates Project Management Plan, Regulatory Standards, System Requirements, Specifications & Documentation Test Item, Test Item Specifications, Regulatory Standards Interim Test Level Status Report Test Level Completion (TP5)
    11. 11. Test Activity Descriptions – Example <ul><li>Each testing activity will be described using a standard template, for example: </li></ul><ul><ul><li>Identifier: TP2 </li></ul></ul><ul><ul><li>Title: Test Design & Building </li></ul></ul><ul><ul><li>Purpose: To design , document and resource test cases that will be executed during a particular test activity. </li></ul></ul><ul><ul><li>Entry Criteria: Test Plan for the testing activity has been written </li></ul></ul><ul><ul><li>Inputs: Test Plan, Test Item(s), Test Item Specification(s) </li></ul></ul><ul><ul><li>Roles: Test Analyst </li></ul></ul><ul><ul><li>Tasks: </li></ul></ul><ul><ul><ul><li>Review Test Plan </li></ul></ul></ul><ul><ul><ul><li>Become familiar with test item(s) </li></ul></ul></ul><ul><ul><ul><li>Review test item specification(s) </li></ul></ul></ul><ul><ul><ul><li>Design and document test cases </li></ul></ul></ul><ul><ul><ul><li>Allocate test cases to tester(s) </li></ul></ul></ul><ul><ul><li>Outputs: Test Specification </li></ul></ul><ul><ul><li>Outcomes: </li></ul></ul><ul><ul><ul><li>Test case(s) has been documented; and </li></ul></ul></ul><ul><ul><ul><li>Test case(s) has been allocated to tester(s) or required testing staff have been requested. </li></ul></ul></ul><ul><ul><li>Exit Criteria: test case(s) has been documented. </li></ul></ul>
    12. 12. Current Progress <ul><li>Developing requirements specification </li></ul><ul><li>Initial drafts of parts 1 to 3 in progress </li></ul><ul><ul><li>Review at first interim meeting in October 2007 (Montr è al) </li></ul></ul><ul><ul><ul><li>Part 1: Concepts & Vocabulary (Alphonse) </li></ul></ul></ul><ul><ul><ul><li>Part 2: Testing Process (Stuart & Tafline) </li></ul></ul></ul><ul><ul><ul><li>Part 3: Documentation (Ursula) </li></ul></ul></ul><ul><ul><li>Liaise with other working groups on related standards </li></ul></ul><ul><li>Next plenary May 2008 (Berlin) </li></ul><ul><ul><li>Respond to feedback on Parts 1 to 3 </li></ul></ul><ul><ul><li>Continue review of Parts 1 to 3 </li></ul></ul><ul><ul><li>Possibly review Part 4: Test Techniques (Stuart & Tafline) </li></ul></ul>
    13. 13. Summary <ul><li>International standard will provide practitioners with guidelines for testing that cover all aspects of STLC </li></ul><ul><ul><li>Provide consistent set of definitions, processes, procedures & techniques for software testing </li></ul></ul><ul><li>Will be adopted by IEEE, ISO & BSI </li></ul><ul><li>Currently has representation from five nations & will be reviewed by software testing specialists world-wide </li></ul><ul><ul><li>Many companies will be contributing/reviewing, including KJRA </li></ul></ul>
    14. 14. Questions? <ul><li>For more information… </li></ul><ul><li>Email [email_address] to be added to email list for information on progress of the working group & requests for contributions and/or reviews </li></ul><ul><li>Visit for access to all documents produced by working group 26 and other working groups </li></ul>