Your SlideShare is downloading. ×
presentation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

presentation

506
views

Published on


1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total Views
506
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
12
Comments
1
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • BS 7925-2 is a component testing standard, thus it was written from the perspective of unit level testing, and does not cover higher level testing techniques BS 7925-1 (software testing vocabulary) was originally written to support BS 7925-2, thus it is focussed only on unit testing, so it does not cover the entire STLC Potential conflict example: IEEE 1008-1987 & BS 7925-2 both cover Unit Testing, IEEE standard is an overview of the unit testing process, whereas BS standard describes actual testing methods, but potential for conflict in vocabulary used Note that the prices are approximations only
  • Joint project between British Standards Institute, IEEE, ISO & other software testing specialist organisations – including KJRA
  • BS standards developed by BCS SIGiST (British Computer Society Specialist Interest Group in Software Testing)
  • Overview of testing principles and practices
  • Test management and test processes
  • Transcript

    • 1. ISO/IEC 29119: Software Testing Standard Test Automation Workshop August 2007 Ms. Tafline Murnane K. J. Ross & Associates Pty. Ltd. PO Box 131, West Burleigh, 4219 Ph: 07 5522 5131 Fax: 07 5522 5232 taflinem@kjross.com.au http://www.kjross.com.au
    • 2. Overview
      • Motivation
      • Goals & contributions
      • Overview of standard
      • Test processes
      • Test activity descriptions - example
      • Current progress
      • Summary
    • 3. Motivation
      • Existing standards do not cover all aspects of STLC
        • Techniques in BS 7925-2 only cover unit testing
        • BS 7925-1 testing vocabulary written for BS 7925-2
        • Missing higher level methods such as Use Case Testing and non-functional testing approaches such as & Performance Testing, Security Testing, etc.
        • Risk-based testing and test strategy development not covered
        • Static Testing not covered
      • Potential conflict in definitions, processes & procedures
      • Practitioners may not know which standard to follow
    • 4. Goals & Contributions
      • “ The purpose is to produce an integrated set of international standards to cover the software testing process throughout the development and maintenance of a software product or system.” W. Suryn, 2007
      • ISO/IEC JTC1/SC7 – working group 26
        • Dr. Stuart Reid, representing British Computer Society (UK)
        • Ms. Ursula Parker, representing IEEE (USA)
        • Ms. Tafline Murnane (Australia)
        • Mr. Alphonse Philippe (France)
        • Dr. Alastair Walker (South Africa)
      • Contributions/reviews from industry & academia are invited
    • 5. Overview of Standard Part 1 Concepts & Vocabulary Part 2 Strategy & Process Part 3 Documentation Part 4 Techniques ISO 25051:6 ISO 25051:7 IEEE 1008 BSI 7925-2 IEEE 829:2007 BSI 7925-1 e.g. Maintenance.. e.g. Acceptance… e.g. System… e.g. Integration… e.g. Unit…. Appendices Normative (Generic) … … Technique 2 Maintenance e.g. technique 1 Acceptance e.g. technique 1 System e.g. technique 1 Integration e.g. technique 1 Unit e.g. technique 1 Technique 1 Appendices Level Normative (Generic)
    • 6. Part 1 Concepts & Vocabulary
      • Topics included:
        • Software testing concepts
        • Introduction to software testing
        • Relationship between testing, development & maintenance
        • Implications of lifecycle models
        • Types of testing
        • Testing vocabulary
        • … etc
    • 7. Part 2 Testing Process
      • Topics included:
        • Test management process
          • Test strategy
          • Test process monitoring
          • Test project completion
        • Test process
          • Test planning
          • Test design
          • Test execution
          • Anomaly reporting
          • Test completion
        • Reporting
          • Status
          • Project
        • Test environment support
        • Appendices:
          • Examples of these processes, at each level of testing & for various lifecycle models
          • Mappings to existing standards
    • 8. Part 3 Documentation
      • Topics included:
        • Test management documentation
          • Test strategy
          • Test project completion report
        • Test documentation
          • Test plan
          • Test specification
          • Test results
          • Anomaly reports
          • Test level completion report
        • Interim status reporting
          • Interim test status report
          • Interim test level status report
        • Test environment report
        • Appendices – examples of each report, at each level of testing
    • 9. Part 4 Techniques
      • Topics included:
        • Test case design techniques
          • Static testing techniques
            • Inspections & walkthroughs, etc.
          • Dynamic testing techniques
            • Black-box, white-box, etc
          • Non-functional testing techniques
            • Security, performance, etc.
        • Test measurement techniques
        • Appendices
          • Examples of each technique, at each level of testing
          • Test technique effectiveness
          • Mappings to existing standards
    • 10. Part 2 – Testing Processes Test Project Completion Report [Test completion criterion not met] Test Level Completion Report Test Planning (TP1) Test Execution (TP3) Anomaly Reporting (TP4) Test Plan Test Spec Test Results [Issue noticed] [No issues noticed] Anomaly Report [Test completion criterion met] Design & Build Test(s) (TP2) Write/Update & Initiate Test Strategy (TMP1) Monitor/Update Test Process (TMP2) Test Completion (TMP3) Test Process Test Management Process Test Strategy Interim Test Status Reports Test Strategy Updates Project Management Plan, Regulatory Standards, System Requirements, Specifications & Documentation Test Item, Test Item Specifications, Regulatory Standards Interim Test Level Status Report Test Level Completion (TP5)
    • 11. Test Activity Descriptions – Example
      • Each testing activity will be described using a standard template, for example:
        • Identifier: TP2
        • Title: Test Design & Building
        • Purpose: To design , document and resource test cases that will be executed during a particular test activity.
        • Entry Criteria: Test Plan for the testing activity has been written
        • Inputs: Test Plan, Test Item(s), Test Item Specification(s)
        • Roles: Test Analyst
        • Tasks:
          • Review Test Plan
          • Become familiar with test item(s)
          • Review test item specification(s)
          • Design and document test cases
          • Allocate test cases to tester(s)
        • Outputs: Test Specification
        • Outcomes:
          • Test case(s) has been documented; and
          • Test case(s) has been allocated to tester(s) or required testing staff have been requested.
        • Exit Criteria: test case(s) has been documented.
    • 12. Current Progress
      • Developing requirements specification
      • Initial drafts of parts 1 to 3 in progress
        • Review at first interim meeting in October 2007 (Montr è al)
          • Part 1: Concepts & Vocabulary (Alphonse)
          • Part 2: Testing Process (Stuart & Tafline)
          • Part 3: Documentation (Ursula)
        • Liaise with other working groups on related standards
      • Next plenary May 2008 (Berlin)
        • Respond to feedback on Parts 1 to 3
        • Continue review of Parts 1 to 3
        • Possibly review Part 4: Test Techniques (Stuart & Tafline)
    • 13. Summary
      • International standard will provide practitioners with guidelines for testing that cover all aspects of STLC
        • Provide consistent set of definitions, processes, procedures & techniques for software testing
      • Will be adopted by IEEE, ISO & BSI
      • Currently has representation from five nations & will be reviewed by software testing specialists world-wide
        • Many companies will be contributing/reviewing, including KJRA
    • 14. Questions?
      • For more information…
      • Email [email_address] to be added to email list for information on progress of the working group & requests for contributions and/or reviews
      • Visit http://www.jtc1-sc7.org/ for access to all documents produced by working group 26 and other working groups