Managing Independent Software
Testing Project - A Case Study
from Multimedia Super Corridor



Khor Cheng San (SADC Manage...
Table of Contents
Objectives of This Case Study
Introduction to Solution Assessment and Development Centre
(SADC)
Test Pro...
Objectives of This Case Study



Present our experience in using PMBOK® and CMMI
combination with our own testing processe...
Solution Assessment & Development Centre (SADC)
             “The solution for product perfection”

SADC offers independen...
Solution Assessment & Development Centre (SADC)
             “The solution for product perfection”




Managing Independen...
Solution Assessment & Development Centre (SADC)
             “The solution for product perfection”




Managing Independen...
Test Project Management (TPM) Methodology

 The SADC’s Project Management methodology applies
 recognized project manageme...
Test Project Management (TPM) Processes

 The concept of our Project Management
 methodology is illustrated below:
       ...
Test Project Management (TPM) Processes

Test Project Initiation

     Initiation is the process of formally authorizing a...
Test Project Management (TPM) Processes

 Test Project Control

       Test Project control will involve the regular revie...
Quality Management System (QMS) Framework


                                                                              ...
Test Methodology Framework (TMF)
 SADC Test Methodology Framework (SADC TMF)

                             Test Methodolog...
Documentation Components of SADC TMF
SADC Test Methodologies contains details of the Test Methodologies
to be employed in ...
Case Study: Test Project Overview
Industry / Market – Airline

The Challenge – Client A wanted to performance test their W...
Case Study: Test Project Overview
Testing Highlights
   Performance testing ensures proper scalability and identifies
   o...
Case Study: Test Project Overview
      Performance Test Methodology
      New Paradigm in Load Test/Stress Test: Virtual ...
Case Study: Test Project Overview
How SADC Managed the Test Project




Managing Independent Software Testing Project    M...
Case Study: Test Project Phases

 Test                   Pre-Project               Research/                    Implement ...
Case Study: Lessons Learned


The combination of PMBOK® and CMMI in
SADC’s Quality Management System (QMS)
Framework and T...
For further information, please visit us at
      www.mscinnovationcentre.com.my/sadc




                     Khor Cheng ...
FOR YOUR ATTENTION



Managing Independent Software Testing Project    MSC Innovation Centre
 - A Case Study from Multimed...
Upcoming SlideShare
Loading in...5
×

Microsoft PowerPoint - MITPM_KhorEddy_Testing_print_final ...

572

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
572
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Microsoft PowerPoint - MITPM_KhorEddy_Testing_print_final ...

  1. 1. Managing Independent Software Testing Project - A Case Study from Multimedia Super Corridor Khor Cheng San (SADC Manager) Azdilizan Abdullah (Senior Executive) Solution Assessment and Development Centre (SADC), MSC Innovation Centre 2 August, 2005 MSC Innovation Centre Copyright Protected 2005 MDC
  2. 2. Table of Contents Objectives of This Case Study Introduction to Solution Assessment and Development Centre (SADC) Test Project Management (TPM) Methodology Test Project Management (TPM) Processes Quality Management System (QMS) Framework Test Methodology Framework (TMF) Case Study: Test Project Overview Case Study: Test Project Phases Case Study: Lessons Learned Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  3. 3. Objectives of This Case Study Present our experience in using PMBOK® and CMMI combination with our own testing processes that is the SADC Test Methodology Framework (SADC TMF) in managing independent software testing services to the stakeholders. The SADC TMF encapsulates the various components required for test execution and test management, and is the basis for conducting Test Projects in the SADC. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  4. 4. Solution Assessment & Development Centre (SADC) “The solution for product perfection” SADC offers independent application verification & validation services, at a fraction (“cost-effective”) of the cost of building and maintaining an internal software test/QA department. Our Added-value proposition are: Objective analysis Fills the gap in staff resource Assures the delivery of reliable & robust application with proven SADC test methodologies and processes (QA/QC functions) “Do what they do best” Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  5. 5. Solution Assessment & Development Centre (SADC) “The solution for product perfection” Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  6. 6. Solution Assessment & Development Centre (SADC) “The solution for product perfection” Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  7. 7. Test Project Management (TPM) Methodology The SADC’s Project Management methodology applies recognized project management methods and techniques that are built upon Project Management Institute's Project Management Body of Knowledge (PMBOK®) concepts. Software Engineering Institute’s Capability Maturity Model® Integration (CMMI) model. This PMBOK® and CMMI combination culminates in the SADC’s Quality Management System (QMS) Framework and Test Methodology Framework (TMF) is to provide the basis for the SADC’s Test project teams to carry out their work in a well-structured manner to produce high quality output. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  8. 8. Test Project Management (TPM) Processes The concept of our Project Management methodology is illustrated below: Test Project Management Processes The Test Project Management Processes of INITIATION Initiation, Planning, Execution, Control and PLANNING EXECUTION Closure are the type of CONTROL processes occurring CLOSURE throughout a test project, keeping in balance the competing demands for scope, time, cost and quality. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  9. 9. Test Project Management (TPM) Processes Test Project Initiation Initiation is the process of formally authorizing a new test project or that an existing test project should continue into its next phase. Test Project Planning Planning is an ongoing effort throughout the life of the test project and is considered the most important phase in test project management. Test Project Execution Test Project execution will be guided by the test plan developed in the Test Research/Analysis/Design Phase. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  10. 10. Test Project Management (TPM) Processes Test Project Control Test Project control will involve the regular review of metrics and report status in order to identify variances from the test planned project baseline so that corrective action can be taken when necessary. Test Project Closure Test Project closure is the last major phase of a test project’s life cycle. It is performed once all stated test project objectives have been met and the client has formally accepted the test project’s deliverables. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  11. 11. Quality Management System (QMS) Framework The QMS contains a set of processes, guidelines, templates, checklists and forms that will be tailored for the purpose of the Test Project. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  12. 12. Test Methodology Framework (TMF) SADC Test Methodology Framework (SADC TMF) Test Methodologies Test Processes Procedures & Templates SADC TMF Standards & Guidelines CM Database Of Test Projects Defect SADC-CM Management Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  13. 13. Documentation Components of SADC TMF SADC Test Methodologies contains details of the Test Methodologies to be employed in the test execution and test management of Test Projects in the SADC. SADC Test Management Framework: Documentation Artifacts SADC Test Methodologies SADC Test Methodologies SADC Standards and Template Documents for SADC CM Database of Guidelines for SADC Test Projects Configuration Test Projects Test and Integration Management Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  14. 14. Case Study: Test Project Overview Industry / Market – Airline The Challenge – Client A wanted to performance test their Web Based System with realistic workloads to determine whether the system can handle the projected user load of 600 concurrent connection (10% of total user load) with a total estimated user base of 7200 crew (1200 Technical Crew and 6000 Cabin Crew) . The Solution - SADC uses Rational Suite TestStudio™ to performance test Client A Web Based System with incremental concurrent user load of 1, 50, 100, 250, 500, 600 and 750 (to stress the system) virtual users. The performance test results will enable the client to accurately predict how their critical (widely used) functions will perform under projected user load. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  15. 15. Case Study: Test Project Overview Testing Highlights Performance testing ensures proper scalability and identifies other performance problems in a real-life business environment. Performance testing uncovers a significant performance slowdown, which could be resolved by re-configuring and re- tuning of the identified root causes during the performance test. The Benefits Improved system quality and performance by pinpointing performance bottlenecks and other potential problems during performance tests. Highlighted specific area of code in the application where changes might significantly improve performance. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  16. 16. Case Study: Test Project Overview Performance Test Methodology New Paradigm in Load Test/Stress Test: Virtual Users & Automated Simulation Virtual Users (VUs) SUT under System processes w hich Pe rformance Test takes the place of actual users. A ctual apps transactions Generates re quired numbe r of V Us, Resource each V U executing the desire d monitor agents apps-functions according to the Selected servers defined W orkloa d M odel. are m onitore d for its resource utilization. Resource Utilization Information ( % RAM and %CPU ) Performance Test CAST relayed back to the Perform ance Performance Tool Test Server. T est Server Work load Relevant Mode l Test Plan s, Test Procedures. M odels full-load pr oduction env ironment of the SUT to be pe rformance-tested. This is tra nscribed from Autom ate d tes t the A pplication Usage App lication s cr ipts f or Distribution. Usage Workload M odel used as applications of Dist ribut ion the SUT to be basis to gener ate V Us Response Time & perf ormance-tested. and execute re quired automated test scripts. Applic ation Se rver Resource These scripts are sy em st Utilizat ion data are play ed back components captured, generated, during test execution, and analyzed. and assigned to VUs. Work-day Period SADC Test Methodology The overall test methodology employed by SADC for conducting the performance test is based on the Concurrent Users Load and Automated Simulation paradigm. This method is also referred to as the Automated Performance Test. Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  17. 17. Case Study: Test Project Overview How SADC Managed the Test Project Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  18. 18. Case Study: Test Project Phases Test Pre-Project Research/ Implement Test Test Test Project Test Analysis Design and Execution and Assessment Project Phases Requirement Test Design Test Setup Test Management Closure Business Test Project Test Plan Test Input Requirement Charter Assessment Report •Define test project •Analysis of test project •Set up of SADC Test •Execute Test •Analyze Test Results requirements. requirements & relevant Equipments at test site Procedures/Test •Final Test Assessment Key Activity •Define Testing Scope Client A documentation. •Set up of SADC Test Scenarios. Report Documentation. •Test Environment •Define Test Project •Analysis & Tools •Manage Test Execution. •Final Test Assessment clean-up. Timeline Estimation mobilization of test •Test Data Preparation •Record results of test Report Briefing. •Test Project close-off •Define Test Criteria execution requirements – •Automated execution. (archive test artifacts; •Agree on manpower, test tools Performance Test Scripts •Monitor & Capture documentation, test Communication (hardware, software). Generation various resource datastores) Channels •Design test •Pre-Test Execution to utilization data. •Agree on Reporting configuration, test check all the automated Procedures, Method and procedures, test test scripts are Frequency scenarios, test cases. functioning as per •Develop Workload requirement. Distribution Model (Load-Test Model). •Develop Test Plan/Test Procedures. Certificate of Output Test Project Proposal Test Plan Test Suites Scripts and Test-related Documents Test Assessment Acceptance Report Test Project Charter Method Managing Independent Software Testing Project MSC Innovation Centre /Tools - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  19. 19. Case Study: Lessons Learned The combination of PMBOK® and CMMI in SADC’s Quality Management System (QMS) Framework and Test Methodology Framework (TMF), provides a well-structured manner in producing high quality output and managing test projects. Challenges Communication Enforcement Trade-off Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  20. 20. For further information, please visit us at www.mscinnovationcentre.com.my/sadc Khor Cheng San (khor@mscinnovationcentre.com.my) & Azdilizan Abdullah (azdilizan@mdc.com.my) Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  21. 21. FOR YOUR ATTENTION Managing Independent Software Testing Project MSC Innovation Centre - A Case Study from Multimedia Super Corridor Copyright Protected 2005 MDC
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×