SlideShare a Scribd company logo
1 of 2
Download to read offline
CASE STUDY


Efficient Test Practice Reduces
Cycle Time by 60%

                                                     STAG’s re-engineering of test practices and process
                                                      standardization drives tangible benefits for a
                                                       global leader in wireless communication, enabling
                                                       it to achieve 60% reduction in testing cycle time
                                                      and 30% increase in productivity.




            Domain/Category -
                                                                             Technology - C++, PERL
            Mobile / Wireless Telecom




CUSTOMER AND PRODUCT BACKGROUND
The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies.


The product in question was a video sharing application that was developed at the IDC using C/C++. The application was
intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls.
The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming.




PROBLEM STATEMENT
The product components from different development centers were integrated at the IDC and then sent out for field-testing
at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting
system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought
the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
SOLUTION

The STAG team conducted a quick analysis of the existing test
process and made the following observations:                                                           # Test cases added: 340


• Test cases documented were not exhaustive and repeatable.
                                                                                                       # PERL scripts created: 25
• Defects observed were not systematically analyzed.
                                                                                                       (average lines of code per script – 150)
• 40% of total defects logged were at the unit level.
• The IDC team spent precious time uncovering system level defects.


The STAG team first set up a pragmatic test practice to formally design and document test cases based on
specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were
implemented using sanity tests that ensured good test readiness.


The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks,
and provide essential timely feedback to the development team for quick and measurable progress in product development.


The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based
BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also
developed PERL scripts to detect defects at the SIP level.


The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used
Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help
the development team fix the code quickly.


The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After
every release, the team generated a test report that gave clear directions for taking the required corrective actions.


OUTCOME AND VALUE ADDITIONS
Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect
types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also,
there was a 90% reduction in network independent system level defects to field testing.
The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to
reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per
release.


Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5
days.


         CUSTOMER SPEAK
         …We are very pleased with our association with STAG, as they brought about a transformation in our
         test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing
         cycle, and a 30% saving from manpower reduction.
                                                                                                                                    - QA Manager


  Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
  Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


  2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.

More Related Content

More from STAG Software Private Limited

Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 

More from STAG Software Private Limited (20)

Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Reflect and Change
Reflect and ChangeReflect and Change
Reflect and Change
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"
 
Enhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturityEnhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product Maturity
 
Too Many Conditions!
Too Many Conditions!Too Many Conditions!
Too Many Conditions!
 
Pre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based ProductPre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based Product
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Efficient Test Practice Reduces Cycle Time by 60%

  • 1. CASE STUDY Efficient Test Practice Reduces Cycle Time by 60% STAG’s re-engineering of test practices and process standardization drives tangible benefits for a global leader in wireless communication, enabling it to achieve 60% reduction in testing cycle time and 30% increase in productivity. Domain/Category - Technology - C++, PERL Mobile / Wireless Telecom CUSTOMER AND PRODUCT BACKGROUND The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies. The product in question was a video sharing application that was developed at the IDC using C/C++. The application was intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls. The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming. PROBLEM STATEMENT The product components from different development centers were integrated at the IDC and then sent out for field-testing at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
  • 2. SOLUTION The STAG team conducted a quick analysis of the existing test process and made the following observations: # Test cases added: 340 • Test cases documented were not exhaustive and repeatable. # PERL scripts created: 25 • Defects observed were not systematically analyzed. (average lines of code per script – 150) • 40% of total defects logged were at the unit level. • The IDC team spent precious time uncovering system level defects. The STAG team first set up a pragmatic test practice to formally design and document test cases based on specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were implemented using sanity tests that ensured good test readiness. The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks, and provide essential timely feedback to the development team for quick and measurable progress in product development. The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also developed PERL scripts to detect defects at the SIP level. The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help the development team fix the code quickly. The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After every release, the team generated a test report that gave clear directions for taking the required corrective actions. OUTCOME AND VALUE ADDITIONS Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also, there was a 90% reduction in network independent system level defects to field testing. The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per release. Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5 days. CUSTOMER SPEAK …We are very pleased with our association with STAG, as they brought about a transformation in our test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing cycle, and a 30% saving from manpower reduction. - QA Manager Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.