SlideShare a Scribd company logo
1 of 2
Download to read offline
CASE STUDY


Efficient Test Practice Reduces
Cycle Time by 60%

                                                     STAG’s re-engineering of test practices and process
                                                      standardization drives tangible benefits for a
                                                       global leader in wireless communication, enabling
                                                       it to achieve 60% reduction in testing cycle time
                                                      and 30% increase in productivity.




            Domain/Category -
                                                                             Technology - C++, PERL
            Mobile / Wireless Telecom




CUSTOMER AND PRODUCT BACKGROUND
The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies.


The product in question was a video sharing application that was developed at the IDC using C/C++. The application was
intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls.
The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming.




PROBLEM STATEMENT
The product components from different development centers were integrated at the IDC and then sent out for field-testing
at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting
system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought
the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
SOLUTION

The STAG team conducted a quick analysis of the existing test
process and made the following observations:                                                           # Test cases added: 340


• Test cases documented were not exhaustive and repeatable.
                                                                                                       # PERL scripts created: 25
• Defects observed were not systematically analyzed.
                                                                                                       (average lines of code per script – 150)
• 40% of total defects logged were at the unit level.
• The IDC team spent precious time uncovering system level defects.


The STAG team first set up a pragmatic test practice to formally design and document test cases based on
specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were
implemented using sanity tests that ensured good test readiness.


The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks,
and provide essential timely feedback to the development team for quick and measurable progress in product development.


The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based
BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also
developed PERL scripts to detect defects at the SIP level.


The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used
Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help
the development team fix the code quickly.


The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After
every release, the team generated a test report that gave clear directions for taking the required corrective actions.


OUTCOME AND VALUE ADDITIONS
Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect
types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also,
there was a 90% reduction in network independent system level defects to field testing.
The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to
reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per
release.


Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5
days.


         CUSTOMER SPEAK
         …We are very pleased with our association with STAG, as they brought about a transformation in our
         test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing
         cycle, and a 30% saving from manpower reduction.
                                                                                                                                    - QA Manager


  Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
  Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


  2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.

More Related Content

More from STAG Software Private Limited

Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 

More from STAG Software Private Limited (20)

Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Reflect and Change
Reflect and ChangeReflect and Change
Reflect and Change
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"
 
Enhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product MaturityEnhanced Delivery Confidence Improved Product Maturity
Enhanced Delivery Confidence Improved Product Maturity
 
Too Many Conditions!
Too Many Conditions!Too Many Conditions!
Too Many Conditions!
 
Pre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based ProductPre-deployment Performance Evaluation of Web-based Product
Pre-deployment Performance Evaluation of Web-based Product
 

Recently uploaded

Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 

Recently uploaded (20)

Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
ASRock Industrial FDO Solutions in Action for Industrial Edge AI _ Kenny at A...
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideCollecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 

Efficient Test Practice Reduces Cycle Time by 60%

  • 1. CASE STUDY Efficient Test Practice Reduces Cycle Time by 60% STAG’s re-engineering of test practices and process standardization drives tangible benefits for a global leader in wireless communication, enabling it to achieve 60% reduction in testing cycle time and 30% increase in productivity. Domain/Category - Technology - C++, PERL Mobile / Wireless Telecom CUSTOMER AND PRODUCT BACKGROUND The customer is the India Development Center (IDC) of a world leader in 3G and next-generation mobile technologies. The product in question was a video sharing application that was developed at the IDC using C/C++. The application was intended for sharing or storing videos on mobile phones with or without Packet Switched (PS) / Circuit Switched (CS) calls. The application used Session Initiation Protocol (SIP) for signaling and Real Time Protocol (RTP) for streaming. PROBLEM STATEMENT The product components from different development centers were integrated at the IDC and then sent out for field-testing at an overseas site. The client discovered that the field-testing QA team spent considerable amount of time detecting system-level defects, leading to an increase in field testing effort and, therefore, delays in product release. The client sought the help of a specialist partner to fix this anomaly immediately and arrest defect escapes to field.
  • 2. SOLUTION The STAG team conducted a quick analysis of the existing test process and made the following observations: # Test cases added: 340 • Test cases documented were not exhaustive and repeatable. # PERL scripts created: 25 • Defects observed were not systematically analyzed. (average lines of code per script – 150) • 40% of total defects logged were at the unit level. • The IDC team spent precious time uncovering system level defects. The STAG team first set up a pragmatic test practice to formally design and document test cases based on specifications/standards for the features to be implemented in every release (weekly) for testing. Clear gate criteria were implemented using sanity tests that ensured good test readiness. The team introduced the concept of build and release notes, which helped the IDC test team focus, prioritize the testing tasks, and provide essential timely feedback to the development team for quick and measurable progress in product development. The team added test cases and executed them incrementally for every release. It applied black box techniques and HBT-based BeST techniques to design test cases. The test cases were developed for both the ‘use’ as well as ‘abuse’ aspects. The team also developed PERL scripts to detect defects at the SIP level. The STAG team also set up unit testing practices for key components before releasing the build for system testing. It used Ethereal and log testing tools to detect, localize, and capture protocol issues and attach them with the defects logged to help the development team fix the code quickly. The team also tracked defects and mapped them to the features, modules, and developers to enable quick resolution. After every release, the team generated a test report that gave clear directions for taking the required corrective actions. OUTCOME AND VALUE ADDITIONS Setting up unit level testing resulted in reduction of defects in system testing and eliminated the occurrence of the same defect types in different features. Reduced rework in coding as well as test execution resulted in a 30% increase in productivity. Also, there was a 90% reduction in network independent system level defects to field testing. The defect identification and fixing cycle was brought down to 2 days from 5 days. Zero defect escape to field contributed to reduction in field testing cycle to 1 day from 3 days for every release. The average defect count reduced from 20 to 12 per release. Overall, as the focus of defect detection moved from unit level to system level, the testing cycle was reduced to 3 days from 5 days. CUSTOMER SPEAK …We are very pleased with our association with STAG, as they brought about a transformation in our test practices. This resulted in a 60% reduction in testing effort, a 66% reduction in the field testing cycle, and a 30% saving from manpower reduction. - QA Manager Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.