SlideShare a Scribd company logo
CASE STUDY


Pre-deployment Performance
Evaluation of Web-based Product

                                                     STAG certifies an eLearning product ‘deploy-ready’
                                                      after extensive LSPS evaluation, enabling our
                                                      partner to successfully deploy it at the world's
                                                      largest publicly funded health services
                                                      organization.



                                                                Technology - Web-based eLearning LCMS,
                                                                Microsoft 2003 Server and Cold Fusion 8,
             Domain - Health Care                               Web Server with Database Server (SQL Server 2005)
                                                                Tools - JMeter, AdventNet AppManager



CUSTOMER AND PRODUCT BACKGROUND
The customer is one of the world’s largest publicly funded health services providers based out of the UK, employing more
than 1.7 million people, including 120,000 hospital doctors, 40,000 general practitioners, 400,000 nurses, and 25,000
ambulance staff.


The product in question is an eLearning product developed by our UK partner. This tool covers a wide range of training
needs and learning competencies to support the implementation and development of an information governance
framework within an organization.


PROBLEM STATEMENT
Our UK partner sought our expertise in LSPS evaluation of the product, as desired by the customer before its deployment
at the customer's place, for the following:

•   Load and performance capability
•   Ability to withstand concurrent loads
•   System scalability
•   Identification of potential bottlenecks (hardware, software, or network)

An estimated 37,500 concurrent users were expected at peak usage times.
SOLUTION
The STAG team created the necessary test environment,
developed a scalable automation framework, created a load                                     Number of users: 15,000
profile, developed performance test scripts, and created test                                  Bandwidth consumed: 31-50 Mbps
data to test the eLearning application for loads of 15,000 and
20,000 respectively, using JMeter. Server side resources like                                 Number of users: 20,000
CPU/Memory statistics of database and application servers                                     Bandwidth consumed: 40-50 Mbps
were monitored using AdventNet AppManager. Think time
was considered between every transaction to ensure that
the tests were realistic. In all, two test cycles were executed
by the team.


The performance metrics for the tests focused on end-user response times and resource utilization (CPU/memory). Based
on this, the STAG team identified major suspect areas that could pose performance challenges and resolved them during
the multiple simulated tests conducted on the application. The major suspect areas identified included:

•   High CPU utilization, up to 90%, of the DB server
•   Database deadlocks while the course data was being updated
•   Inconsistencies in the frequency of the course update sent by the application
•   Discrepancies in concurrency during a bulk upload scenario


Based on the test reports, the STAG team made the following recommendations that would help achieve the performance
objectives of the customer.

• A minimum of 31 Mbps and 40 Mbps network lines for 15,000 and 20,000 users respectively
• Web server CPU capacity upgrade to a dual core processor or to a CPU having two processors
• Reduction of file size (GIF, JPG, etc.) and file compression (PDF, PPT, audio, etc.) to improve further the network utilization
of the bandwidth, given that most eLearning course transactions involve a large volume of image downloads



OUTCOME AND VALUE ADDITIONS
The evaluation by the STAG team resulted in the product being certified to handle up to 20,000 users concurrently with no
degradation in performance, which greatly enhanced the deployment confidence of the customer.


STAG’s value addition was not limited to the technical aspects alone, it also included recommending the suitable
hardware/network resources required to support the current and future load and performance requirements.




Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


2013 © STAG Software Private Limited. All rights reserved. All trademarks are acknowledged.

More Related Content

Similar to Pre-deployment Performance Evaluation of Web-based Product

SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014 SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014
Sujit Ghosh
 
SMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE UniversitySMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE University
Michael Dobe, Ph.D.
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
Future Simmons
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
Future Simmons
 

Similar to Pre-deployment Performance Evaluation of Web-based Product (20)

APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
APPLICATION DEVELOPMENT TO CONVERT HETEROGENEOUS INFORMATION INTO PQDIF (POWE...
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
 
[En] life sciences software outsourcing services
[En] life sciences software outsourcing services[En] life sciences software outsourcing services
[En] life sciences software outsourcing services
 
Neev Load Testing Services
Neev Load Testing ServicesNeev Load Testing Services
Neev Load Testing Services
 
Increased IT infrastructure effectiveness by 80% with Microsoft system center...
Increased IT infrastructure effectiveness by 80% with Microsoft system center...Increased IT infrastructure effectiveness by 80% with Microsoft system center...
Increased IT infrastructure effectiveness by 80% with Microsoft system center...
 
SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014 SCQAA-SF Meeting on May 21 2014
SCQAA-SF Meeting on May 21 2014
 
Resume
ResumeResume
Resume
 
Performance testing : An Overview
Performance testing : An OverviewPerformance testing : An Overview
Performance testing : An Overview
 
SMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE UniversitySMEUG 2006 - Project IBIS: ERP at UAE University
SMEUG 2006 - Project IBIS: ERP at UAE University
 
7.3 Years of Experience
7.3 Years of Experience7.3 Years of Experience
7.3 Years of Experience
 
Case study: Performance Testing using Load Runner
Case study: Performance Testing using Load RunnerCase study: Performance Testing using Load Runner
Case study: Performance Testing using Load Runner
 
Resume
ResumeResume
Resume
 
Vivek kumar ray 5 year Java-Webservices-Bigdata
Vivek kumar ray 5 year Java-Webservices-BigdataVivek kumar ray 5 year Java-Webservices-Bigdata
Vivek kumar ray 5 year Java-Webservices-Bigdata
 
Mdk resume
Mdk resumeMdk resume
Mdk resume
 
Performance Test Slideshow Recent
Performance Test Slideshow RecentPerformance Test Slideshow Recent
Performance Test Slideshow Recent
 
Performance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N TPerformance Test Slideshow R E C E N T
Performance Test Slideshow R E C E N T
 
Hewlett Packard Entreprise | Stormrunner load | Game Changer
Hewlett Packard Entreprise | Stormrunner load | Game ChangerHewlett Packard Entreprise | Stormrunner load | Game Changer
Hewlett Packard Entreprise | Stormrunner load | Game Changer
 
MDK_Resume
MDK_ResumeMDK_Resume
MDK_Resume
 
7 Years of Experience
7 Years of Experience7 Years of Experience
7 Years of Experience
 
RamMohan_Testing_8Exp_Resume
RamMohan_Testing_8Exp_ResumeRamMohan_Testing_8Exp_Resume
RamMohan_Testing_8Exp_Resume
 

More from STAG Software Private Limited

Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
STAG Software Private Limited
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 

More from STAG Software Private Limited (20)

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 

Recently uploaded

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 

Recently uploaded (20)

JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 

Pre-deployment Performance Evaluation of Web-based Product

  • 1. CASE STUDY Pre-deployment Performance Evaluation of Web-based Product STAG certifies an eLearning product ‘deploy-ready’ after extensive LSPS evaluation, enabling our partner to successfully deploy it at the world's largest publicly funded health services organization. Technology - Web-based eLearning LCMS, Microsoft 2003 Server and Cold Fusion 8, Domain - Health Care Web Server with Database Server (SQL Server 2005) Tools - JMeter, AdventNet AppManager CUSTOMER AND PRODUCT BACKGROUND The customer is one of the world’s largest publicly funded health services providers based out of the UK, employing more than 1.7 million people, including 120,000 hospital doctors, 40,000 general practitioners, 400,000 nurses, and 25,000 ambulance staff. The product in question is an eLearning product developed by our UK partner. This tool covers a wide range of training needs and learning competencies to support the implementation and development of an information governance framework within an organization. PROBLEM STATEMENT Our UK partner sought our expertise in LSPS evaluation of the product, as desired by the customer before its deployment at the customer's place, for the following: • Load and performance capability • Ability to withstand concurrent loads • System scalability • Identification of potential bottlenecks (hardware, software, or network) An estimated 37,500 concurrent users were expected at peak usage times.
  • 2. SOLUTION The STAG team created the necessary test environment, developed a scalable automation framework, created a load Number of users: 15,000 profile, developed performance test scripts, and created test Bandwidth consumed: 31-50 Mbps data to test the eLearning application for loads of 15,000 and 20,000 respectively, using JMeter. Server side resources like Number of users: 20,000 CPU/Memory statistics of database and application servers Bandwidth consumed: 40-50 Mbps were monitored using AdventNet AppManager. Think time was considered between every transaction to ensure that the tests were realistic. In all, two test cycles were executed by the team. The performance metrics for the tests focused on end-user response times and resource utilization (CPU/memory). Based on this, the STAG team identified major suspect areas that could pose performance challenges and resolved them during the multiple simulated tests conducted on the application. The major suspect areas identified included: • High CPU utilization, up to 90%, of the DB server • Database deadlocks while the course data was being updated • Inconsistencies in the frequency of the course update sent by the application • Discrepancies in concurrency during a bulk upload scenario Based on the test reports, the STAG team made the following recommendations that would help achieve the performance objectives of the customer. • A minimum of 31 Mbps and 40 Mbps network lines for 15,000 and 20,000 users respectively • Web server CPU capacity upgrade to a dual core processor or to a CPU having two processors • Reduction of file size (GIF, JPG, etc.) and file compression (PDF, PPT, audio, etc.) to improve further the network utilization of the bandwidth, given that most eLearning course transactions involve a large volume of image downloads OUTCOME AND VALUE ADDITIONS The evaluation by the STAG team resulted in the product being certified to handle up to 20,000 users concurrently with no degradation in performance, which greatly enhanced the deployment confidence of the customer. STAG’s value addition was not limited to the technical aspects alone, it also included recommending the suitable hardware/network resources required to support the current and future load and performance requirements. Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2013 © STAG Software Private Limited. All rights reserved. All trademarks are acknowledged.