SlideShare a Scribd company logo
The Process of
PerformanceTesting
FromThe Art of PerformanceTesting, Chapter 4
Presentation by Sebastián Lagoueyte
Last-Minute Exercise
Limited time to test.You have to deploy at a certain date.
PerformanceTesting Approach
So you don’t fall to the same pitfall
Non-functional Requirements Capture
(NRC)
Step One
“A Scoping Exercise”
Gather performance NFRs from all relevant stakeholders.
At the very least
Deadlines
Resources (internal or external)
Test environment
Key use cases
Performance targets
Deliverables
Procedures
Allow enough time to
capture all of the Non-
Functional Requirements
This usually takes a couple of days
PerformanceTest Environment Build
StepTwo
Test environments
should be a close
approximation of the
production
environment.
To build:
1. Allow enough time to configure
2. Take into account all deployment models or environments
3. Also take into account links to external systems
4. Provide enough load injection capacity
5. Ensure that the application is correctly deployed
6. Provide software licenses
7. Deploy performance testing tool
8. Deploy Key Performance Indicator (KPI) monitoring
Use-Case Scripting
StepThree
Some use cases require more time to script
than others. Allow half a day per use-case.
Ideally, most of the work is done for you before testing.
For each
case, you
should…
Identify the session data requirements.
Usually happens after you begin.
Confirm and apply input data
requirements.
Decide how you will checkpoint the use
case.
Indentify and apply any scripting
changes required.
Ensure that the use case replays
correctly.
PerformanceTest Scenario Build
Step Four
This should be simple, since you should have defined
each performance test as part of your NRC.
Consider
What kind of test will this represent? (Pipe-clean, volume, soak, stress)
Decide how many load injectors and virtual users you require
Decide on each load injector profile (Big-Bang, Ramp-up, Ramp-
up/Ramp-down, delayed start)
How long will the test run for?
Do you need to spoof IP addresses?
Do you need to simulate different baud rates?
What runtime monitoring needs to be set up?
Any effects that the application technology will have on your test
PerformanceTest Execution
Step Five
Run and monitor your tests. Carry out a dress
rehearsal of each performance scenario.
This should be straightforward. It should be a matter of validating
your application’s performance targets.
The only unknown is how many test cycles will be
required.
Execution process order:
1. Execute dress-rehearsals or pipe-clean tests as a final
check
2. Execute volume tests
3. Execute isolation tests to explore revealed problems
4. Execute stress tests
5. Execute soak tests to reveal memory leaks
6. Execute any other tests that are not performance related
Allow a minimum of five days.
Reruns of the testing cycle will be required, since any problems that surface
during execution have to be dealt with
Post-Test Analysis and Reporting
Step Six
The final step consists of collecting and analyzing data
from all tests run
You also create reports, a performance baseline and possibly retest
Carry out final data collection
Uninstall software
Determine success or failure (following performance targets)
Document the results
QuestionsTime
Why should you ensure that the application is
correctly deployed? (in the test environment)
What’s the most common problem with
PerformanceTesting?
Thank

More Related Content

What's hot

AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
Peter Marshall
 
Testing introduction
Testing introductionTesting introduction
Testing introduction
FACTS Computer Software L.L.C
 
The best day for qa
The best day for qaThe best day for qa
The best day for qa
Julian Farizi
 
Sanity testing and smoke testing
Sanity testing and smoke testingSanity testing and smoke testing
Sanity testing and smoke testing
MUHAMMAD FARHAN ASLAM
 
How google-tests-software
How google-tests-softwareHow google-tests-software
How google-tests-software
Bhawna Tuteja
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
Axway Appcelerator
 
Embedded Testing 2015
Embedded Testing 2015Embedded Testing 2015
Embedded Testing 2015
Vassilis Rizopoulos
 
What is Regression Testing? | Edureka
What is Regression Testing? | EdurekaWhat is Regression Testing? | Edureka
What is Regression Testing? | Edureka
Edureka!
 
Software testing
Software testingSoftware testing
Software testing
nidhip216
 
Test automation in agile ecosystem
Test automation in agile ecosystemTest automation in agile ecosystem
Test automation in agile ecosystem
JohnRizer
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
pooja deshmukh
 
Regression testing
Regression testingRegression testing
Regression testing
Anamta Sayyed
 
Testing Attributes
Testing AttributesTesting Attributes
Testing AttributesAbiha Naqvi
 
What is component testing | David Tzemach
What is component testing | David TzemachWhat is component testing | David Tzemach
What is component testing | David Tzemach
David Tzemach
 
Testing 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be RequiredTesting 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be Required
ArleneAndrews2
 
Hello
HelloHello
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
Automation in the Bug Flow - Machine Learning for Triaging and TracingAutomation in the Bug Flow - Machine Learning for Triaging and Tracing
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
Markus Borg
 
Types of Non Functional Testing
Types of Non Functional TestingTypes of Non Functional Testing
Types of Non Functional Testing
iFour Technolab Pvt. Ltd.
 
User acceptance testing checklist (uat)
User acceptance testing checklist (uat)User acceptance testing checklist (uat)
User acceptance testing checklist (uat)
Checklists Here There And Everywhere
 
01 software testing_introduction
01 software testing_introduction01 software testing_introduction
01 software testing_introduction
ManishJha237
 

What's hot (20)

AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
 
Testing introduction
Testing introductionTesting introduction
Testing introduction
 
The best day for qa
The best day for qaThe best day for qa
The best day for qa
 
Sanity testing and smoke testing
Sanity testing and smoke testingSanity testing and smoke testing
Sanity testing and smoke testing
 
How google-tests-software
How google-tests-softwareHow google-tests-software
How google-tests-software
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
 
Embedded Testing 2015
Embedded Testing 2015Embedded Testing 2015
Embedded Testing 2015
 
What is Regression Testing? | Edureka
What is Regression Testing? | EdurekaWhat is Regression Testing? | Edureka
What is Regression Testing? | Edureka
 
Software testing
Software testingSoftware testing
Software testing
 
Test automation in agile ecosystem
Test automation in agile ecosystemTest automation in agile ecosystem
Test automation in agile ecosystem
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
 
Regression testing
Regression testingRegression testing
Regression testing
 
Testing Attributes
Testing AttributesTesting Attributes
Testing Attributes
 
What is component testing | David Tzemach
What is component testing | David TzemachWhat is component testing | David Tzemach
What is component testing | David Tzemach
 
Testing 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be RequiredTesting 3: Types Of Tests That May Be Required
Testing 3: Types Of Tests That May Be Required
 
Hello
HelloHello
Hello
 
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
Automation in the Bug Flow - Machine Learning for Triaging and TracingAutomation in the Bug Flow - Machine Learning for Triaging and Tracing
Automation in the Bug Flow - Machine Learning for Triaging and Tracing
 
Types of Non Functional Testing
Types of Non Functional TestingTypes of Non Functional Testing
Types of Non Functional Testing
 
User acceptance testing checklist (uat)
User acceptance testing checklist (uat)User acceptance testing checklist (uat)
User acceptance testing checklist (uat)
 
01 software testing_introduction
01 software testing_introduction01 software testing_introduction
01 software testing_introduction
 

Similar to The process of performance testing

The process of performance testing
The process of performance testingThe process of performance testing
The process of performance testing
Valeria Moreno Zapata
 
Performance testing reference model
Performance testing reference modelPerformance testing reference model
Performance testing reference model
Eduards Salnikovs
 
Test automation principles, terminologies and implementations
Test automation principles, terminologies and implementationsTest automation principles, terminologies and implementations
Test automation principles, terminologies and implementations
Steven Li
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
Clemens Reijnen
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2Yogindernath Gupta
 
Door to perfomance testing
Door to perfomance testingDoor to perfomance testing
Door to perfomance testing
Dharshana Kasun Warusavitharana
 
ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2
onsoftwaretest
 
Perofrmance testing and apache jmeter
Perofrmance testing and apache jmeterPerofrmance testing and apache jmeter
Perofrmance testing and apache jmeter
lethibichhoa
 
Software testing interview Q&A – Part 2
Software testing interview Q&A – Part 2Software testing interview Q&A – Part 2
Software testing interview Q&A – Part 2
Khoa Bui
 
Test planning.ppt
Test planning.pptTest planning.ppt
Test planning.ppt
UmmERayyan2
 
Fundamentals Performance Testing
Fundamentals Performance TestingFundamentals Performance Testing
Fundamentals Performance Testing
Bhuvaneswari Subramani
 
11 steps of testing process - By Harshil Barot
11 steps of testing process - By Harshil Barot11 steps of testing process - By Harshil Barot
11 steps of testing process - By Harshil Barot
Harshil Barot
 
ISTQBCH foundation level chapter 01 fundamentals of testing
ISTQBCH foundation level chapter 01 fundamentals of testingISTQBCH foundation level chapter 01 fundamentals of testing
ISTQBCH foundation level chapter 01 fundamentals of testing
KhalilSalhi5
 
Qtp training session I
Qtp training session IQtp training session I
Qtp training session IAisha Mazhar
 
ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1Yogindernath Gupta
 
Incorporating Performance Testing in Agile Development Process
Incorporating Performance Testing in Agile Development ProcessIncorporating Performance Testing in Agile Development Process
Incorporating Performance Testing in Agile Development Process
Michael Vax
 
ISTQB, ISEB Lecture Notes
ISTQB, ISEB Lecture NotesISTQB, ISEB Lecture Notes
ISTQB, ISEB Lecture Notes
onsoftwaretest
 
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f..." Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
Lohika_Odessa_TechTalks
 
How to fit Performance Testing in Devops environment.pptx.pdf
How to fit Performance Testing in Devops environment.pptx.pdfHow to fit Performance Testing in Devops environment.pptx.pdf
How to fit Performance Testing in Devops environment.pptx.pdf
Knoldus Inc.
 

Similar to The process of performance testing (20)

The process of performance testing
The process of performance testingThe process of performance testing
The process of performance testing
 
Performance testing reference model
Performance testing reference modelPerformance testing reference model
Performance testing reference model
 
Test automation principles, terminologies and implementations
Test automation principles, terminologies and implementationsTest automation principles, terminologies and implementations
Test automation principles, terminologies and implementations
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2ISTQB / ISEB Foundation Exam Practice - 2
ISTQB / ISEB Foundation Exam Practice - 2
 
Door to perfomance testing
Door to perfomance testingDoor to perfomance testing
Door to perfomance testing
 
ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2ISTQB, ISEB Lecture Notes- 2
ISTQB, ISEB Lecture Notes- 2
 
Perofrmance testing and apache jmeter
Perofrmance testing and apache jmeterPerofrmance testing and apache jmeter
Perofrmance testing and apache jmeter
 
Software testing interview Q&A – Part 2
Software testing interview Q&A – Part 2Software testing interview Q&A – Part 2
Software testing interview Q&A – Part 2
 
Test planning.ppt
Test planning.pptTest planning.ppt
Test planning.ppt
 
Fundamentals Performance Testing
Fundamentals Performance TestingFundamentals Performance Testing
Fundamentals Performance Testing
 
11 steps of testing process - By Harshil Barot
11 steps of testing process - By Harshil Barot11 steps of testing process - By Harshil Barot
11 steps of testing process - By Harshil Barot
 
ISTQBCH foundation level chapter 01 fundamentals of testing
ISTQBCH foundation level chapter 01 fundamentals of testingISTQBCH foundation level chapter 01 fundamentals of testing
ISTQBCH foundation level chapter 01 fundamentals of testing
 
Qa documentation pp
Qa documentation ppQa documentation pp
Qa documentation pp
 
Qtp training session I
Qtp training session IQtp training session I
Qtp training session I
 
ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1ISTQB / ISEB Foundation Exam Practice -1
ISTQB / ISEB Foundation Exam Practice -1
 
Incorporating Performance Testing in Agile Development Process
Incorporating Performance Testing in Agile Development ProcessIncorporating Performance Testing in Agile Development Process
Incorporating Performance Testing in Agile Development Process
 
ISTQB, ISEB Lecture Notes
ISTQB, ISEB Lecture NotesISTQB, ISEB Lecture Notes
ISTQB, ISEB Lecture Notes
 
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f..." Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
" Performance testing for Automation QA - why and how " by Andrey Kovalenko f...
 
How to fit Performance Testing in Devops environment.pptx.pdf
How to fit Performance Testing in Devops environment.pptx.pdfHow to fit Performance Testing in Devops environment.pptx.pdf
How to fit Performance Testing in Devops environment.pptx.pdf
 

Recently uploaded

top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
vrstrong314
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
Tier1 app
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
Srikant77
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
Fermin Galan
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
e20449
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
Ortus Solutions, Corp
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 

Recently uploaded (20)

top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
SOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar Research Team: Latest Activities of IntelBroker
SOCRadar Research Team: Latest Activities of IntelBroker
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 

The process of performance testing

  • 1. The Process of PerformanceTesting FromThe Art of PerformanceTesting, Chapter 4 Presentation by Sebastián Lagoueyte
  • 2. Last-Minute Exercise Limited time to test.You have to deploy at a certain date.
  • 3. PerformanceTesting Approach So you don’t fall to the same pitfall
  • 5. “A Scoping Exercise” Gather performance NFRs from all relevant stakeholders.
  • 6. At the very least Deadlines Resources (internal or external) Test environment Key use cases Performance targets Deliverables Procedures
  • 7. Allow enough time to capture all of the Non- Functional Requirements This usually takes a couple of days
  • 9. Test environments should be a close approximation of the production environment.
  • 10. To build: 1. Allow enough time to configure 2. Take into account all deployment models or environments 3. Also take into account links to external systems 4. Provide enough load injection capacity 5. Ensure that the application is correctly deployed 6. Provide software licenses 7. Deploy performance testing tool 8. Deploy Key Performance Indicator (KPI) monitoring
  • 12. Some use cases require more time to script than others. Allow half a day per use-case. Ideally, most of the work is done for you before testing.
  • 13. For each case, you should… Identify the session data requirements. Usually happens after you begin. Confirm and apply input data requirements. Decide how you will checkpoint the use case. Indentify and apply any scripting changes required. Ensure that the use case replays correctly.
  • 15. This should be simple, since you should have defined each performance test as part of your NRC.
  • 16. Consider What kind of test will this represent? (Pipe-clean, volume, soak, stress) Decide how many load injectors and virtual users you require Decide on each load injector profile (Big-Bang, Ramp-up, Ramp- up/Ramp-down, delayed start) How long will the test run for? Do you need to spoof IP addresses? Do you need to simulate different baud rates? What runtime monitoring needs to be set up? Any effects that the application technology will have on your test
  • 18. Run and monitor your tests. Carry out a dress rehearsal of each performance scenario. This should be straightforward. It should be a matter of validating your application’s performance targets. The only unknown is how many test cycles will be required.
  • 19. Execution process order: 1. Execute dress-rehearsals or pipe-clean tests as a final check 2. Execute volume tests 3. Execute isolation tests to explore revealed problems 4. Execute stress tests 5. Execute soak tests to reveal memory leaks 6. Execute any other tests that are not performance related
  • 20. Allow a minimum of five days. Reruns of the testing cycle will be required, since any problems that surface during execution have to be dealt with
  • 21. Post-Test Analysis and Reporting Step Six
  • 22. The final step consists of collecting and analyzing data from all tests run You also create reports, a performance baseline and possibly retest
  • 23. Carry out final data collection Uninstall software Determine success or failure (following performance targets) Document the results
  • 25. Why should you ensure that the application is correctly deployed? (in the test environment) What’s the most common problem with PerformanceTesting?
  • 26. Thank