Global Testing Retreat
#ATAGTR2023
P E R F O R M A N C E E N G I N E E R I N G W I T H
A I / M L
SUJEET KUMAR MAURYA
Global Testing Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Introduction : Problem Statement
AI The Magician : Advantages
Unleashing the power of AI : Roles
The Gamechanger : Best Practices
Global Testing Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
Introduction : Problem Statement
AI The Magician : Advantages
The Gamechanger : Market tools
I N T R O D U C T I O N : P R O B L E M S TAT E M E N T
Identifying accurate business scenarios and
NFR for performance testing
Identifying high quality test data for
business-critical scenarios
Identifying performance bottleneck
and forecasting accuracy
Time consuming and manual process
in scripting real user experience
Top 4 pain areas in End to End Performance Testing/Engineering
45% users expects application to load in 2seconds or less 40% users leave application if loading takes more than 3 seconds
Global Testing Retreat
#ATAGTR2023
Global Testing Retreat
#ATAGTR2023
A I T H E M A G I C I A N : A D V A N TA G E S
Faster decision making
Accurate analysis and helps fine tuning
Visual testing pattern recognition
In depth error detection
Enhanced monitoring
Cost effectiveness
Advantages
Reduction in overall
manual efforts
80%
Reduction in performance
defect leakage to PROD
10% 90%
Savings : Person hours
per sprint
98%
Accurate forecasting of the
application performance and
resources
Global Testing Retreat
#ATAGTR2023
U N L E A S H I N G T H E P O W E R O F A I
R O L E I N P E R F O R M A N C E E N G I N E E R I N G
Global Testing Retreat
#ATAGTR2023
T H E G A M E C H A N G E R : B E S T P R A C T I C E S
Traditional ways of NFT require lots of manual efforts, time and may not be as accurate. Implementing AI/ML will
reduce these efforts and optimize the efficiency of the performance engineering.
Almost all the cloud providers like Google cloud and AWS nowadays provide great AI/ML models as a service which
doesn’t require any specific level of expertise of AI/ML beforehand
Test for users Choose right AI tool
Codeless
performance scripts
Best practice for AI based Performance Engineering
Global Testing Retreat
#ATAGTR2023
T H A N K Y O U

#Interactive Session by Sujeet Kumar Maurya, "Performance engineering with AI/ML" at #ATAGTR2023.

  • 1.
    Global Testing Retreat #ATAGTR2023 PE R F O R M A N C E E N G I N E E R I N G W I T H A I / M L SUJEET KUMAR MAURYA Global Testing Retreat #ATAGTR2023
  • 2.
    Global Testing Retreat #ATAGTR2023 GlobalTesting Retreat #ATAGTR2023 Introduction : Problem Statement AI The Magician : Advantages Unleashing the power of AI : Roles The Gamechanger : Best Practices
  • 3.
    Global Testing Retreat #ATAGTR2023 GlobalTesting Retreat #ATAGTR2023 Introduction : Problem Statement AI The Magician : Advantages The Gamechanger : Market tools I N T R O D U C T I O N : P R O B L E M S TAT E M E N T Identifying accurate business scenarios and NFR for performance testing Identifying high quality test data for business-critical scenarios Identifying performance bottleneck and forecasting accuracy Time consuming and manual process in scripting real user experience Top 4 pain areas in End to End Performance Testing/Engineering 45% users expects application to load in 2seconds or less 40% users leave application if loading takes more than 3 seconds
  • 4.
    Global Testing Retreat #ATAGTR2023 GlobalTesting Retreat #ATAGTR2023 A I T H E M A G I C I A N : A D V A N TA G E S Faster decision making Accurate analysis and helps fine tuning Visual testing pattern recognition In depth error detection Enhanced monitoring Cost effectiveness Advantages Reduction in overall manual efforts 80% Reduction in performance defect leakage to PROD 10% 90% Savings : Person hours per sprint 98% Accurate forecasting of the application performance and resources
  • 5.
    Global Testing Retreat #ATAGTR2023 UN L E A S H I N G T H E P O W E R O F A I R O L E I N P E R F O R M A N C E E N G I N E E R I N G
  • 6.
    Global Testing Retreat #ATAGTR2023 TH E G A M E C H A N G E R : B E S T P R A C T I C E S Traditional ways of NFT require lots of manual efforts, time and may not be as accurate. Implementing AI/ML will reduce these efforts and optimize the efficiency of the performance engineering. Almost all the cloud providers like Google cloud and AWS nowadays provide great AI/ML models as a service which doesn’t require any specific level of expertise of AI/ML beforehand Test for users Choose right AI tool Codeless performance scripts Best practice for AI based Performance Engineering
  • 7.