SlideShare a Scribd company logo
Performance testing for small
projects with JMeter
Max Voitko Test Automation Engineer @ glomex GmbH
#KyivTesters
Introduction
For Whom?
Small-Medium Companies

Small Startup

Big Startup

Facebook Killer

E-commerce Giant
Agenda
Why does performance matter?

Why JMeter?

How to define requirements?

What metrics to track?

How to report?

Tips & Tricks
Why does Performance Matter?
Netflix – Adopting a single optimization, gzip compression, resulted in a 13-25% speedup
and cut their outbound network traffic by 50%

100ms improvement gives up to 1% incremental revenue

47% of consumers expect a web page to load in 2 seconds or less. Kiss Metrics

Cedexis Analytics says that improving page load time by 1 second:

• Increases pages viewed, per session by an average of 13.3% more pages

• Decreases “bounce” rate by an average of 13.9%

• Improves conversion rate by an average of 27.3%, across various conversion types:
downloads, purchases, video playouts, etc.
Mobile is the New Web
Why does Performance Matter?
Why JMeter?
Open-source

Integrations: Selenium, Maven, Jenkins, DB, Grafana… 

3-rd party plugins: Ubik Load Pack, BlazeMeter 

Easy Remote testing 

Multi-Protocol Support: HTTP, SOAP, FTP, JMS, WebSocket, LDAP 

Wide services support: POP3, IMAP4, SMTP

Scaling
JMeter Trade-Offs
Distributed testing

UI-oriented

Inflexible Test Run from the Box

Tricky HTTPS handling

JVM Memory consumption

GUI Test Scripting / No Code Scripting
How to Define Requirements?
Define test strategy and test plan

Know your goals

Crucial business features

Technical bottlenecks

QA expertise
How to Define Requirements?
Whenever you want…

Just Do It
Define Test Strategy and Test Plan
How to Define Requirements?
Until you know your goals you are
ship that journeys through storm and
darkness
Know Your Goals
The Tempest, 1886 by Ivan Aivazovsky
How to Define Requirements?
Define system performance capabilities and bottlenecks

Validate that the application performs properly

Validate that the application conforms to business performance needs

Find, analyze, and help fixing performance problems

Validate the hardware for the application is reasonable

Plan capacity for application future demand

Reach specific performance metrics

Assure that performance doesn’t degrade after changes
Know Your Goals
How to Define Requirements?
Discuss with Product Responsible (PO / PM / RM / BA):

Load

Number of users. Real user != Virtual User

Transactions

Blocker, Acceptable and Excellent performance UX metrics

Crucial Business Features
How to Define Requirements?
Technical bottlenecks:

DB

Autoscaling

Downscaling
Know Your Goals
What Metrics to Track?
Metrics
What to Test?
More metrics = More listeners

More listeners = Poorer performance
Metrics
What Metrics to Track?
Response Time (RT), ms

Throughput, RPS / Concurrent VU

Latency / TtFB, ms

Resource usage: CPU, Memory, Disk

Stability / RT over Time
Key Metrics
How to Report?
Master your Data

Fancy stats are for tech guys not for management

Must have tools:

Blazemeter Sense

Ubik Load Pack
How to Report?
Average numbers are bad metrics

Average numbers are good for tuning the max / min values

90% / 95% / 99% Percentiles

Plots:

RT over Time

RT Distribution

RT Percentiles

Transactions over Time
Master Your Data
BAD Report
GOOD Report
How to Report?
Master Your Data
How to Report?
Master Your Data
How to Report?
Master Your Data
Tips & Tricks
Always run tests in non-GUI mode

Upgrade Stage to Prod replica for test run

Separate property file

Use short smoke test FIRST

Careful DEBUG logging for test creation

Careful INFO logging for test run

Generate reports ONLY after test run

Model load with Ubik Load Pack

Blazemeter Sense reports
Questions
Question the Answers
Maksym Voitko
Twitter

LinkedIn

Medium

@MaxVoitko

mvoitko

@mvoitko

More Related Content

What's hot

Automatic Performance Modelling from Application Performance Management (APM)...
Automatic Performance Modelling from Application Performance Management (APM)...Automatic Performance Modelling from Application Performance Management (APM)...
Automatic Performance Modelling from Application Performance Management (APM)...
Paul Brebner
 
11 Reasons Why You Too Need To Outsource Mobile App Testing
11 Reasons Why You Too Need To Outsource Mobile App Testing11 Reasons Why You Too Need To Outsource Mobile App Testing
11 Reasons Why You Too Need To Outsource Mobile App Testing
Maruti Techlabs
 
Lessons learned from building (and failing) recommender systems
Lessons learned from building (and failing) recommender systemsLessons learned from building (and failing) recommender systems
Lessons learned from building (and failing) recommender systems
Farouq Oyebiyi
 
CustomerCount Capabilities
CustomerCount CapabilitiesCustomerCount Capabilities
CustomerCount Capabilities
Mobius Vendor Partners
 
Visual Performance Management
Visual Performance ManagementVisual Performance Management
Visual Performance Management
Liam Mills
 
Appdynamics Training Session
Appdynamics Training SessionAppdynamics Training Session
Appdynamics Training Session
CodvaTech Labs
 
Interaction feedback
Interaction feedbackInteraction feedback
Interaction feedback
Communications Products, Inc.
 
How to select and Implement an ERP System
How to select and Implement an ERP SystemHow to select and Implement an ERP System
How to select and Implement an ERP System
Shalini Saha
 
PROGNOSIS for Web Applications
PROGNOSIS for Web ApplicationsPROGNOSIS for Web Applications
PROGNOSIS for Web Applications
antoni0martin
 
Developing a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a WeekDeveloping a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a Week
Salesforce Developers
 
Developing a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a WeekDeveloping a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a Week
Salesforce Developers
 
Batch Jobs: Beyond the Basics
Batch Jobs: Beyond the BasicsBatch Jobs: Beyond the Basics
Batch Jobs: Beyond the Basics
Salesforce Developers
 
July Mobility Ffield
July Mobility FfieldJuly Mobility Ffield
July Mobility Ffield
UCUOM
 
CRM-Presenation
CRM-PresenationCRM-Presenation
CRM-Presenation
Qamar Iqbal (1000+)
 
Webinar: Drive Financial Services Innovation Through IT Automation
Webinar: Drive Financial Services Innovation Through IT AutomationWebinar: Drive Financial Services Innovation Through IT Automation
Webinar: Drive Financial Services Innovation Through IT Automation
CFEngine
 

What's hot (15)

Automatic Performance Modelling from Application Performance Management (APM)...
Automatic Performance Modelling from Application Performance Management (APM)...Automatic Performance Modelling from Application Performance Management (APM)...
Automatic Performance Modelling from Application Performance Management (APM)...
 
11 Reasons Why You Too Need To Outsource Mobile App Testing
11 Reasons Why You Too Need To Outsource Mobile App Testing11 Reasons Why You Too Need To Outsource Mobile App Testing
11 Reasons Why You Too Need To Outsource Mobile App Testing
 
Lessons learned from building (and failing) recommender systems
Lessons learned from building (and failing) recommender systemsLessons learned from building (and failing) recommender systems
Lessons learned from building (and failing) recommender systems
 
CustomerCount Capabilities
CustomerCount CapabilitiesCustomerCount Capabilities
CustomerCount Capabilities
 
Visual Performance Management
Visual Performance ManagementVisual Performance Management
Visual Performance Management
 
Appdynamics Training Session
Appdynamics Training SessionAppdynamics Training Session
Appdynamics Training Session
 
Interaction feedback
Interaction feedbackInteraction feedback
Interaction feedback
 
How to select and Implement an ERP System
How to select and Implement an ERP SystemHow to select and Implement an ERP System
How to select and Implement an ERP System
 
PROGNOSIS for Web Applications
PROGNOSIS for Web ApplicationsPROGNOSIS for Web Applications
PROGNOSIS for Web Applications
 
Developing a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a WeekDeveloping a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a Week
 
Developing a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a WeekDeveloping a Recall App on Force.com in a Week
Developing a Recall App on Force.com in a Week
 
Batch Jobs: Beyond the Basics
Batch Jobs: Beyond the BasicsBatch Jobs: Beyond the Basics
Batch Jobs: Beyond the Basics
 
July Mobility Ffield
July Mobility FfieldJuly Mobility Ffield
July Mobility Ffield
 
CRM-Presenation
CRM-PresenationCRM-Presenation
CRM-Presenation
 
Webinar: Drive Financial Services Innovation Through IT Automation
Webinar: Drive Financial Services Innovation Through IT AutomationWebinar: Drive Financial Services Innovation Through IT Automation
Webinar: Drive Financial Services Innovation Through IT Automation
 

Similar to Performance Testing For Small Projects

Show Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business ResultsShow Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business Results
Correlsense
 
Solving 21st Century App Performance Problems Without 21 People
Solving 21st Century App Performance Problems Without 21 PeopleSolving 21st Century App Performance Problems Without 21 People
Solving 21st Century App Performance Problems Without 21 People
Dynatrace
 
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
Galaxy Weblinks
 
Mindtree's performance engineering services.
Mindtree's performance engineering services.Mindtree's performance engineering services.
Mindtree's performance engineering services.
Mindtree Ltd.
 
The Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web ServiceThe Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web Service
Poornima Vijayashanker
 
Accelerate and Streamline Performance Testing with AI-powered Test Automation...
Accelerate and Streamline Performance Testing with AI-powered Test Automation...Accelerate and Streamline Performance Testing with AI-powered Test Automation...
Accelerate and Streamline Performance Testing with AI-powered Test Automation...
RohitBhandari66
 
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
Data Con LA
 
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
Dakiry
 
Improving Speed to Market in E-commerce
Improving Speed to Market in E-commerceImproving Speed to Market in E-commerce
Improving Speed to Market in E-commerce
Cognizant
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro
Mykola Kovsh
 
T3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of ExcellenceT3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of Excellence
veehikle
 
Coradiant
CoradiantCoradiant
Coradiant
gigamon
 
Magical Performance tuning with Gomez
Magical Performance tuning with GomezMagical Performance tuning with Gomez
Magical Performance tuning with Gomez
mcsaha
 
Are You Ready For More Visitors Cognizant Gomez Jan20
Are You Ready For More Visitors   Cognizant  Gomez Jan20Are You Ready For More Visitors   Cognizant  Gomez Jan20
Are You Ready For More Visitors Cognizant Gomez Jan20
Compuware APM
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
sarah david
 
From web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that mattersFrom web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that matters
ManageEngine, Zoho Corporation
 
Performance Optimization: Incorporating Database and Code Optimzitation Into ...
Performance Optimization: Incorporating Database and Code Optimzitation Into ...Performance Optimization: Incorporating Database and Code Optimzitation Into ...
Performance Optimization: Incorporating Database and Code Optimzitation Into ...
Michael Findling
 
Applying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformanceApplying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website Performance
PostSharp Technologies
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
Impetus Technologies
 
Gomez
GomezGomez

Similar to Performance Testing For Small Projects (20)

Show Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business ResultsShow Me the Money: Connecting Performance Engineering to Real Business Results
Show Me the Money: Connecting Performance Engineering to Real Business Results
 
Solving 21st Century App Performance Problems Without 21 People
Solving 21st Century App Performance Problems Without 21 PeopleSolving 21st Century App Performance Problems Without 21 People
Solving 21st Century App Performance Problems Without 21 People
 
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
 
Mindtree's performance engineering services.
Mindtree's performance engineering services.Mindtree's performance engineering services.
Mindtree's performance engineering services.
 
The Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web ServiceThe Evolution of a Scrappy Startup to a Successful Web Service
The Evolution of a Scrappy Startup to a Successful Web Service
 
Accelerate and Streamline Performance Testing with AI-powered Test Automation...
Accelerate and Streamline Performance Testing with AI-powered Test Automation...Accelerate and Streamline Performance Testing with AI-powered Test Automation...
Accelerate and Streamline Performance Testing with AI-powered Test Automation...
 
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
Data Con LA 2022 - Why Data Quality vigilance requires an End-to-End, Automat...
 
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
Микола Ковш “Performance Testing Implementation From Scratch. Why? When and H...
 
Improving Speed to Market in E-commerce
Improving Speed to Market in E-commerceImproving Speed to Market in E-commerce
Improving Speed to Market in E-commerce
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro
 
T3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of ExcellenceT3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of Excellence
 
Coradiant
CoradiantCoradiant
Coradiant
 
Magical Performance tuning with Gomez
Magical Performance tuning with GomezMagical Performance tuning with Gomez
Magical Performance tuning with Gomez
 
Are You Ready For More Visitors Cognizant Gomez Jan20
Are You Ready For More Visitors   Cognizant  Gomez Jan20Are You Ready For More Visitors   Cognizant  Gomez Jan20
Are You Ready For More Visitors Cognizant Gomez Jan20
 
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdfimplementing_ai_for_improved_performance_testing_the_key_to_success.pdf
implementing_ai_for_improved_performance_testing_the_key_to_success.pdf
 
From web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that mattersFrom web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that matters
 
Performance Optimization: Incorporating Database and Code Optimzitation Into ...
Performance Optimization: Incorporating Database and Code Optimzitation Into ...Performance Optimization: Incorporating Database and Code Optimzitation Into ...
Performance Optimization: Incorporating Database and Code Optimzitation Into ...
 
Applying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformanceApplying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website Performance
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
 
Gomez
GomezGomez
Gomez
 

Recently uploaded

AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdfAI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
Techgropse Pvt.Ltd.
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 

Recently uploaded (20)

AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdfAI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
AI-Powered Food Delivery Transforming App Development in Saudi Arabia.pdf
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 

Performance Testing For Small Projects

  • 1. Performance testing for small projects with JMeter Max Voitko Test Automation Engineer @ glomex GmbH #KyivTesters
  • 3. For Whom? Small-Medium Companies Small Startup Big Startup Facebook Killer E-commerce Giant
  • 4. Agenda Why does performance matter? Why JMeter? How to define requirements? What metrics to track? How to report? Tips & Tricks
  • 5. Why does Performance Matter? Netflix – Adopting a single optimization, gzip compression, resulted in a 13-25% speedup and cut their outbound network traffic by 50% 100ms improvement gives up to 1% incremental revenue 47% of consumers expect a web page to load in 2 seconds or less. Kiss Metrics Cedexis Analytics says that improving page load time by 1 second: • Increases pages viewed, per session by an average of 13.3% more pages • Decreases “bounce” rate by an average of 13.9% • Improves conversion rate by an average of 27.3%, across various conversion types: downloads, purchases, video playouts, etc.
  • 6. Mobile is the New Web Why does Performance Matter?
  • 7. Why JMeter? Open-source Integrations: Selenium, Maven, Jenkins, DB, Grafana… 3-rd party plugins: Ubik Load Pack, BlazeMeter Easy Remote testing Multi-Protocol Support: HTTP, SOAP, FTP, JMS, WebSocket, LDAP Wide services support: POP3, IMAP4, SMTP Scaling
  • 8. JMeter Trade-Offs Distributed testing UI-oriented Inflexible Test Run from the Box Tricky HTTPS handling JVM Memory consumption GUI Test Scripting / No Code Scripting
  • 9. How to Define Requirements? Define test strategy and test plan Know your goals Crucial business features Technical bottlenecks QA expertise
  • 10. How to Define Requirements? Whenever you want… Just Do It Define Test Strategy and Test Plan
  • 11. How to Define Requirements? Until you know your goals you are ship that journeys through storm and darkness Know Your Goals The Tempest, 1886 by Ivan Aivazovsky
  • 12. How to Define Requirements? Define system performance capabilities and bottlenecks Validate that the application performs properly Validate that the application conforms to business performance needs Find, analyze, and help fixing performance problems Validate the hardware for the application is reasonable Plan capacity for application future demand Reach specific performance metrics Assure that performance doesn’t degrade after changes Know Your Goals
  • 13. How to Define Requirements? Discuss with Product Responsible (PO / PM / RM / BA): Load Number of users. Real user != Virtual User Transactions Blocker, Acceptable and Excellent performance UX metrics Crucial Business Features
  • 14. How to Define Requirements? Technical bottlenecks: DB Autoscaling Downscaling Know Your Goals
  • 15. What Metrics to Track? Metrics
  • 16. What to Test? More metrics = More listeners More listeners = Poorer performance Metrics
  • 17. What Metrics to Track? Response Time (RT), ms Throughput, RPS / Concurrent VU Latency / TtFB, ms Resource usage: CPU, Memory, Disk Stability / RT over Time Key Metrics
  • 18. How to Report? Master your Data Fancy stats are for tech guys not for management Must have tools: Blazemeter Sense Ubik Load Pack
  • 19. How to Report? Average numbers are bad metrics Average numbers are good for tuning the max / min values 90% / 95% / 99% Percentiles Plots: RT over Time RT Distribution RT Percentiles Transactions over Time Master Your Data
  • 25. Tips & Tricks Always run tests in non-GUI mode Upgrade Stage to Prod replica for test run Separate property file Use short smoke test FIRST Careful DEBUG logging for test creation Careful INFO logging for test run Generate reports ONLY after test run Model load with Ubik Load Pack Blazemeter Sense reports