SlideShare a Scribd company logo
Load Test Drupal Site
Using Apache JMeter & Amazon AWS
By Vladimir Ilic
@burgerboydaddy
About me
• twitter: @burgerboydaddy
• http://burgerboydaddy.com
Quote
• “The designer is concerned with what happens
when 1 user presses a button and the architect
is concerned with what happens when 10,000
users press a button.”
• Sun Certified Enterprise Architect for J2EE Technology Study Guide. Page 6. Mark Cade, Simon Roberts.
2007 JavaOneSM Conference | Session TS-9235 | 2
4
Test Types
• Performance
• Load
• Stress
• Scalability
• Endurance
• Functional
Performance Testing
• Performance testing determines or validates the
speed of the application
(X per T).
• Used for finding bottlenecks and establish
baseline for the system.
• In other words it’s solo purpose is to determine
the response and effectiveness of a system.
Load Testing
• Load testing identifies the maximum operating
capacity of an application as well as any
bottlenecks that might interfere with its
operating capacity.
(or, when does it blow up?)
Stress Testing
• Stress testing is focused on determining an
application’s robustness, availability, and
reliability under extreme conditions
– Heavy loads
– High concurrency
– Limited computational resources
• An attempt to break the system by
overwhelming its resources
Scalability
• Scalability testing determines or validates
whether adding another Y resource (database,
memory, disk, CPU, etc) increases speed of X
proportionally
Endurance Testing
This type of testing is used to check that the system can withstand
the load for a long or large number of transactions.
Preparation for a Test
• Mission
• Network
• Hardware
• Software
• Metrics
Mission
• What is the testing intended to achieve?
• What are basic assumptions like:
– What is our anticipated average number of users
(normal load)?
– What is our anticipated peak number of users?
• When is a good time to load-test our
application (i.e. off-hours or weekends),
bearing in mind that this may very well crash
one or more of our servers?
Environment Prep - Network
• Performance testing is usually network
intensive operation and can affect others in the
organization
• Testing should be done on a separated /
segregated network
• Amazon AWS – virtually unlimited
in/out speed
Environment Prep – Hardware
• Is your machine ready to receive full load?
• Are multiple machine available (for distributed
testing)?
• Do you have enough resources
• Again – Amazon to the rescue – AWS gives you
as many test machines as you need.
Metrics
• Performance testing is all about numbers and
metrics
• Determine which metrics you are concerned about
and how to get them.
• Some simple tests / benchmarks can be done using
Apache Bench “ab” command:
•
Suppose we want to see how fast our site can handle 100 requests, with a
maximum of 10 requests running concurrently:
• ab -n 100 -c 10 http://example.dev/
JMeter – Software of Choice
• Open source desktop / server application
• Designed for functional/load/performance/stress testing
• Extensible… write your own test
• Simulate heavy load (application, server and network)
• Gives instant visual feedback
• Distributed testing
• Various protocols - HTTP, FTP, JDBC, JMS, LDAP, SOAP
• Multi-platform
• Full multithreading framework
• Caching and offline analysis/replaying of test results.
• JMeter is not a web browser!
JMeter vs. Real World
Real World JMeter World
One User Browser request HTTP Request Sampler
One HTML page display with JavaScript
Execution
View Tree Listener with basic HTML
display.
No JavaScript execution
Multiple Users Requesting Pages
Simultaneously
Thread Group Configured for Number of Users,
uses the same HTTP Request Sampler to
simulate multiple users
No Equivalent
Difficult to do
Measuring performance like min, max, and
average (avg) time for processing using
Summary Report Listener
JMeter - Terminology
JMeter Term Meaning
Test Plan - You keep your test plan under me
- Only one per one JMeter window
- Save it for a future use
Thread Group - Represent one set of action – one scenario
- You add actions that single user will do
- JMeter will use them to simulate multiple users
HTTP Request Sampler - Record the request to web server
- Also receive the response from Web server
- Provide all data received for analysis
View Tree Listener - Show the test data in details for each item
- For HTTP Request it show’s Request, Response and Status of
Transaction
Summary Report Listener - Show aggregated values for all users
- Useful when multiple users are simulated
- Provide performance information
17
JMeter Testing Tools
• Test Plan
• Thread Group
• Controllers:
– Samplers &
– Logical Controllers
• Listeners
• Timers
• Assertions
• Configuration Elements
• Pre-Processor Elements
• Post-Processor Elements
• Pre-Processor Elements
• A Pre-Processor executes some action prior to a Sampler Request
being made.
• If a Pre-Processor is attached to a Sampler element, then it will
execute just prior to that sampler element running.
• A Pre-Processor is most often used to modify the settings of a
Sample Request just before it runs, or to update variables that aren't
extracted from response text.
• Post-Processor Elements
• A Post-Processor executes some action after a Sampler Request has
been made.
• If a Post-Processor is attached to a Sampler element, then it will
execute just after that sampler element runs.
• A Post-Processor is most often used to process the response data,
often to extract values from it. See the scoping rules for more details
on when Post-Processors are executed.
Execution order
1. Configuration elements
2. Pre-Processors
3. Timers
4. Sampler
5. Post-Processors (unless SampleResult is null)
6. Assertions (unless SampleResult is null)
7. Listeners (unless SampleResult is null)
• Timers, Assertions, Pre- and Post-Processors are only processed if there is a
sampler to which they apply.
• Logic Controllers and Samplers are processed in the order in which they appear in
the tree.
• Other test elements are processed according to the scope in which they are found,
and the type of test element
JMeter – Basic Elements
21
JMeter – Basic Elements
• “number of threads” - In other words, this variable is the number of users
executing a “real life” use case on your system.
• This number is not the number of concurrent / parallel users executing a “real
life” use case on your system:
• the concurrency of the users depends on both the duration of your scenario
and the ramp up time configured on the thread group.
• The “ramp up time” in a thread group is the actual time taken by JMeter to
spawn all the threads.
• A rough estimation of the throughput (number of requests per second) during
the ramp up period of your test plan is:
number of threads / ramp up time (in seconds).
Tips & Tricks
• You should try to have a constant throughput during a run:
It is often very difficult to “control” the throughput particularly
during the ramp up period
• If your objective is to simulate a “peak”:
You should have a “high” number of threads and a “low” ramp
up time and number of loops
• If your objective is to simulate a “long run”:
You should have a “medium” number of threads, a “higher”
ramp up time and a “high” number of loops
• Note: The terms “high”, “higher”, “medium” and “low” are
voluntary qualitative in the 2 bullets above as they depend on
the system you are testing.
JMeter – HTTP Request Defaults
JMeter – Adding HTTP Requests
• The “HTTP Request Default” elements does not tell
JMeter to send an HTTP request. It simply defines
the default values that the HTTP Request elements
use.
• In our test plan we need to add at least one “HTTP
Request Sampler”.
• JMeter sends requests in the order that they
appear in the tree.
• Add HTTP Request to the JMeter Users element
(Add->Sampler->HTTP Request).
JMeter – HTTP Request
JMeter - Listener
• The final element you need to add is a
Listener.
• This element is responsible for storing all of
the results of your HTTP requests in a file and
presenting a visual model of the data.
• Select the JMeter Users element and add a
Graph Result Listener and Summary Report
Listener. (Add->Listener->Graph Results).
JMeter - Listener
Distributed Testing Using JMeter
29
The Cloud and Load Testing
• One of the things the Cloud is useful for is load testing;
very large amounts of hardware can be used to generate
load at minimal cost.
• Added benefit, if your application you are testing is
external to your corporate network, your tests will be run
from a realistic location which prevents any problems
with artificial bottlenecks occurring on your LAN.
• This type of testing, using externally located hosts, is
increasingly common and JMeter is a superb open-source
solution for facilitating this.
Easy Amazon AWS & JMeter
• Thanks to Oliver from http503.com and his
automated JMeter on EC2 script
http://www.http503.com/2012/run-JMeter-on-amazon-
ec2-cloud
• Run with up to 20 concurrent EC2 instances
(default max number)
• Run when you want it and how you want it!
JMeter – http503.com script
• It does things like:
– Using Amazon’s API to launch instances
– Installing JAVA & JMeter
– Copying test files to each server
– Adjusting thread counts to ensure the load is evenly
distributed over each host
– Editing the jmx for file paths to external data files
– Displaying real-time aggregated results from the test as it
is running
– Downloading and collating all jtl files
– Terminating instances.
32
JMeter-EC2
• Prerequisites
– Test plan to be run has a Generate Summary Results listener.
– Your JMeter test plan has a duration or loop count value set.
• Prerequisites specific to using Amazon:
– That you have an Amazon AWS account.
– You have Amazon’s API tools installed on your machine.
• Note: you can control execution from your local machine,
but you will need to open few ports for data return. Difficult
if you are behind corporate firewall/proxy.
– Solution: Run controller on Amazon AWS (another EC2 instance)
33
Installation Process
• Go to the:
http://www.http503.com/2012/run-jmeter-on-amazon-ec2-
cloud/#example
• Small tips
– Create security group with port 22 open to the world (or
your IP address).
– Also allow all machines inside security group to access
each other.
34
JMeter-EC2
• Setup your machine image key, and your
secret key pair.
– Call it:
project="myblogtestplan" count="3" owner="Vlad”
./jmeter-ec2.sh
DEMO TIME
36
Results Analysis
• Running a test plan is only 50% of the
performance testing task.
• The most challenging part of the performance
testing process is the analysis of test results
and the identification of bottlenecks.
• Think of the load testing reports as the
evidentiary support to prove your innocence to
a crime in court.
Just a moment please…
• Before going any further, we should spend some time
on the measurable outcomes of a stress test. There are
mainly 2 interesting measures that you can record
when you run a stress test on a web application:
• The throughput: is the number of requests per unit of
time (seconds, minutes, hours) that are sent to your
server during the test.
• The response time: is the elapsed time from the
moment when a given request is sent to the server until
the moment when the last bit of information has
returned to the client
... moment please …
• The throughput is the real load processed by
your server during a run but it does not tell
you anything about the performance of your
server during this same run.
• This is the reason why you need both
measures in order to get a real idea about your
server’s performance during a run.
The response time tells you how fast your
server is handling a given load.
Results Analysis – Interpreting Results
• What do we want to find inside our reports?
• Kind of Reports
– Summary Report*
– Graph Results
– View Results in Tree
– View Results in Table
• Extra report types
– Response Times vs Threads**
– Transaction Throughput vs Threads**
• * - must have report listener!
• ** - Thread == user (in JMeter world)
40
Response Times vs Threads
• This graph shows how
Response Time changes
with amount of parallel
threads.
• Naturally, server takes
longer to respond
when a lot of users
requests it
simultaneously. This
graph visualizes such
dependencies.
41
Transaction Throughput vs Threads
• This listener is very similar to Response Times vs
Threads, except it shows total server's transaction
throughput for active test threads.
• The formula for total server transaction throughput is
<active threads> * 1 second / <1 thread response
time>
• So basically, it shows the statistical maximum possible
number of transactions based on number of users
accessing the application.
90% line of response time
Learn to Read Graph
• Load speed
• Throughput
• Deviation
• Hits
Results Graph - Average Load Time
• Page load speeds in
milliseconds.
• Lower is better
• On a stable system, it
should go flat
Results Graph - Deviation
• The deviation
(variability) of the load
speed in milliseconds.
• Lower is better
• On a stable system, it
should go flat
Results Graph - Throughput
• Throughput in pages per
second.
• Higher is better
• On a stable system, it
should go flat
• The black dots are
individual sample
times
Good sign
• When the values on the
graph begin to flatten
out, it shows that the
system has become
stable at that load.
– Speed flattening
– Throughput flattening
– Deviation dropping
– No exceptions ;-)
Connect Results With Logs
• Learn to relate problems on the server to its effect on the
graph.
• Big spikes indicate that you have a problems
• You may see the effects of:
– Exceptions
– Garbage collection
JMeter & New Relic
Tips & Tricks
• A clear name for each performance test
• non-GUI mode is more stable than GUI mode
• Do not use listeners if not needed
• Ramp-up is needed for heavy load
• Assertion is needed to simulate a virtual user
• Unstable tests: think of data while an user run its scenario
• If one user can not login, its later steps should not be counted
• Backup after every important step you made to your script easily by
cloning the jmx file
• Speedup JMeter script modifying with text editors which support
regex
Simulate User Behavior in JMeter
• Only Once Controllers
• Cache Management
• Cookie Management
• Header Management
• Think Times
Gaussian Random Timer
• This timer pauses each thread request for a random
amount of time, with most of the time intervals occurring
near a particular value.
• The total delay is the sum of the Gaussian distributed value
(with mean 0.0 and standard deviation 1.0) times the
deviation value you specify, and the offset value.
References
• Apache JMeter
http://jmeter.apache.org/
• jmeter-ec2 | Run JMeter on Amazon’s ec2 Cloud
http://www.http503.com/2012/run-jmeter-on-amazon-ec2-cloud
• Some thoughts on stress testing web applications with JMeter
http://nico.vahlas.eu/2010/03/17/some-thoughts-on-stress-testing-web-applications-with-jmeter-part-1/
• JMeter tips
http://www.javaworld.com/javaworld/jw-07-2005/jw-0711-jmeter.html
• Response Times: The 3 Important Limits
http://www.nngroup.com/articles/response-times-3-important-limits/
• Apache JMeter Custom Plugins
http://jmeter-plugins.org
• JMeter Wiki
http://wiki.apache.org/jmeter/JMeterLinks
• Amazon AWS EC2 Command Line Toolkit
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/SettingUp_CommandLine.html
• Bayo Ernie - Performance Testing With JMeter 2.9 [Kindle Edition]
Thanks for your time

Q & A

More Related Content

What's hot

Load testing jmeter
Load testing jmeterLoad testing jmeter
Load testing jmeter
Billa Kota Sriram
 
What is Performance Testing?
What is Performance Testing?What is Performance Testing?
What is Performance Testing?
QA InfoTech
 
Apache jMeter
Apache jMeterApache jMeter
Introduction to jmeter
Introduction to jmeterIntroduction to jmeter
Introduction to jmeter
test test
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
Prashanth Kumar
 
Performance testing with JMeter
Performance testing with JMeterPerformance testing with JMeter
Performance testing with JMeter
Mikael Kundert
 
JMeter vs LoadRunner | Edureka
JMeter vs LoadRunner | EdurekaJMeter vs LoadRunner | Edureka
JMeter vs LoadRunner | Edureka
Edureka!
 
J Meter Intro
J Meter IntroJ Meter Intro
J Meter Intro
Sam Varadarajan
 
QA. Load Testing
QA. Load TestingQA. Load Testing
QA. Load Testing
Alex Galkin
 
Performance testing with Apache JMeter
Performance testing with Apache JMeterPerformance testing with Apache JMeter
Performance testing with Apache JMeter
RedBlackTree
 
Performance testing using Jmeter for apps which needs authentication
Performance testing using Jmeter for apps which needs authenticationPerformance testing using Jmeter for apps which needs authentication
Performance testing using Jmeter for apps which needs authentication
Jay Jha
 
JMeter
JMeterJMeter
Perofrmance testing and apache jmeter
Perofrmance testing and apache jmeterPerofrmance testing and apache jmeter
Perofrmance testing and apache jmeter
lethibichhoa
 
Presentation on Apache Jmeter
Presentation on Apache JmeterPresentation on Apache Jmeter
Presentation on Apache Jmeter
Sabitri Gaire
 
Performance Testing Using JMeter | Edureka
Performance Testing Using JMeter | EdurekaPerformance Testing Using JMeter | Edureka
Performance Testing Using JMeter | Edureka
Edureka!
 
Introduction to JMeter
Introduction to JMeterIntroduction to JMeter
Introduction to JMeter
Galih Lasahido
 
Performance Testing With Jmeter
Performance Testing With JmeterPerformance Testing With Jmeter
Performance Testing With Jmeter
Adam Goucher
 
Load testing with J meter
Load testing with J meterLoad testing with J meter
Load testing with J meter
Manoj Shankaramanchi
 
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
Kamran Khan
 
Basic of jMeter
Basic of jMeter Basic of jMeter
Basic of jMeter
Shub
 

What's hot (20)

Load testing jmeter
Load testing jmeterLoad testing jmeter
Load testing jmeter
 
What is Performance Testing?
What is Performance Testing?What is Performance Testing?
What is Performance Testing?
 
Apache jMeter
Apache jMeterApache jMeter
Apache jMeter
 
Introduction to jmeter
Introduction to jmeterIntroduction to jmeter
Introduction to jmeter
 
Performance testing with Jmeter
Performance testing with JmeterPerformance testing with Jmeter
Performance testing with Jmeter
 
Performance testing with JMeter
Performance testing with JMeterPerformance testing with JMeter
Performance testing with JMeter
 
JMeter vs LoadRunner | Edureka
JMeter vs LoadRunner | EdurekaJMeter vs LoadRunner | Edureka
JMeter vs LoadRunner | Edureka
 
J Meter Intro
J Meter IntroJ Meter Intro
J Meter Intro
 
QA. Load Testing
QA. Load TestingQA. Load Testing
QA. Load Testing
 
Performance testing with Apache JMeter
Performance testing with Apache JMeterPerformance testing with Apache JMeter
Performance testing with Apache JMeter
 
Performance testing using Jmeter for apps which needs authentication
Performance testing using Jmeter for apps which needs authenticationPerformance testing using Jmeter for apps which needs authentication
Performance testing using Jmeter for apps which needs authentication
 
JMeter
JMeterJMeter
JMeter
 
Perofrmance testing and apache jmeter
Perofrmance testing and apache jmeterPerofrmance testing and apache jmeter
Perofrmance testing and apache jmeter
 
Presentation on Apache Jmeter
Presentation on Apache JmeterPresentation on Apache Jmeter
Presentation on Apache Jmeter
 
Performance Testing Using JMeter | Edureka
Performance Testing Using JMeter | EdurekaPerformance Testing Using JMeter | Edureka
Performance Testing Using JMeter | Edureka
 
Introduction to JMeter
Introduction to JMeterIntroduction to JMeter
Introduction to JMeter
 
Performance Testing With Jmeter
Performance Testing With JmeterPerformance Testing With Jmeter
Performance Testing With Jmeter
 
Load testing with J meter
Load testing with J meterLoad testing with J meter
Load testing with J meter
 
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
Performance Testing using LoadRunner - Kamran Khan [chromeis.com]
 
Basic of jMeter
Basic of jMeter Basic of jMeter
Basic of jMeter
 

Viewers also liked

Performance testing with 100,000 concurrent users in AWS
Performance testing with 100,000 concurrent users in AWSPerformance testing with 100,000 concurrent users in AWS
Performance testing with 100,000 concurrent users in AWS
Matthias Matook
 
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeterHow to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
Alon Girmonsky
 
JMeter, Docker sitting in a tree
JMeter, Docker sitting in a treeJMeter, Docker sitting in a tree
JMeter, Docker sitting in a tree
srivaths_sankaran
 
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Amazon Web Services
 
Entonamiento y perfilado de Drupal
Entonamiento y perfilado de DrupalEntonamiento y perfilado de Drupal
Entonamiento y perfilado de Drupal
camposer
 
Scalable load testing using jmeter in cloud
Scalable load testing using jmeter in cloudScalable load testing using jmeter in cloud
Scalable load testing using jmeter in cloud
Vijay Rayapati
 
Running JMeter Tests In Appvance PerformanceCloud
Running JMeter Tests In Appvance PerformanceCloudRunning JMeter Tests In Appvance PerformanceCloud
Running JMeter Tests In Appvance PerformanceCloud
Clever Moe
 
Cloud-based Performance & Web Load Testing
Cloud-based Performance & Web Load TestingCloud-based Performance & Web Load Testing
Cloud-based Performance & Web Load Testing
InCycleSoftware
 
Java Performance Engineer's Survival Guide
Java Performance Engineer's Survival GuideJava Performance Engineer's Survival Guide
Java Performance Engineer's Survival Guide
Monica Beckwith
 
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
Alan Richardson
 
Jira
JiraJira
Selenium web driver
Selenium web driverSelenium web driver
Selenium web driver
Sun Technlogies
 
Selenium
SeleniumSelenium
Selenium
Sun Technlogies
 
Selenium webdriver interview questions and answers
Selenium webdriver interview questions and answersSelenium webdriver interview questions and answers
Selenium webdriver interview questions and answers
ITeLearn
 
Silk Performer Presentation v1
Silk Performer Presentation v1Silk Performer Presentation v1
Silk Performer Presentation v1
Sun Technlogies
 
Node.js and Selenium Webdriver, a journey from the Java side
Node.js and Selenium Webdriver, a journey from the Java sideNode.js and Selenium Webdriver, a journey from the Java side
Node.js and Selenium Webdriver, a journey from the Java side
Mek Srunyu Stittri
 
BDD with JBehave and Selenium
BDD with JBehave and SeleniumBDD with JBehave and Selenium
BDD with JBehave and Selenium
Nikolay Vasilev
 
Behavior Driven Development and Automation Testing Using Cucumber
Behavior Driven Development and Automation Testing Using CucumberBehavior Driven Development and Automation Testing Using Cucumber
Behavior Driven Development and Automation Testing Using Cucumber
KMS Technology
 
Selenium Tips & Tricks
Selenium Tips & TricksSelenium Tips & Tricks
Selenium Tips & Tricks
Dave Haeffner
 
Web Test Automation with Selenium
Web Test Automation with SeleniumWeb Test Automation with Selenium
Web Test Automation with Selenium
vivek_prahlad
 

Viewers also liked (20)

Performance testing with 100,000 concurrent users in AWS
Performance testing with 100,000 concurrent users in AWSPerformance testing with 100,000 concurrent users in AWS
Performance testing with 100,000 concurrent users in AWS
 
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeterHow to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
 
JMeter, Docker sitting in a tree
JMeter, Docker sitting in a treeJMeter, Docker sitting in a tree
JMeter, Docker sitting in a tree
 
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
 
Entonamiento y perfilado de Drupal
Entonamiento y perfilado de DrupalEntonamiento y perfilado de Drupal
Entonamiento y perfilado de Drupal
 
Scalable load testing using jmeter in cloud
Scalable load testing using jmeter in cloudScalable load testing using jmeter in cloud
Scalable load testing using jmeter in cloud
 
Running JMeter Tests In Appvance PerformanceCloud
Running JMeter Tests In Appvance PerformanceCloudRunning JMeter Tests In Appvance PerformanceCloud
Running JMeter Tests In Appvance PerformanceCloud
 
Cloud-based Performance & Web Load Testing
Cloud-based Performance & Web Load TestingCloud-based Performance & Web Load Testing
Cloud-based Performance & Web Load Testing
 
Java Performance Engineer's Survival Guide
Java Performance Engineer's Survival GuideJava Performance Engineer's Survival Guide
Java Performance Engineer's Survival Guide
 
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
Hands on Exploration of Page Objects and Abstraction Layers with Selenium Web...
 
Jira
JiraJira
Jira
 
Selenium web driver
Selenium web driverSelenium web driver
Selenium web driver
 
Selenium
SeleniumSelenium
Selenium
 
Selenium webdriver interview questions and answers
Selenium webdriver interview questions and answersSelenium webdriver interview questions and answers
Selenium webdriver interview questions and answers
 
Silk Performer Presentation v1
Silk Performer Presentation v1Silk Performer Presentation v1
Silk Performer Presentation v1
 
Node.js and Selenium Webdriver, a journey from the Java side
Node.js and Selenium Webdriver, a journey from the Java sideNode.js and Selenium Webdriver, a journey from the Java side
Node.js and Selenium Webdriver, a journey from the Java side
 
BDD with JBehave and Selenium
BDD with JBehave and SeleniumBDD with JBehave and Selenium
BDD with JBehave and Selenium
 
Behavior Driven Development and Automation Testing Using Cucumber
Behavior Driven Development and Automation Testing Using CucumberBehavior Driven Development and Automation Testing Using Cucumber
Behavior Driven Development and Automation Testing Using Cucumber
 
Selenium Tips & Tricks
Selenium Tips & TricksSelenium Tips & Tricks
Selenium Tips & Tricks
 
Web Test Automation with Selenium
Web Test Automation with SeleniumWeb Test Automation with Selenium
Web Test Automation with Selenium
 

Similar to Load Test Drupal Site Using JMeter and Amazon AWS

Performancetestingjmeter 121109061704-phpapp02
Performancetestingjmeter 121109061704-phpapp02Performancetestingjmeter 121109061704-phpapp02
Performancetestingjmeter 121109061704-phpapp02
Shivakumara .
 
"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session
Tharinda Liyanage
 
Test talk academy apachejmeter-120521121306-phpapp02
Test talk academy apachejmeter-120521121306-phpapp02Test talk academy apachejmeter-120521121306-phpapp02
Test talk academy apachejmeter-120521121306-phpapp02
veeru madduri
 
JMeter Intro
JMeter IntroJMeter Intro
JMeter Intro
Sam Varadarajan
 
J meter introduction
J meter introductionJ meter introduction
J meter introduction
Bharath Kumar
 
Performancetestingjmeter 131210111657-phpapp02
Performancetestingjmeter 131210111657-phpapp02Performancetestingjmeter 131210111657-phpapp02
Performancetestingjmeter 131210111657-phpapp02
Nitish Bhardwaj
 
Performance testing using jmeter
Performance testing using jmeterPerformance testing using jmeter
Performance testing using jmeter
Rachappa Bandi
 
Real-World Load Testing of ADF Fusion Applications Demonstrated - Oracle Ope...
Real-World Load Testing of ADF Fusion Applications Demonstrated  - Oracle Ope...Real-World Load Testing of ADF Fusion Applications Demonstrated  - Oracle Ope...
Real-World Load Testing of ADF Fusion Applications Demonstrated - Oracle Ope...
Getting value from IoT, Integration and Data Analytics
 
Performance testing and j meter
Performance testing and j meterPerformance testing and j meter
Performance testing and j meter
Purna Chandar
 
Best Jmeter Interview Questions- Prepared by Working Professionals
Best Jmeter Interview Questions- Prepared by Working ProfessionalsBest Jmeter Interview Questions- Prepared by Working Professionals
Best Jmeter Interview Questions- Prepared by Working Professionals
Testing World
 
Performance tuning Grails applications
 Performance tuning Grails applications Performance tuning Grails applications
Performance tuning Grails applications
GR8Conf
 
Jmeter_Presentaion_Parag
Jmeter_Presentaion_ParagJmeter_Presentaion_Parag
Jmeter_Presentaion_Parag
PARAG KHEDIKAR
 
Performance testing
Performance testingPerformance testing
Performance testing
Chalana Kahandawala
 
Jmeter interviewquestions
Jmeter interviewquestionsJmeter interviewquestions
Jmeter interviewquestions
girichinna27
 
05. performance-concepts-26-slides
05. performance-concepts-26-slides05. performance-concepts-26-slides
05. performance-concepts-26-slides
Muhammad Ahad
 
Testing - How Vital and How Easy to use
Testing - How Vital and How Easy to useTesting - How Vital and How Easy to use
Testing - How Vital and How Easy to use
Uma Ghotikar
 
Apachejmeterabriefintroduction
ApachejmeterabriefintroductionApachejmeterabriefintroduction
Apachejmeterabriefintroduction
Foredoomed
 
Performance tuning Grails Applications GR8Conf US 2014
Performance tuning Grails Applications GR8Conf US 2014Performance tuning Grails Applications GR8Conf US 2014
Performance tuning Grails Applications GR8Conf US 2014
Lari Hotari
 
Fastest Servlets in the West
Fastest Servlets in the WestFastest Servlets in the West
Fastest Servlets in the West
Stuart (Pid) Williams
 
Performance Testing - Apache Benchmark, JMeter
Performance Testing  - Apache Benchmark, JMeterPerformance Testing  - Apache Benchmark, JMeter
Performance Testing - Apache Benchmark, JMeter
Antoni Orfin
 

Similar to Load Test Drupal Site Using JMeter and Amazon AWS (20)

Performancetestingjmeter 121109061704-phpapp02
Performancetestingjmeter 121109061704-phpapp02Performancetestingjmeter 121109061704-phpapp02
Performancetestingjmeter 121109061704-phpapp02
 
"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session"Introduction to JMeter" @ CPTM 3rd Session
"Introduction to JMeter" @ CPTM 3rd Session
 
Test talk academy apachejmeter-120521121306-phpapp02
Test talk academy apachejmeter-120521121306-phpapp02Test talk academy apachejmeter-120521121306-phpapp02
Test talk academy apachejmeter-120521121306-phpapp02
 
JMeter Intro
JMeter IntroJMeter Intro
JMeter Intro
 
J meter introduction
J meter introductionJ meter introduction
J meter introduction
 
Performancetestingjmeter 131210111657-phpapp02
Performancetestingjmeter 131210111657-phpapp02Performancetestingjmeter 131210111657-phpapp02
Performancetestingjmeter 131210111657-phpapp02
 
Performance testing using jmeter
Performance testing using jmeterPerformance testing using jmeter
Performance testing using jmeter
 
Real-World Load Testing of ADF Fusion Applications Demonstrated - Oracle Ope...
Real-World Load Testing of ADF Fusion Applications Demonstrated  - Oracle Ope...Real-World Load Testing of ADF Fusion Applications Demonstrated  - Oracle Ope...
Real-World Load Testing of ADF Fusion Applications Demonstrated - Oracle Ope...
 
Performance testing and j meter
Performance testing and j meterPerformance testing and j meter
Performance testing and j meter
 
Best Jmeter Interview Questions- Prepared by Working Professionals
Best Jmeter Interview Questions- Prepared by Working ProfessionalsBest Jmeter Interview Questions- Prepared by Working Professionals
Best Jmeter Interview Questions- Prepared by Working Professionals
 
Performance tuning Grails applications
 Performance tuning Grails applications Performance tuning Grails applications
Performance tuning Grails applications
 
Jmeter_Presentaion_Parag
Jmeter_Presentaion_ParagJmeter_Presentaion_Parag
Jmeter_Presentaion_Parag
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Jmeter interviewquestions
Jmeter interviewquestionsJmeter interviewquestions
Jmeter interviewquestions
 
05. performance-concepts-26-slides
05. performance-concepts-26-slides05. performance-concepts-26-slides
05. performance-concepts-26-slides
 
Testing - How Vital and How Easy to use
Testing - How Vital and How Easy to useTesting - How Vital and How Easy to use
Testing - How Vital and How Easy to use
 
Apachejmeterabriefintroduction
ApachejmeterabriefintroductionApachejmeterabriefintroduction
Apachejmeterabriefintroduction
 
Performance tuning Grails Applications GR8Conf US 2014
Performance tuning Grails Applications GR8Conf US 2014Performance tuning Grails Applications GR8Conf US 2014
Performance tuning Grails Applications GR8Conf US 2014
 
Fastest Servlets in the West
Fastest Servlets in the WestFastest Servlets in the West
Fastest Servlets in the West
 
Performance Testing - Apache Benchmark, JMeter
Performance Testing  - Apache Benchmark, JMeterPerformance Testing  - Apache Benchmark, JMeter
Performance Testing - Apache Benchmark, JMeter
 

Recently uploaded

Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
shanihomely
 
The Impact of the Internet of Things (IoT) on Smart Homes and Cities
The Impact of the Internet of Things (IoT) on Smart Homes and CitiesThe Impact of the Internet of Things (IoT) on Smart Homes and Cities
The Impact of the Internet of Things (IoT) on Smart Homes and Cities
Arpan Buwa
 
Uncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in LibrariesUncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in Libraries
Brian Pichman
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
Safe Software
 
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdfAcumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
BrainSell Technologies
 
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
313mohammedarshad
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Nicolás Lopéz
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
SAI KAILASH R
 
How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...
DianaGray10
 
Patch Tuesday de julio
Patch Tuesday de julioPatch Tuesday de julio
Patch Tuesday de julio
Ivanti
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
bhumivarma35300
 
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
Priyanka Aash
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
SynapseIndia
 
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
Priyanka Aash
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
David Wilson
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Muhammad Ali
 
Connector Corner: Leveraging Snowflake Integration for Smarter Decision Making
Connector Corner: Leveraging Snowflake Integration for Smarter Decision MakingConnector Corner: Leveraging Snowflake Integration for Smarter Decision Making
Connector Corner: Leveraging Snowflake Integration for Smarter Decision Making
DianaGray10
 
Semantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software DevelopmentSemantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software Development
Baishakhi Ray
 
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptxMAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
janagijoythi
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
maigasapphire
 

Recently uploaded (20)

Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
Premium Girls Call Mumbai 9920725232 Unlimited Short Providing Girls Service ...
 
The Impact of the Internet of Things (IoT) on Smart Homes and Cities
The Impact of the Internet of Things (IoT) on Smart Homes and CitiesThe Impact of the Internet of Things (IoT) on Smart Homes and Cities
The Impact of the Internet of Things (IoT) on Smart Homes and Cities
 
Uncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in LibrariesUncharted Together- Navigating AI's New Frontiers in Libraries
Uncharted Together- Navigating AI's New Frontiers in Libraries
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
 
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdfAcumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
Acumatica vs. Sage Intacct vs. NetSuite _ NOW CFO.pdf
 
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
 
How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...How UiPath Discovery Suite supports identification of Agentic Process Automat...
How UiPath Discovery Suite supports identification of Agentic Process Automat...
 
Patch Tuesday de julio
Patch Tuesday de julioPatch Tuesday de julio
Patch Tuesday de julio
 
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
High Profile Girls call Service Pune 000XX00000 Provide Best And Top Girl Ser...
 
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
(CISOPlatform Summit & SACON 2024) Gen AI & Deepfake In Overall Security.pdf
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
 
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
(CISOPlatform Summit & SACON 2024) Cyber Insurance & Risk Quantification.pdf
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
 
Connector Corner: Leveraging Snowflake Integration for Smarter Decision Making
Connector Corner: Leveraging Snowflake Integration for Smarter Decision MakingConnector Corner: Leveraging Snowflake Integration for Smarter Decision Making
Connector Corner: Leveraging Snowflake Integration for Smarter Decision Making
 
Semantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software DevelopmentSemantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software Development
 
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptxMAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
MAKE MONEY ONLINE Unlock Your Income Potential Today.pptx
 
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
Girls Call Churchgate 9910780858 Provide Best And Top Girl Service And No1 in...
 

Load Test Drupal Site Using JMeter and Amazon AWS

  • 1. Load Test Drupal Site Using Apache JMeter & Amazon AWS By Vladimir Ilic @burgerboydaddy
  • 2. About me • twitter: @burgerboydaddy • http://burgerboydaddy.com
  • 3. Quote • “The designer is concerned with what happens when 1 user presses a button and the architect is concerned with what happens when 10,000 users press a button.” • Sun Certified Enterprise Architect for J2EE Technology Study Guide. Page 6. Mark Cade, Simon Roberts. 2007 JavaOneSM Conference | Session TS-9235 | 2
  • 4. 4 Test Types • Performance • Load • Stress • Scalability • Endurance • Functional
  • 5. Performance Testing • Performance testing determines or validates the speed of the application (X per T). • Used for finding bottlenecks and establish baseline for the system. • In other words it’s solo purpose is to determine the response and effectiveness of a system.
  • 6. Load Testing • Load testing identifies the maximum operating capacity of an application as well as any bottlenecks that might interfere with its operating capacity. (or, when does it blow up?)
  • 7. Stress Testing • Stress testing is focused on determining an application’s robustness, availability, and reliability under extreme conditions – Heavy loads – High concurrency – Limited computational resources • An attempt to break the system by overwhelming its resources
  • 8. Scalability • Scalability testing determines or validates whether adding another Y resource (database, memory, disk, CPU, etc) increases speed of X proportionally Endurance Testing This type of testing is used to check that the system can withstand the load for a long or large number of transactions.
  • 9. Preparation for a Test • Mission • Network • Hardware • Software • Metrics
  • 10. Mission • What is the testing intended to achieve? • What are basic assumptions like: – What is our anticipated average number of users (normal load)? – What is our anticipated peak number of users? • When is a good time to load-test our application (i.e. off-hours or weekends), bearing in mind that this may very well crash one or more of our servers?
  • 11. Environment Prep - Network • Performance testing is usually network intensive operation and can affect others in the organization • Testing should be done on a separated / segregated network • Amazon AWS – virtually unlimited in/out speed
  • 12. Environment Prep – Hardware • Is your machine ready to receive full load? • Are multiple machine available (for distributed testing)? • Do you have enough resources • Again – Amazon to the rescue – AWS gives you as many test machines as you need.
  • 13. Metrics • Performance testing is all about numbers and metrics • Determine which metrics you are concerned about and how to get them. • Some simple tests / benchmarks can be done using Apache Bench “ab” command: • Suppose we want to see how fast our site can handle 100 requests, with a maximum of 10 requests running concurrently: • ab -n 100 -c 10 http://example.dev/
  • 14. JMeter – Software of Choice • Open source desktop / server application • Designed for functional/load/performance/stress testing • Extensible… write your own test • Simulate heavy load (application, server and network) • Gives instant visual feedback • Distributed testing • Various protocols - HTTP, FTP, JDBC, JMS, LDAP, SOAP • Multi-platform • Full multithreading framework • Caching and offline analysis/replaying of test results. • JMeter is not a web browser!
  • 15. JMeter vs. Real World Real World JMeter World One User Browser request HTTP Request Sampler One HTML page display with JavaScript Execution View Tree Listener with basic HTML display. No JavaScript execution Multiple Users Requesting Pages Simultaneously Thread Group Configured for Number of Users, uses the same HTTP Request Sampler to simulate multiple users No Equivalent Difficult to do Measuring performance like min, max, and average (avg) time for processing using Summary Report Listener
  • 16. JMeter - Terminology JMeter Term Meaning Test Plan - You keep your test plan under me - Only one per one JMeter window - Save it for a future use Thread Group - Represent one set of action – one scenario - You add actions that single user will do - JMeter will use them to simulate multiple users HTTP Request Sampler - Record the request to web server - Also receive the response from Web server - Provide all data received for analysis View Tree Listener - Show the test data in details for each item - For HTTP Request it show’s Request, Response and Status of Transaction Summary Report Listener - Show aggregated values for all users - Useful when multiple users are simulated - Provide performance information
  • 17. 17 JMeter Testing Tools • Test Plan • Thread Group • Controllers: – Samplers & – Logical Controllers • Listeners • Timers • Assertions • Configuration Elements • Pre-Processor Elements • Post-Processor Elements
  • 18. • Pre-Processor Elements • A Pre-Processor executes some action prior to a Sampler Request being made. • If a Pre-Processor is attached to a Sampler element, then it will execute just prior to that sampler element running. • A Pre-Processor is most often used to modify the settings of a Sample Request just before it runs, or to update variables that aren't extracted from response text. • Post-Processor Elements • A Post-Processor executes some action after a Sampler Request has been made. • If a Post-Processor is attached to a Sampler element, then it will execute just after that sampler element runs. • A Post-Processor is most often used to process the response data, often to extract values from it. See the scoping rules for more details on when Post-Processors are executed.
  • 19. Execution order 1. Configuration elements 2. Pre-Processors 3. Timers 4. Sampler 5. Post-Processors (unless SampleResult is null) 6. Assertions (unless SampleResult is null) 7. Listeners (unless SampleResult is null) • Timers, Assertions, Pre- and Post-Processors are only processed if there is a sampler to which they apply. • Logic Controllers and Samplers are processed in the order in which they appear in the tree. • Other test elements are processed according to the scope in which they are found, and the type of test element
  • 20. JMeter – Basic Elements
  • 21. 21 JMeter – Basic Elements • “number of threads” - In other words, this variable is the number of users executing a “real life” use case on your system. • This number is not the number of concurrent / parallel users executing a “real life” use case on your system: • the concurrency of the users depends on both the duration of your scenario and the ramp up time configured on the thread group. • The “ramp up time” in a thread group is the actual time taken by JMeter to spawn all the threads. • A rough estimation of the throughput (number of requests per second) during the ramp up period of your test plan is: number of threads / ramp up time (in seconds).
  • 22. Tips & Tricks • You should try to have a constant throughput during a run: It is often very difficult to “control” the throughput particularly during the ramp up period • If your objective is to simulate a “peak”: You should have a “high” number of threads and a “low” ramp up time and number of loops • If your objective is to simulate a “long run”: You should have a “medium” number of threads, a “higher” ramp up time and a “high” number of loops • Note: The terms “high”, “higher”, “medium” and “low” are voluntary qualitative in the 2 bullets above as they depend on the system you are testing.
  • 23. JMeter – HTTP Request Defaults
  • 24. JMeter – Adding HTTP Requests • The “HTTP Request Default” elements does not tell JMeter to send an HTTP request. It simply defines the default values that the HTTP Request elements use. • In our test plan we need to add at least one “HTTP Request Sampler”. • JMeter sends requests in the order that they appear in the tree. • Add HTTP Request to the JMeter Users element (Add->Sampler->HTTP Request).
  • 25. JMeter – HTTP Request
  • 26. JMeter - Listener • The final element you need to add is a Listener. • This element is responsible for storing all of the results of your HTTP requests in a file and presenting a visual model of the data. • Select the JMeter Users element and add a Graph Result Listener and Summary Report Listener. (Add->Listener->Graph Results).
  • 29. 29 The Cloud and Load Testing • One of the things the Cloud is useful for is load testing; very large amounts of hardware can be used to generate load at minimal cost. • Added benefit, if your application you are testing is external to your corporate network, your tests will be run from a realistic location which prevents any problems with artificial bottlenecks occurring on your LAN. • This type of testing, using externally located hosts, is increasingly common and JMeter is a superb open-source solution for facilitating this.
  • 30. Easy Amazon AWS & JMeter • Thanks to Oliver from http503.com and his automated JMeter on EC2 script http://www.http503.com/2012/run-JMeter-on-amazon- ec2-cloud • Run with up to 20 concurrent EC2 instances (default max number) • Run when you want it and how you want it!
  • 31. JMeter – http503.com script • It does things like: – Using Amazon’s API to launch instances – Installing JAVA & JMeter – Copying test files to each server – Adjusting thread counts to ensure the load is evenly distributed over each host – Editing the jmx for file paths to external data files – Displaying real-time aggregated results from the test as it is running – Downloading and collating all jtl files – Terminating instances.
  • 32. 32 JMeter-EC2 • Prerequisites – Test plan to be run has a Generate Summary Results listener. – Your JMeter test plan has a duration or loop count value set. • Prerequisites specific to using Amazon: – That you have an Amazon AWS account. – You have Amazon’s API tools installed on your machine. • Note: you can control execution from your local machine, but you will need to open few ports for data return. Difficult if you are behind corporate firewall/proxy. – Solution: Run controller on Amazon AWS (another EC2 instance)
  • 33. 33 Installation Process • Go to the: http://www.http503.com/2012/run-jmeter-on-amazon-ec2- cloud/#example • Small tips – Create security group with port 22 open to the world (or your IP address). – Also allow all machines inside security group to access each other.
  • 34. 34 JMeter-EC2 • Setup your machine image key, and your secret key pair. – Call it: project="myblogtestplan" count="3" owner="Vlad” ./jmeter-ec2.sh
  • 36. 36 Results Analysis • Running a test plan is only 50% of the performance testing task. • The most challenging part of the performance testing process is the analysis of test results and the identification of bottlenecks. • Think of the load testing reports as the evidentiary support to prove your innocence to a crime in court.
  • 37. Just a moment please… • Before going any further, we should spend some time on the measurable outcomes of a stress test. There are mainly 2 interesting measures that you can record when you run a stress test on a web application: • The throughput: is the number of requests per unit of time (seconds, minutes, hours) that are sent to your server during the test. • The response time: is the elapsed time from the moment when a given request is sent to the server until the moment when the last bit of information has returned to the client
  • 38. ... moment please … • The throughput is the real load processed by your server during a run but it does not tell you anything about the performance of your server during this same run. • This is the reason why you need both measures in order to get a real idea about your server’s performance during a run. The response time tells you how fast your server is handling a given load.
  • 39. Results Analysis – Interpreting Results • What do we want to find inside our reports? • Kind of Reports – Summary Report* – Graph Results – View Results in Tree – View Results in Table • Extra report types – Response Times vs Threads** – Transaction Throughput vs Threads** • * - must have report listener! • ** - Thread == user (in JMeter world)
  • 40. 40 Response Times vs Threads • This graph shows how Response Time changes with amount of parallel threads. • Naturally, server takes longer to respond when a lot of users requests it simultaneously. This graph visualizes such dependencies.
  • 41. 41 Transaction Throughput vs Threads • This listener is very similar to Response Times vs Threads, except it shows total server's transaction throughput for active test threads. • The formula for total server transaction throughput is <active threads> * 1 second / <1 thread response time> • So basically, it shows the statistical maximum possible number of transactions based on number of users accessing the application.
  • 42. 90% line of response time
  • 43. Learn to Read Graph • Load speed • Throughput • Deviation • Hits
  • 44. Results Graph - Average Load Time • Page load speeds in milliseconds. • Lower is better • On a stable system, it should go flat
  • 45. Results Graph - Deviation • The deviation (variability) of the load speed in milliseconds. • Lower is better • On a stable system, it should go flat
  • 46. Results Graph - Throughput • Throughput in pages per second. • Higher is better • On a stable system, it should go flat
  • 47. • The black dots are individual sample times
  • 48. Good sign • When the values on the graph begin to flatten out, it shows that the system has become stable at that load. – Speed flattening – Throughput flattening – Deviation dropping – No exceptions ;-)
  • 49. Connect Results With Logs • Learn to relate problems on the server to its effect on the graph. • Big spikes indicate that you have a problems • You may see the effects of: – Exceptions – Garbage collection
  • 50. JMeter & New Relic
  • 51. Tips & Tricks • A clear name for each performance test • non-GUI mode is more stable than GUI mode • Do not use listeners if not needed • Ramp-up is needed for heavy load • Assertion is needed to simulate a virtual user • Unstable tests: think of data while an user run its scenario • If one user can not login, its later steps should not be counted • Backup after every important step you made to your script easily by cloning the jmx file • Speedup JMeter script modifying with text editors which support regex
  • 52. Simulate User Behavior in JMeter • Only Once Controllers • Cache Management • Cookie Management • Header Management • Think Times
  • 53. Gaussian Random Timer • This timer pauses each thread request for a random amount of time, with most of the time intervals occurring near a particular value. • The total delay is the sum of the Gaussian distributed value (with mean 0.0 and standard deviation 1.0) times the deviation value you specify, and the offset value.
  • 54. References • Apache JMeter http://jmeter.apache.org/ • jmeter-ec2 | Run JMeter on Amazon’s ec2 Cloud http://www.http503.com/2012/run-jmeter-on-amazon-ec2-cloud • Some thoughts on stress testing web applications with JMeter http://nico.vahlas.eu/2010/03/17/some-thoughts-on-stress-testing-web-applications-with-jmeter-part-1/ • JMeter tips http://www.javaworld.com/javaworld/jw-07-2005/jw-0711-jmeter.html • Response Times: The 3 Important Limits http://www.nngroup.com/articles/response-times-3-important-limits/ • Apache JMeter Custom Plugins http://jmeter-plugins.org • JMeter Wiki http://wiki.apache.org/jmeter/JMeterLinks • Amazon AWS EC2 Command Line Toolkit http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/SettingUp_CommandLine.html • Bayo Ernie - Performance Testing With JMeter 2.9 [Kindle Edition]
  • 55. Thanks for your time 
  • 56. Q & A

Editor's Notes

  1. Reality check: Architect design for 10,000 users Developer programs for 1 user Murphy crashes it on 100 users
  2. Bottleneck A bottleneck is a phenomenon where the performance or capacity of an entire system is limited by a single or limited number of components or resources. Your web application can consist of several modules used to process request. If one of them has technical limitation, it limits the performance of the whole system Bottleneck in the application can be identified by performing the load test with the defined concurrent user load for various scenarios. Or in other words, performance test is here to determine how fast is the system .
  3. Stress Testing Every system has a capacity limit. When the load goes beyond the limit, the web site starts responding very slowly and even produce errors. The purpose of the stress testing is to find the capacity limit of the system. With it we can verify at which point of time the system degrades or fails. Usually done by increasing the user load in the system.
  4. Endurance Testing Test will be performed with defined set of concurrent users for a prolonged period of time, say for example 5 to 10 hours or 2 to 3 days.
  5. Sequential functional (low-volume) benchmark (the average number of users) load-test (the maximum number of users) test destructively (what is our hard limit?)
  6. JMeter does not execute JavaScript found in HTML pages, nor does it render HTML pages the way a browser does. It does give you the ability to view request responses as HTML through one of its many listeners.
  7. Test Plan A test plan describes a series of steps JMeter will execute when run. A complete test plan will consist of one or more Thread Groups, logic conrollers, sample generating controllers, listeners, timers, assertions, and configuration elements.Thread Group Thread group elements are the beginning points of any test plan. All controllers and samplers must be under a thread group. Other elements, e.g. Listeners, may be placed directly under the test plan, in which case they will apply to all the thread groups. Each thread will execute the test plan in its entirety and completely independently of other test threads. Multiple threads are used to simulate concurrent connections to your server application.Samplers Samplers tell JMeter to send requests to a server and wait for a response. They are processed in the order they appear in the tree. Controllers can be used to modify the number of repetitions of a sampler. Listeners Listeners provide access to the information JMeter gathers about the test cases while JMeter runs. The Graph Results listener plots the response times on a graph. The &quot;View Results Tree&quot; Listener shows details of sampler requests and responses, and can display basic HTML and XML representations of the response.
  8. Controllers JMeter has two types of Controllers: Samplers and Logical Controllers. These drive the processing of a test. Samplers tell JMeter to send requests to a server. For example, add an HTTP Request Sampler if you want JMeter to send an HTTP request. You can also customize a request by adding one or more Configuration Elements to a Sampler. Logical Controllers let you customize the logic that JMeter uses to decide when to send requests. TimersBy default, a JMeter thread sends requests without pausing between each request. We recommend that you specify a delay by adding one of the available timers to your Thread Group. If you do not add a delay, JMeter could overwhelm your server by making too many requests in a very short amount of time. The timer will cause JMeter to delay a certain amount of time before each sampler which is in its scope. AssertionsAssertions allow you to assert facts about responses received from the server being tested. Using an assertion, you can essentially &quot;test&quot; that your application is returning the results you expect it to. Configuration ElementsA configuration element works closely with a Sampler. Although it does not send requests (except for HTTP Proxy Server ), it can add to or modify requests. Pre-Processor ElementsA Pre-Processor executes some action prior to a Sampler Request being made. If a Pre-Processor is attached to a Sampler element, then it will execute just prior to that sampler element running. A Pre-Processor is most often used to modify the settings of a Sample Request just before it runs, or to update variables that aren&apos;t extracted from response text. Post-Processor ElementsA Post-Processor executes some action after a Sampler Request has been made. If a Post-Processor is attached to a Sampler element, then it will execute just after that sampler element runs. A Post-Processor is most often used to process the response data, often to extract values from it. See the scoping rules for more details on when Post-Processors are executed.
  9. Pre-Processor Elements A Pre-Processor executes some action prior to a Sampler Request being made. If a Pre-Processor is attached to a Sampler element, then it will execute just prior to that sampler element running. A Pre-Processor is most often used to modify the settings of a Sample Request just before it runs, or to update variables that aren&apos;t extracted from response text. Post-Processor Elements A Post-Processor executes some action after a Sampler Request has been made. If a Post-Processor is attached to a Sampler element, then it will execute just after that sampler element runs. A Post-Processor is most often used to process the response data, often to extract values from it. See the scoping rules for more details on when Post-Processors are executed.
  10. The Thread Group tells JMeter the number of users we want to simulate, how often the users should send requests, and the how many requests they should send. Threads == number of users. Ramp-Up Period, This property tells JMeter how long to delay between starting each user. For example, if you enter a Ramp-Up Period of 5 seconds, JMeter will finish starting all of your users by the end of the 5 seconds. If we have 25 users and a 5 second Ramp-Up Period, then the delay between starting users would be 5 second (25 users / 5 seconds = 5 user per second). The “ number of loops ” in a thread group is the actual number of times that the scenario will be executed by each thread.
  11. Define the tasks that they will be performing. HTTP requests. (HTTP Request element), you will add HTTP Request elements which use some of the default settings you specified here. Begin by selecting the JMeter Users (Thread Group) element. Click your right mouse button to get the Add menu, and then select Add --&gt; Config Element --&gt; HTTP Request Defaults. Nearly all web testing should use cookie support, unless your application specifically doesn ’ t use cookies. To add cookie support, simply add an HTTP CookieManager to each Thread Group in your test plan. This will ensure that each thread gets its own cookies, but shared across all HTTP Request objects. *** To add the HTTP Cookie Manager , simply select the Thread Group , and choose Add --&gt; Config Element --&gt; HTTP Cookie Manager.
  12. JMeter client machine may not able to simulate enough users to stress server. Control multiple machine to run JMeter without copying test samples to different machine. Configuration: Copy same version of JMeter to different computer. Add remote node IP in JMeter.properties file. Run JMeter on remote machine using /JMETER_HOME/bin/JMeter-server (in command prompt) Start JMeter GUI in host machine. Select any test plan. Go to Run &gt;&gt; Remote Start &gt;&gt; Remote IP Address.
  13. [*Without this no results will be displayed to the screen but the test will still run. No other listeners need to nor should be present.][**Without this the test will run forever or until you press CTRL-C. All testplans should also employ some form of pacing as best practice - load tests should not be run without some way to control the throughput. One way this can be achieved in JMeter is using the Constant Throughput Controller.]
  14. The  View Results Tree  is very handy when “ debugging ” a scenario as it allows to monitor all the HTTP Requests and Responses exchanged with the server. The draw back is that it consumes too much memory to be used in a large stress test. The View Results in Table listener is also useful in the early stages of the stress test implementation as it gives a good and fast overview of the execution of a test plan. However, this listener also consumes too much memory to be used in a large stress test.
  15. Example calculations:when you have one thread (user) sending requests to server and server responds after 100ms, you have 1 thread * 1000ms / 100ms = 10 transactions per second. when you have 10 threads sending requests to server and server responds after 100ms, you have 10 threads * 1000ms / 100ms = 100 transactions per second. This means that your server haven&apos;t reached its resources limits and the more users works with it the more transaction it processes. when you have 20 threads sending requests to server and server responds after 200ms, you have 20 threads * 1000ms / 200ms = 50 transactions per second. This means that at 20 parallel users server become responding slower and there&apos;s some overhead to handle parallelism, e.g. database locks.
  16. [90% line of response time] is more reliable than [average response time] Variation in range of [-5%,5%] should be treated as normal for [response time] Variation out of range [-10%,10%] should be treated as an improvement/decline of [response time] Variation in range of [-10%,-5%) and ( 5%,10%] should be considered as a decline/improvement of [response time] Variation in range of [-3%,3%] should be treated as normal for [Throughput] Variation out of range [-5%,5%] should be treated as an improvement/decline of [Throughput] Variation in range of [-5%,-3%) and ( 3%,5%] should be considered as a decline/improvement of [Throughput]
  17. From Previous Slides: There are mainly 2 interesting measures that you can record when you run a stress test on a web application: The  throughput : is the number of requests per unit of time (seconds, minutes, hours) that are sent to your server during the test. The  response time : is the elapsed time from the moment when a given request is sent to the server until the moment when the last bit of information has returned to the client The throughput is  the real load  processed by your server during a run but it  does   not  tell you anything about the  performance  of your server during this same run. This is the reason why you need both measures in order to get a real idea about your server ’ s performance during a run. The  response time  tells you how fast your server is handling a given  load .
  18. Average value can be very misleading. We can have sample where values goes from 90ms up to 900ms and average to be ~500ms. Other set can have all values from 490ms to 510ms. In both cases average value is the same!
  19. Deviation Standard deviation measures the mean distance of the values to their average. In other words it gives you a good idea of the dispersion or variability of the measures to their mean value.
  20. Gaussian Timer Uniform Random - This timer pauses each thread request for a random amount of time, with each time interval having the same probability of occurring. The total delay is the sum of the random value and the offset value.