http://www.flickr.com/photos/nebraskasc




                                          PrometSource CDMUG Using
                                                  LoadStorm
Objectives
-> LEARN WHEN TO LOAD TEST
-> UNDERSTAND HOW TO LOAD TEST
WITH LOAD STORM
About Me

           • PRESENTER
            • ANDY KUCHARSKI
            • @AKUCHARSKI
           • PROMET SOURCE
            • FOUNDER
            • @PROMETSOURCE
About Promet
 • Focus on Drupal
 • Founded in 2003
 • Offices in the US (Chicago, San Jose)
http://www.flickr.com/photos/peterlozano




What Load Testing is not
     Front End Performance Testing
        High Availability analysis
Why Load Test
   Capacity Planning
    Capacity Testing
  Performance Tuning
www.LoadStorm.com allows you to quickly and
easily remove create a test load hitting your site from
Amazon and Azure cloud servers
The Victim – Drupal 6 Ubercart site
The Victim - 44 objects on home page
How to Set up a load test - Step 1 – create a Plan
Plan is a collection of Scripts, steps and data about the tests its always the first
    step and it’s the highest level
How to Set up a load test - Step 2 – create a Scenario
A scenario is a collection of test steps (user actions, like a click or a form submit).
    Weighing (if you have more than one scenario) min/max pause and form data
    set
How to Set up a load test - Step 2 – create a Step (and repeat)
Steps are user actions. Load storm allows for links, new pages, random
   clicks, static data and form data (for required unique values)
How to Set up a load test - Step 3 – create a Step (and repeat)
Steps are user actions. Load storm allows for links, new pages, random
   clicks, static data and form data (for required unique values)
Two scenarios, main one will register a user in four steps
The Servers – Amazon EC2 Small and Medium VS RS Cloud 2G and 4G
EC2 Small: Peeked at 75
                          users




                       • User Load and Requests
                         per second



                        • Average Response time
                        • Peak Response time
                        • Error rate %




20 to 115 users in 40 minutes
Result: RS peeked at 65
                          users




                       • User Load and Requests
                         per second



                        • Average Response time
                        • Peak Response time
                        • Error rate %




20 to 115 users in 40 minutes
While running load tests, what’s happening on the server? Apache is consuming all
resources, its actually not the database.
Result: EC2 Medium
                          Peeks at 75 users again




                       Random Server Fail
                       – test needs to be
                       restarted




20 to 115 users in 40 minutes
Result: EC2 Medium
                          Peeks at 75 users again




                       • User Load and Requests
                         per second



                        • Average Response time
                        • Peak Response time
                        • Error rate %




20 to 115 users in 40 minutes
Result: RS 2G, keeps
                           going at 115




                       • User Load and Requests
                         per second



                        • Average Response time
                        • Peak Response time
                        • Error rate %




20 to 115 users in 40 minutes
While running load tests, what’s happening on the server? Apache is consuming all
resources, its actually not the database.
Questions?
andy@promethost.com
@akucharski
@prometsource

Stress Test Drupal on Amazon EC2 vs. RackSpace cloud

  • 1.
    http://www.flickr.com/photos/nebraskasc PrometSource CDMUG Using LoadStorm
  • 2.
    Objectives -> LEARN WHENTO LOAD TEST -> UNDERSTAND HOW TO LOAD TEST WITH LOAD STORM
  • 3.
    About Me • PRESENTER • ANDY KUCHARSKI • @AKUCHARSKI • PROMET SOURCE • FOUNDER • @PROMETSOURCE
  • 4.
    About Promet •Focus on Drupal • Founded in 2003 • Offices in the US (Chicago, San Jose)
  • 5.
    http://www.flickr.com/photos/peterlozano What Load Testingis not Front End Performance Testing High Availability analysis
  • 6.
    Why Load Test Capacity Planning Capacity Testing Performance Tuning
  • 10.
    www.LoadStorm.com allows youto quickly and easily remove create a test load hitting your site from Amazon and Azure cloud servers
  • 11.
    The Victim –Drupal 6 Ubercart site
  • 12.
    The Victim -44 objects on home page
  • 13.
    How to Setup a load test - Step 1 – create a Plan Plan is a collection of Scripts, steps and data about the tests its always the first step and it’s the highest level
  • 14.
    How to Setup a load test - Step 2 – create a Scenario A scenario is a collection of test steps (user actions, like a click or a form submit). Weighing (if you have more than one scenario) min/max pause and form data set
  • 15.
    How to Setup a load test - Step 2 – create a Step (and repeat) Steps are user actions. Load storm allows for links, new pages, random clicks, static data and form data (for required unique values)
  • 16.
    How to Setup a load test - Step 3 – create a Step (and repeat) Steps are user actions. Load storm allows for links, new pages, random clicks, static data and form data (for required unique values)
  • 17.
    Two scenarios, mainone will register a user in four steps
  • 18.
    The Servers –Amazon EC2 Small and Medium VS RS Cloud 2G and 4G
  • 19.
    EC2 Small: Peekedat 75 users • User Load and Requests per second • Average Response time • Peak Response time • Error rate % 20 to 115 users in 40 minutes
  • 20.
    Result: RS peekedat 65 users • User Load and Requests per second • Average Response time • Peak Response time • Error rate % 20 to 115 users in 40 minutes
  • 22.
    While running loadtests, what’s happening on the server? Apache is consuming all resources, its actually not the database.
  • 23.
    Result: EC2 Medium Peeks at 75 users again Random Server Fail – test needs to be restarted 20 to 115 users in 40 minutes
  • 24.
    Result: EC2 Medium Peeks at 75 users again • User Load and Requests per second • Average Response time • Peak Response time • Error rate % 20 to 115 users in 40 minutes
  • 25.
    Result: RS 2G,keeps going at 115 • User Load and Requests per second • Average Response time • Peak Response time • Error rate % 20 to 115 users in 40 minutes
  • 27.
    While running loadtests, what’s happening on the server? Apache is consuming all resources, its actually not the database.
  • 29.

Editor's Notes

  • #2 Promet Source Chicago Drupal Meet Up presentation – Using Load Storm
  • #3 Objectives: - Learn when and why to stress test your site - Learn how to use load test with load storm
  • #5 Promet Source is a Chicago based full service Web Development Company focusing on open source technologies to build complex websites and web applications. Promet has used Drupal to develop solutions for Fortune 100 companies, start-ups & non-profits. Promet uses Drupal to build a broad variety of websites, web applications, and has most recently, used Drupal to assist in its Mobile Application Development.Along with their Drupal expertise Promet Source differentiates themselves by providing a superior customer experience throughout all facets of the development process, including design, software engineering, project management, quality assurance as well as hosting & online marketing services.Promet Source areas of Drupal expertise:- Drupal Web Development- Web Application Development- Mobile Application Development- eCommerce Web Development- Member Management Web Development- Web Design- Chicago Web Hosting- Chicago Online Marketing
  • #6 Load testing is NOT front end performance testing It is also not High Availability analysis
  • #7 Why Load Test?Capacity planningCapacity TestingPerformance Tunning
  • #8 Example of over capacity problem
  • #9 Another over capacity problem example
  • #10 Not related, but a fun 404 message
  • #11 What is Load Storm:LoadStorm has been awarded and recognized as the Best Load Testing Tool byWebhostingsearch.com, the leading provider of best quality web hostingreviews on the Internet.“LoadStorm™ is a web-based load testing tool for simulating what users do with a web site or web application. You use it to build tests that send requests to your server in the same way that a user's browser sends requests to your server. But these tests are executed by our automated systems rather than by a user, so they can be done repeatedly and in large numbers simultaneously. They can also be built using our tool in such a way as to simulate a large number of different users with different tasks to perform.
  • #12 Our test site isOptionIt a drupal 6 ecommerce site built by Promet Source
  • #13 The OptionIt home page has 44 objects on it
  • #14 How to Set up a load test - Step 1 – create a Plan Plan is a collection of Scripts, steps and data about the tests its always the first step and it’s the highest level
  • #15 How to Set up a load test - Step 2 – create a ScenarioA scenario is a collection of test steps (user actions, like a click or a form submit). Weighing (if you have more than one scenario) min/max pause and form data set
  • #16 How to Set up a load test - Step 2 – create a Step (and repeat)Steps are user actions. Load storm allows for links, new pages, random clicks, static data and form data (for required unique values)
  • #17 How to Set up a load test - Step 3 – create a Step (and repeat)Steps are user actions. Load storm allows for links, new pages, random clicks, static data and form data (for required unique values)
  • #18 Here is our example scenario
  • #19 We will be load testing the same site installed on four instances: - Amazon small - Amazon mediumVersusRack Space Cloud 1024MB RamRack Space Cloud 2048MB Ram
  • #20 Stress Test results on a drupal site on Amazon small instance
  • #21 Stress Test results on a drupal site on Rack Space Cloud 1024G instance
  • #22 Comparative number of users registered on RackSpace cloud server versus Amazon EC2 small
  • #23 New Relic view of Process memory and CPU usage on RackSpace cloud server during the stress test
  • #24 Stress Test results on a drupal site on Amazon
  • #30 Questions?andy@promethost.com@akucharski@prometsource