0© 2013 SOASTA CONFIDENTIAL - All rights reserved.Webinar
1© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load testing is a team sport
TODAY’S SOASTA PRESENTERS
Ed Salazar: Brad Johnson:
CloudTest Product Manager VP Product marketing
Agenda:
• User Experience is King
• Testing for global, front to back, mobile and web users
• Production is real. Use it to test and for data
Questions:
Submit in chat box during event
2© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Rapid Delivery
Agile development
Continuous
delivery
DevOps principles
Mobile and Web
Online everything
Mobile commerce
Legacy modernization
Complexit
y
Composite apps
3rd party
services
API proliferation
Unprecedented
Scale
100’s to millions
Local to global
100%
availability
3© 2013 SOASTA CONFIDENTIAL - All rights reserved.
o Not built for real time feedback across complex tiers
o Assumes slow iterations and long cycle times
o Not focused on the global user experience
o Expensive license and HW dependencies
o Built for the test lab, but locked out of production
4© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Fast time to results.
SPEED
Hundreds to Millions.
SCALE
Continuously.
AFFORDABILITY
5© 2013 SOASTA CONFIDENTIAL - All rights reserved.
The Old Way
What would YOU
do with more
time?
6© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Memory leaks
Test Scale
Stage/Team
Dev
& Test
Release
& Deploy
Network
& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Top Areas We Find Issues
Performance validation from development to production
Continuous tuning for full-scale…and well beyond
7© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Frequent testing from development through production
o Realism and accuracy from the user’s view to the last server
o Real time analytics and integrated monitoring
o End to end optimization from app to infrastructure
o Test cycle acceleration and optimization
8© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Include real mobile devices and their “system” metrics
o Test in the production environment
o Test to 2-3x the expected peak traffic levels
o Test across geographies
o Test corner cases
o Measure in real time
http://www.soasta.com/knowledge-center/whitepapers/
9© 2012 SOASTA. All rights reserved. May 22, 2012
Two Fronts in the Performance War
What good is reliability
if the average page
load time is 10
seconds?
Who cares if the page
load time is 2
seconds if only 10
people can hit the
site?
Page Speed Reliability
BOTH.
10© 2012 SOASTA. All rights reserved. May 22, 2012
Op
s
Tested apps roll into
production
Real user
performance, usage &
traffic levels
mPulseCloudTest
Dev. & Test
TouchTest
11© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTest
Performance
(Patent)
PRE-PRODUCTION
Test Build & Editing
TouchTest
Functionality
(Patent filed)
mPulse
Real User
Measurement
PRODUCTION
Dev/Test Feedback Loop
SOASTA Core DNA
SOASTA Global Test Cloud
World’s Largest Test Automation Platform
SOASTA Command & Control
Test & Measurement Automation Grid
(Patent)
Real time, Contextual & Actionable
Intelligence
SOASTA Analytic Engine
In-Memory Performance Analytics
(Patent filed)
12© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Ed Salazar
13© 2013 SOASTA CONFIDENTIAL - All rights reserved.
 Mobile & web user behavior is driving pace & scale
 End-to-end load testing should be available everyday
 Testing is about rapid, repeatable, real time results
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Next Webinar: June 26
“’Tis The Season – Holiday 2014 eCommerce Quality Checklist.”
Register:
Webinars future and past: http://www.soasta.com/knowledge-
center/webinars/
Want to evaluate a TouchTest Private Device Cloud?
- email info@soasta.com
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com

Modern Load Testing: Move Your Load Testing from the Past to the Present

  • 1.
    0© 2013 SOASTACONFIDENTIAL - All rights reserved.Webinar
  • 2.
    1© 2013 SOASTACONFIDENTIAL - All rights reserved. Load testing is a team sport TODAY’S SOASTA PRESENTERS Ed Salazar: Brad Johnson: CloudTest Product Manager VP Product marketing Agenda: • User Experience is King • Testing for global, front to back, mobile and web users • Production is real. Use it to test and for data Questions: Submit in chat box during event
  • 3.
    2© 2013 SOASTACONFIDENTIAL - All rights reserved. Rapid Delivery Agile development Continuous delivery DevOps principles Mobile and Web Online everything Mobile commerce Legacy modernization Complexit y Composite apps 3rd party services API proliferation Unprecedented Scale 100’s to millions Local to global 100% availability
  • 4.
    3© 2013 SOASTACONFIDENTIAL - All rights reserved. o Not built for real time feedback across complex tiers o Assumes slow iterations and long cycle times o Not focused on the global user experience o Expensive license and HW dependencies o Built for the test lab, but locked out of production
  • 5.
    4© 2013 SOASTACONFIDENTIAL - All rights reserved. Fast time to results. SPEED Hundreds to Millions. SCALE Continuously. AFFORDABILITY
  • 6.
    5© 2013 SOASTACONFIDENTIAL - All rights reserved. The Old Way What would YOU do with more time?
  • 7.
    6© 2013 SOASTACONFIDENTIAL - All rights reserved. s Memory leaks Test Scale Stage/Team Dev & Test Release & Deploy Network & Ops CDN file placement Load Balancer configuration Network bandwidth Network configuration DNS routing Inadequate server resources Default configuration settings Unbalanced web serversAuto-scaling failures Latency between systems Slow third-party plug-ins Garbage collection Database thread counts Inefficient database queriesSlow pages Conflict with other apps Test Lab Staging Production (100% +++) Search technology limits Method-level tuning Max sockets exceeded Firewall max capacity Global latency variance Security bottlenecks Top Areas We Find Issues Performance validation from development to production Continuous tuning for full-scale…and well beyond
  • 8.
    7© 2014 SOASTACONFIDENTIAL - All rights reserved. o Frequent testing from development through production o Realism and accuracy from the user’s view to the last server o Real time analytics and integrated monitoring o End to end optimization from app to infrastructure o Test cycle acceleration and optimization
  • 9.
    8© 2014 SOASTACONFIDENTIAL - All rights reserved. o Include real mobile devices and their “system” metrics o Test in the production environment o Test to 2-3x the expected peak traffic levels o Test across geographies o Test corner cases o Measure in real time http://www.soasta.com/knowledge-center/whitepapers/
  • 10.
    9© 2012 SOASTA.All rights reserved. May 22, 2012 Two Fronts in the Performance War What good is reliability if the average page load time is 10 seconds? Who cares if the page load time is 2 seconds if only 10 people can hit the site? Page Speed Reliability BOTH.
  • 11.
    10© 2012 SOASTA.All rights reserved. May 22, 2012 Op s Tested apps roll into production Real user performance, usage & traffic levels mPulseCloudTest Dev. & Test TouchTest
  • 12.
    11© 2012 SOASTA.All rights reserved. May 22, 2012 CloudTest Performance (Patent) PRE-PRODUCTION Test Build & Editing TouchTest Functionality (Patent filed) mPulse Real User Measurement PRODUCTION Dev/Test Feedback Loop SOASTA Core DNA SOASTA Global Test Cloud World’s Largest Test Automation Platform SOASTA Command & Control Test & Measurement Automation Grid (Patent) Real time, Contextual & Actionable Intelligence SOASTA Analytic Engine In-Memory Performance Analytics (Patent filed)
  • 13.
    12© 2013 SOASTACONFIDENTIAL - All rights reserved. Ed Salazar
  • 14.
    13© 2013 SOASTACONFIDENTIAL - All rights reserved.  Mobile & web user behavior is driving pace & scale  End-to-end load testing should be available everyday  Testing is about rapid, repeatable, real time results
  • 15.
    Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest RESOURCES NextWebinar: June 26 “’Tis The Season – Holiday 2014 eCommerce Quality Checklist.” Register: Webinars future and past: http://www.soasta.com/knowledge- center/webinars/ Want to evaluate a TouchTest Private Device Cloud? - email info@soasta.com - You’ll hear from us tomorrow (maybe today)
  • 16.