More Related Content Similar to Modern Load Testing: Move Your Load Testing from the Past to the Present Similar to Modern Load Testing: Move Your Load Testing from the Past to the Present (20) Modern Load Testing: Move Your Load Testing from the Past to the Present2. 1© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load testing is a team sport
TODAY’S SOASTA PRESENTERS
Ed Salazar: Brad Johnson:
CloudTest Product Manager VP Product marketing
Agenda:
• User Experience is King
• Testing for global, front to back, mobile and web users
• Production is real. Use it to test and for data
Questions:
Submit in chat box during event
3. 2© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Rapid Delivery
Agile development
Continuous
delivery
DevOps principles
Mobile and Web
Online everything
Mobile commerce
Legacy modernization
Complexit
y
Composite apps
3rd party
services
API proliferation
Unprecedented
Scale
100’s to millions
Local to global
100%
availability
4. 3© 2013 SOASTA CONFIDENTIAL - All rights reserved.
o Not built for real time feedback across complex tiers
o Assumes slow iterations and long cycle times
o Not focused on the global user experience
o Expensive license and HW dependencies
o Built for the test lab, but locked out of production
5. 4© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Fast time to results.
SPEED
Hundreds to Millions.
SCALE
Continuously.
AFFORDABILITY
6. 5© 2013 SOASTA CONFIDENTIAL - All rights reserved.
The Old Way
What would YOU
do with more
time?
7. 6© 2013 SOASTA CONFIDENTIAL - All rights reserved.
s
Memory leaks
Test Scale
Stage/Team
Dev
& Test
Release
& Deploy
Network
& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Top Areas We Find Issues
Performance validation from development to production
Continuous tuning for full-scale…and well beyond
8. 7© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Frequent testing from development through production
o Realism and accuracy from the user’s view to the last server
o Real time analytics and integrated monitoring
o End to end optimization from app to infrastructure
o Test cycle acceleration and optimization
9. 8© 2014 SOASTA CONFIDENTIAL - All rights reserved.
o Include real mobile devices and their “system” metrics
o Test in the production environment
o Test to 2-3x the expected peak traffic levels
o Test across geographies
o Test corner cases
o Measure in real time
http://www.soasta.com/knowledge-center/whitepapers/
10. 9© 2012 SOASTA. All rights reserved. May 22, 2012
Two Fronts in the Performance War
What good is reliability
if the average page
load time is 10
seconds?
Who cares if the page
load time is 2
seconds if only 10
people can hit the
site?
Page Speed Reliability
BOTH.
11. 10© 2012 SOASTA. All rights reserved. May 22, 2012
Op
s
Tested apps roll into
production
Real user
performance, usage &
traffic levels
mPulseCloudTest
Dev. & Test
TouchTest
12. 11© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTest
Performance
(Patent)
PRE-PRODUCTION
Test Build & Editing
TouchTest
Functionality
(Patent filed)
mPulse
Real User
Measurement
PRODUCTION
Dev/Test Feedback Loop
SOASTA Core DNA
SOASTA Global Test Cloud
World’s Largest Test Automation Platform
SOASTA Command & Control
Test & Measurement Automation Grid
(Patent)
Real time, Contextual & Actionable
Intelligence
SOASTA Analytic Engine
In-Memory Performance Analytics
(Patent filed)
14. 13© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Mobile & web user behavior is driving pace & scale
End-to-end load testing should be available everyday
Testing is about rapid, repeatable, real time results