Dan Bartow, VP Performance Engineering, SOASTA and Steve Burton, Technology Evangelist, AppDynamics discuss the convergence of two traditionally separate domains and also demo testing and troubleshooting with CloudTest & AppDynamics.

1. PERFORMANCE:
Where Real-Time Testing & Production
Monitoring Converge

2. In This Webinar:
Reality Is Production…Let’s Test There.
TODAY’S PRESENTERS
Steve Burton: Technology Evangelist, AppDynamics
Dan Bartow: VP Performance Engineering, SOASTA
Brad Johnson: VP Product Marketing, SOASTA
AGENDA
I. The convergence of two traditionally separate domains
II. Demonstration: Testing & Troubleshooting with CloudTest &
AppDynamics
Questions: Submit in the question box during event

3. s
Memory leaks
Scale and Time
Stage/Team
Performance Issues Know No Borders
Trouble spans teams, time and scale
Release
& Deploy
Network
& Ops
CDN file placement
Load Balancer configuration
Hung JVM
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web servers
Auto-scaling failures
Exhausted Connection Pool
Slow third-party plug-ins
Garbage collection
Slow pages
Conflict with other apps
Dev
& Test
Test Lab Staging Production (100% +++)
Method-level tuning
Max sockets exceeded
OutOfMemoryException
Memory leaks
Caching issues and benefits
Capacity limits
Code bugs
Database thread counts
Inefficient database queries
Search technology limits
Security bottlenecks
Synchronization Latency
Reality? Any
issue can occur
in production!

4. Old Way: Performance Testing Has Been a
Lab Exercise
Dev & Test Lab Production EnvironmentDEPLOY
Performance Testing Challenges:
• Linear, multi-step approaches
• Non-correlated, offline analysis
• Disconnected teams
• Costly test hardware
• Non-scalable performance tools
• Time-intensive setup
• Inability to hit realistic scale
Status Quo:
Small test window prior
to release
• Build Test
• Setup
Environment
Run
• Collect
Metrics
• Find Issues
Analyze • Tune Code
• Adjust
Settings
Fix
Time-consuming testing limits
deployment options

5. Dev & Test Lab
Old Way: Problem Isolation Has Been a
Lab Exercise
Problem Isolation Challenges:
• Agile methodology increases change
• SOA increases complexity
• Data volumes differ from prod
• Hardware specs differ from prod
• Profilers slow application down
• Reliability over Scalability
Status Quo:
Applications still crash
and run slow in prod
• Build Test
• Setup
Environment
Run
• Response
Times
• Exceptions
Analyze • Fix Code
• Optimize
Configuration
Fix
Make the application stable
Production EnvironmentDEPLOY

6. Agile development cycles compress test cycles
• Days vs. weeks
• Incomplete knowledge transfer from Dev to Test to Ops
• Difficult to simulate every user session variation
What’s Changed?
Costly to simulate peak loads in test environments
• Performance testing & optimization need to change, too…
Production environments are difficult to replicate
• Horizontal scaling requires many commodity servers
• Transaction volumes have Increased with Web & mobile commerce
• Large data sets are difficult to replicate

7. New Way: Test & Monitor your Applications
from Lab into Production
Dev & Test Lab Production Environment
Start small,
early to root
out code-
level issues
Isolate & fix
performance
issues in the
lab
Hit expected
scale in
staging and
maintenance
windows
Detect
problems in
both real and
synthetic
sessions
Recheck
regularly for
regression
and capacity
Solve issues
as they occur
in the
lifecycle

8. Everyone Wants to be Agile
New Way
(production)
Hours
Minutes
TIME
TESTHW Setup FIXANALYZE RETEST REPEAT?
BUILD TEST
ANALYZE
FIX
Traditional Approaches
Agile Performance Approach
TEST BUILDING
TEST
ANALYZE
FIX
H
W
S
e
t
u
p
H
W
S
e
t
u
p
TEST
ANALYZE
FIX
H
W
S
e
t
u
p
TEST
ANALYZE
FIX
H
W
S
e
t
u
p
TEST
ANALYZE
FIX
H
W
S
e
t
u
p
Extra
time!
Old Way
(dev/test)
Load Testing Weeks
Isolate Problems Hours

9. “But, Testing in Production Is SCARY!”
(Isn’t it?)
It is when using tools & approaches never intended for
the complexity & magnitude of modern environments
SPEED – able to deploy and gain
insight within minutes
SCALE – simulate any number of
geographically disperse users
REAL TIME ANALYSIS – access
to all performance info as issues
occur
CONTROL – Stop, Start, Modify,
Pause user traffic as tests run
These Key Criteria eliminate RISK & make
Production Testing a critical requirement!

10. The Convergence of Real-Time Testing &
Production Monitoring is HERE NOW!
Dan Bartow
(SOASTA)
Demonstration – SOASTA & AppDynamics
Steve Burton
(AppDynamics)

11. Try us for FREE:
http://www.appdynamics.com/free
http://www.soasta.com/cloudtest/lite
Questions & Answers will post on CloudLink:
http://cloudlink.soasta.com
Previous & Upcoming Webinars:
http://www.soasta.com/info-center/webinars/
Q&A
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
Contact AppDynamics
www.appdynamics.com
info@appdynamics.com
415-442-8400
Follow us:
twitter.com/appdynamics
facebook.com/appdynamics