3rd in the "Rewriting the Rules of Performance Testing" series. Slides for this webinar cover ways to start scaling up performance testing with the leading agile testing expert Matt Heusser and SOASTA's Dan Bartow.
Thank you so much for attending this webinar. The archive will be available on our website by the end of this week. Please tell others about it.
Changing rules 3_performance testing across lifecycle_slideshare
SOASTA Webinar SeriesCLOUD TESTING RULE 3:Rewriting the Rules of Performance Testing Across thePerformance Testing Lifecycle
Performance Has Been a Lab Exercise Dev & Test Lab DEPLOY Production Environment Status Quo: Performance Testing is oftensmall test window prior considered hard & non-repeatable to release due to real constraints: • Linear, multi-step approaches Analyze • Non-correlated, offline analysis • Tune Code • Build Test • Adjust • Disconnected teams • Setup • Collect Environment Metrics Settings • Costly test hardware • Find Issues Run Fix • Time-intensive test setup • Inability to hit realistic scale Time-consuming testing limits deployment options
Do We Spend Time Where It Counts? Many approaches are process and pre-test heavy Traditional Approaches TEST BUILDING HW Setup TEST ANALYZE FIX RETEST REPEAT? TIME BUILD H W TEST H W TEST H W TEST H W TEST H W TEST Extra ANALYZE ANALYZE ANALYZE ANALYZE ANALYZE S FIX S S S S time! FIX FIX FIX FIX e e e e e t t t t t u u u u u p p p p p Eliminate constraints and TEST MORE, at SCALE, in LESS TIME Agile approaches deliver results fast
Continuous Performance Testing is Progressive Dev & Test Lab Production Environment Start Include Hit expected Rechecksmall, early to performance scale in Test in regularly for Plan forroot out code- focus in staging and Production regression growth level issues iterations maintenance and capacity windows Keys to agile performance testing? SPEED – SCALE – COST
Performance Bugs Know No Borders Issues span teams, time and scale Latency between systems Network Network configuration Capacity limits & Ops Network bandwidth CDN file placement Conflict with other appsStage / Team DNS routing Load Balancer configuration Firewall max capacity Auto-scaling failures Unbalanced web servers Max sockets exceeded Release & Deploy Slow third-party plug-ins s Global latency variance Security bottlenecks Caching issues and benefits Search technology limits Default configuration settings Inadequate server resources Garbage collection Memory leaks Memory leaks Database thread counts Dev Slow pages & Test Inefficient database queries Code bugs Method-level tuning Test Lab Staging Production (100% +++) Scale and Time
Complete Performance TestingProactive and Predictive Track performance regression (and progression) over time! Performance Coverage Status Begin to track performance coverage across a range of critical objectives!
Let’s Look at the NEW RULES Performance Testing: Early, Often, Always Matt Heusser email@example.com
Q&A Questions & Answers will post on CloudLink: http://cloudlink.soasta.com Previous & Upcoming SOASTA Webinars:Stop Cheating & Start Running Realistic Tests (w/ Scott Barber) Run More Tests & Find More Issues (w/ Neil Gunther) http://www.soasta.com/info-center/webinars/ Contact SOASTA: Contact Matt www.soasta.com/cloudtest/ firstname.lastname@example.org email@example.com Follow Matt: 866.344.8766 Follow us: twitter.com/mheusser twitter.com/cloudtest facebook.com/cloudtest