Download to read offline
Uploaded bySOASTA
Performance Warrior Tales: Cloud Load Testing the Retail Giants
The document outlines tips and strategies for performance testing in retail scenarios, presented by experts from Akamai and a leading retailer. Key recommendations include testing for spikes, monitoring user experience, and preparing for peak load conditions to avoid issues. The emphasis is on proactive risk management and realistic testing practices to ensure optimal website performance, especially during high-traffic seasons.
More Related Content
Similar to Performance Warrior Tales: Cloud Load Testing the Retail Giants
Performance Warrior Tales: Cloud Load Testing the Retail Giants
- 1. 1© 2012 SOASTA.All rights reserved.Webinar Presents Tips and Tricks from Large-Scale Retail Performance Engineers
- 2. 2© 2012 SOASTA.All rights reserved. May 22, 2012 Preparing for the best case retail scenarios TODAY’S SOASTA PRESENTERS Paul Korenevsky: Engagement Manager, Load Testing SME - Akamai Craig Combs: Principal Performance Engineer – Giant Retailer Mike Ostenberg: Sr. Solution Architect – SOASTA Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA Agenda: • Intro & Poll question • Meet Paul from Akamai • Meet Craig from a Top 5 retailer • Panel Questions • CloudTest demo for Retail Questions: Submit in chat box during event
- 3. 3© 2012 SOASTA.All rights reserved. May 22, 2012
- 4. 4© 2012 SOASTA.All rights reserved. May 22, 2012 Paul Korenevsky Engagement Manager, Load Testing SME
- 5. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM The Akamai Intelligent Platform: What is it? Scale & Breadth • 120,000+ servers • 1,100+ networks • 750+ cities • 1,700+ locations • 74 countries The leading Internet Cloud platform for enabling secure, high-performing user experiences on any device, anywhere. Web Traffic • 500 billion hits per day • 19+ million hits per second • 100+ million streams per day • 1M+ concurrent streams • 5.5+ Terabits per second peak • 15 – 30 % of all Web traffic
- 6. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM The Akamai Solution Family Inspire Innovation
- 7. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM How Akamai Works Customer Origin Users Akamai Edge Server closest to Origin Server Akamai “SureRoute” protocol optimizes routes and reduces round trips High Performance Global Overlay Network Edge Region close to End User Web Server Security embedded into Akamai Edge Servers It All Starts in the Cloud – at the Edge
- 8. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM Preparing for Peak Traffic 1. Inventory potential Availability and Performance risks, such as failures at the: • Web(servers/LBs) • App (servers/db/cache) • Back end (OMS, inventory, fraud prevention, tokenization…) • Network (ISP, pipe, DNS, LBs …) • Security (firewall, WAF, IPS/IDS) • CDN (unless its Akamai, of course) • 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …) 2. Evaluate each risk • Stress testing • Load testing • Penetration testing 3. Mitigate each risk, prioritizing based on evaluation • Define and implement proactive mitigations • Prepare and test reactive mitigations
- 9. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM Typical load provides little insight into issues that arise under peak load Origin Infrastructure
- 10. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM Stress test the origin Origin Infrastructure
- 11. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM Why Performance Matters Consumers are becoming less patient - 40% of shoppers will abandon after 3 seconds 8 Seconds 4 Seconds 3 Seconds 0 2 4 6 8 10 Response Time Site Abandonment Threshold Zona Research, 1998 Jupiter Research, 2006 Forrester Research, 2009 10 Seconds Nielsen, 1996 Webpage Load Time Seconds 4 2 6 8 10 2 4 6 8 10 Seconds Consumer Patience
- 12. ©2013 AkamaiAkamai ConfidentialFaster ForwardTM Load test through Akamai for realistic performance results Origin Infrastructure
- 13. 13© 2012 SOASTA.All rights reserved. May 22, 2012 Craig Combs Principal Performance Engineer RetailerA
- 14. 14© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 15. 15© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 16. 16© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 17. 17© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 18. 18© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 19. 19© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 20. 20© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 21. 21© 2012 SOASTA.All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
- 22. 22© 2012 SOASTA.All rights reserved. May 22, 2012
- 23. 23© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing?
- 24. 24© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first?
- 25. 25© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions
- 26. 26© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN?
- 27. 27© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
- 28. 28© 2012 SOASTA.All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
- 29. 29© 2012 SOASTA.All rights reserved. May 22, 2012 CloudTest Actionable intelligence Scale Speed
- 30. 30© 2012 SOASTA.All rights reserved. May 22, 2012 Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest Knowledge Center • White Papers • Webinar Recordings • Case Studies RESOURCES www.SOASTA.com CloudLink Community • Support • Tutorials • Video
Editor's Notes
- #6 The Akamai Intelligent Platform is the leading cloud platform for delivering secure, high-performing user experiences to any device, anywhere. It is a network of over 120,000 servers equipped with proprietary software and deployed in over 75 countries. It relies on applied mathematics and algorithms to help solve congestion and vulnerability problems on the Internet. These servers monitor the Internet in real time - gathering information about traffic, congestion, and trouble spots. Akamai uses this intelligence to optimize routes and replicate data dynamically to deliver content and applications more quickly, reliably, and securely. The Akamai Intelligent Platform can: identify, absorb, and block security threats. provide instant device-level detection and optimization. make decisions based on comprehensive knowledge of network conditions. present unprecedented business and technical insights.
- #8 The globally-distributed Akamai Intelligent Platform continuously pulls and caches fresh content onto servers that are closer to the end user. Akamai’s intelligent dynamic mapping system directs user requests for dynamic content to an optimal Akamai Edge Server. Through route optimization the fastest and most reliable path back to a customer’s data center is identified to retrieve dynamic/interactive content. Trips to the origin server to refresh and retrieve content are optimized via the use of persistent connections, thereby reducing connection setup and teardown latency. Additional connection optimization techniques tune the parameters that govern server-to-server connections, as well as reduce the number of long-haul round trips required to retrieve content embedded in the site.
- #9 Load testing provides insight into site performance, which is closely tied to conversion, engagement, and end user satisfaction Load testing also provides means for accurate evaluation of Dos/DDoS impact
- #10 Artificial load is necessary to simulate peak load conditions
- #11 Evaluate origin infrastructure by stress testing directly against the origin, bypassing CDN and excluding 3rd Party content/services
- #12 The growing requirements of delivering dynamic transactions and interactive content must be matched with an increased ability to scale under high traffic load and perform reliably to meet increased consumer demand. Organizations competing for customers measure their success based not on seconds, but on milliseconds. Research has shown that users will visit a website less often if it is slower than a close competitor by more than 250 milliseconds. The difference between a two second load time and a one second load time can mean the difference between a user conversion, and a lost opportunity. In short, organizations seeking the maximum speed and offload must continue to further refine and optimize website performance.
- #13 With Akamai, fewer unique machines connect to your origin server directly and fewer requests are served by your origin.