Your SlideShare is downloading. ×
0
1© 2012 SOASTA. All rights reserved.Webinar
Presents
Tips and Tricks
from Large-Scale
Retail Performance
Engineers
2© 2012 SOASTA. All rights reserved. May 22, 2012
Preparing for the best case retail scenarios
TODAY’S SOASTA PRESENTERS
P...
3© 2012 SOASTA. All rights reserved. May 22, 2012
4© 2012 SOASTA. All rights reserved. May 22, 2012
Paul Korenevsky
Engagement Manager, Load Testing SME
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Intelligent Platform: What is it?
Scale & Breadth
• 120,000+ s...
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Solution Family
Inspire Innovation
©2013 AkamaiAkamai Confidential Faster ForwardTM
How Akamai Works
Customer
Origin
Users
Akamai Edge Server
closest to Orig...
©2013 AkamaiAkamai Confidential Faster ForwardTM
Preparing for Peak Traffic
1. Inventory potential Availability and Perfor...
©2013 AkamaiAkamai Confidential Faster ForwardTM
Typical load provides little insight into issues that
arise under peak lo...
©2013 AkamaiAkamai Confidential Faster ForwardTM
Stress test the origin
Origin
Infrastructure
©2013 AkamaiAkamai Confidential Faster ForwardTM
Why Performance Matters
Consumers are becoming less patient - 40% of shop...
©2013 AkamaiAkamai Confidential Faster ForwardTM
Load test through Akamai for realistic performance
results
Origin
Infrast...
13© 2012 SOASTA. All rights reserved. May 22, 2012
Craig Combs
Principal Performance Engineer
RetailerA
14© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
15© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
16© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
17© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
18© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
19© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
20© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
21© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test fo...
22© 2012 SOASTA. All rights reserved. May 22, 2012
23© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
24© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critic...
25© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critic...
26© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critic...
27© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critic...
28© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critic...
29© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTest
Actionable
intelligence
Scale
Speed
30© 2012 SOASTA. All rights reserved. May 22, 2012
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.34...
Upcoming SlideShare
Loading in...5
×

Performance Warrior Tales: Cloud Load Testing the Retail Giants

693

Published on

Paul Korenevsky and Craig Combs are battle-scarred veterans in the fight to preserve user experience and online retailer revenue. Paul is Akamai’s load testing Subject Matter Expert (SME) for major clients and Craig, a CloudTest Black Belt, has run Performance Engineering engagements at major retailers like Target, Sears, Best Buy and JCPenney.

They’re taking a rare pause to share their experiences with you, live! Paul and Craig will equip you with real-world tips & advice from the trenches!

· What are the two primary goals for seasonal testing?

· Which critical user-scenarios should be tested first?

· How do you create realistic conditions for distributed users?

· When should you stress your Content Delivery Network?

· Should you be hammering on live production systems?

SOASTA’s CloudTest platform is an Akamai-approved solution for testing retail sites for the eminent and ever increasing crush of holiday traffic. With capabilities that distribute the load across the globe using cloud infrastructure as well as instantaneous visibility into every aspect of performance during load tests, CloudTest is the performance warrior’s weapon of choice.

With real-world advice from battle-trained experts, this webinar is just in time for your seasonal planning!

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
693
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
18
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • The growing requirements of delivering dynamic transactions and interactive content must be matched with an increased ability to scale under high traffic load and perform reliably to meet increased consumer demand. Organizations competing for customers measure their success based not on seconds, but on milliseconds. Research has shown that users will visit a website less often if it is slower than a close competitor by more than 250 milliseconds. The difference between a two second load time and a one second load time can mean the difference between a user conversion, and a lost opportunity. In short, organizations seeking the maximum speed and offload must continue to further refine and optimize website performance.
  • Transcript of "Performance Warrior Tales: Cloud Load Testing the Retail Giants "

    1. 1. 1© 2012 SOASTA. All rights reserved.Webinar Presents Tips and Tricks from Large-Scale Retail Performance Engineers
    2. 2. 2© 2012 SOASTA. All rights reserved. May 22, 2012 Preparing for the best case retail scenarios TODAY’S SOASTA PRESENTERS Paul Korenevsky: Engagement Manager, Load Testing SME - Akamai Craig Combs: Principal Performance Engineer – Giant Retailer Mike Ostenberg: Sr. Solution Architect – SOASTA Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA Agenda: • Intro & Poll question • Meet Paul from Akamai • Meet Craig from a Top 5 retailer • Panel Questions • CloudTest demo for Retail Questions: Submit in chat box during event
    3. 3. 3© 2012 SOASTA. All rights reserved. May 22, 2012
    4. 4. 4© 2012 SOASTA. All rights reserved. May 22, 2012 Paul Korenevsky Engagement Manager, Load Testing SME
    5. 5. ©2013 AkamaiAkamai Confidential Faster ForwardTM The Akamai Intelligent Platform: What is it? Scale & Breadth • 120,000+ servers • 1,100+ networks • 750+ cities • 1,700+ locations • 74 countries The leading Internet Cloud platform for enabling secure, high-performing user experiences on any device, anywhere. Web Traffic • 500 billion hits per day • 19+ million hits per second • 100+ million streams per day • 1M+ concurrent streams • 5.5+ Terabits per second peak • 15 – 30 % of all Web traffic
    6. 6. ©2013 AkamaiAkamai Confidential Faster ForwardTM The Akamai Solution Family Inspire Innovation
    7. 7. ©2013 AkamaiAkamai Confidential Faster ForwardTM How Akamai Works Customer Origin Users Akamai Edge Server closest to Origin Server Akamai “SureRoute” protocol optimizes routes and reduces round trips High Performance Global Overlay Network Edge Region close to End User Web Server Security embedded into Akamai Edge Servers It All Starts in the Cloud – at the Edge
    8. 8. ©2013 AkamaiAkamai Confidential Faster ForwardTM Preparing for Peak Traffic 1. Inventory potential Availability and Performance risks, such as failures at the: • Web(servers/LBs) • App (servers/db/cache) • Back end (OMS, inventory, fraud prevention, tokenization…) • Network (ISP, pipe, DNS, LBs …) • Security (firewall, WAF, IPS/IDS) • CDN (unless its Akamai, of course) • 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …) 2. Evaluate each risk • Stress testing • Load testing • Penetration testing 3. Mitigate each risk, prioritizing based on evaluation • Define and implement proactive mitigations • Prepare and test reactive mitigations
    9. 9. ©2013 AkamaiAkamai Confidential Faster ForwardTM Typical load provides little insight into issues that arise under peak load Origin Infrastructure
    10. 10. ©2013 AkamaiAkamai Confidential Faster ForwardTM Stress test the origin Origin Infrastructure
    11. 11. ©2013 AkamaiAkamai Confidential Faster ForwardTM Why Performance Matters Consumers are becoming less patient - 40% of shoppers will abandon after 3 seconds 8 Seconds 4 Seconds 3 Seconds 0 2 4 6 8 10 Response Time Site Abandonment Threshold Zona Research, 1998 Jupiter Research, 2006 Forrester Research, 2009 10 Seconds Nielsen, 1996 Webpage Load Time Seconds 4 2 6 8 10 2 4 6 8 10 Seconds Consumer Patience
    12. 12. ©2013 AkamaiAkamai Confidential Faster ForwardTM Load test through Akamai for realistic performance results Origin Infrastructure
    13. 13. 13© 2012 SOASTA. All rights reserved. May 22, 2012 Craig Combs Principal Performance Engineer RetailerA
    14. 14. 14© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
    15. 15. 15© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
    16. 16. 16© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
    17. 17. 17© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
    18. 18. 18© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
    19. 19. 19© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything Don’t wait until just before the holidays Test in production
    20. 20. 20© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything  Don’t wait until just before the holidays Test in production
    21. 21. 21© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything  Don’t wait until just before the holidays  Test in production
    22. 22. 22© 2012 SOASTA. All rights reserved. May 22, 2012
    23. 23. 23© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing?
    24. 24. 24© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first?
    25. 25. 25© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions
    26. 26. 26© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN?
    27. 27. 27© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
    28. 28. 28© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
    29. 29. 29© 2012 SOASTA. All rights reserved. May 22, 2012 CloudTest Actionable intelligence Scale Speed
    30. 30. 30© 2012 SOASTA. All rights reserved. May 22, 2012 Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest Knowledge Center • White Papers • Webinar Recordings • Case Studies RESOURCES www.SOASTA.com CloudLink Community • Support • Tutorials • Video
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×