Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Webcast with Target: API Performance Testing for Black Friday

3,139 views

Published on

In 2013, consumers spent $1.96 billion online with U.S. retailers on Black Friday, representing an 18.5% increase over 2012. Discover how Target, one of the nation’s largest retailers, planned for this—their biggest API event of their year. 

Aaron Strey from Target, an Apigee customer, and Greg Brail from Apigee will deep dive into the technical challenges of meeting massive business demand, supporting huge traffic surges, and optimizing API load and performance testing. 

Join to learn: 

• How to forecast load for peak events 
• Effective ways to create tests to measure predicted load
• Continuous load testing to be better prepared next time
• Best load testing and performance tools

Download video: http://youtu.be/X03M6CL-FSA
Download podcast: http://bit.ly/1rn1Jge
Download eBook: Are you where your customers are? http://bit.ly/1puABrr
Download eBook: Mobile mandate for retail http://bit.ly/1rwzbCD

Published in: Software
  • Be the first to comment

Webcast with Target: API Performance Testing for Black Friday

  1. 1. July 24, 2014 Webcast with Target: API Performance Testing for Black Friday
  2. 2. Today’s speakers Aaron Strey Target @Strey203 Greg Brail Apigee @gbrail
  3. 3. Apigee social channels CC BY-SA 3 YouTube http://youtube.com/apigee Slideshare http://slideshare.com/apigee
  4. 4. Target processes tens of millions of API requests per day For a brief period around Black Friday we see a ~10-fold increase in traffic 4
  5. 5. Generating load 5
  6. 6. Treat your test scripts like you treat your code 6
  7. 7. Predicting traffic 7 “Make everything as simple as possible, but not simpler.” -Albert Einstein
  8. 8. Predicting net new API consumer usage is really hard 8
  9. 9. Log and monitor all the things 9
  10. 10. Example metrics 10 Last 15 minutes Total Hits 7m ago 2347 Average TPS 7m ago 3.3 Perfy -­Avg TPS per Minute by API 7m ago 15 10 View results carts v1.0 carts v2.0 guests v3.0 lists v1.0 locat... v2.0 prod... v2.0 prod... v3.0 pro... v2.0 regis... v1.0 1:05 PM Thu Sep 4 2014 1:10 PM 1:15 PM _time 5 Distribution by Region 7m ago View results East NULL Perfy-­Avg Errors per Second per Minute 7m ago 3 2 View results Errors 201...5:00 201...5:00 201...5:00 201...5:00 _time 1 Errors Perfy -­Count of Errors by API 7m ago View results count carts v2.0 products v3.0 API 0 2 4 count 0.164609 7m ago Average Client Total Response Time 0.098480 7m ago Average Gateway Processing Time 0.068041 7m ago Average Backend Processing Time 0.304624 7m ago Standard Deviation Client Total Response Time 0.165385 7m ago Standard Deviation Gateway Processing Time 0.260147 7m ago Standard Deviation Backend Processing Time 7m ago Perfy -­95th Percentile Response Time 1.5 1 View results p95(ClientTotalTime) p95(difference) p95(TargetTotalTime) 1:05 PM Thu Sep 4 2014 1:10 PM 1:15 PM _time 0.5 7m ago Perfy -­95th Percentile Response Time where Cache NOT True 1.5 1 View results p95(ClientTotalTime) p95(difference) p95(TargetTotalTime) 1:05 PM Thu Sep 4 2014 1:10 PM 1:15 PM _time 0.5
  11. 11. Example metrics
  12. 12. Test APIs for anti-fragility 12
  13. 13. Test APIs continuously 13
  14. 14. Keep ownership of performance testing as close to the development team as possible 14
  15. 15. Types of tests Stress: determines the load you can handle and still meet your SLA Load: 80% of stress Soak: 80% of load for an extended period Spike: 80% of load to 120% of load back and forth 15
  16. 16. The hard stuff 16
  17. 17. Key takeaway 17 Performance testing is a first-class citizen
  18. 18. Questions? Aaron Strey Target @strey203 Greg Brail Apigee @gbrail
  19. 19. Thank you 11 February 2014

×