Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
New Approaches to Real-Time ApplicationTesting and Performance MonitoringDecember 15, 2011
Agenda•   Best practices for holiday performance testing•   New testing and monitoring techniques•   Demo•   Q&A
Housekeeping• Presentation will last 45 minutes• Submit questions via the chat window• Slides will be made available
Featured Speakers    Oren Elias    Brad Johnson            Dan Bartow    CEO           VP, Product Marketing   VP, Chief E...
BEFORE, DURING AND AFTERTHE HOLIDAYS
The Online Market              You are here!
Cyber Monday 2011          • $1.3B          • 33% y/y growth in traffic          • 10.8% is Mobile (3.9% last year)
iCommerce: Biggest Mobile Influence
The IT Landscape Has ChangedWhat is “Peak Load”?•   100%, 200%...500%+?•   How much mobile traffic should we prepare for…a...
The IT Landscape Has ChangedWhat is “Peak Load”?•   You must to test to new limits with a mix of web and mobile trafficWha...
BEST PRACTICES
Monitoring best practice 1“Assume Nothing”                             Oops. A                             production serv...
Monitoring best practice 2  Visibility explains REAL phenomenasSpecific transactiontype is failingSpecific location isfail...
Monitoring best practice 2Visibility explains REAL phenomenas                                      It is pretty           ...
Monitoring best practice 3Baseline and compare                    Compare application model of                    100% loa...
Testing best practice 1• Start early & test progressively.   – Begin in development   – Run many iterative tests that addr...
Testing best practice 2• Test realistically.   – Model users acting like humans   – Stress & measure at a realistic pace  ...
Testing best practice 3• Seek a single source of performance truth.  – Get Dev & Ops on the same page. (Is 2 seconds okay?...
Thankfully, There is a Solution         SharePath identifies critical transactions         to test what matters most      ...
Demo
Summary• The IT Landscape has changed• Start your testing early, test progressively, and  test realistically• When monitor...
Questions   Contact SOASTA:                        Contact Correlsense:   www.soasta.com/cloudtest/              www.corre...
Upcoming SlideShare
Loading in …5
×

New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry

1,979 views

Published on

According to the online retail research firm comScore, this year’s Cyber Monday sales surpassed the $1.25 billion mark, breaking all previous records and setting the pace for the busiest online retail season in history. The key to many of this year’s success was deep insight into how web systems would handle realistic user traffic coupled and where issues would occur. Firms must adopt the correct application testing and performance monitoring methodologies to ensure revenues and avoid disaster. Join SOASTA and Correlsense for this engaging webinar, which will give you an executable plan for your IT operations team. You will learn:

Best Practices in planning, executing, and closing out your holiday performance testing campaign
How to test and monitor mission critical applications leading into and during the holiday season
Performance testing and monitoring techniques that will guarantee a satisfying end user experience
Technologies which will allow you to quickly determine the most important tests to run based on what real users are doing
Case studies and demonstrations showing how the combination of deep transactional data and cloud-based testing deliver confidence in holiday retail readiness

Published in: Technology
  • Be the first to comment

  • Be the first to like this

New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry

  1. 1. New Approaches to Real-Time ApplicationTesting and Performance MonitoringDecember 15, 2011
  2. 2. Agenda• Best practices for holiday performance testing• New testing and monitoring techniques• Demo• Q&A
  3. 3. Housekeeping• Presentation will last 45 minutes• Submit questions via the chat window• Slides will be made available
  4. 4. Featured Speakers Oren Elias Brad Johnson Dan Bartow CEO VP, Product Marketing VP, Chief Evangelist Correlsense SOASTA SOASTA
  5. 5. BEFORE, DURING AND AFTERTHE HOLIDAYS
  6. 6. The Online Market You are here!
  7. 7. Cyber Monday 2011 • $1.3B • 33% y/y growth in traffic • 10.8% is Mobile (3.9% last year)
  8. 8. iCommerce: Biggest Mobile Influence
  9. 9. The IT Landscape Has ChangedWhat is “Peak Load”?• 100%, 200%...500%+?• How much mobile traffic should we prepare for…and how?What Are The Most Important Transactions?• What are the most profitable paths users follow?• What is the affect of non-buying “browsing” on paying customers?What System Do You Test In?• Is the lab good enough?• Production testing is taboo (isn’t it)?How Will You Find The Issues?• Complexity reigns• How do we see where issues are at load?
  10. 10. The IT Landscape Has ChangedWhat is “Peak Load”?• You must to test to new limits with a mix of web and mobile trafficWhat Are The Most Important Transactions?• Those that you determine as profitable, complex and/or riskyWhat System Do You Test In?• Testing is a continuous process from the lab to live productionHow Will You Find The Issues?• Monitoring during tests for the the end-to-end view while tests run
  11. 11. BEST PRACTICES
  12. 12. Monitoring best practice 1“Assume Nothing” Oops. A production server! UAT Environment topology autodetected
  13. 13. Monitoring best practice 2 Visibility explains REAL phenomenasSpecific transactiontype is failingSpecific location isfailing
  14. 14. Monitoring best practice 2Visibility explains REAL phenomenas It is pretty easy to see the load balance mismatch You can see that the % Time spent between User and Data Center is the issue here When compared Or the %Time to % Time spent spent rendering within the Data on the user’s Center device
  15. 15. Monitoring best practice 3Baseline and compare Compare application model of 100% load vs. 150% of load
  16. 16. Testing best practice 1• Start early & test progressively. – Begin in development – Run many iterative tests that address performance from code though infrastructure – Finish in production (Live prod to really be sure)
  17. 17. Testing best practice 2• Test realistically. – Model users acting like humans – Stress & measure at a realistic pace – Run at true scale – From different locations and devices
  18. 18. Testing best practice 3• Seek a single source of performance truth. – Get Dev & Ops on the same page. (Is 2 seconds okay?) – Measure with the same tools in Dev, Test & Ops – Correlate monitoring data with test data as tests run
  19. 19. Thankfully, There is a Solution SharePath identifies critical transactions to test what matters most CloudTest enables testing to any level with web or mobile traffic – in lab or production environments Monitor critical metrics during and after tests to isolate and prevent production outages
  20. 20. Demo
  21. 21. Summary• The IT Landscape has changed• Start your testing early, test progressively, and test realistically• When monitoring critical applications, assume nothing, look for root cause phenomena, use baselines, and compare• SharePath and CloudTest provide an integrated solution
  22. 22. Questions Contact SOASTA: Contact Correlsense: www.soasta.com/cloudtest/ www.correlsense.com/demo info@soasta.com www.real-user-monitoring.com 866.344.8766 info@correlsense.com Follow us: Follow us: twitter.com/cloudtest twitter.com/correlsense facebook.com/cloudtest facebook.com/correlsense Get your free copy Download GET STARTED SharePath RUM! CloudTest Lite - FREE! TODAY! http://www.real-user-monitoring.com/www.soasta.com/cloudtest/lite/

×