Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Web Performance Testing


Published on

Web Performance Testing Presentation by Trusted Cloud Services.

Published in: Technology
  • CSC Trusted Cloud features SOASTA's CloudTest! The premier cloud-based testing platform built and adopted by the world's largest technology services firms.
    Are you sure you want to  Yes  No
    Your message goes here

Web Performance Testing

  1. 1. Presenter’s Name Presenter’s Title Date
  2. 2. Agenda <ul><li>The Impact of Web Performance </li></ul><ul><li>Challenges with Traditional Testing </li></ul><ul><li>Trusted Cloud Web Performance Testing </li></ul><ul><li>The Web Performance Testing Model </li></ul><ul><li>A Case Study and Analytic Dashboard </li></ul><ul><li>The CSC Accreditation </li></ul><ul><li>Next Steps </li></ul>
  3. 3. Reliability Matters “ 9 out of 10 website visitors switch to a competitor's website if a company's website fails to load “ - Survey by 1&12 “ 28% of online shoppers will not wait longer than four seconds for a web page to load before leaving “ - Akamai and Jupiter Research “ 90% of all web services are not load-tested” - InformationWeek
  4. 4. Impact of Performance Brand Image Revenue Customer Loyalty Customer Experience
  5. 5. Challenges with Traditional Testing <ul><li>Inability to quickly isolate issues across the infrastructure </li></ul><ul><ul><ul><ul><li>Monitoring application, network and servers </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Aggregation/correlation technology to analyze and synthesize test data </li></ul></ul></ul></ul>Show only Traditional Testing <ul><li>High Cost to Simulate Real World Traffic and Users </li></ul><ul><ul><ul><ul><li>Availability and provisioning of needed hardware </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Software licenses for high volume of Virtual Users </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Staff time required to prepare environment and implement testing </li></ul></ul></ul></ul>
  6. 6. Trusted Cloud Web Performance Testing <ul><li>Effective </li></ul><ul><ul><li>Real Time Monitoring of App-Environment-Platform </li></ul></ul><ul><ul><li>Sophisticated Analytics </li></ul></ul><ul><ul><li>Quickly pinpoint issues and fault points </li></ul></ul><ul><li>Affordable </li></ul><ul><ul><li>Load and Performance Testing </li></ul></ul><ul><ul><li>Leveraging the Cloud On Pay-Per-Use Model </li></ul></ul><ul><li>Scalable </li></ul><ul><ul><li>Simulating Real World Users and Web Traffic </li></ul></ul><ul><ul><li>10,000+ simultaneous users, from multiple servers </li></ul></ul><ul><ul><li>Loads generated from one or multiple global regions </li></ul></ul><ul><li>Agile </li></ul><ul><ul><li>Rapid deployment and execution </li></ul></ul><ul><ul><li>Speed total time to resolution </li></ul></ul>
  7. 7. CSC Web Application Testing Delivery <ul><li>Define Test Requirements Based on Business Need </li></ul><ul><ul><ul><ul><li>Kick-off meeting </li></ul></ul></ul></ul><ul><li>Test Development and Setup </li></ul><ul><ul><ul><ul><li>Performance Engineer creates user scenario and test plans </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Load, stress, performance testing parameters, ramp speed, duration </li></ul></ul></ul></ul><ul><li>The CloudTest TM </li></ul><ul><ul><ul><ul><li>Provision the required load servers/locations </li></ul></ul></ul></ul><ul><ul><ul><ul><li>CloudTest TM (SSH or agent) monitors all aspects of networks, system and applications </li></ul></ul></ul></ul><ul><ul><ul><ul><li>CloudTest TM is pointed at target application and testing begins </li></ul></ul></ul></ul><ul><li>Results and Analytics </li></ul><ul><ul><ul><ul><li>CloudTest TM real time dashboards begin presenting live test results and analysis </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Test engineers review with customer live data as test is running </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Deliver a full written report, including screen shots and tuning recommendations </li></ul></ul></ul></ul>
  8. 8. Define Objectives and Test Requirements Determine Limits Measure User Experience Test Specific Silos Verify Redundancy Exceed Break Points Plan For The Future Reliability Over Time Test Objective Load Test Browser Performance Test Targeting Infrastructure Test Failover Test Stress Test Capacity Test Soak Test Web Performance Test
  9. 9. Test Development and CloudTest TM <ul><ul><ul><li>AJAX-based, Modern Test Application </li></ul></ul></ul><ul><ul><ul><li>The CloudTest TM Global Platform </li></ul></ul></ul><ul><ul><ul><li>Data-Driven, Real-Time Test Analytics </li></ul></ul></ul><ul><ul><ul><li>Test Engineers, Provision and Execute </li></ul></ul></ul>
  10. 10. Performance Assessment Analytics
  11. 11. Trusted Cloud Web Performance Testing Partnership SOASTA and the SOASTA Logo are trademarks of SOASTA, INC.
  12. 12. CSC Global Testing Practice <ul><li>Full lifecycle managed test services </li></ul><ul><li>Industry consulting to drive transformation </li></ul><ul><li>Testing Center of Excellence (CoE) integrating best-of-breed test processes </li></ul><ul><li>Testing solution accelerators </li></ul><ul><ul><li>Technology </li></ul></ul><ul><ul><li>Domain </li></ul></ul><ul><ul><li>Process </li></ul></ul><ul><li>Access to large pool of certified resources </li></ul><ul><li>Lifecycle Automation Solutions </li></ul><ul><ul><li>Test automation frameworks </li></ul></ul><ul><ul><li>Tools labs and alliance partnerships </li></ul></ul><ul><li>6000+ testing personnel </li></ul><ul><li>Optimal mix of domain, testing, tool and management expertise </li></ul><ul><li>Global footprint – </li></ul><ul><ul><li>Multiple low cost centers </li></ul></ul><ul><ul><li>World Sourcing, follow-the-sun model </li></ul></ul><ul><ul><li>ITAR facilities </li></ul></ul><ul><li>Flexible engagement models </li></ul><ul><ul><li>co-ownership, </li></ul></ul><ul><ul><li>managed testing services </li></ul></ul><ul><ul><li>Testing as a Service (TaaS) </li></ul></ul><ul><li>Indigenously developed flexible yet rigorous process models </li></ul><ul><li>Ensured independence through a strong governance structure </li></ul><ul><li>SLA-driven Risk-Reward model </li></ul><ul><li>Cost leveraging right-shoring and reusable assets </li></ul><ul><li>Reduced TCO and cycle time </li></ul>Comprehensive Capability Globalized Service Delivery Predictable Gains Through Delivery Excellence
  13. 13. Requirements Collection System Study Test Strategy Design Test Environmental Setup Deployment of Monitors Scripting Test Run Analysis & Interim Report Implementation of Recommendations Final Comprehensive Report Project Closure Baseline Test Run Enhancement Test Run Diagnostic Test Run Performance Testing Lifecycle Traversal Document
  14. 14. Case Study: Spotlight <ul><li>Millions of eFilers each TAX year </li></ul><ul><li>Several Performance issues in the Past </li></ul><ul><li>Internal Test Lab cost $4M (4K Test) </li></ul><ul><ul><ul><ul><li>Test Tools: Silk-Keynote-Wily </li></ul></ul></ul></ul><ul><li>SOASTA CloudTest TM Live Production </li></ul><ul><ul><ul><ul><li>Tested over (33) Days </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Slowly Ramping up User Traffic </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Ramp-Monitor-Detect-Fix-Ramp </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Peak, Reached 300,000 concurrent users </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Peak, provisioned 2,200 Cloud server cores </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Detected (27) “critical” performance issues </li></ul></ul></ul></ul><ul><li>Testing CloudTest TM achieved (75X) results </li></ul>
  15. 15. Real-Time Test Analytics The Dashboard allows easy-to-use, real-time analytics based on testing implementation.
  16. 16. Case Study “ Most confidence we have had in an Intuit system in production… Ever! Thanks SOASTA! ” Dan Bartow Manager of Performance Engineering TurboTax SOASTA and the SOASTA Logo are trademarks of SOASTA, INC.
  17. 17. CSC Accreditation: Performance Matters <ul><li>Validate performance level of a web application/web site </li></ul><ul><ul><ul><ul><li>Average response time most accurately overall end to end performance metric </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Real time performance feedback during testing to highlight areas of improvement </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Accreditation report defining site performance based on metrics gathered during test </li></ul></ul></ul></ul><ul><li>Accreditation Features </li></ul><ul><ul><ul><ul><li>25 Hours of Performance Testing </li></ul></ul></ul></ul><ul><ul><ul><ul><li>10,000 Virtual Users </li></ul></ul></ul></ul><ul><ul><ul><ul><li>100 Hours of Build-Test-Analysis Time </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Accreditation Report </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Review of Findings On a Debrief Call </li></ul></ul></ul></ul>
  18. 18. Next Steps <ul><li>Trusted Cloud </li></ul><ul><li>Web Performance Testing </li></ul>Schedule a Demonstration of Real Time Analytics Schedule a Kick Off Meeting To Understand needs and requirements