Web Performance Testing

Presenter’s Name Presenter’s Title Date

Agenda
The Impact of Web Performance
Challenges with Traditional Testing
Trusted Cloud Web Performance Testing
The Web Performance Testing Model
A Case Study and Analytic Dashboard
The CSC Accreditation
Next Steps

Reliability Matters “ 9 out of 10 website visitors switch to a competitor's website if a company's website fails to load “ - Survey by 1&12 “ 28% of online shoppers will not wait longer than four seconds for a web page to load before leaving “ - Akamai and Jupiter Research “ 90% of all web services are not load-tested” - InformationWeek

Impact of Performance Brand Image Revenue Customer Loyalty Customer Experience

Challenges with Traditional Testing
Inability to quickly isolate issues across the infrastructure
Monitoring application, network and servers
Aggregation/correlation technology to analyze and synthesize test data
Show only Traditional Testing
High Cost to Simulate Real World Traffic and Users
Availability and provisioning of needed hardware
Software licenses for high volume of Virtual Users
Staff time required to prepare environment and implement testing

Trusted Cloud Web Performance Testing
Effective
Real Time Monitoring of App-Environment-Platform
Sophisticated Analytics
Quickly pinpoint issues and fault points
Affordable
Load and Performance Testing
Leveraging the Cloud On Pay-Per-Use Model
Scalable
Simulating Real World Users and Web Traffic
10,000+ simultaneous users, from multiple servers
Loads generated from one or multiple global regions
Agile
Rapid deployment and execution
Speed total time to resolution

CSC Web Application Testing Delivery
Define Test Requirements Based on Business Need
Kick-off meeting
Test Development and Setup
Performance Engineer creates user scenario and test plans
Load, stress, performance testing parameters, ramp speed, duration
The CloudTest TM
Provision the required load servers/locations
CloudTest TM (SSH or agent) monitors all aspects of networks, system and applications
CloudTest TM is pointed at target application and testing begins
Results and Analytics
CloudTest TM real time dashboards begin presenting live test results and analysis
Test engineers review with customer live data as test is running
Deliver a full written report, including screen shots and tuning recommendations

Define Objectives and Test Requirements Determine Limits Measure User Experience Test Specific Silos Verify Redundancy Exceed Break Points Plan For The Future Reliability Over Time Test Objective Load Test Browser Performance Test Targeting Infrastructure Test Failover Test Stress Test Capacity Test Soak Test Web Performance Test

Test Development and CloudTest TM
AJAX-based, Modern Test Application
The CloudTest TM Global Platform
Data-Driven, Real-Time Test Analytics
Test Engineers, Provision and Execute

Performance Assessment Analytics

Trusted Cloud Web Performance Testing Partnership SOASTA and the SOASTA Logo are trademarks of SOASTA, INC.

CSC Global Testing Practice
Full lifecycle managed test services
Industry consulting to drive transformation
Testing Center of Excellence (CoE) integrating best-of-breed test processes
Testing solution accelerators
Technology
Domain
Process
Access to large pool of certified resources
Lifecycle Automation Solutions
Test automation frameworks
Tools labs and alliance partnerships
6000+ testing personnel
Optimal mix of domain, testing, tool and management expertise
Global footprint –
Multiple low cost centers
World Sourcing, follow-the-sun model
ITAR facilities
Flexible engagement models
co-ownership,
managed testing services
Testing as a Service (TaaS)
Indigenously developed flexible yet rigorous process models
Ensured independence through a strong governance structure
SLA-driven Risk-Reward model
Cost leveraging right-shoring and reusable assets
Reduced TCO and cycle time
Comprehensive Capability Globalized Service Delivery Predictable Gains Through Delivery Excellence

Requirements Collection System Study Test Strategy Design Test Environmental Setup Deployment of Monitors Scripting Test Run Analysis & Interim Report Implementation of Recommendations Final Comprehensive Report Project Closure Baseline Test Run Enhancement Test Run Diagnostic Test Run Performance Testing Lifecycle Traversal Document

Case Study: Spotlight
Millions of eFilers each TAX year
Several Performance issues in the Past
Internal Test Lab cost $4M (4K Test)
Test Tools: Silk-Keynote-Wily
SOASTA CloudTest TM Live Production
Tested over (33) Days
Slowly Ramping up User Traffic
Ramp-Monitor-Detect-Fix-Ramp
Peak, Reached 300,000 concurrent users
Peak, provisioned 2,200 Cloud server cores
Detected (27) “critical” performance issues
Testing CloudTest TM achieved (75X) results

Real-Time Test Analytics The Dashboard allows easy-to-use, real-time analytics based on testing implementation.

Case Study “ Most confidence we have had in an Intuit system in production… Ever! Thanks SOASTA! ” Dan Bartow Manager of Performance Engineering TurboTax SOASTA and the SOASTA Logo are trademarks of SOASTA, INC.

CSC Accreditation: Performance Matters
Validate performance level of a web application/web site
Average response time most accurately overall end to end performance metric
Real time performance feedback during testing to highlight areas of improvement
Accreditation report defining site performance based on metrics gathered during test
Accreditation Features
25 Hours of Performance Testing
10,000 Virtual Users
100 Hours of Build-Test-Analysis Time
Accreditation Report
Review of Findings On a Debrief Call

Next Steps
Trusted Cloud
Web Performance Testing
Schedule a Demonstration of Real Time Analytics Schedule a Kick Off Meeting To Understand needs and requirements www.csc.com/cloud

http://www.trustedcloudservices.com	16
http://www.slideshare.net	11
http://67.222.18.91	3
http://a6.64.354a.static.theplanet.com	2

Web Performance Testing

by CSC Trusted Cloud Services on Mar 19, 2010

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 32

Statistics

Web Performance Testing Presentation Transcript