Provide On-Demand, Real World Load Testing to Your CustomersRobb Corduck, Channel & Alliances ManagerMarina Gil-Santamaria, Product Marketing Manager

Agenda Who is Gomez Reality Load Overview – Load testing from the end user perspective The Services Opportunity for Partners Partnering with Gomez QA

GomezWe help organizations deliver quality experiences to their Web and mobile usersOptimal performance and availabilityQuality operation across all users, browsers, devices, and geographies Rapid issue notification with actionable diagnosticsInsight into how these issues affect your business (revenue, brand, cost)SaaS PlatformNo installationRapid startup & paybackWorld’s most comprehensive testing network (100K+ testing locations)2,500+ Customers Worldwide1,250+ enterprise customers1,250+ SMB customers12 of top 20 US sitesSolid Business PerformanceFive consecutive years double digit revenue growth44% revenue growth 2008Offices worldwideRecognized as Industry LeaderForrester: “The leader in Web Experience Management”Gartner: “A cool vendor”

No installation

Rapid startup & payback

World’s most comprehensive testing network (100K+ testing locations)

1,250+ enterprise customers

1,250+ SMB customers

12 of top 20 US sites

Five consecutive years double digit revenue growth

44% revenue growth 2008

Offices worldwide

Forrester: “The leader in Web Experience Management”

Gartner: “A cool vendor”

Gomez CustomersFinancialServicesMediaEntertainmentHigh TechRetailTravelOther1,250 Enterprise customers5,000Entry/viralcustomers1,250SMB customers12of the top 20 visited US sites

Gomez Network: The World’s Most Comprehensive Performance and Testing Network BackboneVirtual Test BedGomez Last MileWeb Performance Management and Load Testing 100+ locationsCross-Browser Testing 500+ browser/OS combo’s5,000+ supported devicesWeb Performance Management and Load Testing 100,000+ locations

AgendaWho is Gomez Reality Load Overview – Load testing from the end user perspectiveThe Services Opportunity for Partners Partnering with Gomez QA

The Challenge of Delivering Quality Web ExperiencesTraditional testing: “OK”…user is NOT happyThe Web Application Delivery Chain3rd Party/Cloud ServicesBrowsers and devicesUsersUsersLocal ISPLoad BalancingLoad BalancingWeb ServersWeb ServersApp ServersApp ServersInternetDB ServersDB ServersMajorISPMobile CarrierStorageStorageMobile ComponentsMobile ComponentsContent DeliveryNetworksTraditional zone of control

The Web Application Delivery ChainInconsistent geo performanceBad performance under loadBlocking content deliveryIncorrect geo-targeted contentNetwork peering problemsBandwidth throttlingInconsistent connectivityPoorly performing JavaScriptBrowser/device incompatibilityPage size too bigToo many objectsLow cache hit rateConfiguration errorsApplication design issuesCode defectsInsufficient infrastructureNetwork peering problemsOutagesNetwork resource shortage Faulty content transcoding SMS routing / latency issues Configuration issuesOversubscribed POPPoor routing optimizationLow cache hit rateThe Challenge of Ensuring Quality Web ExperiencesTraditional testing: “OK”…user is NOT happyTraditional zone of controlZone of customer expectationZone of customer expectation

Inconsistent geo performance

Bad performance under load

Blocking content delivery

Incorrect geo-targeted content

Network peering problems

Bandwidth throttling

Inconsistent connectivity

Poorly performing JavaScript

Browser/device incompatibility

Page size too big

Too many objects

Low cache hit rate

Configuration errors

Application design issues

Code defects

Insufficient infrastructure

Network peering problems

Outages

Network resource shortage

Faulty content transcoding

SMS routing / latency issues

Configuration issues

Oversubscribed POP

Poor routing optimization

Low cache hit rate

Web Performance MattersAverage impact of 1 second delay in response time for Web usersCustomer SatisfactionPage ViewsConversionsLost revenues*Brand damageMore support callsIncrease costsLOB dissatisfaction with IT*Online business doing $100K/day = $2.5M/year in lost revenue

Lost revenues*

Brand damage

More support calls

Increase costs

LOB dissatisfaction with IT

What Features Should a Realistic Web Performance Testing Platform Have? It Should:Test from the end user’s point of viewDifferent locationsDifferent browsersDifferent loadsDifferent tasksBe easy for developers, testers and business people to use.Identify and resolve problems along the entire web application delivery chain.*Source: Achieving Peak User Experiences — Performance Testing in an Agile Web 2.0 World : Forrester’s Senior Analyst, Mike Gualtieri, and Gomez’s CTO, Imad Mouline

Gomez Reality Load XF: On-Demand Realistic Load Testing from Browser to Data CenterBackboneLast Mile Real-world load Find user experience breaking pointsAccurately measure response timeHigh volume load (HTTP, Browser)Find infrastructure breaking pointsDefine capacity headroom100,000+ consumer- grade desktops168+ countries2,500+ ISPsMajor mobile carriers around the globe100+ commercial-grade nodes & data centers

Reality Load Geographic Perspective Finds Critical Problems Undetectable with other SolutionsOnly 11 error total out of 60,000+ transactionsPage response time stayed under 4 seconds, outside of one brief blipA major hotel chain was planning a major marketing campaign in 3 key regions: Las Vegas, New York & Los Angeles, and they wanted to load test prior to launch. By traditional load testing standards, the test passed.Reality Load Geographic Perspective showed another story thought

Problem identified: A large number of measurements were greater than 4 seconds for key geographies (NY). These findings spurred a code tune and content deployment to a CDN to reduce response time variations across geographies. Overall response times was improved by 2+ secondsReality Load Geographic Perspective Finds Critical Problems Undetectable with other Solutions cont.

Reality Load Identifies Infrastructure-related Issues Test 1: Old Firewall (Benchmark)Users ramp up, and the firewall supported over 2,500 transactions per second.Test 2: New FirewallUsers ramp up, but the transaction rate bottlenecks at 1,000 per second.Response times for users climb  Validation for new firewall failed, bottleneck detectedA financial services organization had deployed new hardware, and they wanted to ensure that they would deliver quality Web experiences under load. Problem identified The new firewall was only licensed for 1,000 transactions per second

Users ramp up, and the firewall supported over 2,500 transactions per second.

Users ramp up, but the transaction rate bottlenecks at 1,000 per second.

Response times for users climb  Validation for new firewall failed, bottleneck detected

Reality Load Detects External Errors or 3rd-party SLAs ViolationsThe transaction rate increases and then falls off as response times climbThe load increases throughout the testErrors are seen, all on a 3rd party objectAn e-retailer had just selected a new third-party provider, and they wanted to verify overall application performance under load. Problem identified  3rd party hardware was insufficient for overall demands on the application, and based on SLA agreement, 3rd-party provider had to increase hardware and improve performance to get paid.

Reality Load Detects External Errors or 3rd-party SLAs Violations (continued)Problem identified  Error with an external redirect (configuration error that was handling a simple redirect as 6 steps)

What Makes Gomez Reality Load XF UniqueOn-demandAgile, responsive and timely testingNo need for large testing infrastructure investmentsFlexible scheduling and usageReal worldLast Mile testing from where your customers areCombines high volume and real browser loadSelf-service and managed-service optionsBrowser to data centerFind and resolve problems across the entire Web application delivery chain See impact of 3rd partiesWorld’s largest load testing network reach

Agile, responsive and timely testing

No need for large testing infrastructure investments

Flexible scheduling and usage

Last Mile testing from where your customers are

Combines high volume and real browser load

Self-service and managed-service options

Find and resolve problems across the entire Web application delivery chain

See impact of 3rd parties

World’s largest load testing network reach

AgendaWho is Gomez Reality Load Overview – Load testing from the end user perspective The Services Opportunity for PartnersPartnering with Gomez QA

What Projects Can Gomez Help With?

Reality Load Complements Existing Load Test ToolsTraditional Load Testing Tools

External Load Test Service OpportunitiesOrganizations lack the time, skill and expertise to:Create a solid load testing methodologyScript web applications including complex Web 2.0 appsExecute load tests within aggressive QA / and launch schedulesExpertly interpret and analyze test result dataConduct root cause analyses based on test resultsImplement proper changes to ensure a quality performance

Partnering Success Story -Challenge:Customer purchased Super Bowl ad and has less than 2 weeks to make switch to new hosting infrastructure and validate that the site can handle the anticipated end-user traffic to be generated by the high-profile ad.Opportunity: Customer lacked time and expertise to set-up, run and analyze a load test in a self-service manner. Also, with time so short, they needed a solution that could dial up load testing in near real-timePartner Managed Test Plan:Develop a test plan to simulate expected volume of site trafficCreate a series of load tests to provide run-up tests and longer duration load testsScript user interactions with the C4G.com websiteExecute a series of tests, tweak performance and re-execute over 2 daysResults: Partner ran a series of short and medium duration load testsIdentified a load-balancer configuration issue with the hosting vendor prior to site launchAfter correcting the issue, confirmed that C4G could handle the expected user trafficThe site performed well and delivered a quality user experience during and after the Super BowlPartner billed for 5 days of pro services

AgendaWho is Gomez Reality Load Overview – Load testing from the end user perspectiveThe Services Opportunity for Partners Partnering with Gomez QA

Benefits of Partnering with GomezBest-in-Class SolutionsGomez is a leader in outside the firewall load testing & user experience monitoringSaaS Suite of testing toolsEliminates need for expensive hardwareNo software to be installedCreate and launch load tests in under 15 minutesTraining & Methodology ResourcesGomez Partner PortalOn-Line Training & Gomez UniversityPartner Certification TrainingProfessional Services Methodologies & Best PracticesUtilize Gomez load test data to identify additional web application optimization projectsRevenue OpportunitiesResell Margins or Referral CommissionsProfessional Services

Gomez Solution in ReviewCovers the entire Web application delivery chain – from browser to data centerOver 100K+ global testing locations,including the Gomez Last MileTMFind and fix the broadest set of issuesWeb 2.0 technologiesUnderstand 3rd party impact on performanceA single, integrated platformExtend your load testing capabilitiesUnderstand real-user experienceLow total cost of ownershipThe most self-service control and flexibilityRapid on-boarding and professional guidanceOn-demand test creation, provisioning, usageConsumption-based pricingAdapts to your changing business needsReduce Cap Ex through SaaSBackboneVirtualLast MileReal UserPrivateEASY

Over 100K+ global testing locations,including the Gomez Last MileTM

Find and fix the broadest set of issues

Web 2.0 technologies

Understand 3rd party impact on performance

Extend your load testing capabilities

Understand real-user experience

Low total cost of ownership

Rapid on-boarding and professional guidance

On-demand test creation, provisioning, usage

Consumption-based pricing

Adapts to your changing business needs

Reduce Cap Ex through SaaS

AgendaWho is Gomez Reality Load Overview – Load testing from the end user perspectiveThe Services Opportunity for PartnersPartnering with GomezQA

Putting the Pieces TogetherQuestions & AnswersTo find out more about becoming a Gomez Partner:(781) 698-2317gomezpartners@gomez.comhttp://www.gomez.com/partners/application/