Gomez loadtesting salesnov2011

Gomez Web Load TestingLoad Testing 1.0 Fails Web 2.0Elad Altstein – CTO Software Products DivisionMatrix

The Browser Is Becoming THE Integration PlatformNumber of hosts accessed directly by the browser,per user transaction, averaged across 3,000 companies 10.6

The Challenge of Delivering Web Applications Systems …user ismanagement NOT happy tools: “OK” The Web Application Delivery Chain 3rd Party/ BrowsersLoad Cloud Services Local ISP and devices UsersBalancersWebServersMobileComponentsAppServers InternetDB MajorServers ISPStorageMainframeNetwork Content Delivery Mobile Networks Carrier Traditional zone of control

The Challenge of Ensuring Quality Web Experiences Systems …user ismanagement NOT happy tools: “OK” The Web Application Delivery Chain 3rd Party/ BrowsersLoad Cloud Services Local ISP and devices UsersBalancers • Inconsistent geo performanceWeb • Bad performance under load • Network peering • PoorlyServers • Blocking content delivery problems performing • Incorrect geo-targeted content • Bandwidth JavaScriptMobile throttling • Browser/deviceComponents • Inconsistent incompatibility • Configuration • Network peering connectivity • Page sizeApp errors problems too bigServers • Application • Outages Internet • Too many design issues • Network resource objectsDB • Code defects Major shortageServers ISP • Low cache • Insufficient • Faulty content hit rateStorage infrastructure transcoding • SMS routing /Mainframe latency issues • Configuration issuesNetwork • Oversubscribed POP Content Delivery Mobile • Poor routing optimization Networks Carrier • Low cache hit rate Traditional zone Traditional zone Zone of customer expectation of customer expectation Zone of customer expectation of control of control Zone

The Business Impact of Poor Web Experiences Systems …user ismanagement NOT happy tools: “OK” The Web Application Delivery Chain 3rd Party/ BrowsersLoad Cloud Services Local ISP and devices UsersBalancersWeb Ineffective SLA’s and • LostServers partner relationships revenue • BrandMobile damageComponents • Dissatisfied customersApp Ineffective SLA’s and • IncreasedServers Over investment partner relationships Internet call center in infrastructure volumeDB Major • IncreasedServers ISP costsStorage Over spending on CDNsMainframeNetwork Content Delivery Mobile Networks Carrier Traditional zone Zone of customer expectation of control

Pinpointing Problems and Optimizing Performance The Web Application Delivery Chain 3rd Party/ BrowsersLoad Cloud Services Local ISP and devices UsersBalancersWebServers Is it myMobileComponents Is it an Is it a Is it aAppServers data ISP or the 3rd party Internet browser orDB center? Internet? Major provider? device?Servers ISPStorageMainframeNetwork Content Delivery Mobile Networks Carrier

The Answer: Adopt an “Outside-in” Customer Point ofView The Web Application Delivery Chain Enterprise Internet 3rd Party/ BrowsersLoad and resolve Isolate Test/monitor your site the Services customers use it: Cloud way your Local ISP and devices UsersBalancers performance • What they do (key pages and transactions) problems across the • Where they do it (geographic locations)Web applicationServers • How they do it (browsers and mobile devices) infrastructure • When they do it (normal and peak usage)Mobile Determine the impact on their behavior and your businessComponentsAppServers “Outside-in” customer point of view InternetDB MajorServersVantage ISP Gomez PlatformStorage Web Enterprise Cross- Web Web Web WebMainframe Application Cross- Load and Performance Performance Browser Browser Performance Management Content Delivery MobileBusinessNetworkTesting Performance Testing Testing Analysis Management Networks Carrier Traditional zone Your zone of control withZone of customer expectation Gomez of control

Gomez Network: The World’s Most Comprehensive Performance and Testing NetworkBackbone Gomez Last Mile Virtual Test Bed Your Actual Users Web Performance Web Performance Cross-Browser Testing Real User Management and Management and 500+ browser/OS Monitoring Load Testing Load Testing combo’s Worldwide, wherever 150+ locations 150,000+ locations 5,000+ supported your users are devices

Traditional Behind-the-firewall Testing (Load Testing1.0) • Pros:Load generation – Best of breed visibility into resources behind the firewall behind the firewall – Optimal for stress testing internal systems • Cons – Offered as a product  you need to install SW, provision hardware, apply patches, etc – Requires hundreds of servers for high volume load testing 3rd Party/ Browsers Load Cloud Services Local ISP & devices Users – Typically harder to script Balancers Web – No visibility into end-user experience Servers Mobile – No visibility into third-party external Components components App Servers Internet – No visibility into geographical response time discrepancies that may surface under DB Servers Major ISP load Storage Mainframe Network Content Delivery Mobile Networks Carrier

Cloud Testing (Load Testing 1.5) Load generation • Pros: from the cloud – Generate large volume of load – Offered as a SaaS (no software to maintain, or hardware to provision) • Cons 3rd Party/ Browsers – No visibility into end-userLoadBalancers Cloud Services Local ISP & devices Users experienceWebServers – No visibility into all third-partyMobile external components (e.gComponents CDNs)AppServers Internet – You can’t find problems acrossDB Major the entire Web ApplicationServers ISP Delivery ChainStorageMainframe – No visibility into geographicalNetwork Content Delivery Mobile response time discrepancies Networks Carrier that can surface under load

Gomez’s Web Load Testing (Load Testing 2.0)High volume cloud load & real-world • Pros: load from +100k Last Mile computers – SaaS – Generate high volume load – Able to find user experience breaking points – Offer full visibility across all external components 3rd Party/ Cloud Services Browsers Local ISP & devices Users – You can find and resolve Load Balancers problems across the entire Web WADC Servers Mobile Components App • Cons Servers Internet DB Major – Offers less visibility within the Servers ISP datacenter (when compared Storage with traditional load testing) Mainframe Network Content Delivery Mobile Networks Carrier

Load Testing from the cloud misses the point… end usersmatter Company: Online Gaming Site Testing a new rollout in support of a new sports season • Support anticipated traffic increases • Load tested using cloud and Last Mile to validate performance for real users in new geographies. 3rd Party/ Browsers Load Cloud Services Local ISP and devices Users Balancers Web Servers Mobile Components App Servers Internet DB Major Servers ISP Storage Mainframe Network Content Delivery Mobile Networks Carrier

View from the Cloud • First 20 minutes Cloud testing shows acceptable performance • After 2500 users Response time climbs Availability drops Error rate climbs

View from the Last Mile • Last Mile shows different story • Availability is terrible even at minimal load for real users Summary: Cloud-only testing may give misleading availability data Cloud starts with 100% availability Less than 25% for the Last Mile 1.0 1.5 2.0 

Difference in browsers • Varied commercial browsers show different response times • Response time change as a function of load is dependent on the browser. Summary: Understanding response time under load requires the use of multiple browsers 1.0 1.5 2.0 

3 Steps To Success - Realistically Load Test YourWebsites And Applications From The Cloud Record Action Easily record Website and application transactions across 5,000+ device profiles with the Gomez Recorder Generate LoadGenerate high volume load from multiple locations outside the data center to find infrastructure breaking points with Gomez Web Load Testing Analyze Results Identify performance bottlenecks and issues with Gomez Web Load Testing

Record Your Business Process With The Gomez Recorder Record your script once and use it in Gomez Web Load Testing across all browsers and devices Record your website orapplication transactions across 5,000+ device profiles

Generate Load From The Cloud With Reality Load Easily upload your scripts across cloud locations and providers for greater accuracy

Identify Issues Under Peak Conditions Before End-Users AreImpacted Drilldown to diagnose and quickly resolveissues with object level detail andscreen capture on error Use your scripts to understand how end-users experience your service during peak traffic times with Gomez Web Load Testing

Test Across the Entire Web Application Delivery ChainThe Need: Load Testing the Entire Web App Delivery Chain The Web Application Delivery Chain Load Testing 2.0 (Gomez) Load Testing 1.5Load Testing 1.0 3rd Party/ BrowsersLoad Cloud Services Local ISP and devices UsersBalancersWebServersMobileComponentsAppServers InternetDB MajorServers ISPStorageMainframeNetwork Content Delivery Mobile Networks Carrier

Gomez Load Testing: Most Accurate Load Test for User Experience Load Test 1.0 Load Test 1.5 Load Test 2.0 HTTP : Behind the HTTP : Data Centers Browser : Data Real World Firewall Centers Desktops Last Mile Traditional Client/ Datacenter Testing Server Test Only Gomez SpansAccuracy of End-User Incomplete Incomplete Indicative Most AccurateResponse TimeAccuracy of Invalid Indicative Indicative Most AccurateApplication AvailabilityAbility to drive large Yes-requires Best Better Goodload volume substantial hardwareUnderstand CDN No Misleading Misleading MostImpact AccurateUnderstand 3rd Party No Minimal Some Most(ads, feeds, etc…) AccurateRealistic object No No Yes Yesdownload Static OnlyVisibility behind the Best Good Good Goodfirewall

Thank YouElad Altstein – CTO Software Products DivisionMatrixelada@matrix.co.il054-4420390

Gomez loadtesting salesnov2011

by ek121268 on Dec 04, 2011

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Gomez loadtesting salesnov2011 — Presentation Transcript