Take the Guesswork out of Mobile Performance Testing with Shunra and HP

Watch a recording of this webinar at:http://www.shunra.com/resources/on-demand-webinars 1

Expert Presenter Team• Todd DeCapua (Shunra) – Vice President of Channel Operations and Services – Extensive consulting experience and senior leadership roles within IT Development and IT Infrastructure organizations – Recognized leader in Application Performance Engineering, and Mobile• John Jeremiah (HP) – Senior Product Marketing Manager; Performance Center, Mobile –Over 20 years of experience in leadership roles with the U.S. Navy, IT consulting and Fortune 500 IT organizations, including: Application developer, project and program manager, Director of Testing Services, and Delivery Process and Methodology Director 2

Agenda• Challenge Please submit your• Best Practices questions in the• Solution Q&A and Chat panels during the• Q&A event. 3

Shunra – Proactive Performance AssuranceNetwork Virtualization & Performance Engineering • More than 2000 customers, including 75% of the Fortune 100 • Average customer ROI < 3 months • Average customer eliminates 14+ remediation incidents per year • 50% of customers use Shunra to resolve monitoring (APM) alarms • Application Performance Engineering: An SDLC Best Practice – Discover – Recreate/Virtualize – Test – Analyze – Remediate/Optimize 4

Performance is THE differentiator 5

Opening Poll | Results Check your mobile device: What operating system does your mobile device use? What is your connection type at this time? How many signal bars do you have?Partnering for Performance:Facing CIO’s Top 5 Challenges You will see the poll results in the Polling Panel of your WebEx screen. 6

The CHALLENGE 7

Everyone is mobile 8

Are You Prepared? Over 60% of application failures are due to non-functional issues. 93% of businesses are currently planning oralready implementing mobile solutions for their workforce and their customers.Less than 50% are prepared to establish, validate, and predict mobile application performance. Shunra Mobile Application Performance Survey 2011

The Impact of Failure “Productivity loss due to application performance issues is estimated at a loss of $42,000 per hour for each user group impacted.” (IT Management News)“The loss associated with IT issues has been quantified as a 63% reduction in productivity, "resulting in an average of 552 people hours lost per year per company.” (CA Technologies, 2011 survey of 1800 companies) 10

Calculate the Cost of FailureHowever, the cost of finding and remediatingproblems is only a single data point.Other Considerations: – What is the impact of bad reviews? Good reviews? – What is the cost of losing a customer? Retaining a customer? Lifetime customer value? Acquiring a customer? – How does performance degradations affect revenue? Productivity? How many performance issues could have been avoided? 11

Poll Question When testing mobile, which options should be considered? You will see the poll results in the Polling Panel of your WebEx screen. 12

The BEST PRACTICES 13

End-to-End Mobile Testing• Mobile Functionality & Device Real-World Network Conditions App. server & Analysis App. server Backend Monitoring Mobile Load & Performance = The COMPLETE solution for performance testing Mobile apps 14

Best Practice #1: Mobile Functional & Device• Automate mobile functional testing• Re-use tests to accelerate delivery and repeatability• Emulators and multiple real devices• Repeat tests as new devices enter the market• Single user performance• Impact of variable mobile networks 15

Best Practice #2: Mobile Network(s) & Variability• Discover mobile network conditions – bandwidth, latency, packet loss• Network conditions are constantly changing in the real-world – device / carrier / region / location• Think ‘network virtualization’ recreating these network conditions in your pre-production lab 16

Best Practice #2: Variability of Mobile Latency & Loss2.5G 3G WiFi 17

Best Practice #3: Mobile Load & Performance• Impact of network on users experience, functional and performance• Impact of multi-users on backend infrastructure due to mobile• Automated mobile optimization recommendations• Prior to production, tune application and infrastructure, mitigating your risk of failure 18

Impact of Mobile Latency on Your Infrastructure High Bandwidth / Low Latency Lower Bandwidth / Higher Latency (Impact of Local Users) (Impact of Relocated, Remote, or Mobile Users)User 1 User 1User 2 User 2User 3 User 3User 4 User 4User 5 User 5User 6 User 6 1 2 3 4 5 6 7 1 3 5 7 9 11 13 15 17 Average of ~1 request / sec Elongated response time to >13 sec concurrency concurrency Resulting from the impact of latency, extending server resource19time on the infrastructure

Best Practice #4: Pre-Production Backend Monitoring• Build pre-production monitoring in• Leverage existing production tools• Enable capacity planning / sizing• Perform disaster recovery and resiliency• All prior to production 20

Simple Mathematical CalculationBasic Assumptions: (Variables Underlined)• Current data center utilization is 60%• Projected future mobile users are 5%• ‘Broadband User’ has 30msec of latency• ‘Mobile User’ has 300msec of latencySimple Calculation Example:5% of your users at 10x latency = 50% increased server resource time;and current data center utilization = 60%;therefore, projected future utilization = 50% + 60%, or 110% of infrastructure capacity.Pictorial Representation: Dynamic Mobile Network Broadband Mobile Wifi-2.5g-3g-4g User User 21

Real-World Server Impacts of Mobile Mobile No Mobile Users Users (9) (500) 22

How To Avoid Failure• Know your limits – What are the breaking points for your mobile app, site, infrastructure?• Know the geography of your end users• Network limits and measurement of those limits• Geographic location and mobility as a risk to continuity• Set expectations with credibility and accuracy• Know true last mile conditions, and incorporate to a lab, so you can test and optimize• Proactively test, analyze, and optimize performance 23

Poll Question Who is driving mobilization at your company? You will see the poll results in the Polling Panel of your WebEx screen.24

The SOLUTION 25

End-to-End Mobile Testing• Mobile Functionality with QTP and QTP Real-World Network Conditions & Performance App. server App. server PC Backend LR Monitoring: Sitescope / Mobile Performance Diagnostics with Mobile Protocols: = The COMPLETE solution for performance testing Mobile apps 26

End-to-End Mobile Testing Executed Network Catcher 4G QuickTest Professional 3G WiMax Mobile Profiling (SLO Compliance) 2.5G WiFi Performance Suite Test Results Packet Capture & Analysis Shunra for HP System(s) Optimization Under TestLoadRunner Performance Center 27

Key Learning’s• Mobile is here, it is moving fast, and impact to the business is significant.• Mobile Best Practices – Functional & Device – Networks & Variability – Load & Performance – Backend Infrastructure & Capacity• End to End Solution for Mobile Testing 28

Questions?Ask a Question: 1. WebEx Q&A or Chat panels 2. Twitter: @Shunra @AppPerfEng Twitter: @Shunra 3. Email: todd.decapua@shunra.com erica.lucas@shunra.com john.jeremiah@hp.com LinkedIn Group: Shunra SoftwareFollow us on Twitter: Todd : @AppPerfEng John: @HPLoadRunner Erica: @AppPerfTips Facebook: Shunra Software 29

Take the Guesswork out of Mobile Performance Testing with Shunra and HP

by Shunra on Jan 24, 2012

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Take the Guesswork out of Mobile Performance Testing with Shunra and HP Presentation Transcript