Mobile Performance Testing - Best Practices


Published on

Best practices of building the mobile performance testing strategy, how it is important to use real device for mobile performance testing.

Published in: Technology

Mobile Performance Testing - Best Practices

  1. 1. Mobile Performance Best Practices Enabling Enterprise mobility Extending Software Quality to Mobile We will be starting momentarilyPerfectomobile Mobile Testing Center of Excellence Group
  2. 2. Webinar Agenda 1 2 3 4• Intro • Mobile • Mobile • Q&A Performance Performance Intro Demo • Mobile • Mobile Performance Performance Case building blocks Study
  3. 3. ∙ Founded 2006∙ 80+ employees Mobile Application Quality across the mobile application lifecycle∙ Office in Boston, London, Israel∙ Over 600 customers Monitoring Testing Automation∙ Fortune 500 enterprises, ALM Continuous Telcos, SMBs Integration Offshoring Integration∙ SaaS Platform + Licenses Public Cloud Private Cloud∙ Recurring revenue model
  4. 4. Solution - The MobileCloud™ Platform
  5. 5. Mobile Performance Testing
  6. 6. Mobile Performance in theapplication lifecycle Performance Automation Functional Production Continuous Delivery Time
  7. 7. What is mobile performancetesting? Measuring the mobile end user experience in real-world simulated conditions Servers will be loaded Networks will experience performance issues Devices will behave differently Optimizing/troubleshooting the bottlenecks Find & measure against a mobile-specific benchmark Understanding the specific mobile bottlenecks. And optimize • Caching • Reduce network dependency & chatter • Provide graceful fallback
  8. 8. Different devices will behavedifferently when the server is loaded(Delay, timeout,…) Response time & availability Mobile KPI Virtual Users
  9. 9. Different devices will behavedifferently under networkconditions The mobile constraint: Bandwidth CPU Transaction response time Mobile KPI Bandwidth WiFi 3G LTE
  10. 10. POLL
  11. 11. “Performance is the key to success”“Efficiency of performance was identified as a focus formobile testing activity by almost two-thirds (64%) of firms”“Mobile users expect robust performance and usability on themove”“Financial firms are the most acutely concerned aboutapplication performance with 72% citing this as a priority. ”
  12. 12. 5 Key Requirements for MobilePerformance Testing Measure the mobile end user experience Define and execute the metrics that users care about Execute the test on a variety of devices Execute the test on a variety of networks Discover the impact of server load on mobile users Measure the mobile experience while server load Enable mobile performance testing on proven enterprise- grade solutions
  13. 13. Performance testing- Mobile User Experience- How To Network conditions Server load conditions Measure user-facing KPIs Convert network sniffer (PCAP) under network conditions file into emulated traffic load Collect network sniffer file Conduct measurement from real devices (while the service Analyze network traffic is under load) View network optimization recommendations Focus on real device measurements
  14. 14. Mobile Performance Demo
  15. 15. Mobile Performance Best PracticesRamesh Nagarajan Sky IT Group
  16. 16. About Sky I.T. GroupAbout Sky I.T. Group Organization• Established in 1997 • Seasoned Executive & Account Management Teams• Headquartered in NYC, Office in: ATL, Raleigh, Boston, Baltimore, • HP Certified PS Delivery Teams Ft. Lauderdale & San Jose • Leading provider of HP Software Solutions• 60+ Employees • Largest/Authorized HP SW Training Partner• Focus: Leverage Technology to solve Business Challenges • HP SW Certification Center• Target Market – Mid-to-Large Enterprise• HP Focus • HP Software Reseller • HP Solution Provider – Professional Services • HP Education Provider• Specialty Focus: • Managed “Testing-as-a-Service” • Mobility Testing CoE• Service Delivery – Throughout the USAAwards• 2012 HP Software Spirit Award• 2011 HP East Commercial Partner of the Quarter & Year• 2010 HP Emerging Partner of the Year• 2010 Arrow Partner of the Year 16
  17. 17. Importance of Mobile Performance TestingYOU YOUR COMPETITOR Impact Customer to your Loss of dissatisfaction brand customers The customer Loss of goes to your revenue competitor’s mobile site
  18. 18. Impact of mobile on performance 500 Web Virtual Users 10 Mobile against a web users application – No Mobile introduced at users until 26 minutes – 26 minutes stable performance
  19. 19. Factors that impact Mobile Performance Mobile Mobile Type ofNumber of Application Devices carriers Connection Mobile Design and Location and their and their – 3G, 4G, users Code OS quality WiFi etc.,
  20. 20. Key Considerations for MobilePerformance Testing Capture, Analyze and Identify the performance bottlenecks Identify the right combination to emulate Selection of Right Mobile Automation Tools
  21. 21. Selection of Right Mobile Automation ToolsScripting capabilityNetwork emulation capabilityLoad testing capabilityAnalyzing capability
  22. 22. Right combinations to emulateKnow your end user profileIdentify the business processesIdentify the most important device and networkconditions combinationsDetermine the expected loadEmulate production load mobile scenarios usingPCAP and real devices
  23. 23. Capture, Analyze and Identify the performance bottlenecksMonitor real devices power and performanceUtilize snapshots, video of test executions & logsCorrelate the metrics and identify bottlenecksAnalyze the impact of mobile users
  24. 24. Mobile Performance White paper In this white paper, you will be able to gain insights into the following mobile performance aspects: Key building blocks for a mobile performance solution Best practices and process to build a mobile performance solution Best practice solution design overview LINK to download (Registration required):
  25. 25. Thank You! If you have any further questions, please contact: Perfecto Mobile Join us on LinkedIn Mobile Testing Center of Excellence