The Essentials of Mobile App Performance Testing and Monitoring

4,952 views

Published on

Complexity across mobile carriers, locations and operating systems has made building mobile apps and monitoring their end user performance time consuming and expensive. The importance of testing mobile apps on iOS, Android and Windows Phone is increasing as more users embrace these devices. Join Correlsense and uTest for an online seminar which will teach you the steps to successful mobile application testing and performance management. We will discuss:

- The proliferation of mobile devices and the technical challenges they bring to end user experience monitoring
- Ways to prepare mobile applications for peak usage periods with the right load and performance testing techniques
- Tips and techniques for gaining visibility into the performance of mobile applications with the right monitoring tools

We will conclude with a discussion of the Correlsense and uTest solutions.

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
4,952
On SlideShare
0
From Embeds
0
Number of Embeds
884
Actions
Shares
0
Downloads
180
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • Dan
  • Don’t read slide. Summarize 
  • When you are thinking about best practices in mobile performance monitoring, you have to think strategically  about your overall business goals and objectives. With that in mind, the first thing you should do is identify all the stakeholders which are driving your mobile strategy and discuss the overall  goals of your mobile plan.Next, you will have to construct  or modify an SLA which is clear to both parties. Make sure all the details are understood and agreed upon by your customers. You must be able to have definitive metrics, and ensure the SLA can be monitored.  Without a measureable SLA, you are essentially leaving your customer in the dark, with know way to manage their expectations. Obviously, this is quite frustrating to them and will most likely cause them to never return. 
  • Being open with your stakeholders is crucial to creating a good customer experience. Also, you will want to keep your fellow IT team members in the loop with what is going on. Ensure the SLA date is readily available to all stakeholders, you don’t want to keep customers or colleagues in the dark.  Before implementing the SLA make sure to: develop tracking mechanisms, establish reporting processes, develop procedures for carrying out stated responsibilities, communicate expectations to staff,  and provide pertinent training.  After the SLA is established:  provide a point of contact for problems related to the agreement, maintain an ongoing contact with the other party, conduct service reviews, coordinate and implement modifications to the SLA when needed, and assess and reporting on how the two parties can further enhance their working relationship.A things not to do with SLAs:Sometimes service providers sometimes want to create an SLA to suppress customer complaints;Don't do this! It backfires most of the time!  This just gives them something else to complain about!As strange as it may sound, most SLAs are initiated and unilaterally established by service providers. The customer is given little or no say about either the content of the SLA or the process by which it is established or managed. Obviously this leads to unhappy customers. Make sure the customer is engaged and understands the SLA. Remember, be open! 
  • But why is this infrastructure in place? It is to host Applications that are required to support the Business.And the Transactions that flow through these applications are what allow the Business to be a Success.The founders of SharePath realized that by managing these Transactions is the most important thing because they are the lifeblood of the company.These transactions can be simple client Server transactions from Thick Clients talking to Databases <click>To more complex legacy Client Server transactions that connect multiple Back-End systems <click>To Web Transactions that now allow end-users to directly interact with your business systems and issue their own transactions.<click>And now these Web Technologies allow internal applications to be built to run the business.The point is that in this Complex, Heterogenous technology architecture, the key thing to monitor is the Transactions of all types that flow through these systems.<click
  • What Is A Transaction?Request issued by an end-userGoes through multiple componentsEach component may be activated multiple timesNote that:Different transaction types take different paths and flowsSometimes instances of the same transaction type execute across different flows
  • The Essentials of Mobile App Performance Testing and Monitoring

    1. 1. The Essentials of Mobile AppPerformance Testing and MonitoringApril 26, 2012
    2. 2. Agenda1. The Mobile Web Today2. Mobile Performance Testing3. Mobile App Monitoring4. Summary/Q&A
    3. 3. Housekeeping• Presentation will last 30 minutes• Submit questions via the chat window• Slides will be made available tomorrow
    4. 4. Featured Speakers Stanton Champion Product Marketing Manager uTest Frank Days VP, Marketing Correlsense
    5. 5. THE MOBILE WEB TODAY…
    6. 6. 1.2 billion mobile web usersworld wide -IDG Feb 2012
    7. 7. 74% of users will bounceafter waiting 5 secondsfor a mobile site to load
    8. 8. Gartner predicts that by2014, 90% of allcorporations will supportapplications on personaldevices – Feb 2012
    9. 9. Mobile’s Just Getting Started 2.5 Tablets 2.0Units$MM 1.5 1.0 Smartphones 0.5 Personal Computers 2000 Year 2016
    10. 10. So Lo MoSocial Local Mobile
    11. 11. Test CoverageWeb Testing Matrix Is ToughFeatures OS & Browser
    12. 12. Test CoverageMobile Testing Matrix Is InsaneFeatures Handset Makers OS & Browser & Models
    13. 13. Test CoverageMobile Testing Matrix Is InsaneFeatures Wireless Handset Makers Carriers OS & Browser & Models
    14. 14. Test CoverageMobile Testing Matrix Is InsaneFeatures Location Wireless Handset Makers Carriers OS & Browser & Models
    15. 15. Increasingly Complex Testing• The laughably simplistic notion of a “test matrix”
    16. 16. Not Just Testing, but More Complex Monitoringfrom Test to Production Wider range of devices are connected to a more complex IT world
    17. 17. Both Are Needed to Improve End User Experience• Opportunities • Challenges – Mobile technologies to – Complaints performance Improve Productivity – No visibility into mobile app – For “mobile workforce” transactions – Real-time data access – Limited/no load testing prior to mobile rollout• Examples: – Huge headache for CIO – CRM – Order entry – ERP
    18. 18. ESSENTIALS FOR PERFORMANCE TESTING
    19. 19. Lab-Based Testing Innovation Manual vs. Automation Managing vs. Leading Teams In-House vs. Outsourced Agile vs. Waterfall Exploratory vs. Testers vs. Test Cases Engineers Offshore vs. Nearshore
    20. 20. Users Work & Live In The Wild I nThe Wi l
    21. 21. Look Beyond The Lab• Recognize it will never again be sufficient on its own• Build your company’s plan for testing ‘In The Wild’ – Real-world conditions: Live testers, real devices, imperfect connectivity – Mirror your user base • Technologically: OS, browser, anti-virus, device, carrier • Geographically: Continent, country, city, language • Demographically: Age, gender, education, employment, industry
    22. 22. Your Connection to the Cloud
    23. 23. Your Automated Load Testing Tool’sConnection to the Cloud
    24. 24. Your Users’ Connections to the Cloud
    25. 25. Testing In The Wild Finds NewBottlenecks • Different users have different connection pathways – Mobile towers – Network providers – Backbone connections – Content Delivery Networks – DNS providers • Above can add latency, making the user’s experience worse In The Wild testing helps you identity down-stream network problems that you can’t find in the lab
    26. 26. Smarter Load Testing With Experts• People dont load test often, few are experts• Professional testers are valuable• Technical understanding improves perception of problems and root causes• When testing In The Wild, need professionals with skills and experience
    27. 27. Coupled with end-to-end monitoring• You need smart, adaptable monitoring that can work in the wild and inside your data center
    28. 28. ESSENTIALS FOR MOBILE APP MONITORING
    29. 29. 1. Be Strategic You need measurable SLAs To tie mobile strategy to biz goals
    30. 30. 2. Be TransparentKeep biz stakeholdersin the loop and ensureSLA data is accessible
    31. 31. 3. Be Paranoid
    32. 32. Watch Every Transaction for Every User SERVER WEB APP SVR PROXY MQ/ESB LDAP CORBA DCOM Web Services Datacenter
    33. 33. Track Key User Experience Metrics Mobile Total End-User Response Time Browser Rendering Time Datacenter Time Network LatencyMobile Real User Monitoring Rendering
    34. 34. 4. Be Smart - Understand what is happening across the Space-Time continuum
    35. 35. Look Across Time
    36. 36. Look Across Locations
    37. 37. Know When There is a Problem
    38. 38. Summary• Mobile web is complex • When testing mobile• New testing and monitoring – Test outside the lab tools are needed – In The Wild• End user experiences are still – Use professionals critical • When monitoring mobile – Be strategic – Be transparent – Be paranoid – Be smart
    39. 39. Questions Contact uTest: Contact Correlsense: http://www.utest.com/ www.correlsense.com/demo Phone: www.real-user-monitoring.com 1-800-445-3914 info@correlsense.com Follow us: Follow us: twitter.com/uTest twitter.com/correlsense facebook.com/uTest facebook.com/correlsense Contact Us At Get your free copyhttp://www.utest.com/contact- GET STARTED SharePath RUM! customers TODAY! http://www.real-user-monitoring.com/

    ×