App & API Monitoring: Building a 5-Star Reputation for your Apps

2,384 views
2,171 views

Published on

Published in: Technology, Business
1 Comment
6 Likes
Statistics
Notes
No Downloads
Views
Total views
2,384
On SlideShare
0
From Embeds
0
Number of Embeds
559
Actions
Shares
0
Downloads
19
Comments
1
Likes
6
Embeds 0
No embeds

No notes for slide
  • Creative Commons Attribution-Share Alike 3.0 United States License
  • Main Point: Once you see bad reviews its too lateBusiness Points:Bad reviews impede your success and are bad for your brandTech Points:Better to be proactive and fix issues before having to be reactive to bad reviewsSequential Story: Illustrate specifically how performance and stability effect a reviewScript:When you look at app ratings you can see the confirmation of these findings. A bad review like the one here shows how a problem early in the apps release cycle can skew results for a long time. This shows the importance of finding and fixing issues related to stability and performance before the app is released as even within 24 hours the negative momentum built by bad reviews can be difficult to overcome. As expected, customers don’t like errors and problems with apps and the review comments will tell you all about the frustration they experience.
  • Main Point: Once you see bad reviews its too lateBusiness Points:Bad reviews impede your success and are bad for your brandTech Points:Better to be proactive and fix issues before having to be reactive to bad reviewsSequential Story: Illustrate specifically how performance and stability effect a reviewScript:When you look at app ratings you can see the confirmation of these findings. A bad review like the one here shows how a problem early in the apps release cycle can skew results for a long time. This shows the importance of finding and fixing issues related to stability and performance before the app is released as even within 24 hours the negative momentum built by bad reviews can be difficult to overcome. As expected, customers don’t like errors and problems with apps and the review comments will tell you all about the frustration they experience.
  • App & API Monitoring: Building a 5-Star Reputation for your Apps

    1. 1. Apps & API Monitoring Apigee @apigee Ole Lensmar @olensmar Alan Ho @karlunho SmartBear @SmartBear Building a 5-Star Reputation for your Apps
    2. 2. groups.google.com/group/api-craft
    3. 3. groups.google.com/group/app-craft
    4. 4. youtube.com/apigee
    5. 5. slideshare.net/apigee
    6. 6. @olensmar Ole Lensmar @karlunho Alan Ho @SmartBear @Apigee During webcast - participate on twitter hastag #5starapp
    7. 7. Agenda • Why (Web) API performance matters • How can you avoid performance issues? • Synthetic Transaction monitoring • Real User monitoring • Recap pros/cons of different techniques • Questions
    8. 8. What matters to the user?
    9. 9. 900,000 apps & growing
    10. 10. Performance Matters • Poor reviews skew your overall app ratings • Majority of Poor Reviews Occurred in first 24 hours • Customers do not tolerate software Errors • Combination of App & API problems • Fixing Problems without trace logs is difficult
    11. 11. Don’t crash
    12. 12. Don’t give me errors
    13. 13. Don’t slow me down
    14. 14. Return on Features vs. Performance Benefit Application Maturity Inflection
    15. 15. How can you avoid performance issues?
    16. 16. API performance = app performance
    17. 17. Indirect vs. Direct API Integration 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier)
    18. 18. 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier) Synthe4c$Monitoring Func4onal$ Monitoring Func4onal$and$Performance Monitoring Synthetic Monitoring • Functional Consistency • Perf. Consistency • Proactive Error Detection
    19. 19. 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier) Synthe4c$Monitoring Func4onal$ Monitoring Func4onal$and$Performance Monitoring Real$User$Monitoring Real User Monitoring • API Errors • API Performance • Variation of Devices / Networks
    20. 20. Demo
    21. 21. 3rd party APIs Mobile Application API Backend Direct Integration Indirect Integration (Mobile Carrier) AlertSite for API Monitoring Functional Monitoring Functional and Performance Monitoring (Mobile Carrier) Apigee Mobile AnalyticsReal User Monitoring Synthetic Monitoring
    22. 22. Pros Cons Real User Monitoring • Capture Real User problems • Exercise real devices and networks • Correlate with errors & abandonment • Need critical mass of traffic for each API monitored • Need to instrument your code • Potential Bandwidth / Battery issues Synthetic Transaction Monitoring • Can monitor all APIs all the time • Doesn’t require instrumentation of app • Can reuse existing test assets from Dev & QA • Doesn’t simulate real users / devices / networks • Need to setup and maintain the monitors • Cannot tell you the end behavior of the app
    23. 23. Use both techniques! • Reduce effect of cons of both techniques • Use RUM traffic to create tests for Synthetic Transaction Monitoring • Correlate STM failures to usage in RUM
    24. 24. In Summary . . .  Mobile app experience depends on API performance  Success depends on meeting users’ performance expectations  Use multiple techniques for monitoring your app
    25. 25. Questions
    26. 26. THANK YOU Questions and ideas to: @olensmar @karlunho groups.google.com/group/api-craft groups.google.com/group/app-craft

    ×