Apps & API Monitoring
Apigee
@apigee
Ole Lensmar
@olensmar
Alan Ho
@karlunho
SmartBear
@SmartBear
Building a 5-Star Reputa...
groups.google.com/group/api-craft
groups.google.com/group/app-craft
youtube.com/apigee
slideshare.net/apigee
@olensmar
Ole Lensmar
@karlunho
Alan Ho
@SmartBear @Apigee
During webcast - participate on twitter hastag #5starapp
Agenda
• Why (Web) API performance matters
• How can you avoid performance issues?
• Synthetic Transaction monitoring
• Re...
What matters to the
user?
900,000 apps & growing
Performance Matters
• Poor reviews skew your
overall app ratings
• Majority of Poor Reviews
Occurred in first 24 hours
• C...
Don’t crash
Don’t give me errors
Don’t slow me down
Return on Features vs. Performance
Benefit
Application Maturity
Inflection
How can you avoid
performance issues?
API performance = app performance
Indirect vs. Direct API Integration
3rd$party$APIs
Mobile$
Applica4on
API$Backend
Direct$Integra4on
Indirect$
Integra4on
(...
3rd$party$APIs
Mobile$
Applica4on
API$Backend
Direct$Integra4on
Indirect$
Integra4on
(Mobile$Carrier)
Synthe4c$Monitoring
...
3rd$party$APIs
Mobile$
Applica4on
API$Backend
Direct$Integra4on
Indirect$
Integra4on
(Mobile$Carrier)
Synthe4c$Monitoring
...
Demo
3rd party APIs
Mobile Application
API Backend
Direct Integration
Indirect
Integration
(Mobile Carrier)
AlertSite for API M...
Pros Cons
Real User
Monitoring
• Capture Real User
problems
• Exercise real devices and
networks
• Correlate with errors &...
Use both techniques!
• Reduce effect of cons of both techniques
• Use RUM traffic to create tests for Synthetic
Transactio...
In Summary . . .
 Mobile app experience depends on API performance
 Success depends on meeting users’ performance
expect...
Questions
THANK YOU
Questions and ideas to:
@olensmar
@karlunho
groups.google.com/group/api-craft
groups.google.com/group/app-craft
Upcoming SlideShare
Loading in...5
×

App & API Monitoring: Building a 5-Star Reputation for your Apps

1,547

Published on

Published in: Technology, Business
1 Comment
5 Likes
Statistics
Notes
No Downloads
Views
Total Views
1,547
On Slideshare
0
From Embeds
0
Number of Embeds
19
Actions
Shares
0
Downloads
17
Comments
1
Likes
5
Embeds 0
No embeds

No notes for slide
  • Creative Commons Attribution-Share Alike 3.0 United States License
  • Main Point: Once you see bad reviews its too lateBusiness Points:Bad reviews impede your success and are bad for your brandTech Points:Better to be proactive and fix issues before having to be reactive to bad reviewsSequential Story: Illustrate specifically how performance and stability effect a reviewScript:When you look at app ratings you can see the confirmation of these findings. A bad review like the one here shows how a problem early in the apps release cycle can skew results for a long time. This shows the importance of finding and fixing issues related to stability and performance before the app is released as even within 24 hours the negative momentum built by bad reviews can be difficult to overcome. As expected, customers don’t like errors and problems with apps and the review comments will tell you all about the frustration they experience.
  • Main Point: Once you see bad reviews its too lateBusiness Points:Bad reviews impede your success and are bad for your brandTech Points:Better to be proactive and fix issues before having to be reactive to bad reviewsSequential Story: Illustrate specifically how performance and stability effect a reviewScript:When you look at app ratings you can see the confirmation of these findings. A bad review like the one here shows how a problem early in the apps release cycle can skew results for a long time. This shows the importance of finding and fixing issues related to stability and performance before the app is released as even within 24 hours the negative momentum built by bad reviews can be difficult to overcome. As expected, customers don’t like errors and problems with apps and the review comments will tell you all about the frustration they experience.
  • Transcript of "App & API Monitoring: Building a 5-Star Reputation for your Apps"

    1. 1. Apps & API Monitoring Apigee @apigee Ole Lensmar @olensmar Alan Ho @karlunho SmartBear @SmartBear Building a 5-Star Reputation for your Apps
    2. 2. groups.google.com/group/api-craft
    3. 3. groups.google.com/group/app-craft
    4. 4. youtube.com/apigee
    5. 5. slideshare.net/apigee
    6. 6. @olensmar Ole Lensmar @karlunho Alan Ho @SmartBear @Apigee During webcast - participate on twitter hastag #5starapp
    7. 7. Agenda • Why (Web) API performance matters • How can you avoid performance issues? • Synthetic Transaction monitoring • Real User monitoring • Recap pros/cons of different techniques • Questions
    8. 8. What matters to the user?
    9. 9. 900,000 apps & growing
    10. 10. Performance Matters • Poor reviews skew your overall app ratings • Majority of Poor Reviews Occurred in first 24 hours • Customers do not tolerate software Errors • Combination of App & API problems • Fixing Problems without trace logs is difficult
    11. 11. Don’t crash
    12. 12. Don’t give me errors
    13. 13. Don’t slow me down
    14. 14. Return on Features vs. Performance Benefit Application Maturity Inflection
    15. 15. How can you avoid performance issues?
    16. 16. API performance = app performance
    17. 17. Indirect vs. Direct API Integration 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier)
    18. 18. 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier) Synthe4c$Monitoring Func4onal$ Monitoring Func4onal$and$Performance Monitoring Synthetic Monitoring • Functional Consistency • Perf. Consistency • Proactive Error Detection
    19. 19. 3rd$party$APIs Mobile$ Applica4on API$Backend Direct$Integra4on Indirect$ Integra4on (Mobile$Carrier) Synthe4c$Monitoring Func4onal$ Monitoring Func4onal$and$Performance Monitoring Real$User$Monitoring Real User Monitoring • API Errors • API Performance • Variation of Devices / Networks
    20. 20. Demo
    21. 21. 3rd party APIs Mobile Application API Backend Direct Integration Indirect Integration (Mobile Carrier) AlertSite for API Monitoring Functional Monitoring Functional and Performance Monitoring (Mobile Carrier) Apigee Mobile AnalyticsReal User Monitoring Synthetic Monitoring
    22. 22. Pros Cons Real User Monitoring • Capture Real User problems • Exercise real devices and networks • Correlate with errors & abandonment • Need critical mass of traffic for each API monitored • Need to instrument your code • Potential Bandwidth / Battery issues Synthetic Transaction Monitoring • Can monitor all APIs all the time • Doesn’t require instrumentation of app • Can reuse existing test assets from Dev & QA • Doesn’t simulate real users / devices / networks • Need to setup and maintain the monitors • Cannot tell you the end behavior of the app
    23. 23. Use both techniques! • Reduce effect of cons of both techniques • Use RUM traffic to create tests for Synthetic Transaction Monitoring • Correlate STM failures to usage in RUM
    24. 24. In Summary . . .  Mobile app experience depends on API performance  Success depends on meeting users’ performance expectations  Use multiple techniques for monitoring your app
    25. 25. Questions
    26. 26. THANK YOU Questions and ideas to: @olensmar @karlunho groups.google.com/group/api-craft groups.google.com/group/app-craft

    ×