API Best Practices Webinar: Metrics - What to Measure

17,255 views

Published on

Part 4 in our series of API Best Practices Webinars - on API Metrics: What to Measure - by @landlessness and @brianpagano

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
17,255
On SlideShare
0
From Embeds
0
Number of Embeds
10,853
Actions
Shares
0
Downloads
172
Comments
0
Likes
7
Embeds 0
No embeds

No notes for slide

API Best Practices Webinar: Metrics - What to Measure

  1. 1. API  Metrics  –  What  to  Measure?  6.2.11  @  11:05  PST  VOIP  or  Dial-­‐in  (see  chat)  Brian  Mulloy  @landlessness  Brian  Pagano  @brianpagano  
  2. 2. @landlessness @brianpagano
  3. 3. “Rapid API” Workshop Webinar Series Mapping  out  your  API  Strategy     PragmaIc  REST:  API  Design  Fu   10  PaMerns  in  Successful  API  Programs   Today:  API  Metrics  –  What  to  Measure?   API  Tech  &    Roadmap  ConsideraIons   Driving  API  AdopIon  
  4. 4. Part  4:    API  Metrics  –  What  to  Measure?  
  5. 5. Successful  API  teams  understand  the  value  chain  of  people  and  technology.  
  6. 6. App App App App World of API API InternalUser Store Developer APIs Team Systems
  7. 7. Two  sets  of  people  make  APIs  successful  
  8. 8. App App App App World of API API InternalUser Store Developer APIs Team Systems
  9. 9. App App App App World of API API InternalUser Store Developer APIs Team Systems
  10. 10. Jason  Michael
  11. 11. What  does  the  ApplicaIon  Developer  need  to  see?  
  12. 12. App App App App World of API API InternalUser Store Developer APIs Team Systems
  13. 13. App App App App World of API API InternalUser Store Developer APIs Team Systems
  14. 14. App App App App World of API API InternalUser Store Developer APIs Team Systems
  15. 15. hufse
  16. 16. Is  the  API  error  prone?  
  17. 17. Which  API  errors  is  my  applicaIon  seeing?  
  18. 18. How  does  the  API  usually  perform?  
  19. 19. Is  the  API  slow  now?  
  20. 20. Which  API  methods  are  slow?  
  21. 21. Does  the  API  have  a  quota?  
  22. 22. Is  my  app  violaIng  the  API  quota?  
  23. 23. How  o[en  does  the  API  go  down?  
  24. 24. Is  the  API  down  now?  
  25. 25. When  will  the  API  be  back  up?  
  26. 26. Why  was  the  API  down?  
  27. 27. Dan  DeChiaro
  28. 28. What’s  in  your  dashboard?  
  29. 29. There  are  a  few  key  indicators  in  a  few  formats  
  30. 30. Key  indicators:  •  Errors  •  Performance  •  Availability  •  Quota  (if  enforced)  
  31. 31. Data  Formats:  •  Everyone’s  aggregate  data  •  Developer-­‐specific  data  •  Trend  charts  •  Categorical  tables  Broadcast  Formats:  •  Status  page  •  TwiMer  •  Blog  
  32. 32. What  does  the  API  Team  need  to  see?  
  33. 33. App App App App World of API API InternalUser Store Developer APIs Team Systems
  34. 34. App App App App World of API API InternalUser Store Developer APIs Team Systems
  35. 35. Almost  everything  
  36. 36. Thai  Jasmine  (Keep  Smiling.g..g.g  :-­‐))
  37. 37. Which  are  our  top  applicaIons?  
  38. 38. Who  are  our  top  applicaIon  users?  
  39. 39. Who  are  our  best  applicaIon  developers?  
  40. 40. Which  API  methods  are  most  popular?  
  41. 41. How  much  API  capacity  will  we  need  next  year?  
  42. 42. Raymond  Larose
  43. 43. Why  is  the  API  down?  
  44. 44. Why  is  the  API  slow?  
  45. 45. Why  is  the  API  throwing  errors?  
  46. 46. Why  is  the  API  traffic  spiking?  
  47. 47. Why  did  the  API  traffic  disappear?  
  48. 48. Dan  DeChiaro
  49. 49. Key  indicators:  •  ApplicaIon  users  •  ApplicaIons  •  Developers  •  API  Quality  •  Internal  systems  
  50. 50. Data  Formats:  •  Alerts  •  Aggregate  data  •  Drill-­‐down  data  •  Trend  charts  •  Categorical  tables  
  51. 51. What  about  the  stuff  behind  the  API?  
  52. 52. App App App App World of API API InternalUser Store Developer APIs Team Systems
  53. 53. TIP:  Put  Internal  System  Data  in  Response  Header    •  Database  Query  Times  •  Message  Bus  Response  Times  •  External  Callout  Response  Times  (Apigee  will  log  it  &  strip  it)  
  54. 54. trochim
  55. 55. API Team Analytics App Dev Analytics Developer Tools   Availability   Developers   Errors   Applications   Performance Developer Connect   App UsersApplication   Quota   API Quality API TeamDeveloper API Gateway Operations Team Monitoring   Availability   Performance Operations   Capability
  56. 56. Next  Time   Mapping  out  your  API  Strategy   PragmaIc  REST:  API  Design  Fu   10  PaMerns  in  Successful  API  Programs   API  Metrics  –  What  to  Measure?   API  Tech  &    Roadmap  ConsideraAons   Driving  API  AdopIon  
  57. 57. THANK  YOU      Ques%ons  and  ideas  to:@landlessness  @brianpagano  @apigee  

×