Your SlideShare is downloading. ×
0
API	  Metrics	  –	  What	  to	  Measure?	  6.2.11	  @	  11:05	  PST	  VOIP	  or	  Dial-­‐in	  (see	  chat)	  Brian	  Mullo...
@landlessness   @brianpagano
“Rapid API” Workshop Webinar Series Mapping	  out	  your	  API	  Strategy	  	   PragmaIc	  REST:	  API	  Design	  Fu	   10...
Part	  4:	  	  API	  Metrics	  –	  What	  to	  Measure?	  
Successful	  API	  teams	  understand	  the	  value	  chain	  of	  people	  and	  technology.	  
App   App    App                       App                                              World of                          ...
Two	  sets	  of	  people	  make	  APIs	  successful	  
App   App    App                       App                                              World of                          ...
App   App    App                       App                                              World of                          ...
Jason	  Michael
What	  does	  the	  ApplicaIon	  Developer	  need	  to	  see?	  
App   App    App                       App                                              World of                          ...
App   App    App                       App                                              World of                          ...
App   App    App                       App                                              World of                          ...
hufse
Is	  the	  API	  error	  prone?	  
Which	  API	  errors	  is	  my	  applicaIon	  seeing?	  
How	  does	  the	  API	  usually	  perform?	  
Is	  the	  API	  slow	  now?	  
Which	  API	  methods	  are	  slow?	  
Does	  the	  API	  have	  a	  quota?	  
Is	  my	  app	  violaIng	  the	  API	  quota?	  
How	  o[en	  does	  the	  API	  go	  down?	  
Is	  the	  API	  down	  now?	  
When	  will	  the	  API	  be	  back	  up?	  
Why	  was	  the	  API	  down?	  
Dan	  DeChiaro
What’s	  in	  your	  dashboard?	  
There	  are	  a	  few	  key	  indicators	  in	  a	  few	  formats	  
Key	  indicators:	  •  Errors	  •  Performance	  •  Availability	  •  Quota	  (if	  enforced)	  
Data	  Formats:	  •  Everyone’s	  aggregate	  data	  •  Developer-­‐specific	  data	  •  Trend	  charts	  •  Categorical	  ...
What	  does	  the	  API	  Team	  need	  to	  see?	  
App   App    App                       App                                              World of                          ...
App   App    App                       App                                              World of                          ...
Almost	  everything	  
Thai	  Jasmine	  (Keep	  Smiling.g..g.g	  :-­‐))
Which	  are	  our	  top	  applicaIons?	  
Who	  are	  our	  top	  applicaIon	  users?	  
Who	  are	  our	  best	  applicaIon	  developers?	  
Which	  API	  methods	  are	  most	  popular?	  
How	  much	  API	  capacity	  will	  we	  need	  next	  year?	  
Raymond	  Larose
Why	  is	  the	  API	  down?	  
Why	  is	  the	  API	  slow?	  
Why	  is	  the	  API	  throwing	  errors?	  
Why	  is	  the	  API	  traffic	  spiking?	  
Why	  did	  the	  API	  traffic	  disappear?	  
Dan	  DeChiaro
Key	  indicators:	  •  ApplicaIon	  users	  •  ApplicaIons	  •  Developers	  •  API	  Quality	  •  Internal	  systems	  
Data	  Formats:	  •  Alerts	  •  Aggregate	  data	  •  Drill-­‐down	  data	  •  Trend	  charts	  •  Categorical	  tables	  
What	  about	  the	  stuff	  behind	  the	  API?	  
App   App    App                       App                                              World of                          ...
TIP:	  Put	  Internal	  System	  Data	  in	  Response	  Header	  	  •  Database	  Query	  Times	  •  Message	  Bus	  Respo...
trochim
API Team Analytics                                   App Dev Analytics                                                    ...
Next	  Time	    Mapping	  out	  your	  API	  Strategy	    PragmaIc	  REST:	  API	  Design	  Fu	    10	  PaMerns	  in	  Suc...
THANK	  YOU	  	           	  Ques%ons	  and	  ideas	  to:@landlessness	  @brianpagano	  @apigee	  
Upcoming SlideShare
Loading in...5
×

API Best Practices Webinar: Metrics - What to Measure

14,838

Published on

Part 4 in our series of API Best Practices Webinars - on API Metrics: What to Measure - by @landlessness and @brianpagano

Published in: Technology
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
14,838
On Slideshare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
141
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide

Transcript of "API Best Practices Webinar: Metrics - What to Measure"

  1. 1. API  Metrics  –  What  to  Measure?  6.2.11  @  11:05  PST  VOIP  or  Dial-­‐in  (see  chat)  Brian  Mulloy  @landlessness  Brian  Pagano  @brianpagano  
  2. 2. @landlessness @brianpagano
  3. 3. “Rapid API” Workshop Webinar Series Mapping  out  your  API  Strategy     PragmaIc  REST:  API  Design  Fu   10  PaMerns  in  Successful  API  Programs   Today:  API  Metrics  –  What  to  Measure?   API  Tech  &    Roadmap  ConsideraIons   Driving  API  AdopIon  
  4. 4. Part  4:    API  Metrics  –  What  to  Measure?  
  5. 5. Successful  API  teams  understand  the  value  chain  of  people  and  technology.  
  6. 6. App App App App World of API API InternalUser Store Developer APIs Team Systems
  7. 7. Two  sets  of  people  make  APIs  successful  
  8. 8. App App App App World of API API InternalUser Store Developer APIs Team Systems
  9. 9. App App App App World of API API InternalUser Store Developer APIs Team Systems
  10. 10. Jason  Michael
  11. 11. What  does  the  ApplicaIon  Developer  need  to  see?  
  12. 12. App App App App World of API API InternalUser Store Developer APIs Team Systems
  13. 13. App App App App World of API API InternalUser Store Developer APIs Team Systems
  14. 14. App App App App World of API API InternalUser Store Developer APIs Team Systems
  15. 15. hufse
  16. 16. Is  the  API  error  prone?  
  17. 17. Which  API  errors  is  my  applicaIon  seeing?  
  18. 18. How  does  the  API  usually  perform?  
  19. 19. Is  the  API  slow  now?  
  20. 20. Which  API  methods  are  slow?  
  21. 21. Does  the  API  have  a  quota?  
  22. 22. Is  my  app  violaIng  the  API  quota?  
  23. 23. How  o[en  does  the  API  go  down?  
  24. 24. Is  the  API  down  now?  
  25. 25. When  will  the  API  be  back  up?  
  26. 26. Why  was  the  API  down?  
  27. 27. Dan  DeChiaro
  28. 28. What’s  in  your  dashboard?  
  29. 29. There  are  a  few  key  indicators  in  a  few  formats  
  30. 30. Key  indicators:  •  Errors  •  Performance  •  Availability  •  Quota  (if  enforced)  
  31. 31. Data  Formats:  •  Everyone’s  aggregate  data  •  Developer-­‐specific  data  •  Trend  charts  •  Categorical  tables  Broadcast  Formats:  •  Status  page  •  TwiMer  •  Blog  
  32. 32. What  does  the  API  Team  need  to  see?  
  33. 33. App App App App World of API API InternalUser Store Developer APIs Team Systems
  34. 34. App App App App World of API API InternalUser Store Developer APIs Team Systems
  35. 35. Almost  everything  
  36. 36. Thai  Jasmine  (Keep  Smiling.g..g.g  :-­‐))
  37. 37. Which  are  our  top  applicaIons?  
  38. 38. Who  are  our  top  applicaIon  users?  
  39. 39. Who  are  our  best  applicaIon  developers?  
  40. 40. Which  API  methods  are  most  popular?  
  41. 41. How  much  API  capacity  will  we  need  next  year?  
  42. 42. Raymond  Larose
  43. 43. Why  is  the  API  down?  
  44. 44. Why  is  the  API  slow?  
  45. 45. Why  is  the  API  throwing  errors?  
  46. 46. Why  is  the  API  traffic  spiking?  
  47. 47. Why  did  the  API  traffic  disappear?  
  48. 48. Dan  DeChiaro
  49. 49. Key  indicators:  •  ApplicaIon  users  •  ApplicaIons  •  Developers  •  API  Quality  •  Internal  systems  
  50. 50. Data  Formats:  •  Alerts  •  Aggregate  data  •  Drill-­‐down  data  •  Trend  charts  •  Categorical  tables  
  51. 51. What  about  the  stuff  behind  the  API?  
  52. 52. App App App App World of API API InternalUser Store Developer APIs Team Systems
  53. 53. TIP:  Put  Internal  System  Data  in  Response  Header    •  Database  Query  Times  •  Message  Bus  Response  Times  •  External  Callout  Response  Times  (Apigee  will  log  it  &  strip  it)  
  54. 54. trochim
  55. 55. API Team Analytics App Dev Analytics Developer Tools   Availability   Developers   Errors   Applications   Performance Developer Connect   App UsersApplication   Quota   API Quality API TeamDeveloper API Gateway Operations Team Monitoring   Availability   Performance Operations   Capability
  56. 56. Next  Time   Mapping  out  your  API  Strategy   PragmaIc  REST:  API  Design  Fu   10  PaMerns  in  Successful  API  Programs   API  Metrics  –  What  to  Measure?   API  Tech  &    Roadmap  ConsideraAons   Driving  API  AdopIon  
  57. 57. THANK  YOU      Ques%ons  and  ideas  to:@landlessness  @brianpagano  @apigee  
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×