Part 4 in our series of API Best Practices Webinars - on API Metrics: What to Measure - by @landlessness and @brianpagano

1. API
Metrics
–
What
to
Measure?
6.2.11
@
11:05
PST
VOIP
or
Dial-­‐in
(see
chat)
Brian
Mulloy
@landlessness
Brian
Pagano
@brianpagano

2. @landlessness @brianpagano

3. “Rapid API” Workshop Webinar Series
Mapping
out
your
API
Strategy
PragmaIc
REST:
API
Design
Fu
10
PaMerns
in
Successful
API
Programs
Today:
API
Metrics
–
What
to
Measure?
API
Tech
&
Roadmap
ConsideraIons
Driving
API
AdopIon

4. Part
4:
API
Metrics
–
What
to
Measure?

5. Successful
API
teams
understand
the
value
chain
of
people
and
technology.

6. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

7. Two
sets
of
people
make
APIs
successful

8. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

9. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

10. Jason
Michael

11. What
does
the
ApplicaIon
Developer
need
to
see?

12. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

13. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

14. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

15. hufse

16. Is
the
API
error
prone?

17. Which
API
errors
is
my
applicaIon
seeing?

18. How
does
the
API
usually
perform?

19. Is
the
API
slow
now?

20. Which
API
methods
are
slow?

21. Does
the
API
have
a
quota?

22. Is
my
app
violaIng
the
API
quota?

23. How
o[en
does
the
API
go
down?

24. Is
the
API
down
now?

25. When
will
the
API
be
back
up?

26. Why
was
the
API
down?

27. Dan
DeChiaro

28. What’s
in
your
dashboard?

29. There
are
a
few
key
indicators
in
a
few
formats

30. Key
indicators:
• Errors
• Performance
• Availability
• Quota
(if
enforced)

31. Data
Formats:
• Everyone’s
aggregate
data
• Developer-­‐specific
data
• Trend
charts
• Categorical
tables
Broadcast
Formats:
• Status
page
• TwiMer
• Blog

32. What
does
the
API
Team
need
to
see?

33. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

34. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

35. Almost
everything

36. Thai
Jasmine
(Keep
Smiling.g..g.g
:-­‐))

37. Which
are
our
top
applicaIons?

38. Who
are
our
top
applicaIon
users?

39. Who
are
our
best
applicaIon
developers?

40. Which
API
methods
are
most
popular?

41. How
much
API
capacity
will
we
need
next
year?

42. Raymond
Larose

43. Why
is
the
API
down?

44. Why
is
the
API
slow?

45. Why
is
the
API
throwing
errors?

46. Why
is
the
API
traffic
spiking?

47. Why
did
the
API
traffic
disappear?

48. Dan
DeChiaro

49. Key
indicators:
• ApplicaIon
users
• ApplicaIons
• Developers
• API
Quality
• Internal
systems

50. Data
Formats:
• Alerts
• Aggregate
data
• Drill-­‐down
data
• Trend
charts
• Categorical
tables

51. What
about
the
stuff
behind
the
API?

52. App
App
App
App
World of
API
API Internal
User Store Developer APIs Team Systems

53. TIP:
Put
Internal
System
Data
in
Response
Header
• Database
Query
Times
• Message
Bus
Response
Times
• External
Callout
Response
Times
(Apigee
will
log
it
&
strip
it)

54. trochim

55. API Team Analytics
App Dev Analytics
Developer Tools
 Availability  Developers
 Errors  Applications
 Performance
Developer Connect  App Users
Application  Quota  API Quality API Team
Developer
API Gateway
Operations Team Monitoring
 Availability
 Performance Operations
 Capability

56. Next
Time
Mapping
out
your
API
Strategy
PragmaIc
REST:
API
Design
Fu
10
PaMerns
in
Successful
API
Programs
API
Metrics
–
What
to
Measure?
API
Tech
&
Roadmap
ConsideraAons
Driving
API
AdopIon

57. THANK
YOU
Ques%ons
and
ideas
to:
@landlessness
@brianpagano
@apigee