Talk at 2014 Velocity Santa Clara Conference on utilizing the Keynote Systems API to help manage automate the reporting of performance metrics

1. Q:What do APIs and cats have in common?
A:They are both AWESOME!

2. Before we get to the cats....

3. Stephen Fishman
Director, Consumer Platforms
Autotrader.com
Robert Tanzola
Manager,Technical Architecture
Autotrader.com
Abelardo Gonzalez
Director, Product Management
Keynote Systems

4. Full Dislosure : We are all dog people

5. And now, back to your regularly scheduled programming of cats.

6. Not much has changed since ancient Egypt...

7. We are still writing on walls and worshipping cats

8. One question remains:Are more cats are better than less cats?

9. This is one of the mysteries of the universe...

10. Maybe we can solve this mystery by looking from a different
perspective

11. The most ardent lovers of cats are just like people who sell ads on
media sites

12. They both believe “more is better”... No matter what the cost

13. Which kinda sucks if it’s your job to herd the cats

14. One of IT’s prime jobs in a well monetized media site, is to make it possible for our cat lovers (i.e., sales) to have more and more and more
cats (i.e., ads) on our site while simultaneously improving the page performance of our site.

15. This is a story of our journey as cat herders

16. At Autotrader,We Have A 25-Page Daily Performance Dashboard

17. Managing Performance Is Good!

18. We Have A Team Of Four Who Manually Produces This Every Day

19. Manually Managing Performance Is Bad!

20. But It Does Not Have to Be That Way!

21. Automation + Performance Management = Transparency + Real TimeVisibility

22. Transparency + Real TimeVisibility = Executive Attention

23. For those who don’t know... Executive Attention Creates Movement

24. Keynote REST API
•http://api.keynote.com/ - JSON or XML output
•Available Services
•Get Test “Slot” meta data (getslotmetadata)
•Get Test measurement results (getgraphdata)
•And more…

25. The API is Listening
To
get
Keynote
graph
data:
https://api.keynote.com/
keynote/api/getgraphdata?
api_key=[api
key]slotidlist=845480&format=j
son&transpagelist=845480:5&pag
ecomponent=x,@,u,f,y,m
JSON
Results:
"measurement" : [ {
"id" : "1105572",
"alias" : “AutoTrader Home Page(TxP)[IE] - Total Time (seconds)",
"bucket_data" : [ {
"name" : "2012-MAY-06 11:18 AM",
"id" : 1,
"perf_data" : {
"value" : "3.393",
"unit" : "seconds"
},
"avail_data" : {
"value" : "100",
"unit" : "percent"
},
"data_count" : {
"value" : "40",
"unit" : "#"
}
.
.
.
(more)

26. Data Processing Tech Stack
•Python 2.7
• HTTP handling
• JSON parsing
• Storage & Transformation
• ELK (ElasticSearch, Logstash, Kibana)
• Graphite
• MySQL
• d3
• Automated email
•Threshold validation
• Minimum and Maximum range

27. Email Based Alerting

28. Overcoming Challenges
•Data Storage
• Splunk vs ELK
•Valid Metrics
• Median vs Mode
•BrowserVariations
• Application Error vs Measurement Error
•Notification Challenges
• Accountable vs Responsible

29. And now, a word from our sponsor.

30. Keynote API
Integrating Keynote data into other
dashboards and applications

31. About the Keynote API
§ RESTful Web service
§ Direct data access
- Raw & aggregate data download
- Direct dashboard download
- Object level performance (July 2014)
§ Alarm polling access (Beta)
- Access the status of any Keynote alarm
- Evaluate/generate alarm on-demand
- Execute instant measurement
- Manage and edit all alarms
Keynote lobby, San Mateo, Calif.

32. IT Management Integration
§ Keynote API allows integration with multiple platforms

33. Integration Scenarios
§ Integrating Keynote data into a Dashboard and using a correlation engine
to better manage alarms
§ Directly importing alarm information into a ticketing system allowing for
better management of incidents
§ The flexibility of the Keynote API allows integration to many 3rd party
platforms
§ Keynote has sample custom integrations available at https://github.com/
KeynoteSystems/Keynote-Apps

34. Enhanced Reporting
§ Integration with Google Docs
- Allow data to be directly imported to a spreadsheet for easier custom reports
§ Integration with Microsoft Excel
- Direct calls within Excel can download data using Get External Data from Web

35. Questions?