From Dev to Ops:Delivering an API to Production with Splunk

464 views

Published on

Dive into the design, implementation, and operations of web APIs. As your API moves into operations, we will explore how you can use the Splunk platform to give your devops or ops teams the operational insight they need. We will demonstrate how Splunk can be used to provide historical and realtime visibility into your API applications and much more.

Originally given at Code on the Beach 2015, Jacksonville, FL.
https://www.codeonthebeach.com
Brian Ritchie, Chief Information Officer, Payspan
Kinjal Mehta, Manager of Systems Development, Peak 10

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
464
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
5
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

From Dev to Ops:Delivering an API to Production with Splunk

  1. 1. Managed Services Data Center & Network Services Cloud Services From Dev to Ops: Delivering an API to Production with Splunk
  2. 2. 22 Speakers Services provided: • IT Infrastructure • Cloud • Managed Service Solutions • Serving 900 Health Plans, 90 million members, 750,000 providers and 5,000 financial institutions • Multi-TB SQL Server database • Over 15 Billion Rows
  3. 3. Aspects of Delivering Internet Grade Services 3 Design Code Deploy Operate
  4. 4. Design with Production in Mind 4 Scalability & Fault Tolerance • REST-based architecture • Stateless • Load-Balancing • Versioning How will you troubleshoot in production? • Only production acts like production • You need operational visibility Pressure to increase velocity and delivery business value • Limited insights into behavior and performance from application logs • Building comprehensive management tools take time
  5. 5. Design with Production in Mind 5 Because s Happen
  6. 6. • REST-based API • Dependency Injection • ORM • Database • Logging Framework Coding the service 6
  7. 7. • Write log data to local file • Institute a log rotation policy • Begin each event with a timestamp • Generate a unique identifier that is assigned to related events • Use key-value pairs to describe the properties of events o Standardize field names across the application • Avoid excessively long events • Avoid spamming the log Logging Best Practices 7
  8. 8. 8 Demo Coding the Service
  9. 9. Deployment Considerations 9 Internet Connectivity, Power Management, Cooling, Physical Security Data Center or Cloud Network, Load Balancing, Compute, Storage, Security Data Center or IT or Cloud
  10. 10. Operating Your API in Production 10
  11. 11. Q: how many programmers does it take to change a light bulb? 11 A: none, they just make darkness standard and tell everyone "this behavior is by design" One way to deal with errors…
  12. 12. Or, you can design for production: You have a live system, tons of log data, and you need:  Monitoring & Trending  Alerting  Event Correlation  Troubleshooting across multiple systems  Billing 12
  13. 13. 1313 Splunk to the Rescue
  14. 14. 1414 Splunk to the Rescue Two threads walk into a bar. The barkeeper looks up and yells, "hey, I want don't any conditions race like time last!" Looking at logs can be like this:
  15. 15. 1515 Splunk to the Rescue But Splunk makes it easy to find & correlate information in your logs:
  16. 16. 1616 Splunk to the Rescue Analysis & Reporting Security & Compliance Infrastructure & Operations Application Management Splunk brings value to your machine data making it accessible to the enterprise.
  17. 17. Splunk Architecture 17
  18. 18. Let’s start Splunk’n 18
  19. 19. 19 demo Find errors easily using full text search
  20. 20. 20 demo Once you’ve found the error, expand the timeframe to find what else was happening at this time.
  21. 21. 21 demo Build alerts to notify you when the error happens again.
  22. 22. 22 demo Analyze data by piping results through advanced commands
  23. 23. 23 demo In a single click, visualization your analysis
  24. 24. 24 demo Build dashboards to give you real-time intelligence
  25. 25. Questions? 25
  26. 26. Thank You! Code on the Beach

×