@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Application Monitoring
using Datadog
Mukta Aphale
(DevOps Practice Head, WhiteHedge Technologies)
12 Dec 2015, DevOps Meetup, Pune
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
WhiteHedge Technologies
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Application Monitoring
• Ensure that a software application processes and performs in an
expected manner and scope
APM Runtime	
  Metrics
Health	
  of	
  the	
  
application
Health	
  of	
  
infrastructure
Provide	
  
system/application	
  
feedback
Continuous	
  
Improvement
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Datadog
• Monitoring as a Service
• Agent Based
• Python
• Integrations
• Dashboards
• Tagging
• Alerts
• Checks
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Environment
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Challenge
• Monitor System Health
• Monitor Redis, MongoDB
• Application (API Server) runs as docker container
• Monitor application performance
• Logging slowed down performance
• Rapid development, No feedback mechanism
• Insight in application needed by management
• Insight needed by support, devops and developers
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Integration Dashboards
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
AWS
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Amazon - ElastiCache
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
System Overview
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
But…
•How to impress the management?! J
•How to deal with X environments and Y
versions?
•How to measure performance, without
affecting performance?
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Overview Dashboard
Dummy
Dummy
Dummy
Dummy
Dummy
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Debug: API Error Rate
Which	
  endpoint	
  is	
  having	
  more	
  errors?	
  Which	
  error	
  codes	
  are	
  being	
  thrown? Search	
  logs	
  in	
  Loggly if	
  needed.
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Datadog Tags
• Inherited from
Integrations
• Custom tags
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Templated Dashboards
• Dashboard variables
• Dynamically explore metrics
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Datadog API
•We can code:
• Instance configuration
• Infrastructure
• Deployments
•Why not monitoring?!
•Datadog has great API
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Datadog module for nodejs
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Measuring http response times from
application code
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Plot it!
Dummy1
Dummy2
Dummy3
Dummy4
Dummy	
  Data
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
What about performance while tracking
performance?
• Metrics from code are sent to local datadog agent using UDP
• Local datadog agent syncs the metrics to the datadog server
• Datadog dashboard reflects the metrics with some delay
• Application performance does not get affected
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Alerts
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Datadog Checks
•Collect metrics from datadog agent check
•Out of the box agent checks
•Custom agent checks in Python
•Interesting use cases:
• Keep alive check (Service is up)
• Network Check (HTTP, TCP)
• Validate response for expected data
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Using Datadog we could…
• Monitor dynamic infrastructure
• Monitor system health
• Monitor application availability
• Monitor application performance
• Show application & infra health graphically
• Provide feedback about health of system
@muktaaWe are hiring! Send resume to: hr@whitehedge.com
Thank You!
Questions?
We are Authorized Datadog Partners!
You can write to me at:
maphale@whitehedge.com
Twitter: @muktaa

Application Monitoring using Datadog

  • 1.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Application Monitoring using Datadog Mukta Aphale (DevOps Practice Head, WhiteHedge Technologies) 12 Dec 2015, DevOps Meetup, Pune
  • 2.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com WhiteHedge Technologies
  • 3.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Application Monitoring • Ensure that a software application processes and performs in an expected manner and scope APM Runtime  Metrics Health  of  the   application Health  of   infrastructure Provide   system/application   feedback Continuous   Improvement
  • 4.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog • Monitoring as a Service • Agent Based • Python • Integrations • Dashboards • Tagging • Alerts • Checks
  • 5.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Environment
  • 6.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Challenge • Monitor System Health • Monitor Redis, MongoDB • Application (API Server) runs as docker container • Monitor application performance • Logging slowed down performance • Rapid development, No feedback mechanism • Insight in application needed by management • Insight needed by support, devops and developers
  • 7.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Integration Dashboards
  • 8.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com AWS
  • 9.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Amazon - ElastiCache
  • 10.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com System Overview
  • 11.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com But… •How to impress the management?! J •How to deal with X environments and Y versions? •How to measure performance, without affecting performance?
  • 12.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Overview Dashboard Dummy Dummy Dummy Dummy Dummy
  • 13.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Debug: API Error Rate Which  endpoint  is  having  more  errors?  Which  error  codes  are  being  thrown? Search  logs  in  Loggly if  needed.
  • 14.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog Tags • Inherited from Integrations • Custom tags
  • 15.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Templated Dashboards • Dashboard variables • Dynamically explore metrics
  • 16.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog API •We can code: • Instance configuration • Infrastructure • Deployments •Why not monitoring?! •Datadog has great API
  • 17.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog module for nodejs
  • 18.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Measuring http response times from application code
  • 19.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Plot it! Dummy1 Dummy2 Dummy3 Dummy4 Dummy  Data
  • 20.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com What about performance while tracking performance? • Metrics from code are sent to local datadog agent using UDP • Local datadog agent syncs the metrics to the datadog server • Datadog dashboard reflects the metrics with some delay • Application performance does not get affected
  • 21.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Alerts
  • 22.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog Checks •Collect metrics from datadog agent check •Out of the box agent checks •Custom agent checks in Python •Interesting use cases: • Keep alive check (Service is up) • Network Check (HTTP, TCP) • Validate response for expected data
  • 23.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Using Datadog we could… • Monitor dynamic infrastructure • Monitor system health • Monitor application availability • Monitor application performance • Show application & infra health graphically • Provide feedback about health of system
  • 24.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Thank You! Questions? We are Authorized Datadog Partners! You can write to me at: maphale@whitehedge.com Twitter: @muktaa