Monitoring your infrastructure is an essential part of running mission critical applications. But what happens when you throw dynamic infrastructure and autoscaling into the mix? How do you define "normal" with servers that scale in and out of existence? In this session, we'll walk through best practices for monitoring an autoscaled application, as well as how to use intelligent alerting to enhance CloudWatch and trigger scaling events. The concepts in this session are not tool-specific, but demos will be based on Datadog. Attendees will learn production-tested lessons and leave with frameworks they can implement to more efficiently autoscale their applications, no matter which platforms and tools they use. This session is brought to you by AWS Summit Chicago sponsor, Datadog.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Daniel Langer
Product Manager, Datadog
7/26/2017
Monitoring and Auto Scaling, a
Match Made in Heaven

2. Datadog Overview

3. Agenda
1. Brief monitoring 101
2. Monitoring static environments (pre-auto scaling days)
3. Dynamic infrastructure monitoring
4. Auto Scaling using intelligent alerts
a. Demo!

5. Collecting Metrics & Events

6. Work Metrics
● Queue Size
● Delivery Rate
● Publish Rate
● Unacknowledged
messages
Example: RabbitMQ
Resource Metrics
● Network IO
● Memory
● Sockets used
● CPU
Events
● Configuration Change
● Code Deployment
● Service Started /
Stopped
● etc..

7. Now that we have metrics, let’s alert!

8. Alerting used to be host-centric

9. Alerting used to be host-centric

10. Alerting used to be host-centric

11. Alerting used to be host-centric

12. Alerting used to be host-centric

13. Alerts themselves only provided host specific
information

14. Modern infrastructures and monitoring – a
whole new world

15. Modern infrastructures and monitoring – a
whole new world

16. A Primer on Auto Scaling
Allows you to scale your EC2 capacity up or down
automatically according to conditions you define
Auto Scaling Group

17. A Primer on Auto Scaling
Average CPU > X?
Auto Scaling Group
Allows you to scale your EC2 capacity up or down
automatically according to conditions you define

18. A Primer on Auto Scaling
Average CPU > X?
Auto Scaling Group Auto Scaling Group
Allows you to scale your EC2 capacity up or down
automatically according to conditions you define

19. Use Auto Scaling to Optimize EC2 Instances in
varying Demand

20. Use Auto Scaling to Optimize EC2 Instances in
varying Demand

21. Use Auto Scaling to Optimize EC2 Instances in
varying Demand

22. How do you monitor an infrastructure with
a dynamic number of virtual machines?

23. Tags, Tags, Tags!

27. Now, monitoring can be service-centric
Collection of EC2s with
common tag,
i.e. Availability Zone

28. Now, monitoring can be service-centric

29. Now, monitoring can be service-centric

31. Back to the match made in heaven...

32. Going beyond CloudWatch into work metrics
Option 1:

33. Going beyond CloudWatch into work metrics
Option 1:

34. Going beyond CloudWatch into work metrics
Option 1:

35. Bleacher Report

36. Python Software Foundation

37. Cvent

38. Going beyond CloudWatch into work metrics
Option 2:
API

39. Demo Time!

50. Resources
• dtdg.co/bleacher-dd
• dtdg.co/python-dd
• dtdg.co/cvent-dd
• dtdg.co/tag-power
• Datadog Booth #119

51. Thank you!
daniel.langer@datadoghq.com