"Applications running in a typical data center are static entities. But applications aren't static in the cloud. Dynamic scaling and resource allocation is the norm on AWS. Technologies such as Amazon EC2, AWS Lambda, and Auto Scaling provide flexibility in building dynamic applications and with this flexibility comes an opportunity to learn how an enterprise application functions optimally. New Relic helps manage these applications without sacrificing simplicity. In this session, we discuss changes in monitoring dynamic cloud resources. We'll share best practices we’ve learned working with New Relic customers on managing applications running in this environment to understand and optimize how they are performing. Session sponsored by New Relic"

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring Performance of Enterprise
Applications on AWS
Lee Atchison ∙ Senior Director Strategic Architecture at New Relic, Inc. / Las Vegas, NV
Understanding the Dynamic Nature of Cloud Computing
ARC207
November 28, 2017

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Does this sound familiar?

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

4. ©2008–17 New Relic, Inc. All rights reserved#FutureStack

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
You had power
most of the time.
Why are you
complaining?

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Keeping your enterprise apps running…
at scale
Visibility…
… into your app
performance

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
… overheard OPs conversation...
Does this sound like something you’ve
heard recently…

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“We were wondering how
changing a setting on our
MySQL database might
impact our performance…
The conversation…

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The conversation…
… but we were worried
that the change may
cause our production
database to fail. …”
“We were wondering how
changing a setting on our
MySQL database might
impact our performance…

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The ‘scary’ overheard conversation…
“Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead. …
Under
construction

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The ‘scary’ overheard conversation…
… After all, it wasn’t
being used for anything
at the moment.”
Under
Construction
“… Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead…

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The ‘scary’ overheard conversation…
Under
construction
X
Until, of course, the backup was needed…

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The ‘scary’ overheard conversation…
This was a true story
Under
construction
!!!!
X
X
Until, of course, the backup was needed…

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Availability can be more subtle. For example…

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
300ms
1.5s

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 17Confidential ©2008-15 New Relic, Inc. All rights reserved.
.9s

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 18

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The data from monitoring your app
dwarfs the data inside the app

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
User Experience
Business Outcome
Servers
Apps
Big Data Problem

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High
expectations
Blame
game
intensity
rises
The problem
must be
someone
else’s fault
Without visibility—panic

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What happened?
You can’t know what happened if you
can’t visualize what your app is doing

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise applications
need data at every level
Typical server/Amazon EC2 Instance
• Application and application microservices
• Server OS
• Hardware (virtual)
Amazon EC2 Instance
BrowserMobile
Server (virtual)
hardware
Server OS
Application and
application
microservices

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (virtual)
hardware
Server OS
Application and
application
microservices
Low-level monitoring
Amazon
CloudWatch
Amazon Web
Services
(AWS) console
Amazon CloudWatch
Monitors
• Amazon EC2 Instance
• Virtualization
• Hardware
• [CPU/disk/
networking]
Doesn’t know about:
• Server OS
• Memory/filesystem
• Processes
• Configuration
• Application
– Latency
– Error rates
– App insights

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (virtual)
hardware
Server OS
Application and
application
microservices
Dashboards
New Relic
application
monitoring
New Relic
infrastructure
monitoring
Amazon
CloudWatch
AWS
console
Monitors (server)
• How OS is performing
• Configuration changes
• Processes
• Hardware
Monitors (application)
• App health
• App performance
• Microservices
Doesn’t know
• Virtualization
Infrastructure/application monitoring

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Instance
BrowserMobile
Server (virtual)
hardware
Server OS
Application and
application
microservices
Full stack monitoring
New Relic
application
monitoring
New Relic
infrastructure
monitoring
Amazon
CloudWatch
AWS
console
Integrations
New Relic
monitors
Dashboards
AWS / Amazon CloudWatch
• Visibility into virtualization
• CPU/disk/networking
• 14 AWS services
APM
• CPU/disk/networking
• Memory/filesystem
• Processes
• Infrastructure components
• Configuration inventory
• Application/microservices:
– Latency
– Error rates
– App insights
Amazon
CloudWatch
monitors

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why measurement matters

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Visibility…
… into your app
performance
Dynamic
cloud…
... tools to make
availability happen
How do you keep your enterprise
apps running?

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Using the cloud in enterprise applications
Better data center Dynamic environment

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Better data center
Better data center Dynamic environment

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud as a ‘better data center’
Resources are
allocated to uses, just
like in a data center
Provisioning
process
is faster
Lifetime of
components is
relatively long
Capacity planning is
still important and
still applies

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why use a ‘better data center?’
Add new
capacity
Capacity where
you need it
Faster Redundant Compliant
Improve application
availability

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud
Better data center Dynamic environment

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud as a ‘dynamic tool for dynamic apps’
Use only
the resources
you need
Allocate/deallocate
resources on the fly
Resource allocation is
an integral part of your
application architecture

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud
Resources are: Application in charge:
Allocated Application is aware of and is
controlling traditional OPs resources
Consumed Deallocated

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic usage example
Docker container age
(Count vs. hours)
1 hour
200 days 833 days

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic usage example
Docker container age
(by minute and hour)
1,200,000
11% under one minute
Container age (minutes)

39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud technologies
Dynamic cloud is about scaling and availability
Amazon EC2 Auto Scaling
Mobile/IoT Dynamic routing
Load balancing
Queues and notifications
Docker

40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud enables better
applications faster
Traditional
data center
Cloud
data center
Dynamic
cloud
Better Best
The way you’ve done things in the past
won’t work in the future
Good

41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud
Server running
application/processes
Process running
a command
Function performing
a task or operation
Amazon EC2 Docker AWS Lambda
Things happen faster because of…

42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Microcomputing & AWS Lambda
• Highly dynamic
• Incredibly scalable
• No infrastructure to provision
• Massively shared infrastructure

43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic cloud
Dynamic cloud
Easier scaling
Faster change
Faster response
Higher availability

44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How do I track what the dynamic cloud
is doing for me (or to me)?
Dynamic cloud has unique monitoring requirements

45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is a dynamic cloud application?
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
Responsible for the parts
you care about
• Application and application
microservices
Let cloud manage the rest
• Infrastructure
• Allocation/provisioning
• Scaling

46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
Monitoring dynamic cloud applications
AWS
console
Amazon
CloudWatch

47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
AWS infrastructureapplication performance
Amazon
CloudWatch
New Relic
application
monitoring
New Relic
infrastructure
monitoring
Dashboards
Integrations
AWS
console

48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
Amazon
CloudWatch
New Relic
application
monitoring
New Relic
infrastructure
monitoring
Dashboards
AWS infrastructureapplication performance
Amazon
CloudWatch and
AWS monitors
Integrations
AWS
console
New Relic
monitors

49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
How do you monitor this?
?How do you
monitor this?

50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Where did it go? It was just here!
The thing you monitored 10 minutes ago…
...doesn’t exist anymore!?

51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring the dynamic cloud
Monitor the cloud
components themselves
Monitor the life cycle of
the cloud components
Very different than monitoring traditional data center components

52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing world
Ops
Previous–STATIC world

53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing world
Dev
Now–DYNAMIC world
Ops
Ops
Previous–STATIC world

54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Changing world of enterprise applications
Dev
Now–DYNAMIC world
Ops
We know:
• Change is inevitable
We must:
• Embrace and drive change
Enabling:
• Quicker growth
• More reliable growth

55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dynamic
cloud…
... tools to make
availability happen
Migration…
... how do I get my
app to the cloud?
Your enterprise apps and the cloud

56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High
expectations
Blame
game
intensity
rises
The problem
must be the
cloud’s fault
Pressure to
declare victory
in the migration
The politics of migration
Show me the
new apps!
Promised
performance gains?
Cost controls?
Optimize costs?
Why is it taking so long?
Migration failure…
This problem is easy to avoid...

57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ops
Use the cloud
Does not have to be painful…
• Move in a controlled way
• Learn as you go
• Measure everything

58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Standard steps
most companies
follow
Progressions in cloud adoption
…the controlled way

59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Progressions in Cloud Adoption
Experiment

60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
What is this cloud thing?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment:
• Non-evasive, safe technologies
• Amazon Simple Storage Service
(Amazon S3)
• Perhaps: Amazon CloudFront,
Amazon Simple Queue Service (Amazon
SQS), Amazon Simple Email Service
(Amazon SES)
• Security: Easy as one-offs
• No “policies” implemented yet
• “Just seeing what this is all about”

61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Progressions in Cloud Adoption

62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
Can we trust the cloud?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud policies:
• IAM (credentials)
• VPC (secure network)
• AWS Direct Connect
(just another data center)
• Cloud policies begin to be formed
• All parts of the company are
involved
• Critical evolution point

63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Progressions in Cloud Adoption

64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable servers, enable SaaS:
• Amazon EC2
– Basic “data center migration”
– Just another server type available
• Multiple AZs/regions
– Part of multidata center resiliency strategy
• Independently: SaaS usage increases
– Non-critical or internal uses first
The cloud seems to work pretty well…

65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Progressions in Cloud Adoption

66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable value-added services:
• Managed databases
– Amazon Relational Database Service (Amazon RDS), Amazon
Aurora
• Other managed services
– AWS Elastic Beanstalk, Amazon SES, Amazon SQS, Amazon
Elasticsearch Service
Dynamic cloud becomes a thing…

67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Progressions in Cloud Adoption

68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enable unique services
• High-value, cloud-specific services
– AWS Lambda, Amazon Kinesis
– Amazon DynamoDB
– Amazon Simple Workflow
Service (Amazon SWF),
Amazon Elastic Transcoder
– Amazon Redshift
• Point of commitment…
– …dependent on cloud
Dynamic cloud is deeply ingrained…

69. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Progressions in Cloud Adoption

70. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise IT cloud adoption strategyProgressions in
Cloud Adoption
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Mandate cloud usage
• Cloud as data center replacement
• Company is now “all in” with cloud
Why do we need our own data centers?

71. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment
Cloud Policies
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
Progressions in Cloud Adoption
Different companies
Different speed
Different needs

72. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cloud adoption strategies
• Experiment
• Cloud policies
• Enable servers, enable SaaS
• Enable value-added services
• Enable unique services
• Mandate cloud usage
• Experiment/peripheral usage
• Cloud servers
• Managed components
• Unique components
• Application cloud committed
Enterprise IT
Cloud adoption strategy
Application
Cloud adoption strategy

73. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Application
adoption
Corporate
adoption Cloud adoption
Mandate
Committed
Allow value-added
Allow SaaS
Allow servers
Policies
Experiment
Experiment Servers Managed
components
Unique
components
Committed
Critical
applications
New
applications
Non-critical/
internal
applications
Step #1
Step #2
Step #4
First Steps
Application
rewrites
Step #3

74. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Experiment Servers Managed
components
Unique
components
Committed
First Steps
Critical
applications
New
applications
Non-critical/
internal
applications
Step #1
Step #2
Step #4
Application
re-Writes
Step #3
Amazon RDS
Amazon SES
AWS IAM
VPC
Non-integral
SaaS
Amazon EC2
AWS Lambda
Kinesis
Amazon
S3
Integral
SaaS
Application
adoption
Mandate
Committed
Allow SaaS
Policies
Experiment
Corporate
adoption Cloud adoption
Allow value-added
Allow servers

75. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adoption sweet spot
First steps
Application
adoption
Corporate
adoption
Cloud adoption
Center of gravity
Experiment Servers Managed
components
Unique
components
Committed
Mandate
Committed
Allow value-added
Allow SaaS
Allow servers
Policies
Experiment

76. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Integral
SaaS
Amazon RDS
Amazon SES
Lambda
Kinesis
Application
adoption
Corporate
adoption
Amazon S3
AWS IAM
VPC
Non-integral
SaaS
Amazon EC2
Cloud adoption
Center of gravity
Adoption sweet spot
Mandate
Committed
Experiment
Allow value-added
Allow SaaS
Allow servers
Policies
Experiment
Servers Managed
components
Unique
components
Committed

77. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How to be successful…
…migrating enterprise apps to the cloud

78. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Adoption success strategies
Understand
your culture
Create a
solid plan
Drive cultural
change
Monitor
your adoption
Understand
your needs

79. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitor your adoption
Before migration
Baseline application
(servers, databases,
caches, applications,
microservices)
Determine your
steady state

80. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitor your adoption
During migration
Incorporate cloud’s internal
monitoring
Continue
application
monitoring
Performance post migration
and during optimization
Pre-migration feasibility and
benchmarking
Understand and solve all deviations from steady state…

81. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Continue monitoring…
Infrastructure
is now out of
your control
Understand
application
impact
Ongoing
application and
infrastructure
monitoring is
essential
Monitor your adoption

82. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
All phases
Before your migration
Establish your
steady state
During your migration
Understand and solve
all deviations from
steady state…
After your migration
Ongoing application and
infrastructure monitoring
is essential
Monitor your adoption

83. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Keeping your app running…at scale
8
Dynamic
cloud…
... tools to make
availability happen.
Migration…
... how do I get my
app to the cloud?
Visibility…
… into your app
performance
Monitor your application and infrastructure

84. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring just the server
worked when rate of change was low…
Amazon EC2 Instance
Server OS
Server (virtual)
hardware
Application and
application microservices
AWS
console Amazon
CloudWatch

85. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dev
Ops
Dynamic world

86. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Server OS
Server (virtual)
hardware
Application and
application
microservices
Provisioning
Application and
application
microservices
Application and
application
microservices
BrowserMobile
Full stack monitoring–full app visibility
New Relic
application
monitoring
New Relic
infrastructure
monitoring
Dashboards
You need:
• Top to bottom monitoring…
• Visibility into your application operation
• Dynamic infrastructure control…

87. ©2008–17 New Relic, Inc. All rights reserved#FutureStack

88. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The world is changing
Dynamic cloud enables better applications, faster
Traditional
data center
Cloud
data center
Dynamic
cloud
Better Best
The way you’ve done things in the past
won’t work in the future
Good

89. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fireside chat
Mark Kelly
Director of Cloud and Infrastructure
Services Architecture

90. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
Visit New Relic at booth #2412