How enterprises go about adopting the cloud.

1. Presenter Name, Title and or Date
Cloud Monitoring
Opportunities, Issues, Success Strategies
Lee Atchison
Principal Cloud Architect and Advocate | New Relic
1Confidential ©2008-15 New Relic, Inc. All rights reserved.

2. Who am I?
2Confidential ©2008-15 New Relic, Inc. All rights reserved.
28 years in industry
- 7 in Amazon Retail & AWS
(Built 1st
AppStore, AWS Elastic Beanstalk)
- 4 in New Relic
(Architecture Lead, Cloud, Service Migration)
Specialize in:
- Cloud computing
- Services & Microservices
- Scalability, Availability

3. 3Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption
Enterprise IT
Cloud Adoption
Strategy
When and how
enterprises decide
to use the cloud…

4. Experiment
Secure the Cloud
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
4Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption
Standard steps
most companies
follow

5. Enterprise IT Cloud Adoption Strategy
Experiment
§ Non-evasive, safe technologies
- S3
- Perhaps: CloudFront, SQS, SES
§ Stay away from EC2/Servers
§ Security: Easy as one-offs
§ No “Policies” implemented yet
§ “Just seeing what this is all about”
Progressions in
Cloud Adoption

6. Progressions in
Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Secure the Cloud
§ IAM (Credentials)
§ VPC (Secure network)
§ AWS Direct Connect (just another data center)
§ Cloud policies begin to be formed
§ Critical evolution point

7. Progressions in
Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Servers, Enable SaaS
§ EC2
- Basic “data center migration”
- Just another server type available…
§ Multiple AZs/Regions
- Part of multi-datacenter resiliency strategy
§ Independently: SaaS usage increases
- Non-critical or internal uses first

8. Progressions in
Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Value-Added Services
§ Managed Databases
- RDS, Aurora
§ Other Managed Services
- Elastic Beanstalk, SES, SQS, ElasticSearch

9. Progressions in
Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Enable Unique Services
§ High value, Cloud-specific services
- Lambda, Kinesis
- SWF, Elastic Transcoder
- Redshift
§ Point of commitment...
...dependent on cloud

10. Progressions in
Cloud Adoption
Enterprise IT Cloud Adoption Strategy
Mandate Cloud Usage
§ Cloud as a data center replacement
§ Company is now “all in” with cloud
§ Netflix…

11. Experiment
Secure the Cloud
Enable Servers, Enable SaaS
Enable Value-Added Services
Enable Unique Services
Mandate Cloud Usage
11Confidential ©2008-15 New Relic, Inc. All rights reserved.
Progressions in Cloud Adoption
Different Companies
Different Speed
Different Needs

12. 12Confidential ©2008-15 New Relic, Inc. All rights reserved.
Application IT
Cloud Adoption
Strategy
Application owners
go thru similar
process

13. 13Confidential ©2008-15 New Relic, Inc. All rights reserved.
Cloud Servers
Managed Components
Unique Components
Peripheral Usage
Application Cloud Committed
Progressions in Cloud Adoption
Parallel process for
application owners

14. Progressions in
Cloud Adoption
Application IT Cloud Adoption Strategy
Peripheral Usage
§ S3
- Large file storage
- Hosting file downloads
§ CloudFront…

15. Progressions in
Cloud Adoption
Application IT Cloud Adoption Strategy
Cloud Servers
§ EC2 as a server choice
- Data center migration
- Often done when apps need a hardware refresh
- Redundant data center
§ Application doesn’t change, just where it runs

16. Progressions in
Cloud Adoption
Application IT Cloud Adoption Strategy
Managed Components
§ RDS for databases
§ ElastiCache, SES, ELB
§ Elastic Beanstalk
§ More DevOps issue than Application

17. Progressions in
Cloud Adoption
Application IT Cloud Adoption Strategy
Unique Components
§ DynamoDB
§ ElasticSearch
§ SNS, SWF
§ Application is distinctly changing
- Rewritten for the cloud

18. Progressions in
Cloud Adoption
Application IT Cloud Adoption Strategy
Application Cloud Committed
§ Lambda
§ Data Pipeline
§ Kinesis
§ Machine Learning
§ Using cloud-unique capabilities
- Cloud provider specific
- Close tie to specific cloud provider

19. Cloud Adoption Strategies
Application Cloud
Adoption Strategy
§ Peripheral Usage
§ Cloud Servers
§ Managed Components
§ Unique Components
§ Application Cloud Committed
Enterprise IT Cloud
Adoption Strategy
§ Experiment
§ Secure the Cloud
§ Enable Servers, Enable SaaS
§ Enable Value-Added Services
§ Enable Unique Services
§ Mandate Cloud Usage

20. Application
Adoption
Corporate
Adoption
Cloud Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed

21. Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
Technologies
Available
S3
IAM
VPC
Non-Integral
SaaS
EC2
Integral
SaaS
RDS
SES
Lambda
Kinesis
Application
Adoption
Corporate
Adoption

22. Adoption
Sweet Spot
First Steps
Application
Adoption
Corporate
Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
Cloud Adoption
Center of Gravity

23. Integral
SaaS
RDS
SES
Lambda
Kinesis
Adoption
Sweet Spot
First Steps
Application
Adoption
Corporate
Adoption
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
S3
IAM
VPC
Non-Integral
SaaS
EC2
Cloud Adoption
Center of Gravity

24. Application
Adoption
Corporate
Adoption
Application Types
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
Critical
Applications
New
Applications
Non-Critical/
Internal
Applications
Step #1
Step #2
Step #4
First Steps
Application
Re-Writes
Step #3
Smaller and
cloud-centric
companies often
start here

25. IAM
VPC
Non-Integral
SaaS
EC2
Integral
SaaS
RDS
SES
Lambda
Kinesis
Application
Adoption
Corporate
Adoption
Application Types
Mandate
Committed
Allow Value-Added
Allow SaaS
Allow Servers
Secure
Experiment
Experiment Servers Managed
Components
Unique
Components
Committed
Critical
Applications
New
Applications
Non-Critical/
Internal
Applications
Step #1
Step #2
Step #4
First Steps
Application
Re-Writes
Step #3
S3

26. Adoption Success Strategies
Understand
where your
culture is
Consciously
plan your
acceptance
Drive your
cultural change
to your
desired level
Monitor
your adoption
Understand
your needs

27. Monitor Your Adoption
Before Migration
Baseline application
(servers, databases,
caches, applications,
microservices)
Determine your
steady state

28. Monitor Your Adoption
During Migration
Incorporate cloud’s
internal monitoring
Continue
application
monitoring

29. The Biggest Role Monitoring Plays In Migration
Performance Post Migration
& During Optimization
Pre-migration Feasibility &
Benchmarking

30. Continue Monitoring…
Infrastructure
is now out of
your control
Some cloud
specific concerns
(EC2 instance failures,
instance degradation)
Understand
application
impact
Ongoing
application &
infrastructure
monitoring is
essential
Monitor Your Adoption

31. What should you monitor?
Cloud Monitoring
31Confidential ©2008-15 New Relic, Inc. All rights reserved.

32. Typical Ec2 Instance
§ Application & Application Microservices
§ Server OS
§ Hardware (virtual)
Typical Application Stack
EC2 Instance
Application &
Application
Microservices
Server OS
Server (Virtual)
Hardware

33. CloudWatch
§ Monitors:
– EC2 instance
– Virtualization
– Hardware
– [CPU/Disk/Networking]
§ Doesn’t know about:
– Server OS
– Memory/Filesystem
– Processes
– Application
• Latency
• Error rates
• Internal insights
AWS Monitoring
EC2 Instance
Application &
Application
Microservices
Server OS
Server (Virtual)
Hardware
CloudWatch
AWS CONSOLE

34. New Relic
§ Monitors (Server):
– How O.S. is performing
– Processes
– Hardware
§ Monitors (Application):
– App health
– App performance
– Microservices
§ Doesn’t know
– Virtualization
New Relic Monitoring
EC2 Instance
Application &
Application
Microservices
New Relic
Application
Monitoring
Server OS
Server (Virtual)
Hardware
New Relic
Server
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS

35. New Relic
§ Plugins
– Infrastructure visibility
– Databases
– Load Balancing
– Networking
– External services
Visibility into CloudWatch
§ AWS metrics on
New Relic Dashboards
AWS çè New Relic work together
EC2 Instance
Application &
Application
Microservices
New Relic
Application
Monitoring
Server OS
Server (Virtual)
Hardware
New Relic
Server
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS

36. AWS/CloudWatch
§ Visibility into virtualization
§ CPU/Disk/Networking
New Relic
§ CPU/Disk/Networking
§ Memory/Filesystem
§ Processes
§ Infrastructure components
§ Application/Microservices:
– Latency
– Error rates
– App insights
AWS çè New Relic work together
EC2 Instance
Application &
Application
Microservices
New Relic
Application
Monitoring
Server OS
Server (Virtual)
Hardware
New Relic
Server
Monitoring
CloudWatch
AWS CONSOLE
DASHBOARDS New Relic
monitors
CloudWatch
monitors

37. Presenter Name, Title and or Date
Thank You
Lee Atchison
Principal Cloud Architect and Advocate | New Relic
37Confidential ©2008-15 New Relic, Inc. All rights reserved.
Architecting for Scale
Published by: O’Reilly Media, Available: May 2016
www.architectingforscale.com
@leeatchison leeatchison

38. New Relic Enables Accountability Between Your Code & AWS
Customers
Mobile / Apps / Browser
On-Premises
On Premises
Relational Data
AWS Responsibility:
• Service Availability & Performance
• Provisioning & operation of DC
• Isolation & security of resources
• Service maintenance & innovation
EC2
AWS
Container Service
AWS RDSSynthetic
Customers
S3
NoSQL
AWS Storage
Services
Your Responsibility:
• Application code & 3rd party services
• App architecture
• Customer experience
• On-premises components

39. 39Confidential ©2008-15 New Relic, Inc. All rights reserved.