Requirements of Monitoring
Cloud Apps & Infrastructure
Clay Smith
Developer Advocate
csmith@newrelic.com
Alberto Gomez
Director, Product Management
agomez@newrelic.com
3
Notes
Confidential ©2008-15 New Relic, Inc. All rights reserved.  
Today’s webinar is being
recorded. A link to the recording
will be emailed to all registrants
shortly after.
Please be sure to ask any
questions via the “questions
panel”
There will be a brief survey after
the webinar for any additional
questions or feedback.
Agenda
❏ How monitoring changes in the cloud
❏ Understanding your cloud application architecture
❏ Getting visibility into managed cloud services with native
integrations
❏ Cloud monitoring explained by data type
❏ Platform requirements for cloud monitoring
❏ Q&A
Confidential ©2008–17 New Relic, Inc. All rights reserved
Diversity of frameworks, tools, languages
and platforms is increasing with cloud adoption.
5
1 deploy/quarter 2 deploy/week
Many
deploys/day
Confidential ©2008–17 New Relic, Inc. All rights reserved
Volume of operational data being generated
is growing exponentially.
Web App: Then Web App: Now
1 application
3 large servers
1 database
1 data center
1 deploy/quarter
30 containers
4 services
10 small instances
2 managed services
2 databases
2 cloud regions
Many deploys/day
Confidential ©2008–17 New Relic, Inc. All rights reserved
Understand the architecture
Get visibility into the relationships
of a complex cloud environment
Confidential ©2008–17 New Relic, Inc. All rights reserved
Service Map helps teams understand application
architecture.
BrowserMobile
Application
New Relic Service Map
Connections created
based on external
network calls.
Confidential ©2008–17 New Relic, Inc. All rights reserved
Health Map: Multiple sources of data
increases visibility into health
See the health of every
application and
dependent hosts (color
coding dependent on
alerts status)
Scroll over a host to see
status details
Filters let you narrow
search to specific
applications or hosts
Server OS
Application
New Relic Health Map
Confidential ©2008–17 New Relic, Inc. All rights reserved
… including visibility into cloud
infrastructure
Server OS
Application
EC2 Region Filtering in Health Map
Filters support
cloud-specific views of
hosts
Confidential ©2008–17 New Relic, Inc. All rights reserved
Native Cloud Integrations
Using a cloud-managed service
shouldn’t reduce visibility
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
New Relic AWS Integrations
New Relic
Application
Monitoring
New Relic
Infrastructure
Monitoring
Amazon
CloudWatch
AWS
CONSOLE
Integrations
New Relic
Monitors
CloudWatch
monitors
DASHBOARDS
AWS / CloudWatch
Integrations
• Visibility into virtualization
• CPU / Disk / Networking
• +20 AWS Services
• More soon!
Popular today: EC2, S3, ELB, RDS, EBS, CloudFront, DynamoDB,
Elasticache, Lambda metrics from Cloudwatch
AWS Integrations
13©2008–17 New Relic, Inc. All rights reserved.
Billing/Cost
Control
Kinesis
Firehose
Elasticsearch Route53 ECS/ECR
New Integrations:
Server (Virtual)
Hardware
Create custom cloud dashboards
using New Relic Insights
14©2008–17 New Relic, Inc. All rights reserved.
Server (Virtual)
Hardware
All AWS Integration event and metric data is available in New Relic Insights
Dashboards
customizable using a
SQL-like query
language
Updates in real time
AWS Integrations: Events
15©2008–17 New Relic, Inc. All rights reserved.
Server (Virtual)
Hardware
Cloud events across services and regions are also captured
Understand AWS
Infrastructure changes
in real-time
Define detailed alert conditions from
cloud integrations and other sources
16©2008–17 New Relic, Inc. All rights reserved.
Server (Virtual)
Hardware
Alerts can be consolidated across on-prem and multiple regions
Alert on metrics and
events
Preview thresholds
Confidential ©2008–17 New Relic, Inc. All rights reserved
Metrics, Traces, and Events
Cloud monitoring explained by
data type
Confidential ©2008–17 New Relic, Inc. All rights reserved
Metrics: Webinar Poll
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application
● What are your sources for
metrics?
● Where are there gaps?
?
?
?
?
Confidential ©2008–17 New Relic, Inc. All rights reserved
From any source, monitoring data can be organized into
three main categories of events
19
Metrics
Traces
Measurement
of an event
Relationships
between events
Examples
Throughput, error rate,
request rate, request
duration
Application
components involved
during a request with
an error
New Relic Provides
Logs
Human-readable
events
System startup output,
process output *via Partner Integrations
Confidential ©2008–17 New Relic, Inc. All rights reserved
• Compute
– CPU Utilization, Load, Memory
• Network
– Transmit/Receive bps
– Transmit/Receive errors
• Storage
– Read/Writes per second
– Disk utilization
“Traditional” Host Metrics
CPU and Load in New Relic Infrastructure
Server OS
Confidential ©2008–17 New Relic, Inc. All rights reserved
• Response time
• Error rate
• Throughput (rpm)
• Apex Score
– Ratio of satisfied users (industry
standard)
Application Key Metrics
Overview Page in New Relic APM
Application
Confidential ©2008–17 New Relic, Inc. All rights reserved
• Transaction is a particular path through your code.
• Grouped transactions help you know where to focus effort
Application Transactions
Application
Viewing the stack of an application trace in New Relic APM
Confidential ©2008–17 New Relic, Inc. All rights reserved
• Sequence of events that took
place in a transaction
Application Traces
Application
Viewing the stack of an application trace in New Relic APM
Confidential ©2008–17 New Relic, Inc. All rights reserved
New Relic creates metrics and traces using code
instrumentation for full-stack troubleshooting.
24
“Page load time increased 40%”
“The /listings endpoint is 3s slower
after a deploy.”
“EC2 CPU utilization is stable.”
“The database is running out of
memory.”
Instrumentation
needed?
Browser
App
AWS EC2
AWS RDS
Example insight from metrics and traces
Confidential ©2008–17 New Relic, Inc. All rights reserved
Instrumentation can be extended with APIs to integrate
business and app-specific metadata.
=+
Apps +
servers
Code instrumentation
with custom attributes
Operational data with
additional dimensions
Confidential ©2008–17 New Relic, Inc. All rights reserved
Build on a platform
Choose a solution that scales to
your biggest day
Confidential ©2008–17 New Relic, Inc. All rights reserved
Amazon EC2 Instance
BrowserMobile
Server (Virtual)
Hardware
Server OS
Application &
Application
Microservices
DASHBOARDS
New Relic
Application
Monitoring
New Relic
Infrastructure
Monitoring
Cloud Monitoring: Platform Requirements
Built for the cloud
• Flexible pricing
• Ability to scale to your
biggest day
• Designed and constantly
updated for the future of
cloud
Confidential ©2008–17 New Relic, Inc. All rights reserved
Learn more about cloud monitoring for your dynamic
environment. More resources and webinars
https://newrelic.com/solutions/topic/cloud-monitoring
Confidential ©2008–17 New Relic, Inc. All rights reserved
100% visibility for every step of your cloud journey
New Relic: Cloud monitoring with confidence
29
“I would still be flying blind without New Relic.”
– Eric Peterson
Marketing Systems Engineer, Tableau
Cloud Migration with
Measurable Results
Modernize with
Confidence
Troubleshoot End-to-End
at Cloud Scale
Questions?
https://newrelic.com/solutions/topic/cloud-monitoring
Thank You
Clay Smith
Developer Advocate
csmith@newrelic.com
Alberto Gomez
Director, Product Management
agomez@newrelic.com

Requirements of monitoring cloud apps & infrastructure (webinar)

  • 1.
    Requirements of Monitoring CloudApps & Infrastructure Clay Smith Developer Advocate csmith@newrelic.com Alberto Gomez Director, Product Management agomez@newrelic.com
  • 2.
    3 Notes Confidential ©2008-15 NewRelic, Inc. All rights reserved.   Today’s webinar is being recorded. A link to the recording will be emailed to all registrants shortly after. Please be sure to ask any questions via the “questions panel” There will be a brief survey after the webinar for any additional questions or feedback.
  • 3.
    Agenda ❏ How monitoringchanges in the cloud ❏ Understanding your cloud application architecture ❏ Getting visibility into managed cloud services with native integrations ❏ Cloud monitoring explained by data type ❏ Platform requirements for cloud monitoring ❏ Q&A
  • 4.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Diversity of frameworks, tools, languages and platforms is increasing with cloud adoption. 5 1 deploy/quarter 2 deploy/week Many deploys/day
  • 5.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Volume of operational data being generated is growing exponentially. Web App: Then Web App: Now 1 application 3 large servers 1 database 1 data center 1 deploy/quarter 30 containers 4 services 10 small instances 2 managed services 2 databases 2 cloud regions Many deploys/day
  • 6.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Understand the architecture Get visibility into the relationships of a complex cloud environment
  • 7.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Service Map helps teams understand application architecture. BrowserMobile Application New Relic Service Map Connections created based on external network calls.
  • 8.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Health Map: Multiple sources of data increases visibility into health See the health of every application and dependent hosts (color coding dependent on alerts status) Scroll over a host to see status details Filters let you narrow search to specific applications or hosts Server OS Application New Relic Health Map
  • 9.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved … including visibility into cloud infrastructure Server OS Application EC2 Region Filtering in Health Map Filters support cloud-specific views of hosts
  • 10.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Native Cloud Integrations Using a cloud-managed service shouldn’t reduce visibility
  • 11.
    Amazon EC2 Instance BrowserMobile Server(Virtual) Hardware Server OS Application & Application Microservices New Relic AWS Integrations New Relic Application Monitoring New Relic Infrastructure Monitoring Amazon CloudWatch AWS CONSOLE Integrations New Relic Monitors CloudWatch monitors DASHBOARDS AWS / CloudWatch Integrations • Visibility into virtualization • CPU / Disk / Networking • +20 AWS Services • More soon!
  • 12.
    Popular today: EC2,S3, ELB, RDS, EBS, CloudFront, DynamoDB, Elasticache, Lambda metrics from Cloudwatch AWS Integrations 13©2008–17 New Relic, Inc. All rights reserved. Billing/Cost Control Kinesis Firehose Elasticsearch Route53 ECS/ECR New Integrations: Server (Virtual) Hardware
  • 13.
    Create custom clouddashboards using New Relic Insights 14©2008–17 New Relic, Inc. All rights reserved. Server (Virtual) Hardware All AWS Integration event and metric data is available in New Relic Insights Dashboards customizable using a SQL-like query language Updates in real time
  • 14.
    AWS Integrations: Events 15©2008–17New Relic, Inc. All rights reserved. Server (Virtual) Hardware Cloud events across services and regions are also captured Understand AWS Infrastructure changes in real-time
  • 15.
    Define detailed alertconditions from cloud integrations and other sources 16©2008–17 New Relic, Inc. All rights reserved. Server (Virtual) Hardware Alerts can be consolidated across on-prem and multiple regions Alert on metrics and events Preview thresholds
  • 16.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Metrics, Traces, and Events Cloud monitoring explained by data type
  • 17.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Metrics: Webinar Poll BrowserMobile Server (Virtual) Hardware Server OS Application ● What are your sources for metrics? ● Where are there gaps? ? ? ? ?
  • 18.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved From any source, monitoring data can be organized into three main categories of events 19 Metrics Traces Measurement of an event Relationships between events Examples Throughput, error rate, request rate, request duration Application components involved during a request with an error New Relic Provides Logs Human-readable events System startup output, process output *via Partner Integrations
  • 19.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved • Compute – CPU Utilization, Load, Memory • Network – Transmit/Receive bps – Transmit/Receive errors • Storage – Read/Writes per second – Disk utilization “Traditional” Host Metrics CPU and Load in New Relic Infrastructure Server OS
  • 20.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved • Response time • Error rate • Throughput (rpm) • Apex Score – Ratio of satisfied users (industry standard) Application Key Metrics Overview Page in New Relic APM Application
  • 21.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved • Transaction is a particular path through your code. • Grouped transactions help you know where to focus effort Application Transactions Application Viewing the stack of an application trace in New Relic APM
  • 22.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved • Sequence of events that took place in a transaction Application Traces Application Viewing the stack of an application trace in New Relic APM
  • 23.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved New Relic creates metrics and traces using code instrumentation for full-stack troubleshooting. 24 “Page load time increased 40%” “The /listings endpoint is 3s slower after a deploy.” “EC2 CPU utilization is stable.” “The database is running out of memory.” Instrumentation needed? Browser App AWS EC2 AWS RDS Example insight from metrics and traces
  • 24.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Instrumentation can be extended with APIs to integrate business and app-specific metadata. =+ Apps + servers Code instrumentation with custom attributes Operational data with additional dimensions
  • 25.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Build on a platform Choose a solution that scales to your biggest day
  • 26.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Amazon EC2 Instance BrowserMobile Server (Virtual) Hardware Server OS Application & Application Microservices DASHBOARDS New Relic Application Monitoring New Relic Infrastructure Monitoring Cloud Monitoring: Platform Requirements Built for the cloud • Flexible pricing • Ability to scale to your biggest day • Designed and constantly updated for the future of cloud
  • 27.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved Learn more about cloud monitoring for your dynamic environment. More resources and webinars https://newrelic.com/solutions/topic/cloud-monitoring
  • 28.
    Confidential ©2008–17 NewRelic, Inc. All rights reserved 100% visibility for every step of your cloud journey New Relic: Cloud monitoring with confidence 29 “I would still be flying blind without New Relic.” – Eric Peterson Marketing Systems Engineer, Tableau Cloud Migration with Measurable Results Modernize with Confidence Troubleshoot End-to-End at Cloud Scale
  • 29.
  • 30.
    Thank You Clay Smith DeveloperAdvocate csmith@newrelic.com Alberto Gomez Director, Product Management agomez@newrelic.com