SlideShare a Scribd company logo
©2008–18 New Relic, Inc. All rights reserved
Monitoring:
Not Just for Production
Chris McCarthy
©2008–18 New Relic, Inc. All rights reserved 2
Safe Harbor
This presentation and the information herein (including any information that may be incorporated by reference) is provided for informational
purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell
securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and
may not be replicated or disclosed without New Relic’s express written permission.
Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or
refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking
statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as
“believes,” “anticipates,” “expects” or words of similar import.
Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are
subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New
Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such
forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks,
uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially
from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements
is included in the filings New Relic makes with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s
Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov.
New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no
warranties, expressed or implied, in this presentation or otherwise, with respect to the information provided.
©2008–18 New Relic, Inc. All rights reserved
Why do we monitor
in the first place?
3
©2008–18 New Relic, Inc. All rights reserved
Common Reasons For Monitoring
4
• We can get useful telemetry from a place
that cannot be actively debugged
• It allows us to detect issues as they
happen
• To tell a story behind what happened and
why
• To keep track of contractual obligations
(uptime, SLAs)
• Drive KPIs - MTTR, MTTD, SLA delivery
©2008–18 New Relic, Inc. All rights reserved
Let’s Talk About Uptime for a Minute
5
• A company’s first use of monitoring is
often after a bad outage
• During a postmortem, they determine
more monitoring is needed to reduce
MTTD/MTTR
• That’s not enough! Let’s see why.
©2008–18 New Relic, Inc. All rights reserved
What Do We Get from Monitoring Production?
6
Production Monitoring
• Reduce MTTR/MTTD
• Ensure SLAs are met
• Detect client-facing issues
©2008–18 New Relic, Inc. All rights reserved
What Happens as We Push Left?
7
Pre-Production Monitoring Production Monitoring
• Reduce number of incidents
• Alert on performance issues and send
directly to dev teams
• Standardize response process
• Reduce MTTR/MTTD
• Ensure SLAs are met
• Detect client-facing issues
©2008–18 New Relic, Inc. All rights reserved
All the Way?
8
Dev/QA
• Easily test performance of
new features
• Instrument key methods at
dev time
• Embrace monitoring as part
of building software, just like
testing
Pre-production
• Reduce number of incidents
• Alert on issues and send
directly to dev teams
• Standardize response
process
Production
• Reduce MTTR/MTTD
• Ensure SLAs are met
• Detect client-facing issues
©2008–18 New Relic, Inc. All rights reserved
Great - how do I achieve this
with New Relic?
9
©2008–18 New Relic, Inc. All rights reserved 10
You Already Require Tests - Why Not Monitoring?
Start to think of preprod alerts as
the monitoring analog of unit and
integration tests. Developers should
consider this up front.
Include custom metrics and custom
attributes at development time so
they’re available in all environments.
©2008–18 New Relic, Inc. All rights reserved
Script Everything!
11
• Use New Relic’s APIs to set your alerts
programmatically.
• Encourage teams to maintain alerts
JSON as part of their projects
• Use the New Relic CLI:
https://github.com/IBM/newrelic-cli
(Apache 2.0)
• Mirror every alert (within reason)
from pre-production and production
to ensure you’re preventing incidents
Thank You
©2008–18 New Relic, Inc. All rights reserved

More Related Content

What's hot

Ground Rules for Code Reviews
Ground Rules for Code ReviewsGround Rules for Code Reviews
Ground Rules for Code Reviews
New Relic
 
FS18 Chicago Keynote
FS18 Chicago Keynote FS18 Chicago Keynote
FS18 Chicago Keynote
New Relic
 
Measureable Cloud Migration
Measureable Cloud MigrationMeasureable Cloud Migration
Measureable Cloud Migration
Tori Wieldt
 
re:Thinking the Cloud
re:Thinking the Cloudre:Thinking the Cloud
re:Thinking the Cloud
New Relic
 
Cloud Migration Acceptance Testing - Prove Success
Cloud Migration Acceptance Testing - Prove SuccessCloud Migration Acceptance Testing - Prove Success
Cloud Migration Acceptance Testing - Prove Success
Kevin Downs
 
How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud SpendHow to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend
Kevin Downs
 
Cloud Adoption Best Practices with New Relic
Cloud Adoption Best Practices with New RelicCloud Adoption Best Practices with New Relic
Cloud Adoption Best Practices with New Relic
New Relic
 
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
New Relic
 
If It Touches Production, It Is Production
If It Touches Production, It Is ProductionIf It Touches Production, It Is Production
If It Touches Production, It Is Production
New Relic
 
10 Things You Can Do With New Relic - Number 9 Will Shock You
10 Things You Can Do With New Relic - Number 9 Will Shock You10 Things You Can Do With New Relic - Number 9 Will Shock You
10 Things You Can Do With New Relic - Number 9 Will Shock You
New Relic
 
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
New Relic
 
Track Welcome: New Relic 101 [FutureStack16]
Track Welcome: New Relic 101 [FutureStack16]Track Welcome: New Relic 101 [FutureStack16]
Track Welcome: New Relic 101 [FutureStack16]
New Relic
 
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
New Relic
 
Our Evolution to GraphQL: Unifying our API Strategy
Our Evolution to GraphQL: Unifying our API StrategyOur Evolution to GraphQL: Unifying our API Strategy
Our Evolution to GraphQL: Unifying our API Strategy
New Relic
 
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
New Relic
 
Track Welcome: Operating Dynamic Infrastructure [FutureStack]
Track Welcome: Operating Dynamic Infrastructure [FutureStack]Track Welcome: Operating Dynamic Infrastructure [FutureStack]
Track Welcome: Operating Dynamic Infrastructure [FutureStack]
New Relic
 
Ground Rules for Code Reviews: Improving development velocity and team commun...
Ground Rules for Code Reviews: Improving development velocity and team commun...Ground Rules for Code Reviews: Improving development velocity and team commun...
Ground Rules for Code Reviews: Improving development velocity and team commun...
New Relic
 
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
Al Sargent
 

What's hot (18)

Ground Rules for Code Reviews
Ground Rules for Code ReviewsGround Rules for Code Reviews
Ground Rules for Code Reviews
 
FS18 Chicago Keynote
FS18 Chicago Keynote FS18 Chicago Keynote
FS18 Chicago Keynote
 
Measureable Cloud Migration
Measureable Cloud MigrationMeasureable Cloud Migration
Measureable Cloud Migration
 
re:Thinking the Cloud
re:Thinking the Cloudre:Thinking the Cloud
re:Thinking the Cloud
 
Cloud Migration Acceptance Testing - Prove Success
Cloud Migration Acceptance Testing - Prove SuccessCloud Migration Acceptance Testing - Prove Success
Cloud Migration Acceptance Testing - Prove Success
 
How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud SpendHow to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend
 
Cloud Adoption Best Practices with New Relic
Cloud Adoption Best Practices with New RelicCloud Adoption Best Practices with New Relic
Cloud Adoption Best Practices with New Relic
 
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
Inversion of Control: How New Relic’s Engineers Picked Their Own Jobs and Bui...
 
If It Touches Production, It Is Production
If It Touches Production, It Is ProductionIf It Touches Production, It Is Production
If It Touches Production, It Is Production
 
10 Things You Can Do With New Relic - Number 9 Will Shock You
10 Things You Can Do With New Relic - Number 9 Will Shock You10 Things You Can Do With New Relic - Number 9 Will Shock You
10 Things You Can Do With New Relic - Number 9 Will Shock You
 
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
New Relic Infrastructure Intro: Increasing Mean Time Between Loss of Sleep [F...
 
Track Welcome: New Relic 101 [FutureStack16]
Track Welcome: New Relic 101 [FutureStack16]Track Welcome: New Relic 101 [FutureStack16]
Track Welcome: New Relic 101 [FutureStack16]
 
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
Track Welcome: New Relic: Analytics for Everyone [FutureStack16]
 
Our Evolution to GraphQL: Unifying our API Strategy
Our Evolution to GraphQL: Unifying our API StrategyOur Evolution to GraphQL: Unifying our API Strategy
Our Evolution to GraphQL: Unifying our API Strategy
 
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
Rock Stars, Builders, and Janitors: You're Doing It Wrong, New Relic [FutureS...
 
Track Welcome: Operating Dynamic Infrastructure [FutureStack]
Track Welcome: Operating Dynamic Infrastructure [FutureStack]Track Welcome: Operating Dynamic Infrastructure [FutureStack]
Track Welcome: Operating Dynamic Infrastructure [FutureStack]
 
Ground Rules for Code Reviews: Improving development velocity and team commun...
Ground Rules for Code Reviews: Improving development velocity and team commun...Ground Rules for Code Reviews: Improving development velocity and team commun...
Ground Rules for Code Reviews: Improving development velocity and team commun...
 
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
Gartner IT Ops Summit 2015: Why Fast is not enough: App Monitoring in the Cus...
 

Similar to Monitoring is Not Just for Production!

How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend
New Relic
 
You’re ready to migrate, but how will you prove success?
You’re ready to migrate, but how will you prove success?You’re ready to migrate, but how will you prove success?
You’re ready to migrate, but how will you prove success?
New Relic
 
Kubernetes in the Wild: Best Practices for Monitoring
Kubernetes in the Wild: Best Practices for MonitoringKubernetes in the Wild: Best Practices for Monitoring
Kubernetes in the Wild: Best Practices for Monitoring
New Relic
 
Cloud Expo (Keynote) - Static vs Dynamic
Cloud Expo (Keynote) - Static vs DynamicCloud Expo (Keynote) - Static vs Dynamic
Cloud Expo (Keynote) - Static vs Dynamic
Lee Atchison
 
Engineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
Engineering and Autonomy in the Age of Microservices - Nic Benders, New RelicEngineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
Engineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
Ambassador Labs
 
Changing The Laws Of Engineering With Github Pull Requests
Changing The Laws Of Engineering With Github Pull RequestsChanging The Laws Of Engineering With Github Pull Requests
Changing The Laws Of Engineering With Github Pull Requests
New Relic
 
Living in the Cloud
Living in the CloudLiving in the Cloud
Living in the Cloud
Kevin Downs
 
Nr fy19 analystday_presentation_web
Nr fy19 analystday_presentation_webNr fy19 analystday_presentation_web
Nr fy19 analystday_presentation_web
investorsnewrelic
 
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
Flink Forward
 
Implementing Docker in Production at Scale
Implementing Docker in Production at ScaleImplementing Docker in Production at Scale
Implementing Docker in Production at Scale
Karl Matthias
 
New Relic After Lift and Shift - FutureStack 2019
New Relic After Lift and Shift - FutureStack 2019New Relic After Lift and Shift - FutureStack 2019
New Relic After Lift and Shift - FutureStack 2019
Kevin Downs
 
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
Ambassador Labs
 
Best Practices for Measuring your Code Pipeline
Best Practices for Measuring your Code PipelineBest Practices for Measuring your Code Pipeline
Best Practices for Measuring your Code Pipeline
New Relic
 
FutureStack'19 Closing Keynote
FutureStack'19 Closing KeynoteFutureStack'19 Closing Keynote
FutureStack'19 Closing Keynote
Lee Atchison
 
Cloud Expo - Flying Two Mistakes High
Cloud Expo - Flying Two Mistakes HighCloud Expo - Flying Two Mistakes High
Cloud Expo - Flying Two Mistakes High
Lee Atchison
 
Scaling with Docker: New Relic’s Containerization Journey
Scaling with Docker: New Relic’s Containerization JourneyScaling with Docker: New Relic’s Containerization Journey
Scaling with Docker: New Relic’s Containerization Journey
Tori Wieldt
 
FutureStack16 NYC Opening Keynote
FutureStack16 NYC Opening KeynoteFutureStack16 NYC Opening Keynote
FutureStack16 NYC Opening Keynote
New Relic
 
Investor Deck - Q2 2015
Investor Deck - Q2 2015Investor Deck - Q2 2015
Investor Deck - Q2 2015
investorsnewrelic
 
Megabase: How We Containerized Databases at New Relic
Megabase: How We Containerized Databases at New RelicMegabase: How We Containerized Databases at New Relic
Megabase: How We Containerized Databases at New Relic
Marty Matheny
 

Similar to Monitoring is Not Just for Production! (19)

How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend How to Lower or Justify your Cloud Spend
How to Lower or Justify your Cloud Spend
 
You’re ready to migrate, but how will you prove success?
You’re ready to migrate, but how will you prove success?You’re ready to migrate, but how will you prove success?
You’re ready to migrate, but how will you prove success?
 
Kubernetes in the Wild: Best Practices for Monitoring
Kubernetes in the Wild: Best Practices for MonitoringKubernetes in the Wild: Best Practices for Monitoring
Kubernetes in the Wild: Best Practices for Monitoring
 
Cloud Expo (Keynote) - Static vs Dynamic
Cloud Expo (Keynote) - Static vs DynamicCloud Expo (Keynote) - Static vs Dynamic
Cloud Expo (Keynote) - Static vs Dynamic
 
Engineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
Engineering and Autonomy in the Age of Microservices - Nic Benders, New RelicEngineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
Engineering and Autonomy in the Age of Microservices - Nic Benders, New Relic
 
Changing The Laws Of Engineering With Github Pull Requests
Changing The Laws Of Engineering With Github Pull RequestsChanging The Laws Of Engineering With Github Pull Requests
Changing The Laws Of Engineering With Github Pull Requests
 
Living in the Cloud
Living in the CloudLiving in the Cloud
Living in the Cloud
 
Nr fy19 analystday_presentation_web
Nr fy19 analystday_presentation_webNr fy19 analystday_presentation_web
Nr fy19 analystday_presentation_web
 
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
Flink Forward Berlin 2018: Caito Scherr & Nikolas Davis - "Flink Positive/Fli...
 
Implementing Docker in Production at Scale
Implementing Docker in Production at ScaleImplementing Docker in Production at Scale
Implementing Docker in Production at Scale
 
New Relic After Lift and Shift - FutureStack 2019
New Relic After Lift and Shift - FutureStack 2019New Relic After Lift and Shift - FutureStack 2019
New Relic After Lift and Shift - FutureStack 2019
 
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
Microservices Practitioner Summit Jan '15 - Designing APIs with Customers in ...
 
Best Practices for Measuring your Code Pipeline
Best Practices for Measuring your Code PipelineBest Practices for Measuring your Code Pipeline
Best Practices for Measuring your Code Pipeline
 
FutureStack'19 Closing Keynote
FutureStack'19 Closing KeynoteFutureStack'19 Closing Keynote
FutureStack'19 Closing Keynote
 
Cloud Expo - Flying Two Mistakes High
Cloud Expo - Flying Two Mistakes HighCloud Expo - Flying Two Mistakes High
Cloud Expo - Flying Two Mistakes High
 
Scaling with Docker: New Relic’s Containerization Journey
Scaling with Docker: New Relic’s Containerization JourneyScaling with Docker: New Relic’s Containerization Journey
Scaling with Docker: New Relic’s Containerization Journey
 
FutureStack16 NYC Opening Keynote
FutureStack16 NYC Opening KeynoteFutureStack16 NYC Opening Keynote
FutureStack16 NYC Opening Keynote
 
Investor Deck - Q2 2015
Investor Deck - Q2 2015Investor Deck - Q2 2015
Investor Deck - Q2 2015
 
Megabase: How We Containerized Databases at New Relic
Megabase: How We Containerized Databases at New RelicMegabase: How We Containerized Databases at New Relic
Megabase: How We Containerized Databases at New Relic
 

More from New Relic

7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale
New Relic
 
7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale
New Relic
 
New Relic University at Future Stack Tokyo 2019
New Relic University at Future Stack Tokyo 2019New Relic University at Future Stack Tokyo 2019
New Relic University at Future Stack Tokyo 2019
New Relic
 
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
New Relic
 
FutureStack Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
FutureStack  Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...FutureStack  Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
FutureStack Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
New Relic
 
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖をFutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
New Relic
 
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
New Relic
 
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
New Relic
 
Three Monitoring Mistakes and How to Avoid Them
Three Monitoring Mistakes and How to Avoid ThemThree Monitoring Mistakes and How to Avoid Them
Three Monitoring Mistakes and How to Avoid Them
New Relic
 
Intro to Multidimensional Kubernetes Monitoring
Intro to Multidimensional Kubernetes MonitoringIntro to Multidimensional Kubernetes Monitoring
Intro to Multidimensional Kubernetes Monitoring
New Relic
 
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
New Relic
 
Top Three Mistakes People Make with Monitoring
Top Three Mistakes People Make with MonitoringTop Three Mistakes People Make with Monitoring
Top Three Mistakes People Make with Monitoring
New Relic
 
Kick Ass Data Exploration through Dashboards
Kick Ass Data Exploration through DashboardsKick Ass Data Exploration through Dashboards
Kick Ass Data Exploration through Dashboards
New Relic
 

More from New Relic (13)

7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale
 
7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale7 Tips & Tricks to Having Happy Customers at Scale
7 Tips & Tricks to Having Happy Customers at Scale
 
New Relic University at Future Stack Tokyo 2019
New Relic University at Future Stack Tokyo 2019New Relic University at Future Stack Tokyo 2019
New Relic University at Future Stack Tokyo 2019
 
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
FutureStack Tokyo 19 -[事例講演]株式会社リクルートライフスタイル:年間9300万件以上のサロン予約を支えるホットペッパービューティ...
 
FutureStack Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
FutureStack  Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...FutureStack  Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
FutureStack Tokyo 19 -[New Relic テクニカル講演]モニタリングと可視化がデジタルトランスフォーメーションを救う! - サ...
 
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖をFutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
FutureStack Tokyo 19 -[特別講演]システム開発によろこびと驚きの連鎖を
 
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
FutureStack Tokyo 19 -[パートナー講演]アマゾン ウェブ サービス ジャパン株式会社: New Relicを活用したAWSへのアプリ...
 
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
FutureStack Tokyo 19_インサイトとデータを組織の力にする_株式会社ドワンゴ 池田 明啓 氏
 
Three Monitoring Mistakes and How to Avoid Them
Three Monitoring Mistakes and How to Avoid ThemThree Monitoring Mistakes and How to Avoid Them
Three Monitoring Mistakes and How to Avoid Them
 
Intro to Multidimensional Kubernetes Monitoring
Intro to Multidimensional Kubernetes MonitoringIntro to Multidimensional Kubernetes Monitoring
Intro to Multidimensional Kubernetes Monitoring
 
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
Understanding Microservice Latency for DevOps Teams: An Introduction to New R...
 
Top Three Mistakes People Make with Monitoring
Top Three Mistakes People Make with MonitoringTop Three Mistakes People Make with Monitoring
Top Three Mistakes People Make with Monitoring
 
Kick Ass Data Exploration through Dashboards
Kick Ass Data Exploration through DashboardsKick Ass Data Exploration through Dashboards
Kick Ass Data Exploration through Dashboards
 

Recently uploaded

National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 

Recently uploaded (20)

National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 

Monitoring is Not Just for Production!

  • 1. ©2008–18 New Relic, Inc. All rights reserved Monitoring: Not Just for Production Chris McCarthy
  • 2. ©2008–18 New Relic, Inc. All rights reserved 2 Safe Harbor This presentation and the information herein (including any information that may be incorporated by reference) is provided for informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission. Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as “believes,” “anticipates,” “expects” or words of similar import. Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements is included in the filings New Relic makes with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov. New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no warranties, expressed or implied, in this presentation or otherwise, with respect to the information provided.
  • 3. ©2008–18 New Relic, Inc. All rights reserved Why do we monitor in the first place? 3
  • 4. ©2008–18 New Relic, Inc. All rights reserved Common Reasons For Monitoring 4 • We can get useful telemetry from a place that cannot be actively debugged • It allows us to detect issues as they happen • To tell a story behind what happened and why • To keep track of contractual obligations (uptime, SLAs) • Drive KPIs - MTTR, MTTD, SLA delivery
  • 5. ©2008–18 New Relic, Inc. All rights reserved Let’s Talk About Uptime for a Minute 5 • A company’s first use of monitoring is often after a bad outage • During a postmortem, they determine more monitoring is needed to reduce MTTD/MTTR • That’s not enough! Let’s see why.
  • 6. ©2008–18 New Relic, Inc. All rights reserved What Do We Get from Monitoring Production? 6 Production Monitoring • Reduce MTTR/MTTD • Ensure SLAs are met • Detect client-facing issues
  • 7. ©2008–18 New Relic, Inc. All rights reserved What Happens as We Push Left? 7 Pre-Production Monitoring Production Monitoring • Reduce number of incidents • Alert on performance issues and send directly to dev teams • Standardize response process • Reduce MTTR/MTTD • Ensure SLAs are met • Detect client-facing issues
  • 8. ©2008–18 New Relic, Inc. All rights reserved All the Way? 8 Dev/QA • Easily test performance of new features • Instrument key methods at dev time • Embrace monitoring as part of building software, just like testing Pre-production • Reduce number of incidents • Alert on issues and send directly to dev teams • Standardize response process Production • Reduce MTTR/MTTD • Ensure SLAs are met • Detect client-facing issues
  • 9. ©2008–18 New Relic, Inc. All rights reserved Great - how do I achieve this with New Relic? 9
  • 10. ©2008–18 New Relic, Inc. All rights reserved 10 You Already Require Tests - Why Not Monitoring? Start to think of preprod alerts as the monitoring analog of unit and integration tests. Developers should consider this up front. Include custom metrics and custom attributes at development time so they’re available in all environments.
  • 11. ©2008–18 New Relic, Inc. All rights reserved Script Everything! 11 • Use New Relic’s APIs to set your alerts programmatically. • Encourage teams to maintain alerts JSON as part of their projects • Use the New Relic CLI: https://github.com/IBM/newrelic-cli (Apache 2.0) • Mirror every alert (within reason) from pre-production and production to ensure you’re preventing incidents
  • 12. Thank You ©2008–18 New Relic, Inc. All rights reserved