SlideShare a Scribd company logo
1 of 54
Download to read offline
DUMB & DUMBER
How smart is your monitoring data
Tom Levey
Tech Evangelist
@tlevey
Big data
is BAD
Big

data
is BAD

monitoring

Make the move to Smart Data
Why do monitoring tools exist?
What is Business Impact?
Enterprise Data Bloating

@

Log Files

Email

monitoring

£
Legal

business
Keep Everything?

!8
Keep Nothing?

!9
just what you need
IT ENVIRONMENT

1200

300,000

servers

trans/min

MONITORING ENVIRONMENT

700
cores

8%
92

servers

80TB
storage
The Digital Hoarders are Winning
Data Storage
System Performance
Network Bandwidth

47%
37%
36%

40-60%
STORAGE REQUIREMENT
INCREASE YEARLY
gartner
smart data
defined
actionable, intelligent, information
IS THIS PERSON PERFORMING WELL?

Heart rate!
150bpm!

Blood pressure!
165/100!
are we talking about this person?
!15
OR this person?
What data could we collect?
Attribute

Person 1

Person 2

Heart Rate

150

150

Blood Pressure

180/90

180/90

Eye Color

Blue

Brown

Blood Type

O+

O-

White Blood Cell Count

3.5

3.8

Hair Color

Brown

Blue

Height

180cm

175cm

Shoe size

11

10

Weight

180kg

94kg

Current activity

sitting

skating
IS PERSON 2 PERFORMING WELL?

Distance

10,000 metres!

Time

12min 44sec!

Record time: 12min 58sec
baseline
New Olympic Record
Jorrit Bergsma 10,000m winner
Traditional Monitoring Tools Are Misleading

Resource Spikes May or May Not Cause Business Impact
Good luck

!21
We’ve become addicted to metrics!

!22
What do these charts tell us about
application performance or business impact?

!23
average response time with historical baseline
monitoring platforms should do the heavy lifting
User & IT perspective
Analytics
Correlation
Intelligent alerting
Resolution path
Disaster Recovery (DR)

vs 

Problem Recovery (PR)
Problem Recovery Planning
STRATEGY
!

MONITORING CONSIDERED CRITICAL
!

END USER FOCUSSED
!

CULTURAL
when a problem occurs…
Do we have monitoring?
!

What kind?
!

What are we collecting?
!

How long do we have history?
when a problem occurs…

Network

LOGS

DATABASE

INFRASTRUCTURE

APPLICATION
Distributed dynamic environments
smart data
MOST APM TOOLS ARE

DUMB
MOST INFRASTRUCTURE
MONITORING TOOLS ARE

DUMBER!
IT ENVIRONMENT

1200

300,000

servers

trans/min

MONITORING ENVIRONMENT

700
cores

8%
92

servers

80TB
storage
Who is using my application
End user experience - kpi's
business transaction - kpi's

Oracle
.NET Service

ESB/MQ
Apache

Browser(s)

Purchase
Search Flight
Flight Status
Login

Native
Mobile
App

Network
application flow - kpi's
code execution Diagnostics
We need to save THE RIGHT data
Analytics

Aggregation

Correlation	

Control

Application

Archive
Don’t be this person…

!42
plan ahead
anticipate needs
intended purpose

!43
QUANTIFY IMPACT
$64,499 per min
Application
Revenue

10.1 s

$11,987 per min

Application
Response time
100 ms
Application
Errors

* Screenshot from US e-Commerce AppDynamics Customer
QUANTIFY BENEFIT
code
release 1

code
release 2

code
release 3

$58,237 per min
$44,499 per min
Application
Revenue
Application
Response time
3.1 sec

1.9 s

!45
EXAMPLES
over 1 million metrics per minute.
what did he say?
1.

2.

3.
1.

2.

3.

Big monitoring data
slows down MTTR and
drives up costs… a lot!
1.

2.

3.

Focusing on Problem Recovery
will help you figure out your
architecture, tools, & process…
This saves time and money
1.

2.

3.

Don’t be a digital hoarder!!!
Make the move to Smart Data
stand 1020

Free trial: appdynamics.com/freetrial
thankyou!

More Related Content

Similar to Dumb and Dumber: how smart is your monitoring data?

COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku LepistoCOSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
Amazon Web Services
 
Identity and Biometrics in the Big Data & Analytics Context
Identity and Biometrics in the Big Data & Analytics ContextIdentity and Biometrics in the Big Data & Analytics Context
Identity and Biometrics in the Big Data & Analytics Context
Charles Li
 
Data Warehousing And Data Mining Presentation Transcript
Data Warehousing And Data Mining   Presentation TranscriptData Warehousing And Data Mining   Presentation Transcript
Data Warehousing And Data Mining Presentation Transcript
SUBODH009
 
Compounding Business Value Through Big Data & Advanced Analytics, v2
Compounding Business Value Through Big Data & Advanced Analytics, v2Compounding Business Value Through Big Data & Advanced Analytics, v2
Compounding Business Value Through Big Data & Advanced Analytics, v2
denesuk
 

Similar to Dumb and Dumber: how smart is your monitoring data? (20)

Observability at Spotify
Observability at SpotifyObservability at Spotify
Observability at Spotify
 
Big Data and Health Care
Big Data and Health CareBig Data and Health Care
Big Data and Health Care
 
One small Step for Consumers, one giant Leap for Enterprise
One small Step for Consumers, one giant Leap for EnterpriseOne small Step for Consumers, one giant Leap for Enterprise
One small Step for Consumers, one giant Leap for Enterprise
 
COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku LepistoCOSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
COSCUP - Open Source Engines Providing Big Data in the Cloud, Markku Lepisto
 
Machine Data Analytics
Machine Data AnalyticsMachine Data Analytics
Machine Data Analytics
 
Big data and APIs for PHP developers - SXSW 2011
Big data and APIs for PHP developers - SXSW 2011Big data and APIs for PHP developers - SXSW 2011
Big data and APIs for PHP developers - SXSW 2011
 
Identity and Biometrics in the Big Data & Analytics Context
Identity and Biometrics in the Big Data & Analytics ContextIdentity and Biometrics in the Big Data & Analytics Context
Identity and Biometrics in the Big Data & Analytics Context
 
Time Difference: How Tomorrow's Companies Will Outpace Today's
Time Difference: How Tomorrow's Companies Will Outpace Today'sTime Difference: How Tomorrow's Companies Will Outpace Today's
Time Difference: How Tomorrow's Companies Will Outpace Today's
 
Big Data
Big DataBig Data
Big Data
 
Big data use cases in the cloud presentation
Big data use cases in the cloud presentationBig data use cases in the cloud presentation
Big data use cases in the cloud presentation
 
Data Warehousing And Data Mining Presentation Transcript
Data Warehousing And Data Mining   Presentation TranscriptData Warehousing And Data Mining   Presentation Transcript
Data Warehousing And Data Mining Presentation Transcript
 
Democratization - New Wave of Data Science (홍운표 상무, DataRobot) :: AWS Techfor...
Democratization - New Wave of Data Science (홍운표 상무, DataRobot) :: AWS Techfor...Democratization - New Wave of Data Science (홍운표 상무, DataRobot) :: AWS Techfor...
Democratization - New Wave of Data Science (홍운표 상무, DataRobot) :: AWS Techfor...
 
Using real time big data analytics for competitive advantage
 Using real time big data analytics for competitive advantage Using real time big data analytics for competitive advantage
Using real time big data analytics for competitive advantage
 
Conf2013 bchristensen thebig_t
Conf2013 bchristensen thebig_tConf2013 bchristensen thebig_t
Conf2013 bchristensen thebig_t
 
Big Data Use Cases and Solutions in the AWS Cloud
Big Data Use Cases and Solutions in the AWS CloudBig Data Use Cases and Solutions in the AWS Cloud
Big Data Use Cases and Solutions in the AWS Cloud
 
No Time Like the Present – The Case for Streaming Analytics
No Time Like the Present – The Case for Streaming AnalyticsNo Time Like the Present – The Case for Streaming Analytics
No Time Like the Present – The Case for Streaming Analytics
 
Compounding Business Value Through Big Data & Advanced Analytics, v2
Compounding Business Value Through Big Data & Advanced Analytics, v2Compounding Business Value Through Big Data & Advanced Analytics, v2
Compounding Business Value Through Big Data & Advanced Analytics, v2
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017
 
Introduction: Real-Time Analytics on Data in Motion
Introduction: Real-Time Analytics on Data in MotionIntroduction: Real-Time Analytics on Data in Motion
Introduction: Real-Time Analytics on Data in Motion
 
Core Code Introduction
Core Code IntroductionCore Code Introduction
Core Code Introduction
 

More from tlevey

Performance in The Cloud - AppDynamics
Performance in The Cloud - AppDynamicsPerformance in The Cloud - AppDynamics
Performance in The Cloud - AppDynamics
tlevey
 

More from tlevey (7)

Realising the true value of DevOps
Realising the true value of DevOpsRealising the true value of DevOps
Realising the true value of DevOps
 
Performance in The Cloud - AppDynamics
Performance in The Cloud - AppDynamicsPerformance in The Cloud - AppDynamics
Performance in The Cloud - AppDynamics
 
Mobile: One small step for consumers, one giant lead for enterprise
Mobile: One small step for consumers, one giant lead for enterpriseMobile: One small step for consumers, one giant lead for enterprise
Mobile: One small step for consumers, one giant lead for enterprise
 
The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
The DevOps Pay Raise: Quantifying Your Value to Move Up the LadderThe DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
 
Realising the true value of DevOps
Realising the true value of DevOpsRealising the true value of DevOps
Realising the true value of DevOps
 
Mobile: One small step for consumers, one giant leap for Enterprise
Mobile: One small step for consumers, one giant leap for EnterpriseMobile: One small step for consumers, one giant leap for Enterprise
Mobile: One small step for consumers, one giant leap for Enterprise
 
The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
The DevOps Pay Raise: Quantifying Your Value to Move Up the LadderThe DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
The DevOps Pay Raise: Quantifying Your Value to Move Up the Ladder
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

Dumb and Dumber: how smart is your monitoring data?