The document discusses AIOps, highlighting its role in enhancing DevOps through machine learning for real-time anomaly detection, root cause analysis, and automation of operational processes. It emphasizes the urgency for organizations to adapt AIOps in order to manage growing engineering burdens and improve reliability standards. Additionally, the document includes various polls and insights on operational metrics and the automation landscape.

1. AIOps: Your
DevOps Copilot
Marco Coulter, Technical Evangelist
Ravi Lachhman, Technical Evangelist

2. 2AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Ravi LachhmanMarco Coulter
Technical Evangelist, AppDynamics Technical Evangelist, AppDynamics

3. 3AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Let’s Level Set on AI
Reliability
Why AIOps?
Defining AIOps
Enhance Yourself with AIOps
Where to Start with AIOps
Learnings

4. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 4
Poll Question 0:
Have you personally trained a machine learning model?

5. 5AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Let’s talk about Machine Learning

6. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 6
Promise vs Reality
Artificial ‘General’ Intelligence
AI/ML

7. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 7
Traditional Programming vs. Machine Learning
T R A D I T I O N A L , R U L E S - B A S E D
Live data
Program Output

8. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 8
Traditional Programming vs. Machine Learning
101000 0110 0
11000011100 1
1001 1101 111
T R A D I T I O N A L , R U L E S - B A S E D M A C H I N E L E A R N I N G
Training
data
Output Program
(Model)
Live data
Program Output
AIOps, Your DevOps CoPilot

9. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 9
Example:
Predict the selling price of a
home using simple linear
regression algorithm
y = a + bx

10. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 10
Instance (Observation, Record)
Feature (Attribute, Predictor) Objective (Target)
Basic Terminology

11. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 11
AIOps, Your DevOps CoPilot
Read the data

12. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 12
AIOps, Your DevOps CoPilotAIOps – How We Will Survive DevOps
Prepare the data

13. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 13
AIOps, Your DevOps CoPilotAIOps – How We Will Survive DevOps
Correlate the data (seeking x)

14. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 14
AIOps, Your DevOps CoPilot
Now we have x, we still need a and b

15. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 15
AIOps, Your DevOps CoPilotAIOps – How We Will Survive DevOps
Train the model (derive a and b) and Test

16. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 16
AIOps, Your DevOps CoPilot
Visualize the result (for fun)

17. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 17
AIOps, Your DevOps CoPilot
Lots of dots becomes blue line because mathematics!

18. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 18
It is not magic, it is just fast!
AI/ML finds patterns and
derives conclusions at speeds
humans aren’t capable of.

19. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 19
Poll Question 1:
What is your average engineer to server/container ratio?
1. 1:100
2. 1:1,000
3. 1:10,000
4. 1:100,000
5. 1:1,000,000+

20. 20AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
You are the Captain of your Reliability

21. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 21
Reliability Engineering

22. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 22
Let’s Fly a Plane

23. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 23
Pilot Run Books - SOPs

24. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 24
How do you increase altitude?

25. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 25
That’s not the Yoke?!

26. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 26
Some Math

27. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 27
Traffic Avoidance System - TCAS

28. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 28
Your Car Today

29. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 29
Poll Question 2:
Are you tracking mean time to resolution (MTTR) in your
organization today?

30. 30AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
About my co-pilot
… umm, what exactly is AIOps?

31. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 31
“
AIOps augments technology operations teams by leveraging
machine learning to derive real-time anomaly detection and
insights, identify root causes and automate threshold definition and
resolutions.

32. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 32
Detect
D
K F
V
Know Fix
Verify
1
2 3
4
MTTRMEAN TIME TO RESOLUTION
MTTR
MEAN TIME TO RESOLUTION

33. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 33
Detect
D
K F
V
Know Fix
Verify
1
2 3
4
PROBLEM TIME SOLUTION TIME
?
MTTRMEAN TIME TO RESOLUTION

34. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 34
What is Normal? Goodbye Manual Thresholds!

35. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 35
AIOps: Detect Correlation

36. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 36
AIOps: Detect Business Anomaly

37. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 37
AIOps: Automated Root Cause Analysis

38. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 38
PROBLEM TIME
?
SOLUTION TIME
Detect
D
K F
V
Know Fix
Verify
1
2 3
4
MTTRMEAN TIME TO RESOLUTION

39. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 39
PROBLEM TIME
?
SOLUTION TIME
Detect
D
K F
V
Know Fix
Verify
1
2 3
4
MTTRMEAN TIME TO RESOLUTION
AIOps TIME

40. 40AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Central Nervous
System – from co-pilot to autopilot

41. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 41
RCA
Public
cloud
Private
cloud
App and business
Timeseriesandeventsdata
Orchestration
KnowledgeDetect Fix
Verify
Incident response
Resource scaling
Cost optimization
Network provisioning
ML/AIAlerting API
InsightVisibility Action
Feedback Loop

42. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 42
RCA
Public
cloud
Private
cloud
App and business
InsightVisibility
Timeseriesandeventsdata
Orchestration
Action
Feedback Loop
Incident response
Resource scaling
Cost optimization
Network provisioning
ML/AIAlerting API

43. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 43
Action
Public
cloud
Private
cloud
Visibility
Correlation engine
Unified dashboard
ML/AI
Insight
Timeseriesandeventsdata
Orchestration
App and business
Infrastructure
Network
Security
Feedback Loop
Incident response
Resource scaling
Cost optimization
Network configuration
Security enforcement
The Central Nervous System
Alerting API

44. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 44
Freedom to innovate by
automating everyday tasks
• Continuously adapt to changing business conditions
• Automation driven by cross domain insight
• At your own pace
Autonomous action
+
Orchestration
Incident response
Resource scaling
Cost optimization
Network configuration
Security enforcement
Action

45. 45AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Enhance Yourself
45

46. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 46
Assistant / Aid

47. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 47
Guardrail

48. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 48
Auto-Tune

49. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 49
Visibility Insight Action
Use case: intelligent applications
Challenge: Scaling infrastructure to meet resource demands is slow and complex
Feedback loop shows improvement which automatically closes the incident and archives slack channel4
1
App and business,
network and
infrastructure
Correlate application performance with
application and infrastructure to determine
root cause and corrective action
+
2
New policy is automatically
provisioned to increase the
application tunables
3

50. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 50
Sonarqube: The Developer’s Friend

51. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 51
Knowing (Historically) What’s Around You

52. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 52
Poll Question 3:
Which quote best matches you today?

53. 53AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Automation Decision Criteria

54. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 54
Frequency

55. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 55
Impact

56. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 56
Coverage

57. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 57
Probability

58. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 58
Latency

59. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 59
Preemptive
“We use data to
continuously optimize our
outcomes”
Predictive
“We use data to predict
and respond to imminent
events”
Reactive
“We react to
operational events
as they happen”
Proactive
”We learn from past
events to improve our
processes
Four Steps to Operations Nirvana

60. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 60
• Engineering burden is only increasing
• AIOps offers immediate relief
• Better with cross domain, including business transaction
• Automate the complex & mundane
• Augment yourself!
AIOps, Your DevOps Co-pilot

61. AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 61
QUESTIONS!
• Email evangelism@appdynamics.com for a copy of the presentation.
• AIOps: A Self-Healing Mentality - https://blog.appdynamics.com/engineering/aiops-a-self-
healing-mentality/
• Our Vision for AIOps - https://blog.appdynamics.com/aiops/aiops-central-nervous-system/
• Staffing IT for AIOps - https://www.forbes.com/sites/appdynamics/2019/03/11/is-your-it-
workforce-ready-for-aiops/#5ff583f2b005
• Blog posts on AIOps - https://blog.appdynamics.com/aiops/
• Avoiding the Fog of Development - https://blog.appdynamics.com/engineering/full-cycle-
developers-avoid-fog-of-development/
Links

62. 62AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Thank you!
@marcocoulter
@ravilach