DevOps began as a way to deliver availability and survive agile methodologies. Along the way to CI/CD, it has become an overwhelming set of tools cobbled together to deploy code. Simultaneously, applications moved to mobile and IoT devices and from simple application servers to front end, backend, cloud, and microservices. The monitor stage of DevOps has exceeded the human capability for comprehension. We are missing things and that leads to outages. We need to augment ourselves with ML & automation. During this session, I want you to think about your last war-room incident and consider whether you are reactive or proactive. By augmenting ourselves through AIOps, we move towards the nirvana of being preemptive. SPEAKER BIO: Marco Coulter, Technical Evangelist | AppDynamics As the Technical Evangelist for AIOps at AppDynamics, Marco Coulter is passionate about the experience humans have when interacting with technology. A former startup CTO, Marco has progressed from operator to leadership roles at CSC, CA Technologies, and more recently 451 Research, where he led the data science team. He earned the nickname "the tech-whisperer" for his skills in translating business drivers for a technical audience and technical concepts for business leaders. When taking the rare break from technology, Marco can be found harvesting fresh vegetables from his NYC garden.

1. #DevOpsLive
AIOps Is How We
Will Survive DevOps
Marco Coulter –
Technical Evangelist
@marcocoulter
www.appdynamics.com/blog/author/marco-coulter/
techwhisperernyc.com/category/strategy/

2. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 2
#about_marco
Marco Coulter
Technical Evangelist
@marcocoulter
marco.coulter@appdynamics.com
www.appdynamics.com/blog/author/marco-coulter/
bit.ly/techwhisperer

3. AppDynamics is now part of Cisco. © 2018 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 3
q “We react to performance events each time they happen”
q ”We proactively learn from past events to improve our
processes”
q “We use data to predict imminent events”
q “We use data to preemptively optimize our outcomes”
Reality check: which quote best matches you?

4. AppDynamics is now part of Cisco. © 2018 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 4
Full report at: http://ow.ly/kI1X30nlXkc or https://connectedfutures.cisco.com/report/transforming-it-operations-for-business-value/
27% 33%7%
26% 38% 22% 14%
33%
Reactive Proactive Predictive Preemptive
Today
In two years
Self-assessment:

5. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 5
Surviving DevOps
Machine Learning Reality Check
What is AIOps
Deciding What to Automate
AIOps Adoption Journey
Chapters:

6. Surviving
DevOps

7. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 7
Plan
Release
DEV OPS

8. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 8
PlanRelease
PLAN/CODE/BUILD/
TEST/RELEASE
Preparation Customer-facing

9. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 9
Mainframe
Private
Cloud
Data
center
VM
VM
VM

10. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 10
Separate Control Planes Aren’t Enough
Domain Controllers
Public cloud
Private cloud
Data center
Business Monitoring
(AppDynamics)
Bug Database
End User Monitoring
(AppDynamics)
Log Management
Change Management
Application Performance Monitoring
(AppDynamics)
Network Management
(DNA-C)
Security Management
(Cisco Security Suite)
Infrastructure Management
(ACI, UCS Director)
Cloud Monitoring
Infra Ops
App Ops
Sec Ops
Net Ops

11. Let’s talk about
Artificial Intelligence
and
Machine Learning

12. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 12
Promise vs. Reality

13. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 13
Example:
Train a model to predict the
selling price (y) of a home using a
simple linear regression algorithm
y = a + bx

14. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 14
Instance (Observation,
Record)
Feature (Attribute, Predictor) Objective (Target)
Basic Terminology

15. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 15
Read the data

16. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 16
Prepare the data

17. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 17
Correlate the data to find our x

18. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 18
Now we have x, we still need a and b

19. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 19
Train the model (derive a and b) and test

20. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 20
Visualize the result (for fun and confirmation)

21. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 21
Lots of dots becomes blue line, because mathematics!

22. AppDynamics is now part of Cisco. © 2018 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 22
AI/ML is not magic, it is just fast!

23. Ok, I now grok
AI/ML, but … umm,
what is AIOps?

24. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 24
What Is AIOps?
AIOps
AI IT Ops
Autonomous IT Systems
• Self-manage
• Auto-configure
• Auto-heal
insights
AI / ML
Top Use Cases:
• Intelligent alerts (67%)
• Event Correlation & RCA (61%)
• Vulnerability & Threat Detection (55%)
• Optimization (54%)
• Predictive & Auto-Remediate (53%)

25. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 25
“
AIOps augments technology teams
by leveraging AI/ML for baselines,
real-time anomaly detection and
insights, identifying root cause(s)
and automating resolutions.

26. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 26
?
Have you manually set health rules
or thresholds for a performance
monitor?
26

27. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 27
What is Normal? Goodbye Manual Thresholds!

28. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 28
AIOps: Contextually Correlate Metrics

29. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 29
AIOps: Contextually Correlate Metrics

30. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 30
Automated Triage
950
900
850
800
750
700
650
600
550
500
450
400
300 350 400 450 500 550 600
ART
Q95ART(ms)
Problem 1
Problem 2

31. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 31
AIOps:
Automated Root
Cause(s) Analysis

32. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 32
AIOps: Detects
anomalies in
business
transaction
performance

33. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 33
AIOps: Correlates
anomalies and
events
to identify the
most suspicious
causes

34. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 34
AIOps: Isolates
resource
problems

35. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 35
AIOps: Detect Business Anomaly

36. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 36
AIOps:
Automated Root
Cause(s) Analysis

37. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 37
Timeseriesandeventsdata
Alerting
API
Correlation Engine
Public
Cloud
Private
Cloud
Application
Business
AI/ML
Orchestration
Feedback Loop
Unified
Visibility
3rd Party Actions
Visibility Insight Action

38. Automation Decision
Criteria

39. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 39
Frequency

40. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 40
Impact

41. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 41
Coverage

42. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 42
Probability

43. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 43
Timescale

44. AIOps Adoption
Journey

45. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 45
AIOps Adoption Journey
DEV DEPL MONIT
DevOps CI/CD pipeline

46. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 46
AIOps Adoption Journey
DEVELOP DEPLOY MONITOR ANALYZE REPAIR
AIOps
DevOps CI/CD pipeline
Intelligent Alerts Event Correlation Optimization
Auto-RemediatePredictive RCA

47. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 47
•AIOps brings immediate relief to engineering burden
•Cross domain strategy
•Automate the complex & mundane
•Build your skills from ‘I’ to ‘T’-shaped
•Augment yourself!
AIOps Is How We Will Survive DevOps

48. AppDynamics (Part of Cisco). © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 48
Questions & Links
• Is Your IT Workforce Ready For AIOps?
https://www.forbes.com/sites/appdynamics/2019/03/11/is-your-it-
workforce-ready-for-aiops/#5ff583f2b005
• https://www.appdynamics.com/blog/aiops/slowdown-new-outage-sinto/
• Writing on AIOps - https://www.appdynamics.com/blog/aiops/
• https://techwhisperernyc.com/category/strategy/
• Transforming IT Operations for Business Value http://ow.ly/kI1X30nlXkc

49. AppDynamics is now part of Cisco. © 2018 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 49
Thank you!
@marcocoulter
Email marco@appdynamics.com for a PDF of this presentation

50. #DevOpsLive
AIOps Is How We
Will Survive DevOps
Marco Coulter –
Technical Evangelist
@marcocoulter
www.appdynamics.com/blog/author/marco-coulter/
techwhisperernyc.com/category/strategy/