Industry consensus is that 60 to 90% of all performance and availability issues are caused by some type of change. DevOps teams are battling to manage change in complex heterogeneous enterprise environments, combining micro-services running on auto-scaling containerization platforms with "brownfield" applications using scalable cloud infrastructure and legacy backend systems. So how can peak performance and stability be maintained in complex enterprise cloud environments, without agility being undermined? DevOps organizations need to effectively answer both questions "What's wrong" and "What changed" to prevent incidents even before there is any symptom of performance degradation or availability threat. The answers should extend from microservice code updates, to AWS account configuration changes, to operating system patches in legacy environments. Working together, AppDynamics and Evolven provide an integrated solution correlating actual changes with performance data and generating actionable insights based on changes that caused or will cause instability. In this webinar we'll show you how this integrated solution helped a large international financial institution to successfully manage a complex and dynamic application environment, while increasing the frequency and volume of delivered changes.

1. Managing Change in a
Modern DevOps-
Powered Enterprise

2. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 2
Your hosts today
SASHA GILENSON
Founder and CEO
Evolven
Software
GREGG
OSTROWSKI
Regional CTO
AppDynamics

3. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 3
4th Major Paradigm Shift
Mainframe Client/Server Web Cloud &
Microservices

4. 4AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Buy Now
Data
center
VM
VM
VM
Mainframe
Private Cloud

5. 5AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Data
center
VM
VM
VM
Mainframe
Private Cloud
Return

6. 6AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Data
center
VM
VM
VM
Private
Cloud
Configuration
change

7. 7AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Data
center
VM
VM
VM
Private
Cloud
Thread contention
in authentication

8. 8AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Data
center
VM
VM
VM
Private
Cloud
Network
policy change

9. Siloed Teams Solve Siloed Problems
Database
looks fine
Definitely not
the database
Which customers
are affected?
Checking
the logs
The War Room
Spend is
down
Conversion rates
are dropping
Why is this
happening?
This app is horrible!
Right now
RETWEETS LIKES
140 1053

10. 10AppDynamics is now part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
AppDynamics to the Rescue

11. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 11
Live Customer Journeys
for every Business
Transaction
Move Fast,
Follow Everything &
Focus on What Matters Most
Network
Private Cloud
Public Cloud
— Lightweight Agents
— Deployed Throughout Application
Environment
— Auto Instrument | Auto Configure

12. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 12
Live Customer Journeys
for every Business
Transaction
Move Fast,
Follow Everything &
Focus on What Matters Most
— Every User,
Every Transaction
— Automates Discovery and
Correlation
— Dynamically Updated
Network
Public Cloud
Private Cloud

13. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 13
Detection of
issues before
Customers notice
Move Fast,
Follow Everything &
Focus on What Matters Most
— Automatic Baselines for
Every Metric
— Machine Learning Anomaly
Detection
— Prevent IT Alert Storms
Network
Public Cloud
Private Cloud

14. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 14
Network
Private Cloud
Public Cloud
Immediate and
Automated Code Level
Diagnostics
Move Fast,
Follow Everything &
Focus on What Matters Most
— No Sifting Through Log Files
— Low Overhead in Production
— Fix Problems in Live and Pre-
Production
Down to the line-of-code
3-CLICKS to ROOT-CAUSE

15. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 15
Powered by Rookout
Deep Code
Insights
• View production application
data, in real-time without
impacting the application
• Securely capture debug data
with dynamic watchpoints
• Improve developer
productivity and software
delivery efficiency

16. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 16
Login
Search Products
Add to Cart
Check Out
Network
Public Cloud
Private Cloud
App & Business
Monitoring
Automated discovery and correlation
Cross-stack visibility
Follow live customer journeys
AppDynamics is now part of Cisco. © 2018 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 32
Login
Search Products
Add to Cart
Check Out
Network
Public Cloud
Private Cloud
App & Business
Monitoring
Automated discovery and correlation
Cross-stack visibility
Follow live customer journeys

17. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 17
Real-time
business
monitoring
• What’s important to the business?
• What’s the actual impact?
• Is this release driving business value?
Mike Smith Platinum Customer
London
Travel Airways API
Total Cost $1,800

18. 18AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
The Central Nervous System

19. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 19
The chaos is too
massive for humans to
manage
• Scale and complexity too large
to be managed manually
• People, processes and systems can’t resolve
issues or capture opportunities fast enough
• Focus on the business and
customer experience is lost

20. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 20
We must adopt
an AIOps mindset
• Prediction over reaction
• Answers over investigation
• Actions over analysis

21. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 21
Timeseriesandeventsdata
Public
Cloud
Private
Cloud
Business
User Experience
Orchestration
FEEDBACK LOOP
Incident response
Debugging
Continuous delivery
validation
CX optimization
VISIBILITY INSIGHT ACTION
Application
AI/ML
Unified
Dashboard
Causality
Analysis
Anomaly Detection
Pattern
Discovery
Alerting
AppDynamics Central Nervous System Supports SDLC

22. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 22
Timeseriesandeventsdata
Public
Cloud
Private
Cloud
Business
User Experience
Orchestration
FEEDBACK LOOP
Incident response
Debugging
Continuous delivery
validation
CX optimization
VISIBILITY INSIGHT ACTION
Application
AI/ML
Unified
Dashboard
Causality
Analysis
Anomaly Detection
Pattern
Discovery
Alerting
AppDynamics Central Nervous System Supports SDLC

23. 23AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Evolven: Focusing on Change As a
Major Source of Risk in Modern
Environments

24. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 24
title
ENTERPRISES TODAY FACE AN AGONIZING
PARADOX

25. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 25
Google launches
4 billion new
containers per week
PayPal converted 700 apps
to 150,000 containers
The broader the DevOps adoption, the more
frequently software is released
CLOUD, DEVOPS, CI/CD FOCUS ON PUSHING
CHANGES AT EVER HIGHER RATE OF SPEED

26. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 26
CI/CD Pipeline
Infrastructure
As A Code
Executing
changes
Observing
impact of changes
Application
Infrastructure
Network
Log
Planning
changes
JIRA
Manual
changes
Unauthorized
changes?
High Risk changes?
Investigating
root cause
Incident & Problem
Management
Who has changed
what?
CHANGE IS THE ROOT OF ALL EVIL
Actual vs. Planned?
But...what actually
changed?!?
Data
Center
Cloud
Brownfield Greenfield
ENTERPRISE CLOUD
About 60%-90% of performance incidents can be traced to changes.

27. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 27
DEVOPS/SRE IS TOO
FOCUSED ON
SYMPTOMS

28. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 28
WHAT’S
WRONG?
WHAT
CHANGED?
• What’s the health of my
application?
• When and where did an issue
exactly start?
• What is the impact?
• It worked before and does not work
now. What changed?
• It works here but not there. What’s
different?
• Which specific changes or
differences caused an issue?
WITH TODAY’S SPEED OF CHANGE,
DEVOPS MUST EFFECTIVELY ANSWER
TWO QUESTIONS

29. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 29
End-to-End
Actual Change
Monitoring
THE ONLY SOLUTION FOR END-TO-END
CHANGE CONTROL FOR DEVOPS AND CLOUD
Correlation with
Enterprise Cloud
Processes & Tools
Patented
Machine Learning
Change Analytics
1
2
3
HD

30. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 30
HD
Actual Changes
Most Granular Level
Entire Environment
All Change Types
Near Real Time
ENTERPRISE CLOUD
Data Center CLOUD
END-TO-END MONITORING OF
ACTUAL CHANGES
PHYSICAL SERVERS
VIRTUAL SERVERS
BROWNFIELD GREENFIELD
ECS EKS
App App
Business Logic
Data Access Layer
User Interface
EC2

31. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 31
CORRELATION WITH ENTERPRISE CLOUD
PROCESSES AND TOOLS
DEVELOP CI PIPELINE CD PIPELINE OPERATE
Code Commit Build Unit Test Integration Tests Review Staging Production Monitoring
Actual Changes
Correlate Actual
Changes with
Performance
Alerts & KPIs
Change Record System | Change Audit Trail | Root-cause | High-risk Changes
CHANGE MANAGEMENT INCIDENT MANAGEMENT PROBLEM MANAGEMENT
Create and Approve
Change Records
Add Potential Root-
causes to Problems
Create Incidents On
High Risk Changes
Correlate to CI/CD pipeline
Correlate to ITSM

32. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 32
PATENTED MACHINE LEARNING
CHANGE ANALYTICS
RISK CALCULATIONCORRELATIONNOISE REDUCTION INSIGHTS

33. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 33
Changes &
Differences
(why)
• Key Events &
Alerts (what)
• Application/
Transaction
Topology &
Breakdown
(where)
Correlation
Actionable Insights
(zoom in on true root causes,
predict future issues)
Risk Analysis
Machine Learning Analytics
TRANSFORMING PERFORMANCE MANAGEMENT
WHAT’S WRONG? WHAT CHANGED?

34. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 34
JOINT USE CASES
Risk
Fix
RCA
Change
Incident
resolved
Incident
PreventedFix
Analysis
Risk
detected
Incident
Alert
Time
Risk
Fix
RCA
Change
Incident
resolved
Change
detected
Alert
Incident
Change correlated
and risk analyzed
Incident
Resolved
Fix
Prevent
Incidents
Accelerate
Troubleshooting
• Detect actual granular changes across enterprise cloud
• Compare working and non-working environments
• Correlate changes and differences with performance alerts
• Identify most probable root cause based on change risk
Accelerate
Troubleshooting
• Identify high risk changes early on
• Alert on risky inconsistencies within and across environments
• Detect unexpected drift and out-of-policy changes
Prevent
Incidents

35. 35AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Joint Story

36. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 36
CUSTOMER BACKGROUND
•A large multinational financial services
firm
•Hundreds of applications
•Heterogeneous IT environment: legacy
to cloud
•Technology teams are distributed across
the globe supporting “follow the sun”
model
•Bi-modal IT organization operating a mix
of legacy and agile processes

37. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 37
CHALLENGE
•Performance incidents have major impact
on the firm’s top line, brand and customer
satisfaction
•IT pushed by the business to increase
pace of change
•Heavy internal operational costs
associated with incident management
and resolution
•Instability affects time-to-market

38. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 38
Correlate
performance issues
(detected by
AppDynamics) to
changes causing them
(detected by Evolven)
SOLUTION
Correlate actual
changes to
transaction map
imported from
AppDynamics Focus on changes
that are most
probable root causes
Use Analytics
tagging and
insights to
understand the
data

39. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 39
Identify
configuration
differences
SOLUTION
Investigate differences between
working and non-working environments
Quickly identify
areas of difference
between working
and non-working
environments
Use Analytics
tagging and
insights to easily
navigate the
differences

40. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 40
Proactively
highlight and
alert on high
risk changes
SOLUTION
Track change risk KPIs for
applications and their
infrastructure
Analyze High
Risk Changes
Take actions on
“bad” changes before
they cause an issue

41. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 41
Proactively verify
alignment of
configuration
between
environments
SOLUTION
Proactively take action addressing
detected inconsistencies
Focus on
recent risky
inconsistencies
Use Analytics
tagging and
insights to easily
navigate the data

42. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 42
BENEFITS
50% faster
incident
resolution
35% decrease in
the number
of incidents
45% increase in
productivity
25% faster
time-to-market

43. AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY 43
Like to find out more?
Follow Evolven via LinkedIn: https://www.linkedin.com/company/evolven/
Follow Evolven via Twitter: @Evolven
Check Evolven website: www.evolven.com
Reach out to Sasha Gilenson: sasha@evolven.com
Take the AppDynamics Free Trial: https://www.appdynamics.com/free-trial/
Follow AppDynamics on Twitter: @AppDynamics
Check AppDynamics website: www.appdynamics.com

44. 44AppDynamics is part of Cisco. © 2019 Cisco and/or its affiliates. All rights reserved. APPDYNAMICS CONFIDENTIAL AND PROPRIETARY
Any Questions?