SlideShare a Scribd company logo
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Improving Adobe Experience Cloud Services Dependability with Machine
Learning
Nicolas Brousse | Director, SRE
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Adobe Experience Cloud — an all-in-one experience solution
Adobe Experience Cloud brings together all of your marketing
tech in a single place, so you can do everything from
managing your content and delivering email campaigns to
automating your ad buying and measuring your success.
One integrated approach for one seamless experience.
2
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 3
Dependable Services
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 4
Real Time Decisions
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 5
Increase In Complexity
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 6
Growing Amount Of Data
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 7
Core Infrastructure
ML & Data Pipeline
Adobe Advertising Cloud
Enable a Machine Learning Pipeline supported by a
Kubernetes Infrastructure to allow fast iterations and
deployment of new models to production.
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 8
Adobe Analytics
Build models to provide traffic
prediction and improve capacity
planning efforts.
Forecasting
&
Capacity Planning
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 9
Adobe Experience Platform
Provide anomaly detection on streamed
live timeseries data to enable auto-
remediation rules based of forecasted
dynamic thresholds.
Anomaly Detection
&
Self-Healing
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 10
Risk Classification
&
Failure Prediction
Adobe Experience Cloud
Improve change management processes through
dynamic risk classification of changes to reduce
number of incidents due to changes.
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 11
Build
&
Deploy
Measure
&
Plan
Verify
&
Test
Operate
&
Monitor
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Replacing Human Intuition with Machine Learning
Toward A Better Notion Of Risk During A Release
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Adoption of Microservices and
Distributed Systems means:
§ Increased complexity for Developers
§ Increased complexity for Operators
§ Increased of noise in DevOps
communications
13
Complexity
Microservices
&
Distributed Systems
Human Cognitive Limit
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Analyze Changes and Likelihood of Leading to An Incident
§ Goal: Reduce Incidents due to Changes With Better Risk Classification
of Changes
§ Exported Data of 123 Incidents due to Change and 40,991 Normal
Changes from January 2017 to June 2018
§ Use of Jupyter Notebooks with Python and scikit-learn, etc.
14
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Data Findings
§ Most Changes Leading to an Incident
are self reported as Low Risk
§ Most Changes Leading to an Incident
have a short approval deadline <2H
§ Incident Occurrence Increases
Proportionally to Maintenance
Duration
15
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Models Comparison
16
Overall
Accuracy
Incident
Accuracy
Notification
Noise
Logistic Regression 85.79% 76.92% 28%
ANN using MLP 83.09% 94.06% 13.8%
Linear SVM 96.04% 99.26% 4.8%
© 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Future Work
§ Link to Existing Monitoring Systems for real-time feedback loop
§ Link to Tickets System and Git repository for better context analysis
§ Link to Service Discovery for Service Dependency awareness
§ Add checkpoints into CI/CD workflow
17
Improving Adobe Experience Cloud Services Dependability with Machine Learning

More Related Content

What's hot

Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
Evolve The Adobe Digital Marketing Community
 
Adobe Marketing Cloud Integration with Adobe AEM
Adobe Marketing Cloud Integration with Adobe AEMAdobe Marketing Cloud Integration with Adobe AEM
Adobe Marketing Cloud Integration with Adobe AEM
Deepak Narisety
 
Collate - Setup Your Own Intranet Portal
Collate - Setup Your Own Intranet PortalCollate - Setup Your Own Intranet Portal
Collate - Setup Your Own Intranet Portal
Codelattice
 
Codelattice E-Commerce Credentials
Codelattice E-Commerce Credentials Codelattice E-Commerce Credentials
Codelattice E-Commerce Credentials
Codelattice
 
Designing an automated and data-driven organization
Designing an automated and data-driven organizationDesigning an automated and data-driven organization
Designing an automated and data-driven organization
India Quotient
 
Build your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power AppsBuild your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power Apps
Tuan Yang
 
Introduction to Marketing Cloud UI, Adobe Summit 2014
Introduction to Marketing Cloud UI, Adobe Summit 2014Introduction to Marketing Cloud UI, Adobe Summit 2014
Introduction to Marketing Cloud UI, Adobe Summit 2014
Damien Antipa
 
Salesforce Cross-Cloud Architecture
Salesforce Cross-Cloud ArchitectureSalesforce Cross-Cloud Architecture
Salesforce Cross-Cloud Architecture
Thierry TROUIN ☁
 
Enterprise apps using Microsoft Power Platform
Enterprise apps using Microsoft Power PlatformEnterprise apps using Microsoft Power Platform
Enterprise apps using Microsoft Power Platform
SkandaRamana Suryanarayana
 
Adobe Experience Manager Vision and Roadmap
Adobe Experience Manager Vision and RoadmapAdobe Experience Manager Vision and Roadmap
Adobe Experience Manager Vision and Roadmap
Loni Stark
 
New Features and Capabilities Added to the Acquia platform over the Past Thre...
New Features and Capabilities Added to the Acquia platform over the Past Thre...New Features and Capabilities Added to the Acquia platform over the Past Thre...
New Features and Capabilities Added to the Acquia platform over the Past Thre...
Rachel Wandishin
 
Carlattice - Car Recommendation Engine
Carlattice - Car Recommendation EngineCarlattice - Car Recommendation Engine
Carlattice - Car Recommendation Engine
Codelattice
 
What's new in AEM 6.0
What's new in AEM 6.0What's new in AEM 6.0
What's new in AEM 6.0
rtpaem
 
Winkapp overview
Winkapp overviewWinkapp overview
Winkapp overview
itaiarad
 
Low code with Flowable
Low code with FlowableLow code with Flowable
Low code with Flowable
Flowable
 
Deep dive: Monetize your API Programs
Deep dive: Monetize your API ProgramsDeep dive: Monetize your API Programs
Deep dive: Monetize your API Programs
Apigee | Google Cloud
 
DayBack at Dreamforce 2016
DayBack at Dreamforce 2016DayBack at Dreamforce 2016
DayBack at Dreamforce 2016
SeedCode
 
01 mvp skill_power platform overview
01 mvp skill_power platform overview01 mvp skill_power platform overview
01 mvp skill_power platform overview
Kumton Suttiraksiri
 
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.aiCase Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
Pronovix
 
Aligning your API business model to your company strategy
Aligning your API business model to your company strategyAligning your API business model to your company strategy
Aligning your API business model to your company strategy
Paul Greenwell
 

What's hot (20)

Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
Evolve18 | Bruce Swann | Adobe Campaign - Capabilities, Roadmap, and Fit With...
 
Adobe Marketing Cloud Integration with Adobe AEM
Adobe Marketing Cloud Integration with Adobe AEMAdobe Marketing Cloud Integration with Adobe AEM
Adobe Marketing Cloud Integration with Adobe AEM
 
Collate - Setup Your Own Intranet Portal
Collate - Setup Your Own Intranet PortalCollate - Setup Your Own Intranet Portal
Collate - Setup Your Own Intranet Portal
 
Codelattice E-Commerce Credentials
Codelattice E-Commerce Credentials Codelattice E-Commerce Credentials
Codelattice E-Commerce Credentials
 
Designing an automated and data-driven organization
Designing an automated and data-driven organizationDesigning an automated and data-driven organization
Designing an automated and data-driven organization
 
Build your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power AppsBuild your Own Business Application Using Microsoft Power Apps
Build your Own Business Application Using Microsoft Power Apps
 
Introduction to Marketing Cloud UI, Adobe Summit 2014
Introduction to Marketing Cloud UI, Adobe Summit 2014Introduction to Marketing Cloud UI, Adobe Summit 2014
Introduction to Marketing Cloud UI, Adobe Summit 2014
 
Salesforce Cross-Cloud Architecture
Salesforce Cross-Cloud ArchitectureSalesforce Cross-Cloud Architecture
Salesforce Cross-Cloud Architecture
 
Enterprise apps using Microsoft Power Platform
Enterprise apps using Microsoft Power PlatformEnterprise apps using Microsoft Power Platform
Enterprise apps using Microsoft Power Platform
 
Adobe Experience Manager Vision and Roadmap
Adobe Experience Manager Vision and RoadmapAdobe Experience Manager Vision and Roadmap
Adobe Experience Manager Vision and Roadmap
 
New Features and Capabilities Added to the Acquia platform over the Past Thre...
New Features and Capabilities Added to the Acquia platform over the Past Thre...New Features and Capabilities Added to the Acquia platform over the Past Thre...
New Features and Capabilities Added to the Acquia platform over the Past Thre...
 
Carlattice - Car Recommendation Engine
Carlattice - Car Recommendation EngineCarlattice - Car Recommendation Engine
Carlattice - Car Recommendation Engine
 
What's new in AEM 6.0
What's new in AEM 6.0What's new in AEM 6.0
What's new in AEM 6.0
 
Winkapp overview
Winkapp overviewWinkapp overview
Winkapp overview
 
Low code with Flowable
Low code with FlowableLow code with Flowable
Low code with Flowable
 
Deep dive: Monetize your API Programs
Deep dive: Monetize your API ProgramsDeep dive: Monetize your API Programs
Deep dive: Monetize your API Programs
 
DayBack at Dreamforce 2016
DayBack at Dreamforce 2016DayBack at Dreamforce 2016
DayBack at Dreamforce 2016
 
01 mvp skill_power platform overview
01 mvp skill_power platform overview01 mvp skill_power platform overview
01 mvp skill_power platform overview
 
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.aiCase Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
Case Study: Creating a DocOps/Docs-As-Code DevPortal for C3.ai
 
Aligning your API business model to your company strategy
Aligning your API business model to your company strategyAligning your API business model to your company strategy
Aligning your API business model to your company strategy
 

Similar to Improving Adobe Experience Cloud Services Dependability with Machine Learning

Digital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the CloudDigital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the Cloud
Amazon Web Services
 
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
IBM Switzerland
 
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
AEM DataLayer IMMERSE 2017 Presentation by Dan KlcoAEM DataLayer IMMERSE 2017 Presentation by Dan Klco
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
Daniel Klco
 
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 TiVo: How to Scale New Products with a Data Lake on AWS and Qubole TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
Amazon Web Services
 
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 TiVo: How to Scale New Products with a Data Lake on AWS and Qubole TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
Amazon Web Services
 
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
Amazon Web Services
 
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
Martin Klie
 
SAP TechEd 2010 Rich Internet Applications for the Enterprise
SAP TechEd 2010 Rich Internet Applications for the EnterpriseSAP TechEd 2010 Rich Internet Applications for the Enterprise
SAP TechEd 2010 Rich Internet Applications for the Enterprise
Anne Kathrine Petterøe
 
Implementing cloud based devops for distributed agile projects
Implementing cloud based devops for distributed agile projectsImplementing cloud based devops for distributed agile projects
Implementing cloud based devops for distributed agile projects
Tom Stiehm
 
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
Zia Consulting
 
BLU Acceleration on the Cloud – 101
BLU Acceleration on the Cloud – 101BLU Acceleration on the Cloud – 101
BLU Acceleration on the Cloud – 101
IBM Analytics
 
The new developer experience
The new developer experienceThe new developer experience
The new developer experience
Eric Cattoir
 
Gartner EA Architecting for DevOps and Hybrid Cloud
Gartner EA Architecting for DevOps and Hybrid CloudGartner EA Architecting for DevOps and Hybrid Cloud
Gartner EA Architecting for DevOps and Hybrid Cloud
Rosalind Radcliffe
 
How to Balance System Speed and Risk for Multi-Platform Innovation
How to Balance System Speed and Risk for Multi-Platform InnovationHow to Balance System Speed and Risk for Multi-Platform Innovation
How to Balance System Speed and Risk for Multi-Platform Innovation
Claudia Ring
 
Ibm symp14 referent_christian klezl_cloud
Ibm symp14 referent_christian klezl_cloudIbm symp14 referent_christian klezl_cloud
Ibm symp14 referent_christian klezl_cloud
IBM Switzerland
 
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Fastly
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons Learned
Amazon Web Services
 
Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?
Sridhar Karnam
 
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il businessIV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
Rad Solutions
 
NA Adabas & Natural User Group Meeting April 2023
NA Adabas & Natural User Group Meeting April 2023NA Adabas & Natural User Group Meeting April 2023
NA Adabas & Natural User Group Meeting April 2023
Software AG
 

Similar to Improving Adobe Experience Cloud Services Dependability with Machine Learning (20)

Digital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the CloudDigital Transformation: Empowering People to Adapt to the Cloud
Digital Transformation: Empowering People to Adapt to the Cloud
 
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
IBM SmartCloud_Rethink IT. Reinvent Business_Dean Marsh_IBM Symp13
 
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
AEM DataLayer IMMERSE 2017 Presentation by Dan KlcoAEM DataLayer IMMERSE 2017 Presentation by Dan Klco
AEM DataLayer IMMERSE 2017 Presentation by Dan Klco
 
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 TiVo: How to Scale New Products with a Data Lake on AWS and Qubole TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 TiVo: How to Scale New Products with a Data Lake on AWS and Qubole TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
TiVo: How to Scale New Products with a Data Lake on AWS and Qubole
 
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
Unlocking Software Innovation with AWS - Adrian White - AWS TechShift ANZ 2018
 
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
2018 re:Invent - Safeguard the Integrity of Your Code for Fast and Secure Dep...
 
SAP TechEd 2010 Rich Internet Applications for the Enterprise
SAP TechEd 2010 Rich Internet Applications for the EnterpriseSAP TechEd 2010 Rich Internet Applications for the Enterprise
SAP TechEd 2010 Rich Internet Applications for the Enterprise
 
Implementing cloud based devops for distributed agile projects
Implementing cloud based devops for distributed agile projectsImplementing cloud based devops for distributed agile projects
Implementing cloud based devops for distributed agile projects
 
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
How to Consolidate in Order to Increase Operational Efficiency by Moving Your...
 
BLU Acceleration on the Cloud – 101
BLU Acceleration on the Cloud – 101BLU Acceleration on the Cloud – 101
BLU Acceleration on the Cloud – 101
 
The new developer experience
The new developer experienceThe new developer experience
The new developer experience
 
Gartner EA Architecting for DevOps and Hybrid Cloud
Gartner EA Architecting for DevOps and Hybrid CloudGartner EA Architecting for DevOps and Hybrid Cloud
Gartner EA Architecting for DevOps and Hybrid Cloud
 
How to Balance System Speed and Risk for Multi-Platform Innovation
How to Balance System Speed and Risk for Multi-Platform InnovationHow to Balance System Speed and Risk for Multi-Platform Innovation
How to Balance System Speed and Risk for Multi-Platform Innovation
 
Ibm symp14 referent_christian klezl_cloud
Ibm symp14 referent_christian klezl_cloudIbm symp14 referent_christian klezl_cloud
Ibm symp14 referent_christian klezl_cloud
 
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
Altitude San Francisco 2018: How Magento moved to the cloud while maintaining...
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons Learned
 
Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?
 
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il businessIV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
IV Evento GeneXus Italia - Il Cloud IBM: motore di crescita per il business
 
NA Adabas & Natural User Group Meeting April 2023
NA Adabas & Natural User Group Meeting April 2023NA Adabas & Natural User Group Meeting April 2023
NA Adabas & Natural User Group Meeting April 2023
 

More from Nicolas Brousse

<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
Nicolas Brousse
 
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
Nicolas Brousse
 
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
Nicolas Brousse
 
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStackAdobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Nicolas Brousse
 
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuiteSuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
Nicolas Brousse
 
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
Nicolas Brousse
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
Nicolas Brousse
 
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Nicolas Brousse
 
Improving Operations Efficiency with Puppet
Improving Operations Efficiency with PuppetImproving Operations Efficiency with Puppet
Improving Operations Efficiency with Puppet
Nicolas Brousse
 
Scaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced EnvironmentScaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced Environment
Nicolas Brousse
 
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Nicolas Brousse
 
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Nicolas Brousse
 
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Nicolas Brousse
 

More from Nicolas Brousse (13)

<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
 
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
 
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support ...
 
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStackAdobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
 
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuiteSuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
 
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
 
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
 
Improving Operations Efficiency with Puppet
Improving Operations Efficiency with PuppetImproving Operations Efficiency with Puppet
Improving Operations Efficiency with Puppet
 
Scaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced EnvironmentScaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced Environment
 
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
 
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
 
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
 

Recently uploaded

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
Federico Razzoli
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
jpupo2018
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 

Recently uploaded (20)

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Webinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data WarehouseWebinar: Designing a schema for a Data Warehouse
Webinar: Designing a schema for a Data Warehouse
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Project Management Semester Long Project - Acuity
Project Management Semester Long Project - AcuityProject Management Semester Long Project - Acuity
Project Management Semester Long Project - Acuity
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 

Improving Adobe Experience Cloud Services Dependability with Machine Learning

  • 1. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Improving Adobe Experience Cloud Services Dependability with Machine Learning Nicolas Brousse | Director, SRE
  • 2. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe Experience Cloud — an all-in-one experience solution Adobe Experience Cloud brings together all of your marketing tech in a single place, so you can do everything from managing your content and delivering email campaigns to automating your ad buying and measuring your success. One integrated approach for one seamless experience. 2
  • 3. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 3 Dependable Services
  • 4. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 4 Real Time Decisions
  • 5. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 5 Increase In Complexity
  • 6. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 6 Growing Amount Of Data
  • 7. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 7 Core Infrastructure ML & Data Pipeline Adobe Advertising Cloud Enable a Machine Learning Pipeline supported by a Kubernetes Infrastructure to allow fast iterations and deployment of new models to production.
  • 8. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 8 Adobe Analytics Build models to provide traffic prediction and improve capacity planning efforts. Forecasting & Capacity Planning
  • 9. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 9 Adobe Experience Platform Provide anomaly detection on streamed live timeseries data to enable auto- remediation rules based of forecasted dynamic thresholds. Anomaly Detection & Self-Healing
  • 10. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 10 Risk Classification & Failure Prediction Adobe Experience Cloud Improve change management processes through dynamic risk classification of changes to reduce number of incidents due to changes.
  • 11. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 11 Build & Deploy Measure & Plan Verify & Test Operate & Monitor
  • 12. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Replacing Human Intuition with Machine Learning Toward A Better Notion Of Risk During A Release
  • 13. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adoption of Microservices and Distributed Systems means: § Increased complexity for Developers § Increased complexity for Operators § Increased of noise in DevOps communications 13 Complexity Microservices & Distributed Systems Human Cognitive Limit
  • 14. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Analyze Changes and Likelihood of Leading to An Incident § Goal: Reduce Incidents due to Changes With Better Risk Classification of Changes § Exported Data of 123 Incidents due to Change and 40,991 Normal Changes from January 2017 to June 2018 § Use of Jupyter Notebooks with Python and scikit-learn, etc. 14
  • 15. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Data Findings § Most Changes Leading to an Incident are self reported as Low Risk § Most Changes Leading to an Incident have a short approval deadline <2H § Incident Occurrence Increases Proportionally to Maintenance Duration 15
  • 16. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Models Comparison 16 Overall Accuracy Incident Accuracy Notification Noise Logistic Regression 85.79% 76.92% 28% ANN using MLP 83.09% 94.06% 13.8% Linear SVM 96.04% 99.26% 4.8%
  • 17. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Future Work § Link to Existing Monitoring Systems for real-time feedback loop § Link to Tickets System and Git repository for better context analysis § Link to Service Discovery for Service Dependency awareness § Add checkpoints into CI/CD workflow 17