SlideShare a Scribd company logo

PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure

Building and scaling a multi-cloud solution that's enabled for cloud bursting is not a trivial task, and requires a lot of automation. While experiencing hyper-growth on the Adobe Advertising Cloud, our operations engineering team had to frequently update and improve its workflow in order to stay nimble and allow fast delivery of new infrastructure. At TubeMogul/Adobe Advertising Cloud, we implemented a lean Puppet workflow that enables the operations engineering team to deploy and support a broad range of services in a complex environment that supports hundreds of billions of requests a day. With over 150 changes released per day on its production infrastructure, the team had to adjust and tune its processes to enforce quality, standards, to review, and to prevent systems from breaking. In this talk, you will learn how we implemented our infrastructure as code by leveraging tools like Puppet, Gerrit, Terraform, and Jenkins, which together enable our private and public cloud infrastructures across 12 locations and four continents.

1 of 23
Download to read offline
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure
Nicolas Brousse | Director of Engineering, Operations
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Increased Complexity and Faster Changes
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Immutable or Mutable?
3
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla remotely extends range of vehicles for free in
Florida to help owners escape Hurricane Irma
4
Source: Electrek.co
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Tesla Over-The-Air Software Update
5
© 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
Any connected device need to handle updates
6

Recommended

NetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebulaNetApp Hybrid Cloud with OpenNebula
NetApp Hybrid Cloud with OpenNebulaOpenNebula Project
 
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWSAWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWSAmazon Web Services
 
Big data on google cloud
Big data on google cloudBig data on google cloud
Big data on google cloudTu Pham
 
Docker Seattle Meetup, May 2017
Docker Seattle Meetup, May 2017Docker Seattle Meetup, May 2017
Docker Seattle Meetup, May 2017Stephen Walli
 
Real World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and AdobeReal World Modern Development Use Cases with RackHD and Adobe
Real World Modern Development Use Cases with RackHD and AdobeTimothy Gelter
 
Amazon EKS - Aws community day bengaluru 2019
Amazon EKS - Aws community day bengaluru 2019Amazon EKS - Aws community day bengaluru 2019
Amazon EKS - Aws community day bengaluru 2019Akash Agrawal
 

More Related Content

What's hot

Evolution of container orchestration in Alibaba Cloud
Evolution of container orchestration in Alibaba CloudEvolution of container orchestration in Alibaba Cloud
Evolution of container orchestration in Alibaba CloudLi Yi
 
AWS re:Invent 2016 Fast Forward
AWS re:Invent 2016 Fast ForwardAWS re:Invent 2016 Fast Forward
AWS re:Invent 2016 Fast ForwardShuen-Huei Guan
 
Getting Started with Google Cloud Platform
Getting Started with Google Cloud PlatformGetting Started with Google Cloud Platform
Getting Started with Google Cloud PlatformChirag Nayyar
 
Replacing vCloud with OpenNebula
Replacing vCloud with OpenNebulaReplacing vCloud with OpenNebula
Replacing vCloud with OpenNebulaOpenNebula Project
 
Ultimate kubernetes platform on aws with eks
Ultimate kubernetes platform on aws with eksUltimate kubernetes platform on aws with eks
Ultimate kubernetes platform on aws with eksarmincoralic
 
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasadGlobal azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasadashishpd
 
Crash Course in Cloud Computing
Crash Course in Cloud ComputingCrash Course in Cloud Computing
Crash Course in Cloud ComputingAll Things Open
 
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CSBetter, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CSJohn Burwell
 
AWS EKS Security Best Practices
AWS EKS Security Best PracticesAWS EKS Security Best Practices
AWS EKS Security Best PracticesStackRox
 
Application Centric DevOps
Application Centric DevOpsApplication Centric DevOps
Application Centric DevOpsNati Shalom
 
How we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effortHow we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effortLibbySchulze
 
How to Architect AWS for Mission-Critical Applications
How to Architect AWS for Mission-Critical ApplicationsHow to Architect AWS for Mission-Critical Applications
How to Architect AWS for Mission-Critical ApplicationsLogicworksNYC
 
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...OpenNebula Project
 
Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users Nati Shalom
 
Cloud Computing - Why it is so popular
Cloud Computing - Why it is so popularCloud Computing - Why it is so popular
Cloud Computing - Why it is so popularSoham Mondal
 
Is Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOpsIs Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOpsNati Shalom
 
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018Julian Wood
 

What's hot (20)

Berlioz Introduction
Berlioz IntroductionBerlioz Introduction
Berlioz Introduction
 
Evolution of container orchestration in Alibaba Cloud
Evolution of container orchestration in Alibaba CloudEvolution of container orchestration in Alibaba Cloud
Evolution of container orchestration in Alibaba Cloud
 
Multicloud
MulticloudMulticloud
Multicloud
 
AWS re:Invent 2016 Fast Forward
AWS re:Invent 2016 Fast ForwardAWS re:Invent 2016 Fast Forward
AWS re:Invent 2016 Fast Forward
 
Getting Started with Google Cloud Platform
Getting Started with Google Cloud PlatformGetting Started with Google Cloud Platform
Getting Started with Google Cloud Platform
 
Replacing vCloud with OpenNebula
Replacing vCloud with OpenNebulaReplacing vCloud with OpenNebula
Replacing vCloud with OpenNebula
 
Ultimate kubernetes platform on aws with eks
Ultimate kubernetes platform on aws with eksUltimate kubernetes platform on aws with eks
Ultimate kubernetes platform on aws with eks
 
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasadGlobal azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
Global azurebootcamp2019vancouver aks_presentation_by_ashprasad_arjavprasad
 
Crash Course in Cloud Computing
Crash Course in Cloud ComputingCrash Course in Cloud Computing
Crash Course in Cloud Computing
 
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CSBetter, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
 
AWS EKS Security Best Practices
AWS EKS Security Best PracticesAWS EKS Security Best Practices
AWS EKS Security Best Practices
 
Application Centric DevOps
Application Centric DevOpsApplication Centric DevOps
Application Centric DevOps
 
How we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effortHow we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effort
 
Blue green deployment
Blue green deploymentBlue green deployment
Blue green deployment
 
How to Architect AWS for Mission-Critical Applications
How to Architect AWS for Mission-Critical ApplicationsHow to Architect AWS for Mission-Critical Applications
How to Architect AWS for Mission-Critical Applications
 
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...
 
Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users Introduction to Cloudify for OpenStack users
Introduction to Cloudify for OpenStack users
 
Cloud Computing - Why it is so popular
Cloud Computing - Why it is so popularCloud Computing - Why it is so popular
Cloud Computing - Why it is so popular
 
Is Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOpsIs Orchestration the Next Big Thing in DevOps
Is Orchestration the Next Big Thing in DevOps
 
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
Connecting VMware Cloud on AWS to Native AWS Services - UKVMUG 2018
 

Similar to PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure

End User Computing with NetApp
End User Computing with NetAppEnd User Computing with NetApp
End User Computing with NetAppNetApp
 
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSIOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSAmazon Web Services
 
Driving Innovation with Containers - CON203 - re:Invent 2017
Driving Innovation with Containers - CON203 - re:Invent 2017Driving Innovation with Containers - CON203 - re:Invent 2017
Driving Innovation with Containers - CON203 - re:Invent 2017Amazon Web Services
 
CON203_Driving Innovation with Containers
CON203_Driving Innovation with ContainersCON203_Driving Innovation with Containers
CON203_Driving Innovation with ContainersAmazon Web Services
 
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStackAdobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStackNicolas Brousse
 
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...Amazon Web Services
 
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...Amazon Web Services
 
深入淺出 AWS 混合式雲端架構
深入淺出 AWS 混合式雲端架構 深入淺出 AWS 混合式雲端架構
深入淺出 AWS 混合式雲端架構 Amazon Web Services
 
Innovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudInnovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudAdrian Hornsby
 
Microprofile at IBM with Liberty
Microprofile at IBM with LibertyMicroprofile at IBM with Liberty
Microprofile at IBM with LibertyErin Schnabel
 
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructureCisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructureNetworkCollaborators
 
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...Amazon Web Services
 
Journey to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataJourney to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataLightbend
 
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...NetworkCollaborators
 
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018Amazon Web Services
 
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@Scale- IBM Cloud and NetAp-Insight-BerlinDevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@Scale- IBM Cloud and NetAp-Insight-BerlinSreeni Pamidala
 
Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Mesosphere Inc.
 
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging CodeAWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging CodeAmazon Web Services
 
Cisco connect montreal 2018 vision mondiale analyse locale
Cisco connect montreal 2018 vision mondiale analyse localeCisco connect montreal 2018 vision mondiale analyse locale
Cisco connect montreal 2018 vision mondiale analyse localeCisco Canada
 

Similar to PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure (20)

End User Computing with NetApp
End User Computing with NetAppEnd User Computing with NetApp
End User Computing with NetApp
 
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSIOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
 
Driving Innovation with Containers - CON203 - re:Invent 2017
Driving Innovation with Containers - CON203 - re:Invent 2017Driving Innovation with Containers - CON203 - re:Invent 2017
Driving Innovation with Containers - CON203 - re:Invent 2017
 
CON203_Driving Innovation with Containers
CON203_Driving Innovation with ContainersCON203_Driving Innovation with Containers
CON203_Driving Innovation with Containers
 
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStackAdobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
Adobe Advertising Cloud: The Reality of Cloud Bursting with OpenStack
 
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
 
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
NEW LAUNCH! Introducing AWS Cloud9, a cloud IDE to write, run, & debug your c...
 
深入淺出 AWS 混合式雲端架構
深入淺出 AWS 混合式雲端架構 深入淺出 AWS 混合式雲端架構
深入淺出 AWS 混合式雲端架構
 
Innovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudInnovations fueled by IoT and the Cloud
Innovations fueled by IoT and the Cloud
 
ML Inference at the Edge
ML Inference at the EdgeML Inference at the Edge
ML Inference at the Edge
 
Microprofile at IBM with Liberty
Microprofile at IBM with LibertyMicroprofile at IBM with Liberty
Microprofile at IBM with Liberty
 
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructureCisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
Cisco Connect 2018 Singapore - Next generation hyperconverged infrastructure
 
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...
NEW LAUNCH! Push Intelligence to the edge with Greengrass - IOT209 - re:Inven...
 
Journey to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataJourney to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big Data
 
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
Cisco Connect 2018 Thailand - Next generation hyperconverged infrastructure-s...
 
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018
Production-Ready Environments for Kubernetes (CON307-S) - AWS re:Invent 2018
 
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@Scale- IBM Cloud and NetAp-Insight-BerlinDevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
DevOps@Scale- IBM Cloud and NetAp-Insight-Berlin
 
Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)
 
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging CodeAWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
AWS Cloud9 – Cloud IDE for Writing, Running and Debugging Code
 
Cisco connect montreal 2018 vision mondiale analyse locale
Cisco connect montreal 2018 vision mondiale analyse localeCisco connect montreal 2018 vision mondiale analyse locale
Cisco connect montreal 2018 vision mondiale analyse locale
 

More from Nicolas Brousse

<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...Nicolas Brousse
 
Improving Adobe Experience Cloud Services Dependability with Machine Learning
Improving Adobe Experience Cloud Services Dependability with Machine LearningImproving Adobe Experience Cloud Services Dependability with Machine Learning
Improving Adobe Experience Cloud Services Dependability with Machine LearningNicolas Brousse
 
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...Nicolas Brousse
 
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuiteSuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuiteNicolas Brousse
 
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...Nicolas Brousse
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthNicolas Brousse
 
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...Nicolas Brousse
 
Improving Operations Efficiency with Puppet
Improving Operations Efficiency with PuppetImproving Operations Efficiency with Puppet
Improving Operations Efficiency with PuppetNicolas Brousse
 
Scaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced EnvironmentScaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced EnvironmentNicolas Brousse
 
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Nicolas Brousse
 
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...Nicolas Brousse
 
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...Nicolas Brousse
 

More from Nicolas Brousse (12)

<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
<Programming> 2019 - ICW'19: The Issue of Monorepo and Polyrepo In Large Ente...
 
Improving Adobe Experience Cloud Services Dependability with Machine Learning
Improving Adobe Experience Cloud Services Dependability with Machine LearningImproving Adobe Experience Cloud Services Dependability with Machine Learning
Improving Adobe Experience Cloud Services Dependability with Machine Learning
 
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
IEEE ISSRE 2018 - Use of Self-Healing Techniques to Improve the Reliability o...
 
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuiteSuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
SuiteWorld16: Mega Volume - How TubeMogul Leverages NetSuite
 
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
SRECon16: Moving Large Workloads from a Public Cloud to an OpenStack Private ...
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
 
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
Puppet Camp Silicon Valley 2015: How TubeMogul reached 10,000 Puppet Deployme...
 
Improving Operations Efficiency with Puppet
Improving Operations Efficiency with PuppetImproving Operations Efficiency with Puppet
Improving Operations Efficiency with Puppet
 
Scaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced EnvironmentScaling Bleeding Edge Technology in a Fast-paced Environment
Scaling Bleeding Edge Technology in a Fast-paced Environment
 
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
Scaling on EC2 in a fast-paced environment (LISA'11 - Full Paper)
 
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
Bringing Business Awareness to Your Operation Team (Nagios World Conference 2...
 
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
Optimizing your Monitoring and Trending tools for the Cloud (Nagios World Con...
 

Recently uploaded

DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonDNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonAPNIC
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPTPraveenKumarThota7
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Damar Juniarto
 
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...Prometix Pty Ltd
 
NANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonNANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonAPNIC
 
Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfgalfinprihardiputra0
 

Recently uploaded (6)

DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff HustonDNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
DNS-OARC 42: Is the DNS ready for IPv6? presentation by Geoff Huston
 
Biometrics Technology Intresting PPT
Biometrics Technology Intresting PPTBiometrics Technology Intresting PPT
Biometrics Technology Intresting PPT
 
Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023Regulation is Coming - Trusted Media Summit 2023
Regulation is Coming - Trusted Media Summit 2023
 
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...
Elevate Your Business: Unleashing Collaboration and Efficiency through Expert...
 
NANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff HustonNANOG 90: 'BGP in 2023' presented by Geoff Huston
NANOG 90: 'BGP in 2023' presented by Geoff Huston
 
Model Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdfModel Jaringan network jaringan komputer.pdf
Model Jaringan network jaringan komputer.pdf
 

PuppetConf 2017 | Adobe Advertising Cloud: A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure

  • 1. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. A Lean Puppet Workflow to Support a Multi-Cloud and Cloud-Bursting Infrastructure Nicolas Brousse | Director of Engineering, Operations
  • 2. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Increased Complexity and Faster Changes
  • 3. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Immutable or Mutable? 3
  • 4. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Tesla remotely extends range of vehicles for free in Florida to help owners escape Hurricane Irma 4 Source: Electrek.co
  • 5. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Tesla Over-The-Air Software Update 5
  • 6. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Any connected device need to handle updates 6
  • 7. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Connected Home gets more sophisticated 7
  • 8. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Likewise Enterprises Infrastructure Complexity increase 8 • IaaS / PaaS (AWS, Azure, GCP, IBM, Oracle…) • Cloud Productivity Apps (G Suite, Office 365, AWS...) • CRM • Private Cloud (OpenStack, VMware...) • Containers Orchestration (K8s, Mesos, Swarm, Nomad...) • Bare-metal servers, mainframes (IBM Z 2017) • Edge Computing • Quantum Annealer (D-Wave) Next Quantum Computers?
  • 9. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 9
  • 10. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Patching (very) quickly matters 10
  • 11. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. The Adobe Advertising Cloud
  • 12. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Technical Challenges 12 Latency Requirement <50ms @ 95th percentile High Volume Traffic +100 billions request a day Huge Datasets billions of object to store
  • 13. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. > 6,000 servers > 10,000 Puppet code deployments a year > 40,000 Application deployments a year 1 Puppet Master 13
  • 14. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. 14
  • 15. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Bare-metal Infrastructure Automation Fully automated deployment Rack-And-Roll Infrastructure Puppet Hiera and eYAML 15
  • 16. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Bare-metal Infrastructure Automation – Rack… 16 Buy Build Burn Test ShipRack, Bolt, Powered onConnect to Network
  • 17. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. And Roll… 17 Jenkins API TFTP PXE boot API puppet Log centralization Monitoring and Metrics IdM & IDS
  • 18. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Containers Environments 18 git jenkins docker terraform puppet K8s
  • 19. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Cloud Bursting 19 git jenkins terraform puppet puppet jenkins Application DeploymentInfrastructure Deployment git
  • 20. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Final word
  • 21. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Configuration Management is not dead It’s complicated and diverse 21
  • 22. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Key Take Aways § Acknowledge the reality of complex infrastructure in the enterprise world § Understand your Infrastructures models § Strongly Immutable § Weakly Immutable § Mutable § Prevent and detect configuration drift + allow patching § Holistic understanding of your product lifecycle § Infrastructure As Code (multiple tools involved) § Feature Toggles § Beta Percentage Rollout § Blue / Green Deployments § Mean Time to Release Changes at scale 22