Devops for drupal

Kris Buytaert
Kris BuytaertDevops, Linux and Open Source Expert at Inuits
What's this devops thing
       anyhow ?
           Kris Buytaert
  DrupalCon Munich , August 2012
Kris Buytaert
•   I used to be a Dev,
•   Then Became an Op
•   Chief Trolling Officer and Open Source
    Consultant @inuits.eu
•   Everything is an effing DNS Problem
•   Building Clouds since before the bookstore
•   Some books, some papers, some blogs
•   But mostly, trying to be good at my job
•   not related to @dries afaik
What's this devops thing about ?
World , 200X-2009
Patrick Debois, Gildas Le Nadan, Andrew Clay Shafer, Kris Buytaert, Jezz
Humble, Lindsay Holmwood, John Allspaw, John Willis, Chris Read, Julian
                      Simpson, and lots of others ..

                    Gent , October 2009
                       Mountain View , June 2010

                        Hamburg , October 2010

                           Boston, March 2011

                        Mountain View, June 2011

             Bangalore, Melbourne, Manilla, Sau Paulo, Tokyo

                        Goteborg , October 2011

                           Austin , April 2012,

                         Mountainview July 2012,

                    Rome , October 2012
                                   ....
●   Devops is a growing movement
●   We don't have all the answers yet
●   We are reaching out to different communities
●   We will point out problems we see..
●   Only the name is new




          While we are still working out the solutions
Devops, a definition:
●   Adopt the new philosophy. We are in a new economic age. Western management
    must awaken to the challenge, must learn their responsibilities, and take on leadership
    for change.
●   Cease dependence on inspection to achieve quality. Eliminate the need for massive
    inspection by building quality into the product in the first place.
●   Improve constantly and forever the system of production and service, to improve
    quality and productivity, and thus constantly decrease costs.
●   Institute training on the job.
●   Institute leadership The aim of supervision should be to help people and machines and
    gadgets do a better job.
●   Drive out fear, so that everyone may work effectively for the company.
●   Break down barriers between departments. People in research, design, sales, and
    production must work as a team, in order to foresee problems of production and
    usage that may be encountered with the product or service.
●   Eliminate slogans, exhortations, and targets for the work force asking for zero defects
    and new levels of productivity. Such exhortations only create adversarial relationships,
    as the bulk of the causes of low quality and low productivity belong to the system and
    thus lie beyond the power of the work force.

              ●
                  Eliminate management by objective. Eliminate management by numbers
                  and numerical goals. Instead substitute with leadership.

              ●
                  Remove barriers that rob the hourly worker of his right to pride of
                  workmanship. The responsibility of supervisors must be changed from
                  sheer numbers to quality.

              ●
                  Remove barriers that rob people in management and in engineering of
                  their right to pride of workmanship.
●   Institute a vigorous program of education and self-improvement.
●   Put everybody in the company to work to accomplish the transformation. The
    transformation is everybody's job.
William Edwards
          Deming
1986, Out of the Crisis.



  http://en.wikipedia.org/wiki/W._Edwards_Deming
“DevOps is a cultural and
professional movement”
                        Adam Jacob
CAMS
●   Culture
●   Automation
●   Measurement
●   Sharing


              Damon Edwards and John Willis
What's the problem ?
The community of developers whose work you
see on the Web, who probably don’t know what
ADO or UML or JPA even stand for, deploy better
systems at less cost in less time at lower risk than
we see in the Enterprise. This is true even when
you factor in the greater flexibility and velocity of
startups.


Tim Bray , on his blog January 2010
The real problem :
●   Friday evening at 16:59
    “Put this Code Live, here's a tarball”
    NOW!
●   Backups ?
●   What database ?
●   Security ?
●   High Availability ?
●   Scalability ?
●   Who is on Call ?
How did we get here ?
A typical dev shop
●   The PM:
•“Put this Code Live, here's a tarball” NOW!
•Marketing Campain is launched
•We need this yesterday
•It's going on national radio at 5
An oldschool ops shop
●   What dependencies ?
●   No machines available ?
●   What database ?
●   Security ?
●   High Availability ?
●   Scalability ?
●   My computer can't install this ?
Devs vs Ops
10 days into production
●   What High Load ? What Memory usage ?
●   Are these Logs ? Or this is actualy customer
    data ?
●   How many users are there , should they launch
    100 queries each ?? Oh we're having 10K
    users
●   Why is debugging enabled ?
●   Who the fsck wrote this crap ?
11 days into production
Is it really that bad ?
   How about Drupal ?
A survey started a year ago.
We can solve this !
         ●   Some people think
             the Ops work starts
             on deployment
         •Ops = both system,
         app as platform !
         ●   It starts much earlier
         ●   Get Devs and Ops to
             talk asap
Talk about Non
     functional Reqs NOW!
●   Security
●   Backups
●   Upgradability
●   Deployment
High Availabilty
Scalability
Monitor
Breaking the Silos




Devs    Ops    Getting Along
Nirvana
An “ecosystem” that supports continuous delivery, from
infrastructure, data and configuration management to
business.
Through automation of the build, deployment, and testing
process, and improved collaboration between developers,
testers, and operations, delivery teams can get changes
released in a matter of hours — sometimes even minutes–no
matter what the size of a project or the complexity of its code
base.
                            Continuous Delivery , Jez Humble
How many times a day ?
●   10 @ Flickr
●   Deployments used to be pain
●   Nobody dared to deploy a site
●   Practice makes perfect
●   Knowing you can vs constantly doing it
How do we get there ?
Todays Enviroments
          For Devs                     For Ops
●   Version Control         ●   Version Control
●   Automated Build         ●   Automated Build
●   Bugtracking             ●   Bugtracking
●   Continous integration   ●   Continous integration
●   Integrated testing      ●   Integrated testing
●   Automated               ●   Automated
    deployment                  deployment
Drupalistas & Version
      Control
Devops for  drupal
Devops for  drupal
Devops for  drupal
Drupal & Continuous
    Integration
Do YOU test your code ?
Devops for  drupal
Where do you develop ?
●   It works on my
    machine :(




●   What other platforms
    do you use :
Sharing environments

●   Build identical environments
●   Share code
●   Shared ownership of content , code and
    configuration
Vagrant
●   Abstraction layer for VirtualBox
●   Integrates well with Puppet/Chef
●   Project =
          ●
              Vagrantfile
          ●
              Manifests / Cookbooks
●   Portable, Small , Versionable
●   Use veewee to build your boxen
Vagrantfile
Vagrant::Config.run do |config|
 # All Vagrant configuration is done here. The most common configuration
 # options are documented and commented below. For a complete reference,
 # please see the online documentation at vagrantup.com.

 config.vm.define :mongo1 do |mongo1_config|
   mongo1_config.ssh.max_tries = 100
   mongo1_config.vm.box = "MyCentOS2"
   mongo1_config.vm.network("192.168.99.101")
   mongo1_config.vm.host_name = "mongo1"
   mongo1_config.vm.provision :puppet do |mongo1_puppet|
         mongo1_puppet.pp_path = "/tmp/vagrant-puppet"
    mongo1_puppet.manifests_path = "manifests"
    mongo1_puppet.module_path = "modules"
    mongo1_puppet.manifest_file = "site.pp"
   end
 end
 config.vm.define :mongo2 do |mongo2_config|
  mongo2_config.ssh.max_tries = 100
   mongo2_config.vm.box = "MyCentOS2"
   mongo2_config.vm.network("192.168.99.102")
   mongo2_config.vm.host_name = "mongo2"
   mongo2_config.vm.provision :puppet do |mongo2_puppet|
    mongo2_puppet.pp_path = "/tmp/vagrant-puppet"
    mongo2_puppet.manifests_path = "manifests"
    mongo2_puppet.module_path = "modules"
    mongo2_puppet.manifest_file = "site.pp"
   end
 end
Vagrant Rocks
●   Vagrant init
●   Vagrant up
●   Vagrant provision
●   Vagrant down
●   Vagrant destroy
If my computer can't install your
software, your software is broken.
                     Luke Kanies, Fosdem 2007
Infrastructure as Code
●   Automated Deployments
●   If my computer can't install it , the installer is
    borken
●   Reproducable
●   With configuration mgmt
●   Think :
•Cfengine,Puppet, Chef
●   Put configs under version control
Deployment
●   Database Imports are
    EVIL
●   Manual Installations
    are
         ●
             Error Prone       How do you deploy ?

         ●
             Non
             Reproducible


●   61% does it WRONG
                            Do you Test Deployments ?
Looking for ?
“As a system administrator, I can tell when software
vendors hate me. It shows in their products.”

“DON'T make the administrative interface a GUI. System
administrators need a command-line tool for constructing
repeatable processes. Procedures are best documented
by providing commands that we can copy and paste from
the procedure document to the command line. We cannot
achieve the same repeatability when the instructions are:
"Checkmark the 3rd and 5th options, but not the 2nd
option, then click OK." Sysadmins do not want a GUI that
requires 25 clicks for each new user.”
                        Thomas A. Limoncelli in ACM Queue December 2010

                                http://queue.acm.org/detail.cfm?id=1921361
If my computer can't deploy your site,
       it isn't worth deploying.
                 Kris Buytaert, DrupalCon Munich 2012
Challenges
●   What about the data ?
●   Content vs Config
•Drupal provides no clear distinction
●   e.g a billing application
•Table Creation
•Provisioning (e.g. Rates, Call plan types)
•Actual Data
●   D8 ?
Devops a definition
●   There is no definition
●   It certainly isn't a person
●   No strict rules
●   No strict tools
●   It's not even new
●   If you aren't doing it already ...
    .. failure is upon you ...
Conclusions
●   Drupal gets it and is supportive
●   Conversation happens
●   Long Journey ahead
●   Heading in the right direction
Surviving the test !
          ●   After 5+ years of
              preaching I`m not
              alone anymore
          ●   Devops, a new
              Movement !
          ●   Join the movement !
          •Devopsdays.org
          •Agile System
          Adminstration
          GoogleGroups
It's not about the tools
  It's about change
It's about the people
Open Up!
Connecting Systems
    AND PEOPLE
Contact
Kris Buytaert
Kris.Buytaert@inuits.eu

Further Reading
@krisbuytaert
http://www.krisbuytaert.be/blog/
http://www.inuits.eu/




                             Inuits

                             Duboistraat 50
                             2060 Antwerpen
                             Belgium


                             +32 475 961221
1 of 53

Recommended

Devops, the future is here it's not evenly distributed yet by
Devops, the future is here it's not evenly distributed yetDevops, the future is here it's not evenly distributed yet
Devops, the future is here it's not evenly distributed yetKris Buytaert
2.8K views85 slides
DevOps Requires Agility by
DevOps Requires AgilityDevOps Requires Agility
DevOps Requires AgilityStephen Ritchie
1K views29 slides
Devops Devops Devops, at Froscon by
Devops Devops Devops, at FrosconDevops Devops Devops, at Froscon
Devops Devops Devops, at FrosconKris Buytaert
8K views49 slides
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ... by
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...
MeasureWorks - Velocity Conference Europe 2012 - a Web Performance dashboard ...MeasureWorks
2.9K views234 slides
Continuous Deployment by
Continuous DeploymentContinuous Deployment
Continuous DeploymentBrian Moon
3.6K views24 slides
Devops at Startup Weekend BXL by
Devops at Startup Weekend BXLDevops at Startup Weekend BXL
Devops at Startup Weekend BXLKris Buytaert
1.3K views29 slides

More Related Content

What's hot

Devopsguys DevOps 101 for recruiters by
Devopsguys   DevOps 101 for recruitersDevopsguys   DevOps 101 for recruiters
Devopsguys DevOps 101 for recruitersDevOpsGroup
43.9K views33 slides
DevOps game marshmallow challenge by
DevOps game marshmallow challengeDevOps game marshmallow challenge
DevOps game marshmallow challengeMurughan Palaniachari
10.9K views20 slides
Introduction to DevOps by
Introduction to DevOpsIntroduction to DevOps
Introduction to DevOpsJulien Pivotto
3.8K views68 slides
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation Game by
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation GameBring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation Game
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation GameDana Pylayeva
5.7K views44 slides
Scale quality with kaizen - Tech.Rocks conference by
Scale quality with kaizen - Tech.Rocks conferenceScale quality with kaizen - Tech.Rocks conference
Scale quality with kaizen - Tech.Rocks conferenceFabrice Bernhard
976 views33 slides
Top 10 devops values by
Top 10 devops valuesTop 10 devops values
Top 10 devops valuesMurughan Palaniachari
1.9K views16 slides

What's hot(20)

Devopsguys DevOps 101 for recruiters by DevOpsGroup
Devopsguys   DevOps 101 for recruitersDevopsguys   DevOps 101 for recruiters
Devopsguys DevOps 101 for recruiters
DevOpsGroup43.9K views
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation Game by Dana Pylayeva
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation GameBring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation Game
Bring Down the Wall of Confusion with Chocolate, LEGO and Scrum Simulation Game
Dana Pylayeva5.7K views
Scale quality with kaizen - Tech.Rocks conference by Fabrice Bernhard
Scale quality with kaizen - Tech.Rocks conferenceScale quality with kaizen - Tech.Rocks conference
Scale quality with kaizen - Tech.Rocks conference
Fabrice Bernhard976 views
You only have to change one thing to make DevOps work, Everything by Ken Mugrage
You only have to change one thing to make DevOps work, EverythingYou only have to change one thing to make DevOps work, Everything
You only have to change one thing to make DevOps work, Everything
Ken Mugrage321 views
Agile2015: Introduction to DevOps with Chocolate and Lego Game by Dana Pylayeva
Agile2015: Introduction to DevOps with Chocolate and Lego GameAgile2015: Introduction to DevOps with Chocolate and Lego Game
Agile2015: Introduction to DevOps with Chocolate and Lego Game
Dana Pylayeva2.9K views
Zero downtime release through DevOps Continuous Delivery by Murughan Palaniachari
Zero downtime release through DevOps Continuous DeliveryZero downtime release through DevOps Continuous Delivery
Zero downtime release through DevOps Continuous Delivery
Building A devopsy Team by Kris Buytaert
Building A devopsy TeamBuilding A devopsy Team
Building A devopsy Team
Kris Buytaert6.8K views
Beyond WIP Limits (Lean Kanban Tour Edition) by Pawel Brodzinski
Beyond WIP Limits (Lean Kanban Tour Edition)Beyond WIP Limits (Lean Kanban Tour Edition)
Beyond WIP Limits (Lean Kanban Tour Edition)
Pawel Brodzinski2.9K views
Automated testing DrupalCamp in Asheville by Promet Source
Automated testing DrupalCamp in AshevilleAutomated testing DrupalCamp in Asheville
Automated testing DrupalCamp in Asheville
Promet Source2.1K views
DSC UTeM DevOps Session#1: Intro to DevOps Presentation Slides by DSC UTeM
DSC UTeM DevOps Session#1: Intro to DevOps Presentation SlidesDSC UTeM DevOps Session#1: Intro to DevOps Presentation Slides
DSC UTeM DevOps Session#1: Intro to DevOps Presentation Slides
DSC UTeM73 views
You only have to change on thing to do the DevOps, everything by Ken Mugrage
You only have to change on thing to do the DevOps, everythingYou only have to change on thing to do the DevOps, everything
You only have to change on thing to do the DevOps, everything
Ken Mugrage570 views
Introduction to devops 2016 by gjdevos
Introduction to devops 2016Introduction to devops 2016
Introduction to devops 2016
gjdevos680 views
DevOps a peek into high performing organizations by Ram0603
DevOps a peek into high performing organizationsDevOps a peek into high performing organizations
DevOps a peek into high performing organizations
Ram060390 views

Similar to Devops for drupal

Devops, the future is here, it's just not evenly distributed yet. by
Devops, the future is here, it's just not evenly distributed yet.Devops, the future is here, it's just not evenly distributed yet.
Devops, the future is here, it's just not evenly distributed yet.Kris Buytaert
18.3K views53 slides
Devops, Secops, Opsec, DevSec *ops *.* ? by
Devops, Secops, Opsec, DevSec *ops *.* ?Devops, Secops, Opsec, DevSec *ops *.* ?
Devops, Secops, Opsec, DevSec *ops *.* ?Kris Buytaert
18.5K views56 slides
Drupal and Devops , the Survey Results by
Drupal and Devops , the Survey ResultsDrupal and Devops , the Survey Results
Drupal and Devops , the Survey ResultsKris Buytaert
5.6K views49 slides
Devops For Drupal by
Devops  For DrupalDevops  For Drupal
Devops For DrupalKris Buytaert
10.6K views43 slides
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove by
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveOSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveNETWAYS
204 views42 slides
Buytaert kris tools by
Buytaert kris toolsBuytaert kris tools
Buytaert kris toolskuchinskaya
526 views46 slides

Similar to Devops for drupal(20)

Devops, the future is here, it's just not evenly distributed yet. by Kris Buytaert
Devops, the future is here, it's just not evenly distributed yet.Devops, the future is here, it's just not evenly distributed yet.
Devops, the future is here, it's just not evenly distributed yet.
Kris Buytaert18.3K views
Devops, Secops, Opsec, DevSec *ops *.* ? by Kris Buytaert
Devops, Secops, Opsec, DevSec *ops *.* ?Devops, Secops, Opsec, DevSec *ops *.* ?
Devops, Secops, Opsec, DevSec *ops *.* ?
Kris Buytaert18.5K views
Drupal and Devops , the Survey Results by Kris Buytaert
Drupal and Devops , the Survey ResultsDrupal and Devops , the Survey Results
Drupal and Devops , the Survey Results
Kris Buytaert5.6K views
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove by NETWAYS
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveOSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
NETWAYS204 views
Buytaert kris tools by kuchinskaya
Buytaert kris toolsBuytaert kris tools
Buytaert kris tools
kuchinskaya526 views
OSDC 2012 | Devops and Open Source by Kris Buytaert by NETWAYS
OSDC 2012 | Devops and Open Source by Kris BuytaertOSDC 2012 | Devops and Open Source by Kris Buytaert
OSDC 2012 | Devops and Open Source by Kris Buytaert
NETWAYS23 views
OSDC 2012 | Devops and Open Source by Kris Buyaert by NETWAYS
OSDC 2012 | Devops and Open Source by Kris BuyaertOSDC 2012 | Devops and Open Source by Kris Buyaert
OSDC 2012 | Devops and Open Source by Kris Buyaert
NETWAYS18 views
7 tools for your devops stack by Kris Buytaert
7 tools for your devops stack7 tools for your devops stack
7 tools for your devops stack
Kris Buytaert35.9K views
7 Tools for your Puppetized Devops stack by Kris Buytaert
7 Tools for your Puppetized Devops stack7 Tools for your Puppetized Devops stack
7 Tools for your Puppetized Devops stack
Kris Buytaert4.6K views
11 tools for your PHP devops stack by Kris Buytaert
11 tools for your PHP devops stack11 tools for your PHP devops stack
11 tools for your PHP devops stack
Kris Buytaert12.6K views
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal... by AgileNetwork
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
Agile Gurgaon 2016 | Thinking Beyond :: Marry Agile and DevOps for Phenomenal...
AgileNetwork115 views
11 Tools for your Open Source devops stack by Kris Buytaert
11 Tools for your Open Source devops stack 11 Tools for your Open Source devops stack
11 Tools for your Open Source devops stack
Kris Buytaert13.5K views
Evolving to Cloud-Native - Anand Rao by VMware Tanzu
Evolving to Cloud-Native - Anand RaoEvolving to Cloud-Native - Anand Rao
Evolving to Cloud-Native - Anand Rao
VMware Tanzu471 views
Building and Scaling High Performing Technology Organizations by Jez Humble a... by Agile India
Building and Scaling High Performing Technology Organizations by Jez Humble a...Building and Scaling High Performing Technology Organizations by Jez Humble a...
Building and Scaling High Performing Technology Organizations by Jez Humble a...
Agile India547 views

More from Kris Buytaert

Years of (not) learning , from devops to devoops by
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoopsKris Buytaert
65 views44 slides
Observability will not fix your Broken Monitoring ,Ignite by
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,IgniteKris Buytaert
167 views20 slides
Infrastructure as Code Patterns by
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code PatternsKris Buytaert
117 views53 slides
From devoops to devops 13 years of (not) learning by
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learningKris Buytaert
185 views40 slides
Pipeline all the Dashboards as Code by
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as CodeKris Buytaert
644 views20 slides
Help , My Datacenter is on fire by
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fireKris Buytaert
542 views38 slides

More from Kris Buytaert(20)

Years of (not) learning , from devops to devoops by Kris Buytaert
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoops
Kris Buytaert65 views
Observability will not fix your Broken Monitoring ,Ignite by Kris Buytaert
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,Ignite
Kris Buytaert167 views
Infrastructure as Code Patterns by Kris Buytaert
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code Patterns
Kris Buytaert117 views
From devoops to devops 13 years of (not) learning by Kris Buytaert
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learning
Kris Buytaert185 views
Pipeline all the Dashboards as Code by Kris Buytaert
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as Code
Kris Buytaert644 views
Help , My Datacenter is on fire by Kris Buytaert
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fire
Kris Buytaert542 views
Devops is Dead, Long live Devops by Kris Buytaert
Devops is Dead, Long live DevopsDevops is Dead, Long live Devops
Devops is Dead, Long live Devops
Kris Buytaert289 views
10 years of #devopsdays, but what have we really learned ? by Kris Buytaert
10 years of #devopsdays, but what have we really learned ? 10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ?
Kris Buytaert594 views
Continuous Infrastructure First by Kris Buytaert
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
Kris Buytaert568 views
Is there a Future for devops ? by Kris Buytaert
Is there a Future for devops   ? Is there a Future for devops   ?
Is there a Future for devops ?
Kris Buytaert478 views
10 Years of #devopsdays weirdness by Kris Buytaert
10 Years of #devopsdays weirdness10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdness
Kris Buytaert400 views
ADDO 2019: Looking back at over 10 years of Devops by Kris Buytaert
ADDO 2019:    Looking back at over 10 years of DevopsADDO 2019:    Looking back at over 10 years of Devops
ADDO 2019: Looking back at over 10 years of Devops
Kris Buytaert578 views
Continuous Infrastructure First Ignite Edition by Kris Buytaert
Continuous Infrastructure First  Ignite EditionContinuous Infrastructure First  Ignite Edition
Continuous Infrastructure First Ignite Edition
Kris Buytaert476 views
Continuous Infrastructure First by Kris Buytaert
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
Kris Buytaert521 views
Open Source Monitoring in 2019 by Kris Buytaert
Open Source Monitoring in 2019 Open Source Monitoring in 2019
Open Source Monitoring in 2019
Kris Buytaert1.5K views
Devops is a Security Requirement by Kris Buytaert
Devops is a Security RequirementDevops is a Security Requirement
Devops is a Security Requirement
Kris Buytaert699 views

Recently uploaded

Kyo - Functional Scala 2023.pdf by
Kyo - Functional Scala 2023.pdfKyo - Functional Scala 2023.pdf
Kyo - Functional Scala 2023.pdfFlavio W. Brasil
298 views92 slides
AMAZON PRODUCT RESEARCH.pdf by
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdfJerikkLaureta
19 views13 slides
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...Bernd Ruecker
33 views69 slides
Unit 1_Lecture 2_Physical Design of IoT.pdf by
Unit 1_Lecture 2_Physical Design of IoT.pdfUnit 1_Lecture 2_Physical Design of IoT.pdf
Unit 1_Lecture 2_Physical Design of IoT.pdfStephenTec
12 views36 slides
Roadmap to Become Experts.pptx by
Roadmap to Become Experts.pptxRoadmap to Become Experts.pptx
Roadmap to Become Experts.pptxdscwidyatamanew
14 views45 slides
SAP Automation Using Bar Code and FIORI.pdf by
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdfVirendra Rai, PMP
22 views38 slides

Recently uploaded(20)

AMAZON PRODUCT RESEARCH.pdf by JerikkLaureta
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdf
JerikkLaureta19 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker33 views
Unit 1_Lecture 2_Physical Design of IoT.pdf by StephenTec
Unit 1_Lecture 2_Physical Design of IoT.pdfUnit 1_Lecture 2_Physical Design of IoT.pdf
Unit 1_Lecture 2_Physical Design of IoT.pdf
StephenTec12 views
SAP Automation Using Bar Code and FIORI.pdf by Virendra Rai, PMP
SAP Automation Using Bar Code and FIORI.pdfSAP Automation Using Bar Code and FIORI.pdf
SAP Automation Using Bar Code and FIORI.pdf
PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi126 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院 by IttrainingIttraining
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson66 views
Perth MeetUp November 2023 by Michael Price
Perth MeetUp November 2023 Perth MeetUp November 2023
Perth MeetUp November 2023
Michael Price19 views
Lilypad @ Labweek, Istanbul, 2023.pdf by Ally339821
Lilypad @ Labweek, Istanbul, 2023.pdfLilypad @ Labweek, Istanbul, 2023.pdf
Lilypad @ Labweek, Istanbul, 2023.pdf
Ally3398219 views
Black and White Modern Science Presentation.pptx by maryamkhalid2916
Black and White Modern Science Presentation.pptxBlack and White Modern Science Presentation.pptx
Black and White Modern Science Presentation.pptx
maryamkhalid291616 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada135 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana16 views
From chaos to control: Managing migrations and Microsoft 365 with ShareGate! by sammart93
From chaos to control: Managing migrations and Microsoft 365 with ShareGate!From chaos to control: Managing migrations and Microsoft 365 with ShareGate!
From chaos to control: Managing migrations and Microsoft 365 with ShareGate!
sammart939 views

Devops for drupal

  • 1. What's this devops thing anyhow ? Kris Buytaert DrupalCon Munich , August 2012
  • 2. Kris Buytaert • I used to be a Dev, • Then Became an Op • Chief Trolling Officer and Open Source Consultant @inuits.eu • Everything is an effing DNS Problem • Building Clouds since before the bookstore • Some books, some papers, some blogs • But mostly, trying to be good at my job • not related to @dries afaik
  • 3. What's this devops thing about ?
  • 4. World , 200X-2009 Patrick Debois, Gildas Le Nadan, Andrew Clay Shafer, Kris Buytaert, Jezz Humble, Lindsay Holmwood, John Allspaw, John Willis, Chris Read, Julian Simpson, and lots of others .. Gent , October 2009 Mountain View , June 2010 Hamburg , October 2010 Boston, March 2011 Mountain View, June 2011 Bangalore, Melbourne, Manilla, Sau Paulo, Tokyo Goteborg , October 2011 Austin , April 2012, Mountainview July 2012, Rome , October 2012 ....
  • 5. Devops is a growing movement ● We don't have all the answers yet ● We are reaching out to different communities ● We will point out problems we see.. ● Only the name is new While we are still working out the solutions
  • 7. Adopt the new philosophy. We are in a new economic age. Western management must awaken to the challenge, must learn their responsibilities, and take on leadership for change. ● Cease dependence on inspection to achieve quality. Eliminate the need for massive inspection by building quality into the product in the first place. ● Improve constantly and forever the system of production and service, to improve quality and productivity, and thus constantly decrease costs. ● Institute training on the job. ● Institute leadership The aim of supervision should be to help people and machines and gadgets do a better job. ● Drive out fear, so that everyone may work effectively for the company. ● Break down barriers between departments. People in research, design, sales, and production must work as a team, in order to foresee problems of production and usage that may be encountered with the product or service. ● Eliminate slogans, exhortations, and targets for the work force asking for zero defects and new levels of productivity. Such exhortations only create adversarial relationships, as the bulk of the causes of low quality and low productivity belong to the system and thus lie beyond the power of the work force. ● Eliminate management by objective. Eliminate management by numbers and numerical goals. Instead substitute with leadership. ● Remove barriers that rob the hourly worker of his right to pride of workmanship. The responsibility of supervisors must be changed from sheer numbers to quality. ● Remove barriers that rob people in management and in engineering of their right to pride of workmanship. ● Institute a vigorous program of education and self-improvement. ● Put everybody in the company to work to accomplish the transformation. The transformation is everybody's job.
  • 8. William Edwards Deming 1986, Out of the Crisis. http://en.wikipedia.org/wiki/W._Edwards_Deming
  • 9. “DevOps is a cultural and professional movement” Adam Jacob
  • 10. CAMS ● Culture ● Automation ● Measurement ● Sharing Damon Edwards and John Willis
  • 11. What's the problem ? The community of developers whose work you see on the Web, who probably don’t know what ADO or UML or JPA even stand for, deploy better systems at less cost in less time at lower risk than we see in the Enterprise. This is true even when you factor in the greater flexibility and velocity of startups. Tim Bray , on his blog January 2010
  • 12. The real problem : ● Friday evening at 16:59 “Put this Code Live, here's a tarball” NOW! ● Backups ? ● What database ? ● Security ? ● High Availability ? ● Scalability ? ● Who is on Call ?
  • 13. How did we get here ?
  • 14. A typical dev shop ● The PM: •“Put this Code Live, here's a tarball” NOW! •Marketing Campain is launched •We need this yesterday •It's going on national radio at 5
  • 15. An oldschool ops shop ● What dependencies ? ● No machines available ? ● What database ? ● Security ? ● High Availability ? ● Scalability ? ● My computer can't install this ?
  • 17. 10 days into production ● What High Load ? What Memory usage ? ● Are these Logs ? Or this is actualy customer data ? ● How many users are there , should they launch 100 queries each ?? Oh we're having 10K users ● Why is debugging enabled ? ● Who the fsck wrote this crap ?
  • 18. 11 days into production
  • 19. Is it really that bad ? How about Drupal ? A survey started a year ago.
  • 20. We can solve this ! ● Some people think the Ops work starts on deployment •Ops = both system, app as platform ! ● It starts much earlier ● Get Devs and Ops to talk asap
  • 21. Talk about Non functional Reqs NOW! ● Security ● Backups ● Upgradability ● Deployment
  • 25. Breaking the Silos Devs Ops Getting Along
  • 26. Nirvana An “ecosystem” that supports continuous delivery, from infrastructure, data and configuration management to business. Through automation of the build, deployment, and testing process, and improved collaboration between developers, testers, and operations, delivery teams can get changes released in a matter of hours — sometimes even minutes–no matter what the size of a project or the complexity of its code base. Continuous Delivery , Jez Humble
  • 27. How many times a day ? ● 10 @ Flickr ● Deployments used to be pain ● Nobody dared to deploy a site ● Practice makes perfect ● Knowing you can vs constantly doing it
  • 28. How do we get there ?
  • 29. Todays Enviroments For Devs For Ops ● Version Control ● Version Control ● Automated Build ● Automated Build ● Bugtracking ● Bugtracking ● Continous integration ● Continous integration ● Integrated testing ● Integrated testing ● Automated ● Automated deployment deployment
  • 34. Drupal & Continuous Integration
  • 35. Do YOU test your code ?
  • 37. Where do you develop ? ● It works on my machine :( ● What other platforms do you use :
  • 38. Sharing environments ● Build identical environments ● Share code ● Shared ownership of content , code and configuration
  • 39. Vagrant ● Abstraction layer for VirtualBox ● Integrates well with Puppet/Chef ● Project = ● Vagrantfile ● Manifests / Cookbooks ● Portable, Small , Versionable ● Use veewee to build your boxen
  • 40. Vagrantfile Vagrant::Config.run do |config| # All Vagrant configuration is done here. The most common configuration # options are documented and commented below. For a complete reference, # please see the online documentation at vagrantup.com. config.vm.define :mongo1 do |mongo1_config| mongo1_config.ssh.max_tries = 100 mongo1_config.vm.box = "MyCentOS2" mongo1_config.vm.network("192.168.99.101") mongo1_config.vm.host_name = "mongo1" mongo1_config.vm.provision :puppet do |mongo1_puppet| mongo1_puppet.pp_path = "/tmp/vagrant-puppet" mongo1_puppet.manifests_path = "manifests" mongo1_puppet.module_path = "modules" mongo1_puppet.manifest_file = "site.pp" end end config.vm.define :mongo2 do |mongo2_config| mongo2_config.ssh.max_tries = 100 mongo2_config.vm.box = "MyCentOS2" mongo2_config.vm.network("192.168.99.102") mongo2_config.vm.host_name = "mongo2" mongo2_config.vm.provision :puppet do |mongo2_puppet| mongo2_puppet.pp_path = "/tmp/vagrant-puppet" mongo2_puppet.manifests_path = "manifests" mongo2_puppet.module_path = "modules" mongo2_puppet.manifest_file = "site.pp" end end
  • 41. Vagrant Rocks ● Vagrant init ● Vagrant up ● Vagrant provision ● Vagrant down ● Vagrant destroy
  • 42. If my computer can't install your software, your software is broken. Luke Kanies, Fosdem 2007
  • 43. Infrastructure as Code ● Automated Deployments ● If my computer can't install it , the installer is borken ● Reproducable ● With configuration mgmt ● Think : •Cfengine,Puppet, Chef ● Put configs under version control
  • 44. Deployment ● Database Imports are EVIL ● Manual Installations are ● Error Prone How do you deploy ? ● Non Reproducible ● 61% does it WRONG Do you Test Deployments ?
  • 45. Looking for ? “As a system administrator, I can tell when software vendors hate me. It shows in their products.” “DON'T make the administrative interface a GUI. System administrators need a command-line tool for constructing repeatable processes. Procedures are best documented by providing commands that we can copy and paste from the procedure document to the command line. We cannot achieve the same repeatability when the instructions are: "Checkmark the 3rd and 5th options, but not the 2nd option, then click OK." Sysadmins do not want a GUI that requires 25 clicks for each new user.” Thomas A. Limoncelli in ACM Queue December 2010 http://queue.acm.org/detail.cfm?id=1921361
  • 46. If my computer can't deploy your site, it isn't worth deploying. Kris Buytaert, DrupalCon Munich 2012
  • 47. Challenges ● What about the data ? ● Content vs Config •Drupal provides no clear distinction ● e.g a billing application •Table Creation •Provisioning (e.g. Rates, Call plan types) •Actual Data ● D8 ?
  • 48. Devops a definition ● There is no definition ● It certainly isn't a person ● No strict rules ● No strict tools ● It's not even new ● If you aren't doing it already ... .. failure is upon you ...
  • 49. Conclusions ● Drupal gets it and is supportive ● Conversation happens ● Long Journey ahead ● Heading in the right direction
  • 50. Surviving the test ! ● After 5+ years of preaching I`m not alone anymore ● Devops, a new Movement ! ● Join the movement ! •Devopsdays.org •Agile System Adminstration GoogleGroups
  • 51. It's not about the tools It's about change It's about the people

Editor's Notes

  1. Nr of users Nagios Plugins Prod_check
  2. Vagrant etc