Devops For Drupal

Devops, Devops, Drupal Dries Vanlerberghe and Kris Buytaert

Kris Buytaert@krisbuytaert● I used to be a Dev, Then Became an Op● Senior Linux and Open Source Consultant @inuits.be● „Infrastructure Architect“● Building Clouds since before the Cloud th● Surviving the 10 floor test● Co-Author of some books● Guest Editor at some sites

Dries Vanlerberghe● I used to be a Dev, and kept it that way!● Open Source Consultant @inuits.be● „Developer“● +10 years Web development● Translating business needs to working applications

Whats this Devops thing about ?

Alternative Titles● Tales from Grumpy old Sysadmin● Devops, Devops, Devops th● Surviving the 10 floor test● Why devs hated ops

● Devops is a growing movement● We dont have all the answers yet● We are reaching out to different communities● We will point out problems we see.. While we are still working out the solutions

CAMS● Culture● Automation● Measurement● Sharing Damon Edwards and John Willis

Whats the problem ?The community of developers whose work yousee on the Web, who probably don’t know whatADO or UML or JPA even stand for, deploy bettersystems at less cost in less time at lower riskthan we see in the Enterprise. This is true evenwhen you factor in the greater flexibility andvelocity of startups.Tim Bray , on his blog January 2010

How did we get here ?

The Old Days● “Put this Code Live, heres a tarball” NOW!● What dependencies ?● No machines available ?● What database ?● Security ?● High Availability ?● Scalability ?● My computer cant install this ?

Devs vs Ops

10 days into production● What High Load ? What Memory usage ?● Are these Logs ? Or this is actualy customer data ?● How many users are there , should they launch 100 queries each ?? Oh were having 10K users● Why is debugging enabled ?● Who the fsck wrote this crap ?

11 days into production

We can solve this ! ● Some people think the Ops work starts on deployment • Ops = both system, app as platform ! ● It starts much earlier ● Get Devs and Ops to talk asap

Talk about Nonfunctional Reqs NOW!● Security● Backups● High Availability● Upgradability● Deployment● Monitoring● Scale

Breaking the SilosDevs Ops Getting Along

NirvanaAn “ecosystem” that supports continuous delivery, frominfrastructure, data and configuration management tobusiness.Through automation of the build, deployment, and testingprocess, and improved collaboration between developers,testers, and operations, delivery teams can get changesreleased in a matter of hours — sometimes even minutes–nomatter what the size of a project or the complexity of its codebase. Continuous Delivery , Jez Humble

How many times a day ?● 10 @ Flickr● Deployments used to be pain● Nobody dared to deploy a site● Practice makes perfect● Knowing you can vs constantly doing it

How do we get there ?

Todays Enviroments For Devs For Ops● Version Control ● Version Control● Automated Build ● Automated Build● Bugtracking ● Bugtracking● Continous integration ● Continous integration● Integrated testing ● Integrated testing● Automated ● Automated deployment deployment

Infrastructure as Code● Automated Deployments● If my computer cant install it , the installer is borken● Reproducable● With configuration mgmtThink : • Cfengine,Puppet, Chef● Put configs under version control

Deploying a Site● Code vs Config● Think: • Capistrano, Controltier, ..● Pulling stuff from version control • Is your repo accessible from production ?● Ops people like stuf packaged • .rpm, .deb, not .tgz , not .war

Why ops like to package● Uniquely identify where files come from • Package or cfg-mgmt● Source repo not always available • Firewall / Cloud etc ..● Weird deployment locations , no easy access● Little overhead when you automate● CONFIG does not belong in a package

Looking for ?“As a system administrator, I can tell when softwarevendors hate me. It shows in their products.”“DONT make the administrative interface a GUI. Systemadministrators need a command-line tool for constructingrepeatable processes. Procedures are best documented byproviding commands that we can copy and paste from theprocedure document to the command line. We cannotachieve the same repeatability when the instructions are:"Checkmark the 3rd and 5th options, but not the 2ndoption, then click OK." Sysadmins do not want a GUI thatrequires 25 clicks for each new user.” Thomas A. Limoncelli in ACM Queue December 2010 http://queue.acm.org/detail.cfm?id=1921361

Can you please talk about Drupal now ?

Deploying a Drupal Site● Drush_make● Profiles● Features ,strongarm , Custom code • Configuration as Code● What with external apps and libraries? • Lucene – Solr – Tika – BI software● Test before you drive!

Upgrading a site● Drush • pm-updatecode • Updatedb • Features-update● Once again, test before you drive!● But ... what about userdata ?

Challenges● What about the data ?● Content vs Config • Drupal provides no clear distinction● e.g a billing application • Table Creation • Provisioning (e.g. Rates, Call plan types) • Actual Data● D8 ?

Deploying a Drupal Site● Drush_make● Profiles ? • Not reusable for upgrades • Drush site-install profile● Features ,strongarm , Custom code • Configuration as Code● D7 Looks Better

Upgrading a site● Drush • upgrade • Updatedb • Features-update● But ... what about userdata ?

Challenges● What about the data ?● Content vs Config • Drupal provides no clear distinction● e.g a billing application • Table Creation • Provisioning (e.g. Rates, Call plan types) • Actual Data● D8 ?

Going Live

High Availabilty

Scalability

Monitor

Devops a definition● There is no definition● It certainly isnt a person● No strict rules● No strict tools● Its not even new● If you arent doing it already ... .. failure is upon you ...

Surviving the test ! ● After 5+ years of preaching I`m not alone anymore ● Devops, a new Movement ! ● Join the movement ! • Devopsdays.org • Agile System Adminstration GoogleGroups

Contact :Kris BuytaertKris.Buytaert@inuits.beFurther Reading@krisbuytaerthttp://www.krisbuytaert.be/blog/http://www.inuits.be/http://www.virtualization.com/http://www.oreillygmt.com/ Inuits Esquimaux t Hemeltje Kheops Business Gemeentepark 2 Center 2930 Brasschaat Avenue Georges 891.514.231 Lemaître 54 6041 Gosselies +32 473 441 636 889.780.406 +32 495 698 668

Images:http://www.flickr.com/photos/huffstutterrobertl/4135257384/http://www.flickr.com/photos/brighton/2153602543/http://www.flickr.com/photos/gchorus/2074271352/http://www.flickr.com/photos/49024304@N00/2951673691/sizes/l/http://www.flickr.com/photos/30302096@N06/2953698548/http://www.flickr.com/photos/jamescridland/613445810/http://www.flickr.com/photos/johnmcga/4468003947/And some stuff from my previous devops presentation with@patrickdebois

http://coderwall.com	7
http://staging1.bronney.com	3
http://www.onlydoo.com	2
http://www.istikbal.gr	2
https://fronter.com	2
http://paper.li	1
http://static.slidesharecdn.com	1

Devops For Drupal

by Kris Buytaert on Feb 05, 2011

Accessibility

Tags

Upload Details

Usage Rights

7 Embeds 18

Statistics

Devops For Drupal — Presentation Transcript