Automate or Die

AUTOMATE OR DIE! Trotter Cashion / Strange Loop 2010 http://pinktentacle.com/images/irex2009_4_large.jpg

CO-FOUNDER

@CASHION http://www.charlesheﬂin.com/wp-content/uploads/2010/06/fail-whale.jpg

github.com/trotter http://gems.github.com/octocat.png

AGENDA

THE MANUAL PROBLEM

CHEF SERVER VS. CHEF SOLO

COOKBOOK INTERNALS

GOING WAY BACK http://www.ameshistoricalsociety.org/identify/old_car1.jpg

FORD VS. THE OTHER GUYS Pre-Ford (?-1907) Model T (1915) $2,000 - $3,000 $850 Made by hand Assembly Line 12.5 hours to build 1.5 hours

BY 1930 250 car companies had died http://sdo210.ﬁles.wordpress.com/2010/05/grantwood-american-gothic-1930.jpg

SO WHAT ABOUT US? http://media.photobucket.com/image/nerds%20candy/civy1811/car002.jpg

Most Tech Companies are Essentially American Auto Companies Pre-Ford

MYSQL http://www.dolphinsc.com/images/Dolphin.jpg

POSTGRES http://images.buycostumes.com/mgen/merchandiser/32494.jpg

APACHE http://www.wallpapers-free.org/34/-/Apache_Longbow_Helicopter/

NGINX http://www.allbestwallpapers.com/travel-kremlin_and_red_square_ﬁreworks,_moscow,_russia_wallpapers.html

Memcached

Memcached Redis

Memcached Redis Mongodb

Memcached Redis Mongodb Riak

Memcached Redis Mongodb Riak Cassandra

Memcached Redis Mongodb Riak Cassandra Project Voldemort

Memcached Redis Mongodb Riak Ubuntu Cassandra Project Voldemort

Memcached Redis Redhat Mongodb Riak Ubuntu Cassandra Project Voldemort

Memcached Redis Redhat Solaris Mongodb Riak Ubuntu Cassandra Project Voldemort

Memcached iptables Redis Redhat Solaris Mongodb Riak Ubuntu Cassandra Project Voldemort

Memcached iptables Redis Redhat Solaris Mongodb Riak Ubuntu Cassandra sshd Project Voldemort

Memcached iptables Redis Redhat Solaris Mongodb Riak DNS Servers Ubuntu Cassandra sshd Project Voldemort

Memcached iptables Redis Redhat Solaris Mongodb Riak DNS Servers Ubuntu Cassandra sshd TCP/IP internals Project Voldemort

We Idolize the Artisan Sysadmin

... but what do we end up with?

SNOWFLAKES ... that become avalanches http://www.enviro-bc.ca/wp-content/uploads/2009/04/bowlake-aval_clair-israelson.jpg

HEISENBUGS http://osulibrary.oregonstate.edu/specialcollections/coll/nonspcoll/catalogue/portrait-heisenberg-600w.jpg

NO MORE MONEY! http://assets.troubledteenswizard.com/uploaded/WoW/nomoney1.jpg

We’re really left with two choices

Automate... or die.

Automation is not hard!

CFENGINE http://hackedgadgets.com/wp-content/2/LEGO_V8_Engine_1.jpg

PUPPET http://www.ﬂickr.com/photos/willemvelthoven/381608678/sizes/l/

CHEF! http://www.ﬂickr.com/photos/venndiagram/4891510333/sizes/l/

WRITTEN BY http://www.opscode.com/

WRITTEN IN http://www.prestonlee.com/wp-content/uploads/2008/09/ruby.png

Two Delicious Flavors

SERVER http://upload.wikimedia.org/wikipedia/commons/e/e0/Google%E2%80%99s_First_Production_Server.jpg

HOW IT WORKS

HOW IT WORKS Your Computer

HOW IT WORKS Your Computer Box to Provision

HOW IT WORKS Your Computer Box to Chef Server Provision

HOW IT WORKS Your Computer Prepare Box to Chef Server Provision

HOW IT WORKS Your Computer Prepare What now? Box to Chef Server Provision

HOW IT WORKS Your Computer Prepare Cookbooks What now? Box to Chef Server Provision

HOW IT WORKS Your Computer Prepare Cookbooks What now? Box to Chef Server Provision Run!

SOLO http://www.pbs.org/parents/supersisters/han_solo-thumb-454x654.jpg

HOW IT WORKS

HOW IT WORKS Your Computer

HOW IT WORKS Your Box to Computer Provision

HOW IT WORKS Prepare Your Box to Computer Provision

HOW IT WORKS Prepare Your Box to Computer Cookbooks Provision

HOW IT WORKS Prepare Your Box to Computer Cookbooks Provision Go!

Chef Structure

CHEF HEIRARCHY Node Roles Cookbooks Cookbooks Recipes Attributes Templates Deﬁnitions

ROLES ARE REUSABLE! conﬁg/dev.json conﬁg/db.json roles/db.rb

GETTING GOING http://www.ﬂickr.com/photos/seandreilinger/959864706/sizes/o/

WHAT YOU NEED

WHAT YOU NEED Ruby & Rubygems

WHAT YOU NEED Ruby & Rubygems `gem install chef` Chef Gem

WHAT YOU NEED Ruby & Rubygems `gem install chef` Chef Gem `git clone http://github.com/ Chef Repo opscode/chef-repo.git`

COOKBOOKS.OPSCODE.COM http://cookbooks.opscode.com/

TERMINAL JUNKIES

TERMINAL JUNKIES •spatula search mysql

TERMINAL JUNKIES •spatula search mysql •spatula install mysql

TERMINAL JUNKIES •spatula search mysql •spatula install mysql •spatula show mysql

TERMINAL JUNKIES •spatula search mysql •spatula install mysql •spatula show mysql •... knife has similar functionality

GET THE BOX READY ssh db-one.host “install ruby” spatula prepare db-one.host = ssh db-one.host “install chef”

GO GO GO! rsync repo to db-one.host spatula cook db-one.host db = ssh db-one.host “sudo chef-solo -c conﬁg/solo.rb -j conﬁg/db.json”

WITH CHEF SERVER install dependencies turn on client send cookbooks to client

DIGGING DEEPER http://media.photobucket.com/image/minecraft/bluekabal/roma/minesofroma.jpg

A NODE // ./config/db_one.json { "run_list": ["role[db]"] } Recipes and Roles go here

A ROLE # ./roles/db.rb name "database" description "Be a DB" run_list [ "apache2", "mysql::server" ]

A ROLE # ./roles/db.rb name "database" Recipes to run description "Be a DB" run_list [ "apache2", "mysql::server" ]

A ROLE # ./roles/db.rb name "database" description "Be a DB" run_list [ "apache2", "mysql::server" ] ./cookbooks/apache2/recipes/default.rb

A ROLE # ./roles/db.rb name "database" description "Be a DB" run_list [ "apache2", "mysql::server" ] ./cookbooks/mysql/recipes/server.rb

ATTRIBUTES # ./cookbooks/mysql/attributes/server.rb default[:mysql][:server_debian_password] = secure_password default[:mysql][:server_root_password] = secure_password default[:mysql][:server_repl_password] = secure_password default[:mysql][:bind_address] = ipaddress default[:mysql][:datadir] = "/var/lib/mysql" # Tunables default[:mysql][:tunable][:key_buffer] = "250M" default[:mysql][:tunable][:max_connections] = "800" default[:mysql][:tunable][:wait_timeout] = "180"

OVERRIDING ATTRIBUTES Node // ./config/db.json { "mysql": { "server_root_password": "beefcake" }, "recipes": [ "mysql" ] } Role # ./roles/db.rb name "database" description "Be a DB" run_list [ "mysql::server" ] default_attributes :mysql => { :server_root_password => "beefcake" }

THE RECIPE... PART 1 # ./cookbooks/mysql/recipes/server.rb include_recipe "mysql::client"

THE RECIPE... PART 2 package "mysql-server" do action :install end

THE RECIPE... PART 3 template "/etc/mysql/my.cnf" do source "my.cnf.erb" owner "root" group "root" mode "0644" notifies :restart, resources(:service => "mysql"), :immediately end

A TEMPLATE SAMPLE user = mysql pid-file = /var/run/mysqld/mysqld.pid socket = /var/run/mysqld/mysqld.sock datadir = <%= @datadir %> bind-address = <%= @node[:mysql][:bind_address] %>

A TEMPLATE SAMPLE user = mysql pid-file = /var/run/mysqld/mysqld.pid socket = /var/run/mysqld/mysqld.sock datadir = <%= @datadir %> bind-address = <%= @node[:mysql][:bind_address] %> OMG, ERB!!

A TEMPLATE SAMPLE user = mysql pid-file = /var/run/mysqld/mysqld.pid socket = /var/run/mysqld/mysqld.sock datadir = <%= @datadir %> bind-address = <%= @node[:mysql][:bind_address] %> From Attributes

A TEMPLATE SAMPLE user = mysql pid-file = /var/run/mysqld/mysqld.pid socket = /var/run/mysqld/mysqld.sock datadir = <%= @datadir %> From Template bind-address = <%= @node[:mysql][:bind_address] %>

ASSIGNING VARIABLES template "/etc/mysql/my.cnf" do source "my.cnf.erb" owner "root" group "root" mode "0644" variables :datadir => “/var/lib/mysql” end

DEFINITIONS define :apache_conf do dir = node[:apache][:dir] template "#{dir}/mods-available/#{params[:name]}.conf" do source "mods/#{params[:name]}.conf.erb" notifies :restart, resources(:service => "apache2") end end # In your recipe apache_conf "mod_ssl"

LET’S WRAP IT U P http://www.ﬂickr.com/photos/andresthor/3946773501/sizes/l/in/photostream/

AUTOMATE EVERYTHING!! http://www.ﬂickr.com/photos/kenfagerdotcom/3409813881/

Deploying == Provisioning

USE CHEF!!!!! http://www.ﬂickr.com/photos/martin_borjesson/4083726805/sizes/o/

ON THE INTERNETS

ON THE INTERNETS •twitter - @cashion

ON THE INTERNETS •twitter - @cashion •github - http://github.com/trotter

ON THE INTERNETS •twitter - @cashion •github - http://github.com/trotter •email - cashion on the gmailz

DOMO ARIGATO http://www.ﬂickr.com/photos/dancoulter/21042744/sizes/o/

RESOURCES

RESOURCES • http://wiki.opscode.com/display/chef/Resources

RESOURCES • http://wiki.opscode.com/display/chef/Resources •#chef on freenode

RESOURCES • http://wiki.opscode.com/display/chef/Resources •#chef on freenode •cashion@gmail.com

Automate or Die

by Trotter Cashion on Oct 15, 2010

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Automate or Die Presentation Transcript