Config managament for development environments ii

Conﬁguration Management
for Development Environments

LRUG 8th August 2011

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/36144637@N00/159627088/

Gareth Rushgrove

gareth rushgrove | morethanseven.net

Blog at morethanseven.net


Curate devopsweekly.com


Problems

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/iancarroll/5027441664

1. Not all developers want to be sysadmins

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/34652102@N04/5059217055

2. New team members getting started time


3. Running a full set of services locally

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/biggreymare

4. Works on my machine


⚡ brew info mysql
mysql 5.5.14

$ aptitude show mysql-server
Package: mysql-server
State: not installed
Version: 5.1.41-3ubuntu12.10

Homebrew is great but...


23 releases and 21 months in-between 5.1.41 and 5.5.14. Here’s
some ﬁxed bugs:

- An ORDER BY clause was bound to the incorrect substatement
when used in UNION context.
- A NOT IN predicate with a subquery containing a HAVING clause
could retrieve too many rows, when the subquery itself returned
NULL.
- MIN(year_col) could return an incorrect result in some cases.

And lots more

What’s a few versions between friends?


Spot the cross platform bug (not the security ﬂaw)


⚡ ./server.rb &
⚡ curl "http://127.0.0.1:8181/?query=Bob"
⚡ curl "http://127.0.0.1:8181/?query=bob"
⚡ ls
Bob
⚡ cat Bob
Hello bob

On our Mac


$ ./server.rb &
$ curl "http://127.0.0.1:8181/?query=Bob"
$ curl "http://127.0.0.1:8181/?query=bob"
$ ls
Bob bob
$ cat Bob
Hello Bob
$ cat bob
Hello bob

On Linux


Solutions


Virtualisation

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/dawilson/2598713027

VirtualBox


VMware


Virtualisation needs powerful hardware

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/martinoc/477335951

What about editing code?

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/peteradams/2272928740

Shared Folders or NFS


Vim


Vagrantup.com


- Automated virtual machine creation using Oracle’s VirtualBox
- Automated provisioning of virtual environments using Chef or Puppet
- Full SSH access to created environments
- Assign a static IP to your VM, accessible from your machine
- Forward ports to the host machine
- Shared folders allows you to continue using your own editor
- Package environments into distributable boxes
- Completely tear down environment when you’re done
- Easily rebuild a complete environment with a single command

What is Vagrant?


Base boxes

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/dawilson/2793319903

VeeWee


Community boxes


⚡ gem install vagrant
⚡ vagrant box add lucid32 http://.../lucid32.box
⚡ vagrant init
⚡ vagrant up

Vagrant up


⚡ ls
Vagrantfile
⚡ vagrant up
⚡ vagrant ssh
⚡ vagrant reload
⚡ vagrant halt
⚡ vagrant destroy

Vagrant command line


⚡ vagrant ssh-config
Host default
HostName 127.0.0.1
User vagrant
Port 2222
IdentityFile /Users/.../vagrant-0.8.2/keys/vagrant
...

Export SSH conﬁguration


Vagrant::Config.run do |config|
config.vm.box = "lucid32"
end

Vagrantﬁle


config.vm.forward_port("web", 80, 8080)
config.vm.forward_port("ftp", 21, 4567)
config.vm.forward_port("ssh", 22, 2222, :auto => true)
end

Port forwarding


config.vm.share_folder("folder", "/guest", "../host")
end

Shared folders


config.vm.define :web do |web_config|
web_config.vm.box = "web"
web_config.vm.forward_port("http", 80, 8080)
end

config.vm.define :db do |db_config|
db_config.vm.box = "db"
db_config.vm.forward_port("db", 3306, 3306)
end
end

Multiple VMs in one ﬁle


config.vm.boot_mode = :gui
config.ssh.forward_agent = true
config.vm.customize do |vm|
vm.memory_size = 512
end
end

Lots more options


Puppet


config.vm.provision :puppet do |puppet|
puppet.manifests_path = "puppetmanifests"
puppet.manifest_file = "newbox.pp"
end
end

Vagrant provisioning with Puppet


Chef


config.vm.provision :chef_solo do |chef|
chef.add_recipe = "garethr"
chef.cookbooks_path = “cookbooks”
end
end

Vagrant provisioning with Chef


chef.roles_path = "roles"
chef.add_role("vm")
end
end

Specifying Chef roles


chef.recipe_url = "http://github.com/cookbooks.tar.gz"
chef.add_recipe "garethr"
chef.cookbooks_path = [:vm, "cookbooks"]
chef.json.merge!({ :garethr => {
:ohmyzsh => "https://github.com/.../oh-my-zsh.git",
:dotvim => "https://github.com/garethr/dotvim.git"
}})
end
end

Remote ﬁle


- Vagrant Hosts - https://github.com/dwt/vagrant-hosts
- Sahara - https://github.com/jedi4ever/sahara
- Vagrantboxes - https://github.com/garethr/ruby-vagrantboxes

Plugins

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/s3a/4710416678

Local conﬁguration management

gareth rushgrove | morethanseven.net http://www.ﬂickr.com/photos/crustyscumbrothersontour/2674351601

- I want my development environment everywhere
- I don’t want a wiki page of instructions
- I don’t want to have to manually install everything
- I don’t want to care about destroying a virtual machine
- So I have a simple Chef cookbook to bootstrap my machines

Real world example


⚡ cd /m/somefolder
⚡ tree
├── Vagrantfile
└── cookbooks
└── garethr
├── attributes
│   └── default.rb
├── files
│   └── default
│   └── zshrc
└── recipes
└── default.rb

Chef cookbook layout


%w{zsh wget curl lynx
git-core ack-grep vim-nox
dvtm build-essential tree}.each do |pkg|
package pkg do
action :install
end
end

Packages I like


git "/home/vagrant/.oh-my-zsh" do
repository node[:garethr][:ohmyzsh]
action :checkout
user "vagrant"
group "vagrant"
end

cookbook_file "/home/vagrant/.zshrc" do
source "zshrc"
owner "vagrant"
group "vagrant"
end

My shell conﬁgs


default[:garethr][:dotvim] =
"https://github.com/carlhuda/janus.git"

default[:garethr][:ohmyzsh] =
"https://github.com/robbyrussell/oh-my-zsh.git"

Attributes


git "/home/vagrant/.vim" do
repository node[:garethr][:dotvim]
action :checkout
user "vagrant"
end

execute "build janus" do
command "rake"
user "vagrant"
cwd "/home/vagrant/.vim"
environment ({'HOME' => '/home/vagrant'})
creates "/home/vagrant/.vimrc"
end

My Vim conﬁgs


require "chefspec"

describe "garethr" do
before(:all) do
@chef_run = ChefSpec::ChefRunner.new
@chef_run.converge "garethr"
end

it "should install zsh" do
@chef_run.should install_package "zsh"
end
end

Testing with ChefSpec


- The Chef Server
- Roles and Environments
- Knife and Shef
- Splitting the one ﬁle into multiple cookbooks
- Managing running services
- Simplifying cookbooks by creating system packages
- Supporting different operating systems
- The Chef architecture
- Testing with Cucumber-Chef

Awesome things I ignored


- Using Virtualisation catches bugs early
- Using Vagrant makes using virtual machines pleasurable
- Storing conﬁguration as code makes it shareable
- Able to apply development best practice to dev environments

Conclusions


- IRC - #vagrant on Freenode
- Github Issues - https://github.com/mitchellh/vagrant/issues
- Google Groups - http://groups.google.com/group/vagrant-up

More information


Questions?

gareth rushgrove | morethanseven.net http://ﬂickr.com/photos/psd/102332391/

Config managament for development environments ii

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (7)

Similar to Config managament for development environments ii

Similar to Config managament for development environments ii (20)

More from Gareth Rushgrove

More from Gareth Rushgrove (18)

Recently uploaded

Recently uploaded (20)

Config managament for development environments ii