Virtualization with Vagrant (ua.pycon 2011)

Virtual testing &development** batteries included

$ git clone git://server.com/project.git$ runIdeal world

$ git clone git://server.com/project.gitReal world

$ git clone git://server.com/project.git... read help$ mkdir, cp, vim config.conf, configure, make, makeinstall... ask guru$ /project/hidden/blackmagic --fix_that --fix_this --undocumented_parameter=MAGIC_CONST_42... %îng @#$@#%@!!!!Real world

$ git clone git://server.com/project.git... read help$ mkdir, cp, vim config.conf, configure, make, makeinstall... ask guru$ /project/hidden/blackmagic --fix_that --fix_this --undocumented_parameter=MAGIC_CONST_42... %îng @#$@#%@!!!!$ runReal world

Operating SystemUser SpaceMusicWebServerDBAppServerIMEditorBrowser

Problems• No isolation (oh, wrong binary onpath...?)• Not repeatable (that README ain’tgonna run itself!)• No guarantees (“..but it works on mycomputer!”)

Solution?

Operating SystemMusicWebServer DBAppServerIM EditorBrowserUser SpaceVirtualized OS

Benefits• Isolation (project and version specificfiles only)• Repeatable (snapshots, copies,automation)• Guarantees (same OS different day)

Business beneﬁts• Reduce costs (less hardware, lower energyconsumption)• Backup and data protection• Application availability• Less time to respond to changing businessneeds• Less time spent on routine tasks• Better IT department perception

Time spend on routine tasksaccording to VMware small & medium business survey

Why haven’t we been doingthis for a long time?• Big companies have been• Amazon EC2• Microsoft• Google• Only recently possible on local machines• Cheat hardware• Cheap RAM• Desktop virtualization API

Ok, let’s go virtual.Now what?

Vagrant is a tool for building anddistributing virtualized developmentenvironments (vagrantup.com)

VirtualBox is cross-platform virtualization softwarethat works on all the major platforms(virtualbox.org)

High level overview• Describe environment with Vagrantﬁles• Command line interface to manage VM lifecycle• Automate provisioning and conﬁguration• Share folder with host OS via NFS• Provide SSH access to guest OS• Network multiple VMs• Package and distribute VMs

Vagrant boxes• Box = pre-packaged VM environment (~OSimage)• A number of ready to use boxes @ http://vagrantbox.es• Ubuntu 32 / 64• CentOS• Solaris• RH

Vagrantfile• Vagrantfile is to Vagrant as Makefile is toMake• Describes VM in code• One Vagrantfile per project (can containmultiple VMs)• Commit it to version control• Actually a Ruby code - easy to extent

VagrantﬁleVagrant::Config.run do |config|config.vm.box = “base_ubuntu"end

Command line$ vagrant helpvagrant initvagrant upvagrant haltvagrant reloadvagrant suspendvagrant resumevagrant destroyvagrant provisionvagrant package…

• Isolation (project and versionspeciﬁc ﬁles only)• Repeatable (snapshots, copies,automation)• Guarantees (same OS different day)

Chef is an open-source systemsintegration framework built speciﬁcallyfor automating the cloud (opscode.com/chef)

Puppet is a system for automatingsystem administration tasks, workson most UNIX-like operatingsystems (puppetlabs.com)

How Chef/Puppet works• You create recipes• Recipes describe desired system state• Then you manage your server park• Safely• Repeatedly• In automated way

Provisioning in Vagrant• Use Chef, Puppet, bash scripts, etc. tomanage VM conﬁguration• Repeatable!• Use same tools for production - Chef,Puppet

Vagrant + ChefVagrant::Config.run do |config|config.vm.box = “base_ubuntu_box"config.vm.provision :chef_solo do |chef|chef.recipe_url = "http://server/cookbooks.tar.gz"chef.add_recipe(“aptitude")chef.add_recipe(“apache2")chef.add_recipe(“mysql-server")chef.add_recipe(“python27")chef.add_recipe(“pip")endend

Networking• Assign IP to VM in Vagrantﬁle• Forward ports• Access VM from your browser

NetworkingVagrant::Config.run do |config|config.vm.box = "lucid32"config.vm.network("10.20.30.49")config.vm.forward_port("web", 80, 4567)end

Packaging• When environment is stable• Package and distribute prepared VMs• Minimize setup time

Beyond that• Multi-VM Vagrantﬁle• DB• AppServer• WebServer• Use vagrant as library• Call API functions to do the tasks fromRuby code• Run custom SSH commands

Demohttp://youtu.be/O3-MNsowgHc

Demogithub.com/dreamiurg/timetest•Django application•Apache2 + MySQL on single VM•Additional Python packages like used (South, annoying)•DB migrations handled by South•Deployment process• Vagrant is used to create VM, install required packages andconﬁgure services• Fabric (fabﬁle.org) is used to populate DB, set up apache2 confand install Python modules

Prerequisites$ <install python>$ <install ruby>$ <install virtualbox>$ gem install vagrant$ git clone http://server/project.git$ cd project

Demo: create VM, deploy project00:00:00 $ vagrant box add base http://server/base.box... base box for VM is copied to your computer00:02:00 $ vagrant up... vagrant creates VM from base box, installs and conﬁguresrequired packages – apt, apache2, mysql, python, git, …00:05:00 $ fab deploy... DB is populated with initial data, apache conﬁg updated, apacherestarted00:07:00 $ curl http://localhost:8080/... site is up and running.

Real world

Our experience• 10+ projects during last 18 months• From small (single webserver, no DB) tomedium (several webservers + load balancer,master/slave DB replication)• New developer start time reduced from 2-3days to 1 hr on average• Number of deployment/environment defectsreduced by 75%

Links• http://vagrantup.com• http://www.vagrantbox.es• http://fabﬁle.org• http://opscode.com• http://puppetlabs.com• http://github.com/dreamiurg/timetest• http://www.vmware.com/ﬁles/pdf/VMware-SMB-Survey.pdf

Dmitry Guyvoronskyhttp://about.me/dreamiurgdmitry.guyvoronsky@gmail.com@dreamiurg

http://demiurg.com.ua	602
http://cardioshock.blogspot.com	8
http://www.linkedin.com	3
http://www.hanrss.com	1

Virtualization with Vagrant (ua.pycon 2011)

by Dmitry Guyvoronsky

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 614

Statistics

Virtualization with Vagrant (ua.pycon 2011) Presentation Transcript