Code but now as we know it - Devoxx edition

Infrastructure as Code Patrick Debois http://www.tumblr.com/tagged/star-trek-quotesThursday 15 November 12

Organizer Since 2009 Europe Organizer 2010 First Europe Training 2010 Speaker Monitoring Chapter Technical Reviewer Co-Author Veewee / Sahara / Mccloud Libvirt - Fog Freelance consultant Engineer http://github.com/jedi4ever Blog: http://jedi.be/blog - Twitter: @patrickdebois - #devopsThursday 15 November 12

http://cfengine.com/ http://ansible.cc/ http://puppetlabs.com/ http://palletops.com/ http://opscode.com/chef/ CONFIGURATION MANAGEMENT SYSTEMSThursday 15 November 12

Chef & Puppet focused based on my experience http://www.nerdnirvana.org/wp-content/uploads/2010/12/apology-form.jpgThursday 15 November 12

DECLARATIVE LANGUAGE PACKAGE FILE1 SERVICE FILE2Thursday 15 November 12

“KNOWN STATE” STATE X CODE RUN STATE Y FILE1 PACKAGE FILE1 SERVICE FILE2 convergenceThursday 15 November 12

“IDEMPOTENCE” STATE Y CODE RUN STATE Y PACKAGE PACKAGE FILE1 SERVICE FILE1 SERVICE FILE2 FILE2Thursday 15 November 12

GIVE ME THE CODE: “LANGUAGE”Thursday 15 November 12

EXAMPLE SYNTAX Puppet Chef class myapache { package “apache2” package “apache2” service “apache2 do action [:enable , :start] service “apache2”: end ensure => “running”, require => Package[“apache2”] }Thursday 15 November 12

TERMINOLOGY Java Puppet Chef manifests recipes *.java *.pp *.rb package module cookbookThursday 15 November 12

TERMINOLOGY (2) Java Puppet Chef parametrized recipes with singleton classes attributes deﬁnes, deﬁnitions, class classes librariesThursday 15 November 12

SYNTAX Puppet Chef Limited DSL DSL + full ruby (by design) Extended by Light Weight Deﬁnitions Resource Providers / Custom Resource Deﬁnitions Providers, Light providers Weight Resource ERB & Custom Providers Libraries LibrariesThursday 15 November 12

LOOPING CONSTRUCTS Puppet Chef pass array of elements erb template for loops do while , repeat etc. create_resource available through (:type, hash) native rubyThursday 15 November 12

VARIABLES Puppet Chef special syntax native ruby $bla = “aa” bla = “aa” string interpolation string interpolation $bla_string = “${bla}” bla_string = #{bla}Thursday 15 November 12

SINGLE CLASS INHERITANCE Puppet Chef override via ‘module override via path’ ‘cookbook’ path +> operator “cookbook” attributeThursday 15 November 12

PROJECT STRUCTURE Puppet Module Chef Cookbook attributes/ definitions/ files/ files/ libraries/ lib/ metadata.rb README.rdoc providers/ manifests/ README.rdoc templates/ recipes/ resources/ templates/Thursday 15 November 12

EXECUTION MODEL Puppet Chef Compile catalog (directed graph Top Down execution model) Then ExecuteThursday 15 November 12

PLUGINS Puppet Chef KNIFE FACES PLUGINS REPORT REPORTS HANDLERS http://puppetlabs.com/blog/puppet-faces-what-the-heck-are-faces/ http://wiki.opscode.com/display/chef/Knife+PluginsThursday 15 November 12

CODE EDITORThursday 15 November 12

LEXERS http://redmine.djagios.org/projects/puppet-lexer https://github.com/rodjek/puppet-pygments-lexerThursday 15 November 12

VIM SYNTAX HIGHLIGHTIING https://github.com/rodjek/vim-puppet https://github.com/t9md/vim-chef https://github.com/vim-scripts/Cfengine-version-3-syntaxThursday 15 November 12

GEPPETTO - ECLIPSE IDE https://github.com/cloudsmith/geppetto http://cloudsmith.github.com/geppetto/Thursday 15 November 12

COMING SOON JETBRAINS RUBYMINE (PUPPET) http://youtrack.jetbrains.com/issue/RUBY-10832 https://github.com/janschumann/intellij-lang-puppet REACTOR8 http://beta.r8network.com/Thursday 15 November 12

REVERSE ENGINEERING Existing Server -> Manifest/Recipes https://github.com/devstructure/blueprintThursday 15 November 12

CODING STYLEThursday 15 November 12

Puppet Chef http://puppet-lint.com/ http://acrmp.github.com/ foodcritic/ • FC001: Use strings in preference to symbols to access node attributes • Must use two-space soft tabs. • FC002: Avoid string interpolation where not required • Must not use literal tab characters. • FC003: Check whether you are running with chef server before using server- specific features • Must not contain trailing white space. • FC004: Use a service resource to start and stop services • Should not exceed an 80 character line width • FC005: Avoid repetition of resource declarations An exception has been made for source => puppet://... lines as • FC006: Mode should be quoted or fully specified when setting file permissions splitting these over multiple lines decreases the readability of the • FC007: Ensure recipe dependencies are reflected in cookbook metadata manifests. • FC008: Generated cookbook metadata needs updating • Should align arrows (=>) within blocks of attributes. • FC009: Resource attribute not recognised • FC010: Invalid search syntax • .... • FC011: Missing README in markdown format • FC012: Use Markdown for README rather than RDoc • • FC013: Use file_cache_path rather than hard-coding tmp paths • https://github.com/ampledata/cookbook-style-guide http://docs.puppetlabs.com/guides/style_guide.htmlThursday 15 November 12

http://www.slideshare.net/PuppetLabs/modern-module- development-ken-barber-2012-edinburgh-puppet-campThursday 15 November 12

http://projects.puppetlabs.com/projects/hiera https://github.com/crayﬁshx/hiera-gpg CODE VS CONFIG (THINK “PROFILES”) http://wiki.opscode.com/display/chef/Data+BagsThursday 15 November 12

“STOP THE FORK(ING)”http://devopsanywhere.blogspot.it/2012/11/how-to-write-reusable-chef-cookbooks.htmlhttp://realityforge.org/code/2012/11/12/reusable-cookbooks-revisited.htmlhttps://github.com/jedi4ever/stop-the-forkThursday 15 November 12

PRE-COMMIT CHECKSThursday 15 November 12

DEPENDENCY MGMT Git Submodules à la Pom File SubtreeThursday 15 November 12

UPSTREAM REPOS http://community.opscode.com/ http://forge.puppetlabs.com/Thursday 15 November 12

Puppet Chef https://github.com/rodjek/ https://github.com/ librarian-puppet applicationsonline/librarian http://berkshelf.com/ site "http://community.opscode.com/api/v1" cookbook "ntp" cookbook "timezone", "0.0.1" cookbook "rvm", :git => "https://github.com/fnichol/chef-‐rvm", :ref => "v0.7.1" cookbook "cloudera", :path => "vendor/cookbooks/cloudera-‐cookbook"Thursday 15 November 12

CHEF METADATAThursday 15 November 12

Dependency Graphshttp://bitﬁeldconsulting.com/puppet-dependency-graphs https://github.com/miketheman/knife-role-spaghettiThursday 15 November 12

Online Servicehttp://wham.cloudsmith.comThursday 15 November 12

DEBUGGINGThursday 15 November 12

LOGGING WITH DIFFERENT LEVELS Info only, no exception Chef::Log.info(Some useful info) Fatal, raising exception Chef::Log.fatal(Something bad)Thursday 15 November 12

REPL - STYLE (READ EVAL PRINT) https://github.com/pry/pry http://wiki.opscode.com/display/chef/ShefThursday 15 November 12

https://github.com/vimeo/simple-black-boxThursday 15 November 12

DEV ENVIRONMENTThursday 15 November 12

Virtual Machine (1) Virtual Machine ... N PACKAGE FILE1 SERVICE FILE2 Just Enough Operating System + Conﬁg Management Tool virtualization Your laptop (Linux,Thursday 15 November 12 Wind

http://vagrantup.com/ Virtual Machine (1) PACKAGE FILE1 SERVICE FILE2 Just Enough Operating System + Conﬁg Management Tool virtualization Virtualbox + (Fusion Soon) Your Laptop Linux & WindowsThursday 15 November 12

USEFUL VAGRANT PLUGINS https://github.com/dotless-de/vagrant-vbguest https://github.com/folken-laeneck/vagrant-bindfs https://github.com/BIAINC/vagrant-windows https://github.com/BerlinVagrant/vagrant-dns https://github.com/dwt/vagrant-hostsThursday 15 November 12

VAGRANT ECLIPSE INTEGRATION http://marketplace.eclipse.org/node/519961#.UKISB-Oe-d4Thursday 15 November 12

Vagrant ‘clones’ EC2, KVM, FUSION, https://github.com/jedi4ever/mccloud/ HOSTS, Vagrant https://github.com/lstoll/tenderloin FUSION https://github.com/neerolyte/vagueant LXC https://github.com/rtyler/blimpy EC2Thursday 15 November 12

VAGRANT - CLOJURE https://github.com/tbatchelli/vmfestThursday 15 November 12

VAGRANT - JAVA https://github.com/guigarage/vagrant-bindingThursday 15 November 12

JEOS CREATION https://github.com/jedi4ever/veewee/ Centos, Ubuntu, Debian, Solaris, Gentoo, Suse, Oracle Linux, .... Just Enough Operating System + Conﬁg Management Tool And windows now too! Virtualbox , Fusion virtualization KVM, Parallels Your Laptop Linux & WindowsThursday 15 November 12

CREATING BASEBOX ‘EN MASS’ https://github.com/atkm/origami https://github.com/atkm/seisan-line uses #veewee https://github.com/opscode/bento https://github.com/opscode/test-kitchenThursday 15 November 12

SHARE YOUR SETUP http://www.vagrantbox.es/ http://vagrantﬁl.es/http://www.morethanseven.net/2011/05/08/Vagrant-plugin-for-interacting-with-vagrantboxes/http://www.nodescription.net/ideation-into-the-void-vagrant-plugin-for-vagThursday 15 November 12

UNIT TESTINGThursday 15 November 12

https://github.com/nistude/cucumber-puppetThursday 15 November 12

https://github.com/rodjek/rspec-puppet https://github.com/acrmp/chefspec https://github.com/calavera/rspec-chefThursday 15 November 12

DON’T TEST YOUR CONFIG MANAGEMENT TEST YOUR LOGIC NOT YES Was the If (OS=’X’ ) and (ﬁle package exists) ... installed did it give an error?Thursday 15 November 12

Thursday 15 November 12 FAKE THE FACTS

https://github.com/customink/fauxhaiThursday 15 November 12

CODE AUTO RUN EDIT FEEDBACK AUTO-TRIGGER TESTS RUN https://github.com/guard/guard-rspec https://github.com/johnbintz/guard-puppet https://github.com/alister/guard-puppet-lint https://github.com/guard/guard-chefThursday 15 November 12

LOCAL VM TESTING http://www.cucumber-chef.org/ EC2+LXC Faster testing via LXC spinning up a vm is expensive unless in container Vagrant+LXC https://github.com/exceedhl/toftThursday 15 November 12

CI INTEGRATIONThursday 15 November 12

Junit processor for Ruby https://github.com/nicksieger/ci_reporterThursday 15 November 12

SYNTAX CHECKS UNIT TESTS NO VM COMPILE CHECKS NEEDED SMOKE TESTS REAL VMThursday 15 November 12

STATE A STATE B Create VM CLEAN Code Run Code Run Tests VM Applied SNAPSHOT SMOKE TESTING (ON REAL MACHINE)Thursday 15 November 12

http://auxesis.github.com/cucumber-nagios/Thursday 15 November 12

RE-USABLE CUCUMBER STEPS http://www.cucumber-chef.org/ https://github.com/hedgehog/cuken https://github.com/cucumber/arubaThursday 15 November 12

Validate “inside” the provision-run cycle https://github.com/calavera/minitest-chef-handler https://github.com/jedi4ever/puppet-assertThursday 15 November 12

VM CREATION IS EXPENSIVE STATE A STATE B Create VM CLEAN Code Run Code Run Tests VM Applied SNAPSHOT ROLLBACK https://github.com/t9md/vagrant-snap https://github.com/jedi4ever/saharaThursday 15 November 12

https://github.com/rtyler/vagrant-pluginThursday 15 November 12

Uses vagrant & veewee https://travis-ci.org/Thursday 15 November 12

Windows https://github.com/tknerr/bills-kitchenThursday 15 November 12

TARGETED TESTING IMPACT OF CHANGE MODULEA Real VM testing ROLE1 is expensive MODULEB ROLE2 Only test what’s needed MODULEC ROLEN https://github.com/jonlives/knife-preﬂight MODULE... https://github.com/jedi4ever/puppet-cicThursday 15 November 12

PERFORMANCE/METRICSThursday 15 November 12

https://github.com/rodjek/puppet-proﬁlerThursday 15 November 12

execution time number of classes https://github.com/krux/puppet-module-graphite-report https://github.com/imeyer/chef-handler-graphite https://github.com/joemiller/puppet-graphite_eventThursday 15 November 12

Infrastructure as Code Patrick Debois http://www.tumblr.com/tagged/star-trek-quotesThursday 15 November 12

Thursday 15 November 12

THANK YOU!Thursday 15 November 12

QUESTIONS?Thursday 15 November 12

http://foodﬁghtshow.org/Thursday 15 November 12

http://wiki.opscode.com/display/chef/Whyrun+TestingThursday 15 November 12

https://github.com/lak/puppet-memcachedThursday 15 November 12

https://github.com/lak/puppet-static-compilerThursday 15 November 12

http://puppetlabs.com/blog/what-is-user-experience-in- puppet/Thursday 15 November 12

AUDITING http://www.fusioninventory.org/ http://www.normation.com/en/solutions/rudderThursday 15 November 12

http://comodit.github.com/synapse-agent/Thursday 15 November 12

http://saltstack.org/Thursday 15 November 12

https://github.com/tobami/littlechefThursday 15 November 12

https://github.com/dwt/vagrant-hostsThursday 15 November 12

https://github.com/opscode/omnibusThursday 15 November 12

https://github.com/puppetlabs/puppet-module-toolThursday 15 November 12

http://wiki.opscode.com/display/chef/Recipes#Recipes- ExceptionsandLoggingThursday 15 November 12

http://projects.puppetlabs.com/projects/puppet/wiki/ Anchor_PatternThursday 15 November 12

VENDORINGThursday 15 November 12

https://github.com/railsmachine/rumpThursday 15 November 12

http://www.example42.com/?q=Puppi_A_Puppet_module_for_Deployment_AutomationThursday 15 November 12

http://rundeck.org/Thursday 15 November 12

http://www.sonian.com/cloud-monitoring-sensu/Thursday 15 November 12

http://docs.puppetlabs.com/guides/parameterized_classes.htmlThursday 15 November 12

https://github.com/rerun/rerunThursday 15 November 12

AUTHENTICATIONThursday 15 November 12

DASHBOARDSThursday 15 November 12

http://puppetlabs.com/puppet/related-projects/dashboard/Thursday 15 November 12

http://blog.mornati.net/2012/01/29/kermit-a-webui-for- mcollective/Thursday 15 November 12

http://www.opscode.com/hosted-chef/Thursday 15 November 12

http://theforeman.org/Thursday 15 November 12

https://github.com/chapmanb/cloudbiolinuxThursday 15 November 12

https://github.com/aetherical/nimblestratusThursday 15 November 12

https://github.com/ﬁddyspence/puppet-mconotifyThursday 15 November 12

https://twitter.com	23
https://si0.twimg.com	2
https://web.tweetdeck.com	1

Code but now as we know it - Devoxx edition

by Patrick Debois on Nov 15, 2012

Accessibility

Categories

Upload Details

Usage Rights

3 Embeds 26

Statistics

Code but now as we know it - Devoxx edition Presentation Transcript