Moonshine: Configuration Management and Deployment

Rails Machine

Thursday, January 15, 2009

The State of Rails
Application Deployment


It’s easy, I’ll just use
Capistrano.


ssh m
e@myn
e wserv
er.co
m

Capistrano.


ssh m
e@myn
e wserv
er.co
m

Capistrano.
apt
‐ge
t in
lib stal
mag l l
ick ibm
9‐d agi
ck1
ev
0

ssh m
e@myn
e wserv
er.co
m
ick
ag
rm
l
al
nst
i
em
g

Capistrano.
apt
‐ge
t in
lib stal
mag l l
ick ibm
9‐d agi
ck1
ev
0

l‐
ssh m ysq
e@myn m by
all ‐ru
ewser
st ql
ver.c in ys ev
t bm
om
5‐d
ge li
t‐ r t1
p en
k a rve
cli
gic se ysql
ma
l r bm
l li
ta
ins
m
e
g

Capistrano.
apt
‐ge
t in
lib stal
mag l l
ick ibm
9‐d agi
ck1
ev
0

l‐
ssh m ysq
e@myn m by
all ‐ru
ewser
st ql
ver.c in ys ev
t bm
om
5‐d
ge li
t‐ r t1
p en
k a rve
cli
gic se ysql
ma
l r bm
l li
ta
ins
m
e
g

Capistrano. /my.cnf
apt
‐ge
etc
t in /
vi
sta
lib
mag ll l
ick ibm
9‐d agi
ck1
ev
0


l‐
ssh m ysq
e@myn m by
all ‐ru
ewser
st ql
ver.c in ys ev
t bm
om
5‐d
ge li
t‐ r t1
p en
k a rve
cli
gic se ysql
ma
l r bm
l li
ta
ins
m
e
g

Capistrano. /my.cnf
apt
‐ge
etc
t in /
vi
sta
lib
mag ll l /etc/
init.
ibm
ick d/mys
9‐d agi ql st
art
ck1
ev
0


UR SHIPMENT OF FAIL HAS ARRIVED

What is
deployment?


A Series of
Dependencies
• Rails v2.2.2, v1.2.3, etc
• Ruby/Ruby Enterprise
• Apache/Nginx
• Passenger/Thin/Mongrel
• MySQL/PostgreSQL
• system user

A Series of
Dependencies
• rmagick
• libmagick10 libmagick9-dev
• thinking-sphinx
• compile by hand
• memcached
• libmemcached, rubygem, service

Satisfying these dependencies via
shell commands is backwards


• impossible to verify
• not revisioned
• no ‘migrations’
• not DRY
• not testable


Not “The Rails Way”


script/plugin install moonshine_rails*
script/generate moonshine


Moonshine::Manifest

#config/moonshine/default.rb
class Moonshine::Manifest::Rails::Production < Moonshine::Manifest::Rails
  #packages(%w(vim curl))

  #service('memcached', %w(memcache libmemcached))

  #puppet.exec 'foo',
  #  :command => quot;echo 'normal puppet stuff' > /tmp/testquot;
end


Opinionated Software

Opinionated Deployment

Decisions We’ve
Made For You
• Ubuntu

• Apache

• Passenger

• Ruby Enterprise Edition

• MySQL

• ‘rails’ user

• /srv/rails


Look at all the choices
I’m not making
class Moonshine::Manifest::Rails < Moonshine::Manifest
  requires [
    :user,
    :ruby,
    :rubygems,
    :db,
    :web,
    :rails,
    :deploy
  ]
  provides :user, 'rails'
  provides :ruby, 'enterprise_ruby'
  provides :rubygems, 'enterprise_rubygems'
  provides :db, 'mysql'
  provides :web, 'apache2'
  provides :rails, 'passenger'
  provides :deploy, 'git'
end


On your server...


sudo apt‐get install moonshine*
sudo moonshine


Answer some questions
• application name
• git repo
• branch to deploy from
• user to create
• generates SSH key for git host
• server ‘tags’

Moonshine goes to
work
• clones your repo
• parses and executes generated moonshine
manifests
• installs needed gems
• install dependencies
• migrates your db
• deploys your app

Gem Dependencies
gem_dependencies do |gem|

  #lots of dependencies are specified for you already
  #gem.packages 'mysql', %w(mysql‐dev libmysqlclient5‐dev)
  #gem.packages 'rmagick', %w(ruby‐dev libmagick9‐dev)
  #...

  #can specify a mini‐manifest to satisfy before
  #installation of this gem
  gem.custom 'urgem' do |puppet|
    puppet.file '/file/needed/by/ur/gem',
      :ensure   => 'present',
      :content  => 'foo'

    build_tarball('http://whatever.com/lib‐something.tgz')
  end

end


#need to deploy again?
sudo moonshine


On subsequent runs
• updates your repo
• parses and executes updated moonshine
manifests
• veriﬁes needed gems
• veriﬁes dependencies
• migrates your db
• deploys your app

Deployment is now...
• Reproducible
• Veriﬁed from top-bottom on each deploy
• Versionable with your application
• same commit can contain, for example,
thinking sphinx and installation of the
sphinx searchd daemon
• DRY

Puppet Based
class MysqlMain < Moonshine::Manifest
  puppet.file '/etc/my.cnf',
    :content => quot;quot;quot;
[client]
port      = 3306
socket    = /var/run/mysqld/mysqld.sock
[mysqld]
default‐character‐set = utf8
key_buffer            = 16M
max_allowed_packet    = 16M
thread_stack          = 128K
thread_cache_size     = 8
quot;quot;quot;
end


But Ruby

class MysqlMain < Moonshine::Manifest
  puppet.file '/etc/my.cnf',
    :content  => ArbitraryKlass.arbitrary_function('foo')
end


Modular
UrClass < Moonshine::Manifest::Rails < Moonshine::Manifest

• easy to create your own reusable
server manifests

• extend existing ones with modules


Sample ‘plugin’
module MoonshineOrderedPackages
  def packages(array_or_name, params = {})
    package_array = array_or_name.to_a
    params = {
      :ensure => 'installed'
    }.merge(params)

    package_array.each_with_index do |name,index|
      #ensure packages are installed in order given
      package_params = params
      if package_array[index+1]
        package_params.merge({
          :before => package(package_array[index+1])
        })
      end
      puppet.package name.to_s, package_params
    end
  end
end

Moonshine::Manifest::Rails.send(:extend, MoonshineOrderedPackages)


Coming Soon

• screencast demo (blog.railsmachine.com)
• source on GitHub


Questions?


Jesse Newland

jesse@railsmachine.com


Flickr FTW

• http://www.flickr.com/photos/wolfgangstaudt/2279651479/sizes/o/

• http://www.flickr.com/photos/ramdac/373881476/sizes/o/

• http://www.flickr.com/photos/striatic/2192189572/sizes/o/

• http://www.flickr.com/photos/blakespot/2376243022/sizes/o

• http://www.flickr.com/photos/gravestone/449328990/sizes/l/

• http://www.flickr.com/photos/redglow/410800461/sizes/o/


Moonshine: Configuration Management and Deployment

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (20)

Recently uploaded

Recently uploaded (20)

Moonshine: Configuration Management and Deployment