Talk I give about a project where we automated an environment using packer, jenkins, vagrant and openstack. 24 october 2017 - Prague Devops Meetup

1. Packer openstack
Jan Collijs
@visibilityspots

2. Jan CollijsJan Collijs
● Linux & Open-Source enthousiastLinux & Open-Source enthousiast
● Made my hobby my profession 5 years agoMade my hobby my profession 5 years ago
@inuits@inuits
● Want to drink cocktails at the beach whileWant to drink cocktails at the beach while
everything is automatedeverything is automated

3. Use caseUse case
● Automated test suite using some CPE/CSAutomated test suite using some CPE/CS
(centos) devices(centos) devices
● Used to be a serverpark maintained by puppetUsed to be a serverpark maintained by puppet
● Want a more flexible way of using resourcesWant a more flexible way of using resources
● ReproducibleReproducible
● FastFast

4. Private cloud solutionPrivate cloud solution

5. ● RDORDO
● https://www.rdoproject.orghttps://www.rdoproject.org
● packstackpackstack

6. VagrantVagrant
● Development Environments Made EasyDevelopment Environments Made Easy
● Local environment based on puppetLocal environment based on puppet
● Using vagrant-lxc containers or virtualboxUsing vagrant-lxc containers or virtualbox
– https://github.com/visibilityspots/vagrant-puppethttps://github.com/visibilityspots/vagrant-puppet
● ServerspecServerspec
– http://serverspec.orghttp://serverspec.org
– With Serverspec, you can write RSpec testsWith Serverspec, you can write RSpec tests
for checking your servers are configuredfor checking your servers are configured
correctly.correctly.

7. VagrantfileVagrantfileVAGRANTFILE_API_VERSION = "2"
Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
config.vm.provision "shell", inline: "true"
config.vm.provider :virtualbox do |virtualbox, override|
override.vm.box = "vStone/centos-6.x-puppet.3.x"
end
config.vm.provider :lxc do |lxc, override|
override.vm.box = "visibilityspots/centos-6.x-puppet-3.x"
end
config.vm.define :cpe do |cpe|
cpe.vm.host_name = "cpe"
cpe.vm.synced_folder "hieradata", "/etc/hiera"
ext_env = ENV['VAGRANT_PUPPET_ENV']
ext_env = 'development'
env = ext_env ? ext_env : config_env
cpe.vm.synced_folder "puppet/environments/#{env}/modules", "/etc/puppet/environments/#{env}/modules"
cpe.vm.synced_folder "spec/", "/tmp/tests"
cpe.vm.provision :puppet do |puppet|
puppet.options = "--environment #{env}"
puppet.hiera_config_path = "hieradata/hiera.yaml"
puppet.manifests_path = "puppet/environments/#{env}/manifests"
puppet.manifest_file = ""
puppet.module_path = "puppet/environments/#{env}/modules"
end
end
end

8. require 'vagrant-openstack-provider'
VAGRANTFILE_API_VERSION = "2"
Vagrant.configure(VAGRANTFILE_API_VERSION) do |config|
config.vm.provision "shell", inline: "true"
if Vagrant.has_plugin?("vagrant-cachier")
config.cache.scope = :box
end
config.vm.provider :virtualbox do |virtualbox, override|
override.vm.box = "vStone/centos-6.x-puppet.3.x"
end
config.vm.provider :lxc do |lxc, override|
override.vm.box = "visibilityspots/centos-6.x-puppet-3.x"
end
config.vm.provider :openstack do|os, override|
override.nfs.functional = false
override.ssh.pty = true
override.ssh.username = "root"
os.flavor = "m1.small"
os.image = "centos-base-image"
os.availability_zone = "default"
os.security_groups = ['default']
os.openstack_auth_url = "http://#.#.#.#/v2.0/tokens"
os.tenant_name = "tenant"
os.keypair_name = "tenant"
os.username = "centos"
os.password = "password"
override.ssh.private_key_path = "/path/to/ssh/key"
os.networks = [
'net-tenant',
]
end
config.vm.define :cpe do |cpe|
cpe.vm.host_name = "cpe"
cpe.vm.synced_folder "hieradata", "/etc/hiera"
ext_env = ENV['VAGRANT_PUPPET_ENV']
ext_env = 'development'
env = ext_env ? ext_env : config_env
cpe.vm.synced_folder "puppet/environments/#{env}/modules", "/etc/puppet/environments/#{env}/modules"
cpe.vm.synced_folder "spec/", "/tmp/tests"
cpe.vm.provision :puppet do |puppet|
puppet.options = "--environment #{env}"
puppet.hiera_config_path = "hieradata/hiera.yaml"
puppet.manifests_path = "puppet/environments/#{env}/manifests"
puppet.manifest_file = ""
puppet.module_path = "puppet/environments/#{env}/modules"
end
end
end

9. Packer.ioPacker.io
● Build Automated Machine ImagesBuild Automated Machine Images
● Using puppetUsing puppet
● Based on a centos minimal with kickstart in initialBased on a centos minimal with kickstart in initial
phasephase
● ServerspecServerspec
– With Serverspec, you can write RSpec testsWith Serverspec, you can write RSpec tests
for checking your servers are configuredfor checking your servers are configured
correctly.correctly.
● Based on a centos cloud based imageBased on a centos cloud based image
– https://wiki.centos.org/Cloudhttps://wiki.centos.org/Cloud

10. PackerfilePackerfile
{
"provisioners": [
{
"type": "file",
"source": "hieradata",
"destination": "/tmp"
},
{
"type": "file",
"source": "tests",
"destination": "/tmp"
},
{
"type": "shell",
"execute_command": "echo 'packer' | {{.Vars}} sudo -S -E bash '{{.Path}}'",
"scripts": [
"scripts/installrepos.sh",
"scripts/initialize.sh",
"scripts/installrvm.sh",
"scripts/installserverspec.sh"
]
},
{
"type": "puppet-masterless",
"manifest_file": "puppet/environments/production/manifests/",
"hiera_config_path": "hieradata/hiera.yaml",
"module_paths": "puppet/environments/production/modules/"
},
{
"type": "shell",
"execute_command": "echo 'packer' | {{.Vars}} sudo -S -E bash '{{.Path}}'",
"scripts": [
"scripts/serverspec.sh",
"scripts/cleanup.sh",
"scripts/zerodisk.sh"
]
}
],
"builders": [
{
"availability_zone": "nova",
"type": "openstack",
"ssh_username": "username",
"tenant_name": "tenant",
"region": "RegionOne",
"image_name": "cpe",
"source_image": "####",
"flavor": "cpe.tiny",
"networks": ["####"],
"ssh_pty" : true
}
]
}

11. JenkinsJenkins
● The leading open source automation server,The leading open source automation server,
Jenkins provides hundreds of plugins to supportJenkins provides hundreds of plugins to support
building, deploying and automating any project.building, deploying and automating any project.
● https://jenkins.iohttps://jenkins.io

12. Jenkins jobJenkins job
● One repository containing the vagrantfile andOne repository containing the vagrantfile and
packer filepacker file
● Git/SVN commit hookGit/SVN commit hook
● Checkout by jenkinsCheckout by jenkins
● Shell script to execute packer provisioned onShell script to execute packer provisioned on
openstackopenstack
● Openstack image will be pushed to the cloud byOpenstack image will be pushed to the cloud by
packer automaticallypacker automatically

13. ContactContact
Jan Collijs jan.collijs@inuits.euJan Collijs jan.collijs@inuits.eu
Further ReadingFurther Reading
@visibilityspots@visibilityspots
https://visibilityspots.orghttps://visibilityspots.org
https://inuits.euhttps://inuits.eu
InuitsInuits
Essensteenweg 31Essensteenweg 31
BrasschaatBrasschaat
BelgiumBelgium
891.514.231891.514.231
+32 479 586488+32 479 586488