DevOps as a buzzword has had a lot of attention recently. This presentation is my take on the origins and essence of the matter, as well as an introduction to how Chef, the open source configuration management software, can help to solve one of the problems an Operations team faces as it moves towards the DevOps goals.

1. DevOps
&
Chef
Friday 16 March 12

2. DevOps
Friday 16 March 12

3. Devs vs Ops
Friday 16 March 12

4. Devs vs Ops
Friday 16 March 12

5. Devs vs Ops
The Wall Of Confusion
Friday 16 March 12

6. Change
vs
Stability
Friday 16 March 12

7. A Meeting of Minds
Follow code into
the wild
Accept change:
become agile
Friday 16 March 12

8. Buzzword: DevOps
Friday 16 March 12

9. Buzzword: DevOps Buzzword
Buzzword Buzzword
Buzzword Buzzword
Buzzword
Buzzword
Buzzword
Friday 16 March 12

10. Buzzword: DevOps Buzzword
Buzzword Buzzword
Buzz Lightyear Buzzword
Buzzword Buzzword
Buzzword Buzzword
Buzzword Buzzword
Buzzword Buzzword
Buzzword Buzzword
Friday 16 March 12

11. Buzzword
DevOps
Buzzword: Buzzword
Buzzword Buzzword Buzzword Buzzword
Buzzword Buzzword Lightyear Buzzword
Buzz
Buzzword
Buzzword Buzzword
Buzzword
Buzzword
Buzzword
Buzzword Buzzword
Buzzword Buzzword
Buzzword Buzzword Buzzword
Buzz Aldrin
Buzzword
Buzzword Buzzword
Friday 16 March 12

12. What is DevOps?
Friday 16 March 12

13. What is DevOps?
What is DevOps NOT?
Friday 16 March 12

14. What is DevOps?
They are making a play for our jobs
What is DevOps NOT?
Friday 16 March 12

15. Devs want root
What is DevOps?
They are making a play for our jobs
What is DevOps NOT?
Friday 16 March 12

16. DevOps is not a job title, it’s a philosophy
Devs want root
What is DevOps?
They are making a play for our jobs
What is DevOps NOT?
Friday 16 March 12

17. DevOps is not a job title, it’s a philosophy
Devs want root
What is DevOps?
They are making a play for our jobs
What is DevOps NOT?
So many words
Friday 16 March 12

18. DevOps, for me
Friday 16 March 12

19. DevOps, for me:
Testing
Friday 16 March 12

20. DevOps, for me:
Testing
Monitoring
Friday 16 March 12

21. DevOps, for me:
Testing
Monitoring
Automation
Friday 16 March 12

22. DevOps, for me:
Testing
Monitoring
Automation
Friday 16 March 12

23. DevOps, for me:
Testing Don’t release broken things
Monitoring Know when things break
Automation Replace/fix broken things instantly
Friday 16 March 12

24. ✔ ?
Friday 16 March 12

25. SCCS:
Source Code Control System
Friday 16 March 12

26. SCCS:
Source Code Control System
1972
40 Years Ago!
Friday 16 March 12

27. Revision Control
✔
Friday 16 March 12

28. Revision Control
Test Driven Development
✔
Friday 16 March 12

29. Revision Control
Test Driven Development
Feature Branches
✔
Friday 16 March 12

30. Revision Control
Test Driven Development
Feature Branches
Continuous Integration
✔
Friday 16 March 12

31. Revision Control
Test Driven Development
Feature Branches
Continuous Integration
Staging Environments
✔
Friday 16 March 12

32. Revision Control
Test Driven Development
Feature Branches
Continuous Integration
Staging Environments AGILE
✔
Friday 16 March 12

33. AGILE
Friday 16 March 12

34. AGILE OPS
?
Friday 16 March 12

35. AGILE OPS
Continuous Deployment ?
Feature Flags Dark Launches
Automated Recovery
IMVU - 50+ Flickr - 10+
Etsy - 25
Friday 16 March 12

36. Instant Feedback
Rollbacks
Confidence
No fear of change
Friday 16 March 12

37. Code Infrastructure
Friday 16 March 12

38. Infrastructure Code
Friday 16 March 12

39. Infrastructure As Code
Friday 16 March 12

40. $ ssh root@web1
Last login: Tue Mar 13
# apt-­‐get install apache2
...
# vim /etc/apache2/sites-­‐enabled/default.conf
...
# /etc/init.d/apache2 restart
...
# scp web2:/root/.ssh/authorized_keys ~/.ssh
Friday 16 March 12

41. Chef
Friday 16 March 12

42. SERVER
chef-client on node
use knife to push retrieves
config to server configuration
from server
use knife to query and
CLIENT CLIENT
ssh to clients
(workstation) (server/node)
Friday 16 March 12

43. Chef/nodes/web1.json
Friday 16 March 12

44. {
"access" : [ "developers", "designers" ],
"name": "web1",
"run_list": [ "role[base]", "role[web]",
"recipe[splunk]" ]
}
Friday 16 March 12

45. {
"access" : [ "developers", "designers" ],
"name": "web1",
"run_list": [ "role[base]", "role[web]",
"recipe[splunk]" ]
}
Friday 16 March 12

46. Chef/nodes/web1.json
Chef/roles/web.rb
Friday 16 March 12

47. run_list("recipe[apache]",
"role[monitoring]")
Friday 16 March 12

48. run_list("recipe[apache]",
"role[monitoring]")
Friday 16 March 12

49. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
Friday 16 March 12

50. package "apache2" do
action :install
end
Friday 16 March 12

51. apache_modules = ['wsgi', 'ssl',
'auth_tkt', 'proxy_http',
'headers', 'rewrite', 'status']
apache_modules.each do |mod|
apache_module mod do
enable true
notifies :restart,
"service[apache2]"
end
end
Friday 16 March 12

52. apache_modules = ['wsgi', 'ssl',
'auth_tkt', 'proxy_http',
'headers', 'rewrite', 'status']
apache_modules.each do |mod|
apache_module mod do
enable true
notifies :restart,
"service[apache2]"
end
end
Friday 16 March 12

53. package "apache2" do
case node[:platform]
when "centos","redhat","fedora","suse"
package_name "httpd"
when "debian","ubuntu"
package_name "apache2-mpm-prefork"
end
action :install
end
Friday 16 March 12

54. package "apache2" do
case node[:platform]
when "centos","redhat","fedora","suse"
package_name "httpd"
when "debian","ubuntu"
package_name "apache2-mpm-prefork"
end
action :install
end
Friday 16 March 12

55. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
Friday 16 March 12

56. default[:apache][:version] = "2.2"
Friday 16 March 12

57. package "apache2" do
action :install
version "#{node[:apache][:version]}"
end
Friday 16 March 12

58. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
templates/default/apache2.conf.erb
Friday 16 March 12

59. template "#{node[:apache][:dir]}/apache2.conf" do
source "apache2.conf.erb"
owner "root"
mode 0644
notifies :restart, resources(:service =>
"apache2")
end
Friday 16 March 12

60. It’s all Ruby
Friday 16 March 12

61. It’s all Ruby
http://wiki.opscode.com/display/chef/Just+Enough+Ruby+for+Chef
“Just Enough Ruby for Chef”
Friday 16 March 12

62. It’s all Ruby
Let’s hack
Friday 16 March 12

63. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
templates/default/apache2.conf.erb
libraries/default.rb
Friday 16 March 12

64. class Chef
class Recipe
def apache_ports(&block)
@node[:apache][:vhosts].each do |vh|
vh[:ports].each do |p|
block.call(p)
end
end
end
end
end
Friday 16 March 12

65. apache_ports do |p|
firewall_port p do
action :open
end
end
Friday 16 March 12

66. apache_ports do |p|
firewall_port p do
action :open
end
end
Friday 16 March 12

67. define :firewall_port, :action => :open do
if not params.has_key?(:port)
params[:port] = params[:name]
end
if params[:action] == :open
execute "open #{params[:port]}" do
command "iptables -A INPUT --destination-port
#{params[:port]} -j ACCEPT"
end
else
execute "close #{params[:port]}" do
command "iptables -A INPUT --destination-port
#{params[:port]} -j DROP"
end
end
end
Friday 16 March 12

68. Providers
package "apache2" do
action :install
end apt-get install
yum install
node[:platform]
brew install
Friday 16 March 12

69. "#{File.expand_path(
Chef::Config[:file_cache_path]
)}/handlers/yola.rb"
Friday 16 March 12

70. "#{File.expand_path(
Chef::Config[:file_cache_path]
)}/handlers/yola.rb"
class YolaHandler < Chef::Handler
def report()
run_status.updated_resources.each do |r|
campfire_speak(r.to_s)
end
end
end
Friday 16 March 12

71. "#{File.expand_path(
Chef::Config[:file_cache_path]
)}/handlers/yola.rb"
class YolaHandler < Chef::Handler
def report()
run_status.updated_resources.each do |r|
campfire_speak(r.to_s)
end
end
end
Friday 16 March 12

72. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
templates/default/apache2.conf.erb
libraries/default.rb
Chef/environments/production.rb
Friday 16 March 12

73. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
templates/default/apache2.conf.erb
libraries/default.rb
Chef/environments/production.rb
Chef/environments/testing.rb
Friday 16 March 12

74. default_attributes({
"aws_region" => "usa-east"
})
default_attributes({
"aws_region" => "usa-east",
"logging" => {
"debug" => true
}
})
Friday 16 March 12

75. Chef/nodes/web1.json
Chef/roles/web.rb
Chef/cookbooks/apache/
recipes/default.rb
attributes/default.rb
templates/default/apache2.conf.erb
libraries/default.rb
Chef/environments/production.rb
Chef/environments/testing.rb
Chef/data_bags/employees/jonathan.json
Friday 16 March 12

76. {
"name": "Jonathan Hitchcock",
"id": "jonathan",
"groups": ["developers", "operations"],
"ssh_keys": [
{ "key":
"AAAB3NzC1yc2EAAAABIwAAAQEA3advEyDE0aEo=="
}
]
}
Friday 16 March 12

77. Provisioning
Friday 16 March 12

78. Provisioning
$ knife ec2 server create -r 'role[webserver]'
-I ami-7000f019 -f m1.small
Friday 16 March 12

79. Provisioning
$ knife ec2 server create -r 'role[webserver]'
-I ami-7000f019 -f m1.small
Amazon EC2 Openstack
Rackspace Cloud libvirt
Eucalyptus
KVM Kickstart
XEN Vagrant
Friday 16 March 12

80. Integration
configuration data vs configuration logic
Friday 16 March 12

81. Integration
configuration vs configuration logic
data
Friday 16 March 12

82. Integration
configuration vs configuration logic
data
Ohai Collects infrastructure data
Stored and indexed in NoSQL
Search and use
Friday 16 March 12

83. (A side note on) Attributes
default
normal
override
automatic
Friday 16 March 12

84. (A side note on) Attributes
default cookbooks, data bags
normal node definitions
override for special cases
automatic ohai
Friday 16 March 12

85. (Back to) Integration
search(:node, 'role:webbackend') do |wb|
haproxy_backend "#{wb[:apache][:port]}" do
action :create
end
end
Systems auto-discover each other
Configuration is responsive to changes
Friday 16 March 12

86. Integration
search(:node, 'role:webbackend') do |wb|
haproxy_backend "#{wb[:apache][:port]}" do
action :create
end
end
Systems auto-discover each other
Configuration is responsive to changes
So you don’t have to be!
Friday 16 March 12

87. Jonathan Hitchcock
@vhata
github.com/vhata
Friday 16 March 12