Streamlining Workflows with Puppet Faces

PUPPET FACES Streamlining Workﬂows Kelsey Hightower

AgendaFirst World ProblemsPuppet Faces Familiar Faces A New FaceCore ComponentsWhy?

puppet dashboard

Puppet DashboardVisualize Your Infrastructure: Status, Graphs, andReportsExternal Node Classiﬁer (ENC)

manage parameters,groups and classes

First World Problems

First World ProblemsOne key/value pair at a time

First World ProblemsOne key/value pair at a timeTime consuming

First World ProblemsOne key/value pair at a timeTime consumingManaging ENC data in dashboard could be better

First World Problems

First World ProblemsClick Chrome icon

First World ProblemsClick Chrome iconClick on PuppetDashboard bookmark

First World ProblemsClick Chrome iconClick on PuppetDashboard bookmarkClick on each system

First World ProblemsClick Chrome iconClick on PuppetDashboard bookmarkClick on each systemClick edit

First World ProblemsClick Chrome iconClick on PuppetDashboard bookmarkClick on each systemClick editClick add newparameter

First World ProblemsClick Chrome icon Click saveClick on PuppetDashboard bookmarkClick on each systemClick editClick add newparameter

First World ProblemsClick Chrome icon Click saveClick on Puppet Click on each groupDashboard bookmarkClick on each systemClick editClick add newparameter

First World ProblemsClick Chrome icon Click saveClick on Puppet Click on each groupDashboard bookmark Click editClick on each systemClick editClick add newparameter

First World ProblemsClick Chrome icon Click saveClick on Puppet Click on each groupDashboard bookmark Click editClick on each system Click some more.Click editClick add newparameter

Lots of clicking!!

Puppet?

parameters: node: - "el6.puppetize.me": "domain": "puppetize.me" group: - "webservers": "apache_version": "2.2.16"

puppet cool-subcommand import data.yaml

Puppet Faces

What are Puppet Faces?

What are Puppet Faces?API for extending existing Puppet functionality

What are Puppet Faces?API for extending existing Puppet functionalityAPI for creating Puppet subcommands andactions

Familiar Facescatalog mancertificate nodecertificate_request reportconfig resourcefacts statusfile

catalog

catalogpuppet catalog select puppet.testing.org package

catalogpuppet catalog select puppet.testing.org packagePackage[openssh-server]

catalogpuppet catalog select puppet.testing.org packagePackage[openssh-server]puppet catalog download

catalogpuppet catalog select puppet.testing.org packagePackage[openssh-server]puppet catalog downloadnotice: Saved catalog for puppet.testing.org to yaml

catalogpuppet catalog select puppet.testing.org packagePackage[openssh-server]puppet catalog downloadnotice: Saved catalog for puppet.testing.org to yamlpuppet catalog apply

catalogpuppet catalog select puppet.testing.org packagePackage[openssh-server]puppet catalog downloadnotice: Saved catalog for puppet.testing.org to yamlpuppet catalog applynotice: Finished catalog run in 0.39 seconds"#<Puppet::Transaction::Report:0x98eafcc>"

conﬁg

conﬁgpuppet config print server --mode agent

conﬁgpuppet config print server --mode agentpuppet.testing.org

conﬁgpuppet config print server --mode agentpuppet.testing.orgpuppet config print all --mode agent

conﬁgpuppet config print server --mode agentpuppet.testing.orgpuppet config print all --mode agentallow_duplicate_certs = falsearchive_file_server = puppet.testing.orgarchive_files = falseasync_storeconfigs = falseauthconfig = /etc/puppet/namespaceauth.confautoflush = falseautosign = /etc/puppet/autosign.confbindaddress = ""bucketdir = /var/lib/puppet/bucket...

certiﬁcate

certiﬁcatepuppet certificate find puppet.testing.org --ca-location=remote

certiﬁcatepuppet certificate find puppet.testing.org --ca-location=remote-----BEGIN CERTIFICATE-----MIIClzCCAgCgAwIBAgIBBjANBgkqhkiG9w0BAQUFADAoMSYwJAYDVQQDDB1QdXBwZXQgQ0E6IHB1cHBldC50ZXN0aW5nLm9yZzAeFw0xMTA5MDcxNzE1MjJaFw0xNjA5MDUxNzE1MjJaMB0xGzAZBgNVBAMMEnB1cHBldC50ZXN0aW5nLm9yZzCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEA0C8WqEYaZiYRGb0mY1LFSEp7M3NIpugcmhJ1eZ9gck0gEtYrk2FetOqBqwF45df3FDXUvHKovcNaJeJ05Gn0XFrAZ8Y7IQsboX993Dd3d+7yq0T4gK1myjnizzqPaa/cgJrAtc1caByoxe1fYL1SJKnm+/u9z6YOT4OI8UtfYskCAwEAAaOB2zCB2DA4BglghkgBhvhCAQ0EKxYpUHVwcGV0IFJ1YnkvT3BlblNTTCBHZW5lcmF0ZWQgQ2VydGlmaWNhdGUwDAYDVR0TAQH/BAIwADAdBgNVHQ4EFgQUaBiSUyQXKLtAj+cNlcEAsVwjRNkwCwYDVR0PBAQDAgWgMCcGA1UdJQQgMB4GCCsGAQUFBwMBBggrBgEFBQcDAgYIKwYBBQUHAwQwOQYDVR0RBDIwMIIGcHVwcGV0ghJwdXBwZXQudGVzdGluZy5vcmeCEnB1cHBldC50ZXN0aW5nLm9yZzANBgkqhkiG9w0BAQUFAAOBgQBgOYHKMehXRba77I0zOLmnZMh0Y0HvyuSX843e++pXrje/+fCBIqvVai7wCrElLB6pdLsFYVyeLkONGRB6eGGeHr9yRWwSVhEPPySdh2uRER3M530JxCG+tkz4BNtnGGQB+wI12p8EL47axxP/OiCMGCdS8Xi21+FIg2/dwQnsPA==-----END CERTIFICATE-----

resource

resourcepuppet resource package telnet ensure=present

resourcepuppet resource package telnet ensure=presentnotice: /Package[telnet]/ensure: created

resourcepuppet resource package telnet ensure=presentnotice: /Package[telnet]/ensure: createdpackage { telnet: ensure => 0.17-36,}

dashboard face

dashboard

dashboardQuery Puppet Dashboard

dashboardQuery Puppet DashboardImport/Export data

Programming Motherfu*ker

Project LayoutLICENSEREADMElib/puppet/application/dashboard.rblib/puppet/face/dashboard.rblib/puppet/face/dashboard/*.rb

Core Componentsapplicationoptionsargumentsactions

Only limited by your imagination.

Dragon FaceOnly limited by your imagination.

puppet dashboard import data.yaml

puppet dashboard import data.yaml application

Applicationcopyrightlicensesummarydescriptionshort_descriptionaction

Application Classdashboard-puppet-face/lib/puppet/application/dashboard.rbrequire puppet/facerequire puppet/application/face_baseclass Puppet::Application::Dashboard < Puppet::Application::FaceBaseend

Application Classdashboard-puppet-face/lib/puppet/application/dashboard.rbrequire puppet/facerequire puppet/application/face_baseclass Puppet::Application::Dashboard < Puppet::Application::FaceBaseend inherit FaceBase

Applicationpuppet-dashboard-face/lib/puppet/face/dashboard.rbrequire puppetrequire puppet/facePuppet::Face.define(:dashboard, 0.0.1) do summary "Puppet Dashboard Integration" copyright "Kelsey Hightower", 2011 license "Apache 2 license" description "Puppet Dashboard Integration"end

Applicationpuppet-dashboard-face/lib/puppet/face/dashboard.rbrequire puppet subcommandrequire puppet/facePuppet::Face.define(:dashboard, 0.0.1) do summary "Puppet Dashboard Integration" copyright "Kelsey Hightower", 2011 license "Apache 2 license" description "Puppet Dashboard Integration"end

Applicationpuppet-dashboard-face/lib/puppet/face/dashboard.rbrequire puppetrequire puppet/facePuppet::Face.define(:dashboard, 0.0.1) do summary "Puppet Dashboard Integration" copyright "Kelsey Hightower", version api 2011 license "Apache 2 license" description "Puppet Dashboard Integration"end

puppet dashboard import data.yaml--adapter=mysql --host=127.0.0.1

puppet dashboard import data.yaml--adapter=mysql --host=127.0.0.1 options

Optionsadapterusernamepasswordhostdatabase

Optionspuppet-dashboard-face/lib/puppet/face/dashboard.rbrequire puppetrequire puppet/facePuppet::Face.define(:dashboard, 0.0.1) do ... option "--adapter ADAPTER" do summary "Active Record database adapter" description <<-EOT The adapter for to use when accessing the Puppet Dashboard database. EOT end ...end

Optionspuppet-dashboard-face/lib/puppet/face/dashboard.rbrequire puppetrequire puppet/face deﬁne optionsPuppet::Face.define(:dashboard, 0.0.1) do ... option "--adapter ADAPTER" do summary "Active Record database adapter" description <<-EOT The adapter for to use when accessing the Puppet Dashboard database. EOT end ...end

puppet dashboard import data.yaml arguments

ArgumentsFaces can accept positional arguments

Argumentspuppet-dashboard-face/lib/puppet/face/dashboard/import.rbPuppet::Face.define(:dashboard, 0.0.1) do action :import do summary "Import ENC paramters" arguments "<data>" description <<-EOT Bulk import external nodes configuration data into dashboard EOT endend

puppet dashboard import data.yaml action

Actionssummary when_invokedarguments when_renderingreturnsdescriptionnotesexamples

Actionspuppet-dashboard-face/lib/puppet/face/dashboard/import.rbPuppet::Face.define(:dashboard, 0.0.1) do action :import do summary "Import ENC paramters" arguments "<data>" description <<-EOT Bulk import external nodes configuration data into dashboard EOT when_invoked do |data, options| ... end endend

Actionspuppet-dashboard-face/lib/puppet/face/dashboard/import.rbPuppet::Face.define(:dashboard, 0.0.1) do action :import do summary "Import ENC paramters" Action arguments "<data>" description <<-EOT Bulk import external nodes configuration data into dashboard EOT when_invoked do |data, options| ... end endend

Actionspuppet-dashboard-face/lib/puppet/face/dashboard/import.rbPuppet::Face.define(:dashboard, 0.0.1) do action :import do summary "Import ENC paramters" arguments "<data>" description <<-EOT Bulk import external nodes configuration data into dashboard EOT when_invoked do |data, options| ... end endend This is where the works gets done.

Almost ready tosolve this problem.

Deploying our Face

Deployment

Deploymentrsync -av puppet-dashboard-face/lib/puppet/ /opt/ruby/lib/ruby/gems/1.8/gems/puppet-2.7.3/lib/puppet/

Deploymentrsync -av puppet-dashboard-face/lib/puppet/ /opt/ruby/lib/ruby/gems/1.8/gems/puppet-2.7.3/lib/puppet/sending incremental file list./application/application/dashboard.rbface/face/dashboard.rbface/dashboard/face/dashboard/import.rbface/dashboard/list.rbface/dashboard/models.rbface/dashboard/report.rbface/dashboard/search.rbsent 9069 bytes received 160 bytes 18458.00 bytes/sectotal size is 8546 speedup is 0.93

Deployment

Deploymentpuppet help

Deploymentpuppet helpUsage: puppet <subcommand> [options] <action> [options]Available subcommands, from Puppet Faces: catalog Compile, save, view, and convert catalogs. facts Retrieve and store facts. help Display Puppet help. dashboard Puppet Dashboard Integration. man Display Puppet manual pages. node View and manage node definitions. parser Interact directly with the parser.

Helppuppet help dashboard

Helppuppet help dashboardUSAGE: puppet dashboard <action> [--host HOST] ...Interact with Puppet DashboardOPTIONS: ... --adapter ADAPTER - Active Record Database Adapter --host HOST - Database HostnameACTIONS: import Import data into Puppet Dashboard.See puppet man dashboard or man puppet-dashboard for fullhelp.

Read The Face Manual

Read The Face Manualpuppet man dashboard

Read The Face Manualpuppet man dashboardPUPPET-DASHBOARD(8) Puppet Manual PUPPET-DASHBOARD(8)NAME puppet-dashboard - Interact with Puppet DashboardSYNOPSIS puppet dashboard action [--adapter ADAPTER] [--database DATBASE] [--username USER] [--password PASSWORD] [--host HOST]OPTIONS Note that any configuration parameter thats valid in the configuration file is also a valid long argument, although it may or may not be rele- vant to the present action. For example, server is a valid configuration parameter, so you can specify --server <servername> as an argument.

Putting it all together

parameters: node: - "master.lab.org": "domain": "puppetize.me" group: - "webservers": "apache_version": "2.2.16"

Problem solved!

Better for theenvironment

75% less batteries

Why Puppet Faces?

Consolidation

Consolidation/usr/sbin/dashboard_importer

Consolidation/usr/sbin/dashboard_importer/usr/sbin/dashboard_importer.bak

Consolidation/usr/sbin/dashboard_importer/usr/sbin/dashboard_importer.bak/usr/sbin/dashboardImporter

Consolidation/usr/sbin/dashboard_importer/usr/sbin/dashboard_importer.bak/usr/sbin/dashboardImporter/usr/sbin/dashboard_importer.new

Consolidation/usr/sbin/dashboard_importer/usr/sbin/dashboard_importer.bak/usr/sbin/dashboardImporter/usr/sbin/dashboard_importer.newpuppet dashboard importer

Free Documentationpuppet man dashboardpuppet help dashboard

Free Ruby API

Free Ruby APIirb

Free Ruby APIirbirb> require rubygems

Free Ruby APIirbirb> require rubygemsirb> require puppet/face

Free Ruby APIirbirb> require rubygemsirb> require puppet/faceirb> arguments = /tmp/data.yaml

Free Ruby APIirbirb> require rubygemsirb> require puppet/faceirb> arguments = /tmp/data.yamlirb> options = {:adapter => mysql, :password => ..

Free Ruby APIirbirb> require rubygemsirb> require puppet/faceirb> arguments = /tmp/data.yamlirb> options = {:adapter => mysql, :password => ..irb> dashboard = Puppet::Face[:dashboard,0.0.1]

Free Ruby APIirbirb> require rubygemsirb> require puppet/faceirb> arguments = /tmp/data.yamlirb> options = {:adapter => mysql, :password => ..irb> dashboard = Puppet::Face[:dashboard,0.0.1]irb> dashboard.import(arguments, options)

Free Ruby APIirbirb> require rubygemsirb> require puppet/faceirb> arguments = /tmp/data.yamlirb> options = {:adapter => mysql, :password => ..irb> dashboard = Puppet::Face[:dashboard,0.0.1]irb> dashboard.import(arguments, options)puppet dashboard import /tmp/data.yaml --adapter=mysql ...

Good Investment

The FutureReference custom parameters from puppet.confExpose Faces to external REST API

khightower/puppet-dashboard-face github

@kelseyhightower twitter

puppetize.me web

Questions?

http://paper.li	46
http://www.hanrss.com	6
http://twitter.com	3
http://puppetize.me	2
http://us-w1.rockmelt.com	1

Streamlining Workflows with Puppet Faces

by Kelsey Hightower on Sep 25, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

5 Embeds 58

Statistics

Streamlining Workflows with Puppet Faces — Presentation Transcript