OpenNebula
and
SaltStack
Valentin Bud
CEO
databus.pro | valentin@databus.pro | @databuspro
OpenNebulaConf
Berlin, Germany,...
SaltStack
About
• The name is the vision
• A different approach to infrastructure
management
• Transparent control system
...
SaltStack
Standing on the Shoulders of the Giants
• Python
• 0MQ
• MessagePack
• M2Crypto
#OpenNebulaConfValentin Bud | @v...
SaltStack
Architecture
...
0MQ
MASTER(S)
minion
minion
minion
#OpenNebulaConfValentin Bud | @valentinbud
SaltStack
The Remote Execution Engine
root@salt ~ # salt ‘*’ test.ping
nfs:
True
salt:
True
node01:
True
salt nfs
test.pin...
SaltStack
Meet your minions - Grains
root@salt ~ # salt ‘nfs’ grains.items
nfs:
...
kernel: Linux
kernelrelease: 2.6.32-35...
SaltStack
Grains - Tag your minions
root@salt ~ # salt ‘salt’ grains.setval role opennebula-frontend
salt:
role: opennebul...
SaltStack
Target your Minions
GLOBBING
root@salt ~ # salt -G 'web*' test.ping
REGULAR EXPRESSIONS
root@salt ~ # salt -E 'w...
OpenNebula and SaltStack
OpenNebulaConf Demo Cloud
salt
frontend
node01
salt
nfs
Services Network
private
virtual
machine
...
SaltStack
The State System
• The Configuration Management
component
• Already available with a basic setup
• Powerful, fas...
opennebula-server State
Install the OpenNebula Server
opennebula-server/init.sls:
opennebula-server:
pkg:
- installed
serv...
The Anatomy of a State
IT IS ALL JUST DATA!
opennebula-server/init.sls:
opennebula-server:
pkg:
- installed
service:
- run...
opennebula-sunstone State
Beyond a single State File
opennebula-server/init.sls:
opennebula-server:
pkg:
- installed
servi...
State Execution
Behind the scenes
salt minion
state.sls opennebula-server
response
root@salt ~ # salt ‘minion’ state.sls o...
SaltStack
The Highstate
root@salt ~ # salt ‘*’ state.highstate
states/top.sls
base:
‘frontend’:
- opennebula-server
- open...
SaltStack
The Render System
• State data is just that - data
• It does not need to be represented in
YAML
• State files ca...
SaltStack
Be a Ninja with Jinja2
libvirt/init.sls:
libvirt:
pkg:
- installed
{% if grains[‘os’] == ‘Debian’ %}
- name: lib...
State Execution
Behind the scenes with Jinja2
salt minion
state.sls libvirt
response
root@salt ~ # salt ‘minion’ state.sls...
SaltStack
The Pillar Interface
• Generate/store data for specific minions
• Highly sensitive data
• Minion configuration
•...
OpenNebula oneadmin Password
Stored in Pillar
pillar/opennebula.sls:
opennebula:
oneadmin:
password: SecurePassword
state/...
OpenNebula Node Communication
TOP SECRET
frontend node
START VM
VM STARTED
NEEDS:
SSH password-less communication
Distribu...
SaltStack
The Mine
node
mine
mine.send
oneadmin_public_key.put
1
mine.get
2
/var/lib/one/.ssh/authorized_keys
3
frontend:
...
SaltStack
The Mine in States
state/oneadmin_ssh_auth.sls:
oneadmin_ssh_auth:
ssh_auth:
- present
- user: oneadmin
- name: ...
SaltStack
Peer Communication
• Allow minion to “talk” to each other
• Chatting done via Master
• Must be enabled on the Ma...
OpenNebula Node Up
Create it on the Frontend
salt node
state.sls opennebula-node-kvm
communicate frontend to
create node
1...
Bootstrap OpenNebula Demo
Cloud
The SaltStack Overstate
overstate
all
network
nfs-server
storage
frontend
frontend
nodes
n...
Conclusions
• Two simple tools together = POWER
• Salt is fast
• Both are easy to use
• Salt can morph and grow together w...
databus.pro
@
Upcoming SlideShare
Loading in …5
×

OpenNebula and SaltStack - OpenNebulaConf 2013

2,294 views

Published on

Published in: Technology
  • Be the first to comment

OpenNebula and SaltStack - OpenNebulaConf 2013

  1. 1. OpenNebula and SaltStack Valentin Bud CEO databus.pro | valentin@databus.pro | @databuspro OpenNebulaConf Berlin, Germany, September 25th #OpenNebulaConf
  2. 2. SaltStack About • The name is the vision • A different approach to infrastructure management • Transparent control system • A simple viable building block #OpenNebulaConfValentin Bud | @valentinbudm
  3. 3. SaltStack Standing on the Shoulders of the Giants • Python • 0MQ • MessagePack • M2Crypto #OpenNebulaConfValentin Bud | @valentinbud
  4. 4. SaltStack Architecture ... 0MQ MASTER(S) minion minion minion #OpenNebulaConfValentin Bud | @valentinbud
  5. 5. SaltStack The Remote Execution Engine root@salt ~ # salt ‘*’ test.ping nfs: True salt: True node01: True salt nfs test.ping response 0MQ #OpenNebulaConfValentin Bud | @valentinbud
  6. 6. SaltStack Meet your minions - Grains root@salt ~ # salt ‘nfs’ grains.items nfs: ... kernel: Linux kernelrelease: 2.6.32-358.18.1.el6.x86_64 localhost: nfs master: salt mem_total: 1877 nodename: nfs num_cpus: 2 num_gpus: 1 os: CentOS os_family: RedHat oscodename: Final osfullname: CentOS ... #OpenNebulaConfValentin Bud | @valentinbud
  7. 7. SaltStack Grains - Tag your minions root@salt ~ # salt ‘salt’ grains.setval role opennebula-frontend salt: role: opennebula-frontend root@salt ~ # salt ‘salt’ grains.item role salt: role: opennebula-frontend #OpenNebulaConfValentin Bud | @valentinbud
  8. 8. SaltStack Target your Minions GLOBBING root@salt ~ # salt -G 'web*' test.ping REGULAR EXPRESSIONS root@salt ~ # salt -E 'web1-(prod|devel)' test.ping LISTS root@salt ~ # salt -L 'web1,web2,web3' test.ping GRAINS root@salt ~ # salt -G '@os:CentOS' test.ping #OpenNebulaConfValentin Bud | @valentinbud
  9. 9. OpenNebula and SaltStack OpenNebulaConf Demo Cloud salt frontend node01 salt nfs Services Network private virtual machine network #OpenNebulaConfValentin Bud | @valentinbud
  10. 10. SaltStack The State System • The Configuration Management component • Already available with a basic setup • Powerful, fast, lightweight system #OpenNebulaConfValentin Bud | @valentinbud
  11. 11. opennebula-server State Install the OpenNebula Server opennebula-server/init.sls: opennebula-server: pkg: - installed service: - running - require: - pkg: opennebula-server #OpenNebulaConfValentin Bud | @valentinbud
  12. 12. The Anatomy of a State IT IS ALL JUST DATA! opennebula-server/init.sls: opennebula-server: pkg: - installed service: - running - require: - pkg: opennebula-server ID DECLARATION STATE DECLARATION STATE ARGUMENTS #OpenNebulaConfValentin Bud | @valentinbud
  13. 13. opennebula-sunstone State Beyond a single State File opennebula-server/init.sls: opennebula-server: pkg: - installed service: - running - require: - pkg: opennebula-server opennebula-sunstone/init.sls: include: - opennebula-server opennebula-sunstone: pkg: - installed service: - running - require: - service: opennebula-server #OpenNebulaConfValentin Bud | @valentinbud
  14. 14. State Execution Behind the scenes salt minion state.sls opennebula-server response root@salt ~ # salt ‘minion’ state.sls opennebula-server 1 parse and execute 2 3 0MQ #OpenNebulaConfValentin Bud | @valentinbud
  15. 15. SaltStack The Highstate root@salt ~ # salt ‘*’ state.highstate states/top.sls base: ‘frontend’: - opennebula-server - opennebula-frontend #OpenNebulaConfValentin Bud | @valentinbud
  16. 16. SaltStack The Render System • State data is just that - data • It does not need to be represented in YAML • State files can be rendered from any medium • Modular system #OpenNebulaConfValentin Bud | @valentinbud
  17. 17. SaltStack Be a Ninja with Jinja2 libvirt/init.sls: libvirt: pkg: - installed {% if grains[‘os’] == ‘Debian’ %} - name: libvirt-bin {% elif grains[‘os’] == ‘CentOS’ %} - name: libvirt {% endif %} #OpenNebulaConfValentin Bud | @valentinbud
  18. 18. State Execution Behind the scenes with Jinja2 salt minion state.sls libvirt response root@salt ~ # salt ‘minion’ state.sls opennebula-server 1 parse execute 2 4 render 3 0MQ #OpenNebulaConfValentin Bud | @valentinbud
  19. 19. SaltStack The Pillar Interface • Generate/store data for specific minions • Highly sensitive data • Minion configuration • Variables • Arbitrary data #OpenNebulaConfValentin Bud | @valentinbud
  20. 20. OpenNebula oneadmin Password Stored in Pillar pillar/opennebula.sls: opennebula: oneadmin: password: SecurePassword state/oneadmin.sls: oneadmin_password: cmd: - run - name: oneuser passwd 0 {{ pillar[‘opennebula’][‘oneadmin’] [‘password’] }} #OpenNebulaConfValentin Bud | @valentinbud
  21. 21. OpenNebula Node Communication TOP SECRET frontend node START VM VM STARTED NEEDS: SSH password-less communication Distribute Public Key to Nodes #OpenNebulaConfValentin Bud | @valentinbud
  22. 22. SaltStack The Mine node mine mine.send oneadmin_public_key.put 1 mine.get 2 /var/lib/one/.ssh/authorized_keys 3 frontend: oneadmin_public_key: ssh-rsa ... #OpenNebulaConfValentin Bud | @valentinbud
  23. 23. SaltStack The Mine in States state/oneadmin_ssh_auth.sls: oneadmin_ssh_auth: ssh_auth: - present - user: oneadmin - name: {{ salt['mine.get']('frontend', 'oneadmin_public_key.get') }} #OpenNebulaConfValentin Bud | @valentinbud
  24. 24. SaltStack Peer Communication • Allow minion to “talk” to each other • Chatting done via Master • Must be enabled on the Master • Live data from other minions! #OpenNebulaConfValentin Bud | @valentinbud
  25. 25. OpenNebula Node Up Create it on the Frontend salt node state.sls opennebula-node-kvm communicate frontend to create node 1 configure node 2 4 3 frontend createnode #OpenNebulaConfValentin Bud | @valentinbud
  26. 26. Bootstrap OpenNebula Demo Cloud The SaltStack Overstate overstate all network nfs-server storage frontend frontend nodes nodes 1 2 3 4 5 6 7 8 #OpenNebulaConfValentin Bud | @valentinbud
  27. 27. Conclusions • Two simple tools together = POWER • Salt is fast • Both are easy to use • Salt can morph and grow together with your needs 2 #OpenNebulaConfValentin Bud | @valentinbud
  28. 28. databus.pro @

×