This document provides an overview of a presentation on building Infrastructure as a Service (IaaS) clouds with OpenNebula. The presentation covers what OpenNebula is, the anatomy of an IaaS cloud including components like networking, storage, virtualization and services, and provides a single node example of building an OpenNebula cloud. It also discusses lessons learned around not hiding complexity and ensuring interoperability.

1. LINUXCON EUROPE 2012
Barcelona, November 5th
Building IaaS Clouds and the Art of Virtual
Machine Management: A Practical Guide
with OpenNebula
Rubén S. Montero
rsmontero@opennebula.org
OpenNebula.org
@ruben_s_montero
© OpenNebula Project. Creative Commons Attribution-NonCommercial-ShareAlike License

2. Contents
● What is OpenNebula?
● Design Principles & Vision
● The Anatomy of an IaaS Cloud
● Building an IaaS Cloud: A single node example
● Lessons Learned

3. What is OpenNebula?
Public Cloud Private
Cloud
Simple Web Interface A Cloud behind a firewall
Infrastructure Resources Security Concerns
Elastic & “infinite” Improve Operations
Hybrid Cloud / CloudBursting
Supplement Capacity of the
Private
Utility Computing for Real

4. What is OpenNebula?
Image Management
Monitoring & Scheduling
Networking
Multi-tenancy
Interfaces & APIs
VM VM VM VM VM VM VM VM
Hypervisor
Physical Hardware
.. Hypervisor
Physical Hardware
Host Host

5. Design Principles and Vision
● Flexible: One solution can not fit all data-centers
● Simple: just-what-you-need components & simple protocols
● Scalable: single instance & multi-tier architectures
● Open Source: Apache License v2.0
● Provide basic components, but easily hack by others

6. The Anatomy of an IaaS Cloud
Interfaces, Tools & API
● CLI & Sunstone (GUI)
● API
● Cloud (EC2,OCCI)
● Service Management & Catalogs
Network Storage
● VLAN ● VM disks (file & block)
● Firewalling ● Image Distribution
● Multiple Technologies ● Multiple Backends
Multi-tenancy
● AAA Services
● Scheduling
● Permissions & roles
Compute Hosts
● Grouped in logical clusters
● Multiple hypervisors
● Monitoring

7. Building an IaaS Cloud: A single node example
Image Datastore System Datastore
(DS_ID: 1) (DS_ID: 0)
"NAS" "NAS"
wlan0
Internet
vbr0
VM VM
KVM
My Laptop

8. Building an IaaS Cloud: Tools & Interfaces
Tools
● DevOps vs Users
● Command Line Interface
Command Line Interface
● GUI
○ Sunstone
○ Self-service
● Cloud API's
○ EC2 Query API
○ OCCI

9. Building an IaaS Cloud: Hosts
Host Management
● Monitoring
○ Simple - SSH probes
○ Ganglia HOST HOST HOST
● Cluster
○ Logical set of:
■ Storage
■ Network
■ Hosts
○ Deal with heterogeneity

10. Building an IaaS Cloud: Storage
Storage
● Datastore
○ Image store Image Datastore System Datastore
(DS_ID: 1) (DS_ID: 0)
○ Balance I/O
○ Policies
○ File, iSCSI, LVM, VMFS
"NAS" "NAS"
● Image distribution
○ System Datastore
○ Shared/Distributed FS
○ SSH
○ iSCSI
○ LVM

11. Building an IaaS Cloud: Network
Images
● Files vs Block devices
○ Performance Image Datastore System Datastore
(DS_ID: 1) (DS_ID: 0)
○ Management
● Types
○ Golden Images
"NAS" "NAS"
○ Persistent
○ Volatile
● Context
CD-ROM with
custom data
Disk images

12. Building an IaaS Cloud: Network
Networks
● Define a MAC-IP address
space
● Layer 2 Isolation (drivers)
○ 802.1Q (Tagging)
○ OpenvSwitch vbr0
○ ebtables VM VM VR
○ Flat
● Layer 3 simple firewalling
○ TCP/UDP ports
Internet
○ ICMP's
● Virtual Router

13. Building an IaaS Cloud: Virtualization
Virtualization
● Virtual Machine Templates
○ Capacity
○ Disks VM VM
○ NICs
Hypervisor
○ Other (VNC, OS,...)
● Support VM operations
○ Stop/Resume
○ Migration (live)
○ Attach/Detach
○ Shutdown/Reboot/Reset
● Hypervisor
○ Agnostic
○ Xen, KVM and VMware

14. Building an IaaS Cloud: Misc Services
AuthZ, AuthN & Acct.
● Multi-tenancy
○ Groups
○ Permissions & ACLs
● Authentication
○ X509 Core & Scheduler
○ SSH Keys
● OpenNebula core
○ LDAP
daemon
○ Internal
○ Orchestration
● Authorization
○ Driver based
○ Quotas
○ Fast & Robust (C++)
● Accounting (Billing)
● Scheduler
○ Matchmaking

15. Building an IaaS Cloud: Misc Services
Marketplace
Marketplace
● Ready-to-use Image Sharing
● Store meta-data
● Images stored elsewhere
● Meeting point Devs & Users
● "one-click" deployment

16. Building an IaaS Cloud: Integration at a Glance

17. Building an IaaS Cloud: Integration at a Glance

18. History of the Project
Third party scalability
● Develop & innovate tests: 16000 VMs
● Support the community
● Collaborate Commercial Support
TP v3.2 3.4 3.8
v1.0 v1.2 v1.4 v2.0 v2.2 v3.0
2005 2008 2009 2010 2011 2012
dsa group doing
research…
4,000
downloads/month
European Funding

19. Lessons Learned
Do not hide the Complexity, Architect the Cloud!
● Let IT staff adapt/desgin/develop their cloud deployments
● Design to Automate
● Scale your deployments
Be Interoperable, Have a Rich set of API’s & Interfaces
● Be prepared for different uses cases (don’t look at the service)
● Be prepared to deal with different solutions (storage, virt., nets)
● Be prepared to interoperate at different levels

20. Join us at www.opennebula.org
#opennebula OpenNebula/one
@opennebula dev.opennebula.org

21. Backup: Survey - Deployment Size

22. Backup: Survey - Hypervisor

23. Backup: Survey - Distro

24. Backup: Survey - Storage