Baylisa - Dive Into OpenStack

Dive Into OpenStack
Jesse Andrews & VishIshaya
Anso Labs

Overview of OpenStack
Background
Compute: Nova
Object Storage: Swift
A Story of Three Deploys
Kicking the Tires
Digging In
Getting Physical
Internals / Q & A

The Mission
"To produce the ubiquitous Open Source cloud computing platform that will meet the needs of public and private cloud providers regardless of size, by being simple to implement and massively scalable."

+
&
and many more…

creating open source software to buildpublic and private clouds
Software to provision virtual machines on standard hardware at massive scale
Software to reliably store billions of objects distributed across standard hardware

History

Swift Components
The Ring: Maps names to entities (accounts, containers, objects) on disk.
Stores data based on zones, devices, partitions, and replicas
Weights can be used to balance the distribution of partitions
Used by the Proxy Server for many background processes
Proxy Server: Request routing, exposes the public API
Replication: Keep the system consistent, handle failures
Updaters: Process failed or queued updates
Auditors: Verify integrity of objects, containers, and accounts
Account Server: Handles listing of containers, stores as SQLite DB
Container Server: Handles listing of objects, stores as SQLite DB
Object Server: Blob storage server, metadata kept in xattrs, data in binary format
Recommended to run on XFS Object location based on hash of name & timestamp

Using OpenStack

Kicking the Tires
Vagrant is a tool for building and distributing virtualized environments on your laptop/desktop.
Install VirtualBox 4
Install ruby, rubygems, vagrant
Config uses maverick, chef, debs
$ sudogem install vagrant --pre
$ gitclone git://github.com/ansolabs/openstack-cookbooks -b devpackages
$ mkdiraptcache; mkdirchef; cd chef
$ curl -o Vagrantfilehttps://gist.github.com/raw/786945/solo.rb
$ vagrant up

Demo using vagrant
http://ansolabs.com/deploy

Digging In
nova.sh is a simple script for setting up a development environment for nova.
Install Maverick (in a VM or physical box)
Download & run nova.sh
Code, test, commit, repeat!
$ curl -O https://github.com/vishvananda/novascript/raw/master/nova.sh
$ chmod755 nova.sh
$ ./nova.sh branch
$ ./nova.sh install
$ sudo ./nova.sh run

Demo using nova.sh
http://ansolabs.com/deploy

Getting Physical

Hardware Selection
OpenStack is designed to run on industry standard hardware, with flexible configurations
Compute
x86 Server (Hardware Virt. recommended)
Storage flexible (Local, SAN, NAS)
Object Storage
x86 Server (other architectures possible)
Do not deploy with RAID (can use controller for cache)

Server Vendor Support
Find out how much configuration your hardware vendor can provide
Basic needs
BIOS settings (hardware virtualization)
Network boot IP on IPMI card
Advanced support
Host OS installation
Still get management network IP via DHCP

Network Device Configuration
Build in a manner that requires minimal change
Lay out addressing in a block based model
Go to L3 from the top of rack uplink
Keep configuration simple
More bandwidth is better than advanced QoS
Let the compute host machines create logical zones

Host Networking
DHCP for the management network
Infinite leases
Base DNS on IP
pod-a-10-241-61-8.example.org
OpenStack Compute handles IP provisioning for all guest instances
Cloud deployment tools only need to setup management IPs

Host OS Seed Installation
BOOTP / TFTP – Simple to configure
Security must be handled outside of TFTP
Host node must be able to reach management system via broadcast request
Top of rack router can be configured to forward
GPXE
Not all hardware supports
Better concurrent install capability than TFTP

Host OS Installation
Building a configuration based on a scripted installation is better than a monolithic “golden image”
Preseed for Ubuntu / Debian hosts
Kickstartfor Fedora / CentOS / RHEL hosts
YaSTfor SUSE / SLES hosts
Remote bootstrapping for XenServer / Hyper-V hosts
Scripted configuration allows for incremental updates with less effort

Post OS Configuration
Utilize a configuration management solution
Puppet: lp:novacontrib/puppet
Chef: http://github.com/ansolabs/openstack-cookbooks
Cfengine: patches welcome
Create roles to scale out controller infrastructure
Support: Queue, Database, LDAP
Interfaces: API controllers
Workers: Compute, Storage, Networking
Automate registration of new host machines
Base the configuration to run on management net IP

Monitoring
Maintain your cloud using technologies you already use to maintain your datacenter(s)
Nagios – alerting
Ganglia – performance
Syslog – log aggregation
Splunk / Ossec

Coming Soon
IPv6 support
Live migration
Puppet deployment tools
Snapshotting
Ceph, SheepDog block storage support
Web UI
Network refactor to use open vswitch

Thanks!
Questions? Answers?
Get started at http://ansolabs.com/deploy
Some content “stolen” from
http://www.slideshare.net/bpiatt/openstack-tutorial

LDAP Data Store
Ubuntu OS
Puppet
PXE
Cloud Node
SQL DB / KVS
HTTP API
RabbitMQ
Scheduler

Project VLAN
Running Instance
LibVirt
Brctl
Ubuntu OS
Puppet
KVM
802.1(q)
PXE
Compute Node

Exported Volume
iSCSI
Ubuntu OS
Puppet
LVM
PXE
Volume Node

Project VLAN
Public Internet
Brctl
IPTables
Ubuntu OS
Puppet
802.1(q)
PXE
Network Node

Baylisa - Dive Into OpenStack

by Jesse Andrews

Accessibility

Categories

Upload Details

Usage Rights

2 Embeds 3

Statistics

Baylisa - Dive Into OpenStack Presentation Transcript

http://twitter.com	2
http://www.onlydoo.com	1