Deploying OpenStack Object Storage (Swift)

Deploying OpenStack Object StorageJuan J. Martínez <jjm@usebox.net> 10-11 September 2011http://www.usebox.net/jjm/ University Club, Oxford

What is OpenStack?Open Source software for “building clouds” ● OpenStack Object Storage (Swift) Storage ● OpenStack Compute (Nova) ● OpenStack Image Service (Glance) IaaS ● Incubating projects: Keystone, Dashboard, Crowbar, ... Image Service PaaS?

What is Swift?Open Source software for creating redundant,scalable object storage using clusters ofstandardized servers to store petabytes ofaccessible data. Object Storage Real File System ● Not a real file system ● open, read, write, seek, close ● RESTful HTTP API ● chdir, mkdir, rmdir ● Blob and metadata (name, content ● remove, rename type, date-time, size, MD5) ● chmod, chown, access ● Support for pseudo-hierarchical ● etc directories

Swift Architecture 3 Different Listing entities: Zone 3 Replicas In DIFFERENT Zones Accounts Containers Objects Partitions Zone ListingThe Ring: location of an entity in the cluster Zone● Three rings (were intended for the Elves)● Weights can be used to balance the distribution● Three different logical levels Drives

Swift Services● proxy server● account server● container server● object server Proxy Server● replicators (rsync based)● updaters (container, object)● auditors● reappers (account, container) Storage Node Storage Node Storage Node Storage Node

Swift Authentication (pluggable) Client Request (Token) User/Password TokenDifferent solutions: Public Auth Proxy Server● devauth (obsolete)● swauth (external project) Private Auth● tempauth (testing)● keystone (the future!) Storage Node Storage Node Token? Storage Node Storage Node DMZ

Swift Interfaces Client OpenStack API HTTP (Rackspace Cloud Files) FTP/SFTP CDN FTP/SFTP Public Auth Proxy Server Private Auth Other clients: Storage Node Storage Node S3 Proxy Storage Node Storage Nodehttps://github.com/chmouel/ftp-cloudfshttps://github.com/Memset/sftpcloudfs DMZ

Swift Operations● Managing the rings (adding/removing devices, zones, search fordevices, rebalance the ring)● Upgrading services (one zone at a time)● Handling driver failure (unmount; optionally remove it from the ring,mount a new EMPTY drive)● Zone failure (temporal: nothing!)● Detecting failing disks (device audit)● Object auditor (manually after a system crash) What could possibly go wrong?

Any questions? Thanks for your attention! http://openstack.org/Juan J. Martínez <jjm@usebox.net> 10-11 September 2011http://www.usebox.net/jjm/ University Club, Oxford

Deploying OpenStack Object Storage (Swift)

by Juan José Martínez on Sep 11, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 5

Statistics

Deploying OpenStack Object Storage (Swift) — Presentation Transcript

http://www.linkedin.com	4
http://paper.li	1