Deploying OpenStack Object Storage (Swift)

4,212 views
3,793 views

Published on

Published in: Technology, Business
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
4,212
On SlideShare
0
From Embeds
0
Number of Embeds
13
Actions
Shares
0
Downloads
177
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide

Deploying OpenStack Object Storage (Swift)

  1. 1. Deploying OpenStack Object StorageJuan J. Martínez <jjm@usebox.net> 10-11 September 2011http://www.usebox.net/jjm/ University Club, Oxford
  2. 2. What is OpenStack?Open Source software for “building clouds” ● OpenStack Object Storage (Swift) Storage ● OpenStack Compute (Nova) ● OpenStack Image Service (Glance) IaaS ● Incubating projects: Keystone, Dashboard, Crowbar, ... Image Service PaaS?
  3. 3. What is Swift?Open Source software for creating redundant,scalable object storage using clusters ofstandardized servers to store petabytes ofaccessible data. Object Storage Real File System ● Not a real file system ● open, read, write, seek, close ● RESTful HTTP API ● chdir, mkdir, rmdir ● Blob and metadata (name, content ● remove, rename type, date-time, size, MD5) ● chmod, chown, access ● Support for pseudo-hierarchical ● etc directories
  4. 4. Swift Architecture 3 Different Listing entities: Zone 3 Replicas In DIFFERENT Zones Accounts Containers Objects Partitions Zone ListingThe Ring: location of an entity in the cluster Zone● Three rings (were intended for the Elves)● Weights can be used to balance the distribution● Three different logical levels Drives
  5. 5. Swift Services● proxy server● account server● container server● object server Proxy Server● replicators (rsync based)● updaters (container, object)● auditors● reappers (account, container) Storage Node Storage Node Storage Node Storage Node
  6. 6. Swift Authentication (pluggable) Client Request (Token) User/Password TokenDifferent solutions: Public Auth Proxy Server● devauth (obsolete)● swauth (external project) Private Auth● tempauth (testing)● keystone (the future!) Storage Node Storage Node Token? Storage Node Storage Node DMZ
  7. 7. Swift Interfaces Client OpenStack API HTTP (Rackspace Cloud Files) FTP/SFTP CDN FTP/SFTP Public Auth Proxy Server Private Auth Other clients: Storage Node Storage Node S3 Proxy Storage Node Storage Nodehttps://github.com/chmouel/ftp-cloudfshttps://github.com/Memset/sftpcloudfs DMZ
  8. 8. Swift Operations● Managing the rings (adding/removing devices, zones, search fordevices, rebalance the ring)● Upgrading services (one zone at a time)● Handling driver failure (unmount; optionally remove it from the ring,mount a new EMPTY drive)● Zone failure (temporal: nothing!)● Detecting failing disks (device audit)● Object auditor (manually after a system crash) What could possibly go wrong?
  9. 9. Any questions? Thanks for your attention! http://openstack.org/Juan J. Martínez <jjm@usebox.net> 10-11 September 2011http://www.usebox.net/jjm/ University Club, Oxford

×