Downloaded 80 times
Uploaded byUdo Seidel
Gluster.community.day.2013
The document presents a talk by Dr. Udo Seidel about using GlusterFS as a replacement for Swift in OpenStack, detailing its architecture, features, and integration capabilities. It covers the evolution of GlusterFS, its distributed storage model, and the advantages of using it within the OpenStack ecosystem. Key takeaways include its modular architecture, operational readiness, and active community support.
More Related Content
Gluster.community.day.2013
- 1. Bricks and Translators: GlusterFSas SWIFT replacement in OpenStack Dr. Udo Seidel Linux-Strategy @ Amadeus
- 2. Agenda ● Introduction ● High level overview ● Storageinside ● Team up with OpenStack ● Summary GlusterFS Day London 2013
- 3.
- 4. Me ;-) ● Teacher ofmathematics & physics ● PhD in experimental physics ● Started with Linux in 1996 ● Linux/UNIX trainer ● Solution engineer in HPC and CAx environment ● Head of the Linux Strategy team @Amadeus GlusterFS Day London 2013
- 5.
- 6. Distributed Storage Systems ● 'Recent'attention on distributed storage ● ● ● Cloud hype Big Data See also ● CEPH ● XtreemFS ● FhGFS ● ... GlusterFS Day London 2013
- 7. Distributed storage: Paradigm changes ● Block-> Object ● Central -> Distributed ● ● ● Few -> Many Big -> Small Server <-> Storage GlusterFS Day London 2013
- 8. Distributed storage –Now what?!? ● Several implementations ● Different functions ● Support models ● Storage vendors initiatives ● Relation to Linux distributions Here and now ==> GlusterFS GlusterFS Day London 2013
- 9. High level overview GlusterFSDay London 2013
- 10. History ● Gluster founded in2005 ● Gluster = GNU + cluster ● Acquisition by Red Hat in 2011 ● Community project ● ● 3.3 in 2012 ● ● 3.2 in 2011 3.4 in 2013 Commercial product: RedHat Storage Server GlusterFS Day London 2013
- 11. The Client ● Native ● ● Not partof the Linux Kernel ● ● 'speaks' GLUSTERFS FUSE-based NFS ● ● Normal NFS client stack libgfapi (since 3.4) GlusterFS Day London 2013
- 12. The Server ● Data ● ● Translators ● ● Bricks Volumes ->exported/served to the client Meta-Data ● No dedicated instance ● Distributed hashing approach GlusterFS Day London 2013
- 13. The 'traditional' picture GlusterFSDay London 2013
- 14. Storage inside GlusterFS DayLondon 2013
- 15. The Brick ● Trust eachother ● Interconnect ● ● TCP/IP and/or RDMA/Infiniband Dedicated file systems on GlusterFS server ● ● ● XFS recommended, EXT4 works too Extended attributes a must Two main processes/daemons ● glusterd and glusterfsd GlusterFS Day London 2013
- 16. The Translator ● One perpurpose ● Replication ● POSIX ● Quota ● I/O behaviour ● ... ● Chained -> brick graph ● Technically: configuration GlusterFS Day London 2013
- 17. The Volume ● Service unit ● Layerof configuration ● distributed, replicated, striped, ... ● NFS ● Cache ● Permissions ● .... GlusterFS Day London 2013
- 18. The Distributed Volume GlusterFSDay London 2013
- 19. The Replicated Volume GlusterFSDay London 2013
- 20. The Distributed-Replicated Volume GlusterFSDay London 2013
- 21.
- 22. Meta Data ● 2 kinds ● ● ● Moreof local file system style Related to distributed nature Some stored in backend file system ● ● Time stamps ● ● Permissions Distribution/replication Some calculated on the fly ● Brick location GlusterFS Day London 2013
- 23. Elastic Hash Algorithm ● Basedon file names & paths ● Name space divided ● Full brick handled via relinking ● Stored in extended attributes ● Client needs to know topology GlusterFS Day London 2013
- 24. Distributed Hash Tables GlusterFSDay London 2013
- 25. Self-Healing ● On demand vs.Scheduled ● File based ● Based on extended attributes ● Split-brain ● Quorum function ● Sometimes: manual intervention GlusterFS Day London 2013
- 26. Geo replication ● Asynchronous ● Based onrsync/ssh ● Master-Slave ● If needed: cascading ● One way street ● Clocks in sync! ● Coming: Parallel GeoRep GlusterFS Day London 2013
- 27. From files toobjects ● Introduced with version 3.3 ● Hard links with some hierarchy ● ● Re-uses GFID (inode number) UFO ● Unified File and Object ● Combination with RESTful API ● S3 and Swift compatible GlusterFS Day London 2013
- 28. Operations: Growth, shrinkage ..failures ● A Must! ● Easy ● Rebalance! ● Backup?!? ● Order of servers important GlusterFS Day London 2013
- 29. What else ...? ● Encryption:-| ● Compression :-( ● Snapshots :-( ● Hadoop connector :-) ● Locking granularity :-| ● File system statistics :-) ● Monitoring :-( GlusterFS Day London 2013
- 30. Team up withOpenStack GlusterFS Day London 2013
- 31. OpenStack ● Infrastructure as asService (IaaS) ● 'Opensource version' of AWS :-) ● New versions every 6 months ● ● ● Previous (2013.1.3) is called Grizzly Current (2013.1.4) is called Havana Managed by Openstack Foundation GlusterFS Day London 2013
- 32. OpenStack Architecture GlusterFS DayLondon 2013
- 33. OpenStack Components ● Keystone -identity ● Glance – image ● Nova - compute ● Cinder – block storage ● Swift – object storage ● Quantum - network ● Horizon - dashboard GlusterFS Day London 2013
- 34. About Swift ● Replace AmazonS3 ● ● ● Scalable Redundant Openstack object store ● Proxy ● Object ● Container ● Account ● Auth GlusterFS Day London 2013
- 35. Why GlusterFS inthe first place? ● Scale out storage ● HA + self healing ● Easy integration on O/S level ● Already exposed to similar workloads GlusterFS Day London 2013
- 36. Replacing Swift –a story in 3 acts ● Sneaking in ● Step in and throw out ● Teaming up GlusterFS Day London 2013
- 37. Replacing Swift –the 'lazy' way ● Before 3.3 ● Just mounting ● Works for Glance too ... ● ... and even for Cinder GlusterFS Day London 2013
- 38. Replacing Swift –the next version ● With 3.3 ● Changes to Swift code ● UFO (Unified File and Object) ● Mainly proxy server ● Helper tools ● Meta data -> Extended attributes ● One volume per tenant GlusterFS Day London 2013
- 39. Replacing Swift –limitations ● Dependent on Swift release ● Missing/late new development ● Packaging GlusterFS Day London 2013
- 40. Replacing Swift –Gone! ● Since 3.4 and Grizzly ● RedHat big player in Openstack ● UFO renamed to G4O GlusterFS Day London 2013
- 41. And Cinder? ● Block Storage(since Folsom) ● Integration similar to Swift ● Mounting OR ● Since Grizzly & GlusterFS 3.4: – /etc/cinder/cinder.conf – /etc/cinder/shares.conf – Still fuse mounted volume GlusterFS Day London 2013
- 42. What else? ● Storage forVM images (Glance) ● ● ● 'Lazy' mode -> one volume Better way with future versions NAS type GlusterFS Day London 2013
- 43. New with Havanarelease ● Glance can point to Cinder interface ● ● Cinder can use libgfapi ● ● Disk space savings Performance Nova integration via libgfapi ● Performance ● QEMU assisted snapshotting GlusterFS Day London 2013
- 44. Down the road ● Manila ● ● ● OpenStack'sshared FS service Different possible frontends Savanna ● Elastic Hadoop on OpenStack ● Analytics as a Service GlusterFS Day London 2013
- 45. Reviewed: Why GlusterFS? ● ● Previousarguments still valid One way to cover different storage entities ● Modular usage ● Separation of duties possible ● Co-location with other/foreign workloads GlusterFS Day London 2013
- 46.
- 47. Take aways ● Thin distributedfile system layer ● Modular architecture ● Operationally ready ● Good integration in Openstack ● Active development and community GlusterFS Day London 2013
- 48.
- 49. Thank you! GlusterFS DayLondon 2013
- 50. Bricks and Translators: GlusterFSas SWIFT replacement in OpenStack Dr. Udo Seidel Linux-Strategy @ Amadeus GlusterFS Day London 2013