7 distributed storage_open_stack

  • 2,444 views
Uploaded on

 

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • looks great, thinking about using it as storage for new varicloud project
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
2,444
On Slideshare
0
From Embeds
0
Number of Embeds
3

Actions

Shares
Downloads
99
Comments
1
Likes
6

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Distributed Storage in OpenStack Vijay Bellur GlusterFS co-maintainer Red Hat
  • 2. Agenda Storage in OpenStack Today Future Distributed Storage Options Pros/Cons Distributed Storage with GlusterFS Architecture & Concepts Integration with OpenStack Benefits Q & A
  • 3. Storage in OpenStack Prominent Use Cases Today: Swift Cinder Ephemeral Glance
  • 4. Prominent Use Cases Today
  • 5. EMERGING USE CASES: Savanna Manila Raksha Trove DRaaS
  • 6. Savanna
  • 7. Raksha
  • 8. Manila Manila aims to be the shared filesystem management project for OpenStack. Provides tenant specific file shares Planned for incubation in Icehouse Interest from several NAS vendors More details available at https://launchpad.net/manila
  • 9. Trove Database as a Service for Openstack Snapshots to Swift Logs to Manila?
  • 10. DRaaS Ongoing efforts in various services to provide Disaster Recovery.
  • 11. Distributed Storage - Options Some open: Ceph GlusterFS Sheepdog and some not so open: GPFS Scality
  • 12. SDS - Why Advantages of Software Defined Distributed Storage: Runs on commodity hardware Cost Effective Leverage recent Hardware innovations Flexible Scale-out approach blends in with ecosystem Resilient to node failures High Availability Enables Live Migration
  • 13. SDS - Why NOT Performance Location awareness helps Tiered distributed storage can actually improve performance!
  • 14. Distributed Storage - GlusterFS
  • 15. GlusterFS GlusterFS is an open source distributed file system capable of scaling to several petabytes. Aggregates storage building blocks over Infiniband RDMA or TCP/IP interconnect to provide unified namespace. Filesystem is stackable and completely in userspace.
  • 16. GlusterFS Deployment
  • 17. GlusterFS Architecture & Concepts
  • 18. GlusterFS Translators Building blocks for GlusterFS process Translators can be stacked together to achieve desired functionality Can be loaded on client or server stacks - mostly deployment agnostic
  • 19. GlusterFS Translators
  • 20. GlusterFS Concepts
  • 21. GlusterFS Brick A brick is the combination of a node and an export directory Each brick inherits limits of the underlying filesystem Ideally, each brick in a cluster should be of the same size
  • 22. GlusterFS Volume A volume is a logical collection of bricks A volume is identified by an administrator provided name Volumes can be either distributed, striped, and/or replicated Most administrative actions tied to a volume today
  • 23. Distributed Volume Distributed files across various bricks of the volume Directories are present on all bricks of the volume
  • 24. Replicated Volume Creates synchronous copies of all directory and file updates Provides high availability of data when nodes failures occur Transaction driven for ensuring consistency
  • 25. Striped Volume Files are striped into chunks and placed in various bricks Recommended only when very large files greater than the size of the bricks
  • 26. Distributed Replicated Volume Distribute files across replicated bricks Provides both Scale out and high availability Most preferred model of deployment currently
  • 27. GlusterFS Volume Example Example: Create a six node distributed and replicated volume with a two-way mirror $ sudo gluster volume create myvolume replica 2 transport tcp server1:/export/brick/myvolume server2:/export/brick/myvolume server3:/export/brick/myvolume server4:/export/brick/myvolume server5:/export/brick/myvolume server6:/export/brick/myvolume $ sudo gluster volume start myvolume $ sudo mount -t glusterfs server1:myvolume /mnt/gluster/myvolume
  • 28. Accessing GlusterFS volumes
  • 29. Geo Replication Master-slave setup Asynchronous incremental replication Disaster recovery
  • 30. GlusterFS with OpenStack
  • 31. GlusterFS for Glance Shared storage capacity Geo Replication Storage resizing
  • 32. GlusterFS for Ephemeral Storage (Nova) Shared storage capacity Live Migrations Protection using replicated storage Enhanced performance using libgfapi
  • 33. GlusterFS for Cinder Shared storage capacity Geo Replication Hypervisor assisted snapshots Mostly Complete capability matrix
  • 34. GlusterFS for Swift Data access over multiple protocols Shared storage capacity Geo Replication Swift Grizzly supported Swift Havana support in progress
  • 35. OpenStack + GlusterFS Swift Use Case
  • 36. GlusterFS performance
  • 37. GlusterFS Benefits Unified Access for Block, File, Object and HDFS Modular extensible architecture Geo-replication Choice of interconnects - RDMA, GigE, 10GE Locality Compute / Virtualization transparent storage maintenance Integrated with RDO and RHOS
  • 38. GlusterFS resources Mailing lists: gluster-users@gluster.org gluster-devel@nongnu.org IRC: #gluster and #gluster-dev on freenode Links: http://www.gluster.org http://hekafs.org http://forge.gluster.org
  • 39. Thank You Questions ??