GlusterFS Architecture - June 30, 2011 Meetup

7,390 views
7,215 views

Published on

Published in: Technology, Business
1 Comment
8 Likes
Statistics
Notes
  • This was presented by AB Periasamy, Gluster CTO, at the inaugural GlusterFS meetup on June 30, 2011 at Gluster headquarters.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
7,390
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
298
Comments
1
Likes
8
Embeds 0
No embeds

No notes for slide

GlusterFS Architecture - June 30, 2011 Meetup

  1. 1. AB Periasamy | CTO Gluster, Inc. Thu 30 June 2011 GlusterFS Architecture Petascale Cloud Filesystem
  2. 2. &quot;userspace filesystem&quot;? People who think that userspace filesystems are realistic for anything but toys are just misguided . – Linus Torvalds GlusterFS is safe for kids . <ul><ul><li>– Misguided Toy Maker </li></ul></ul>
  3. 3. Fast Growing Commercial Deployments
  4. 4. Benchmark - 64 bricks with ib-verbs transport 32 GBs Servers: 64 bricks clustered storage servers / bricks Clients: Cluster of 220 servers Interconnect: 10 Gbps InfiniBand interconnect; ib0verbs transport protocol Method: 220 clients pounding the storage servers with multiple dd (disk-dump) instances Size: Each clients reads / writes a 1 GB file with 1MB block size.
  5. 5. Typical Gluster Deployment = N bricks = N x Performance & Capacity + +
  6. 6. NAS Storage - POSIX Compatible MS Windows Client GNU/Linux Client
  7. 7. # gluster peer probe HOSTNAME # gluster volume info # gluster volume create VOLNAME [stripe COUNT] [replica COUNT] [transport tcp | rdma] BRICK … # gluster volume delete VOLNAME # gluster volume add-brick VOLNAME NEW-BRICK ... # gluster volume rebalance VOLNAME start GlusterFS Simple Commands
  8. 9. Evolution of GlusterFS 2006-2009 GlusterFS v1.0 – v3.0 Distributed Filesystem capabilities with self-healing, synchronous replication, stripe, distribute (global name space) 2010 GlusterFS v3.1 Elastic Cloud capabilities 2011 Q2 GlusterFS v3.2 GeoGraphic replication, Enhanced monitoring, Directory level quotas (also works as cloud usage billing APIs) 2011 Q3/Q4 Hadoop HDFS drop-in replacement, Unified File and Object Storage (Amazon S3 compatible) and Near CDP.
  9. 10. Gluster Architecture Advantages <ul><li>Software only
  10. 11. No metadata server </li></ul><ul><ul><li>Fully distributed architecture, no bottleneck
  11. 12. Gluster Elastic Hash </li></ul><li>High performance global namespace </li><ul><li>Scale out with linear performance
  12. 13. Hundreds of petabytes
  13. 14. 1 GbE, 10GbE </li></ul><li>High availability </li><ul><li>Replication to survive hardware failure
  14. 15. Self-healing
  15. 16. Data stored in NFS-like native format </li></ul><li>Stackable userspace design </li><ul><li>No kernel dependencies, simple install
  16. 17. Match specific workload profiles
  17. 18. Early maturity and rich functionality </li></ul></ul>‘ Google Storage’ for Everyone <ul><li>Intelligence in the SW
  18. 19. Leverage commodity HW
  19. 20. Scale-out elastically
  20. 21. Replication for reliability
  21. 22. Software enables virtualization </li></ul>
  22. 23. GlusterFS – FUSE Architecture Kernel Userland Kernel Userland VFS Glibc Applications FUSE GlusterFS GlusterFS Disk FS (ZFS / Ext3 / XFS) TCP, RDMA IB / 10GigE / 1GigE
  23. 24. volume photo-store type storage/posix option directory /data/export end-volume volume server type protocol/server option transport-type tcp/server option auth.ip.brick.allow * subvolumes photo-store end-volume Volume Specification
  24. 25. work.ods corporate.odp driver.c benchmark.pdf test.ogg initcore.c mylogo.xcf driver.c ether.c test.m4a Distribute Volume accounts-2007.ods backup.db.zip accounts-2006.ods accounts-2007.ods backup.db.zip accounts-2006.db accounts-2007.ods backup.db.zip accounts-2006.ods Replicated Volume north-pole-map dvd1.iso kvm-image north-pole-map dvd1.iso kvm-image north-pole-map dvd1.iso kvm-image Stripe Volume BRICK1 BRICK2 BRICK3
  25. 26. Stripe Volume Block 0 Block 1 Block 2 Block 3 Block 4 Block 5 Block 6 Block 7 Brick-A Brick-B Brick-C Brick-D
  26. 27. Thank You www.gluster.org

×