The document discusses GlusterFS, an open source distributed file system. It provides details about GlusterFS architecture, which uses a userspace filesystem design running on top of FUSE. It also summarizes GlusterFS capabilities like elastic scaling, high availability through replication, and support for various volume types including distribute, replicate, and stripe. Benchmark results show GlusterFS achieving high performance with 64 servers and 220 clients connected over InfiniBand.

1. AB Periasamy | CTO Gluster, Inc. Thu 30 June 2011 GlusterFS Architecture Petascale Cloud Filesystem

2. "userspace filesystem"? People who think that userspace filesystems are realistic for anything but toys are just misguided . – Linus Torvalds GlusterFS is safe for kids . – Misguided Toy Maker

3. Fast Growing Commercial Deployments

4. Benchmark - 64 bricks with ib-verbs transport 32 GBs Servers: 64 bricks clustered storage servers / bricks Clients: Cluster of 220 servers Interconnect: 10 Gbps InfiniBand interconnect; ib0verbs transport protocol Method: 220 clients pounding the storage servers with multiple dd (disk-dump) instances Size: Each clients reads / writes a 1 GB file with 1MB block size.

5. Typical Gluster Deployment = N bricks = N x Performance & Capacity + +

6. NAS Storage - POSIX Compatible MS Windows Client GNU/Linux Client

7. # gluster peer probe HOSTNAME # gluster volume info # gluster volume create VOLNAME [stripe COUNT] [replica COUNT] [transport tcp | rdma] BRICK … # gluster volume delete VOLNAME # gluster volume add-brick VOLNAME NEW-BRICK ... # gluster volume rebalance VOLNAME start GlusterFS Simple Commands

9. Evolution of GlusterFS 2006-2009 GlusterFS v1.0 – v3.0 Distributed Filesystem capabilities with self-healing, synchronous replication, stripe, distribute (global name space) 2010 GlusterFS v3.1 Elastic Cloud capabilities 2011 Q2 GlusterFS v3.2 GeoGraphic replication, Enhanced monitoring, Directory level quotas (also works as cloud usage billing APIs) 2011 Q3/Q4 Hadoop HDFS drop-in replacement, Unified File and Object Storage (Amazon S3 compatible) and Near CDP.

10. Gluster Architecture Advantages Software only

11. No metadata server Fully distributed architecture, no bottleneck

12. Gluster Elastic Hash High performance global namespace Scale out with linear performance

13. Hundreds of petabytes

14. 1 GbE, 10GbE High availability Replication to survive hardware failure

15. Self-healing

16. Data stored in NFS-like native format Stackable userspace design No kernel dependencies, simple install

17. Match specific workload profiles

18. Early maturity and rich functionality ‘ Google Storage’ for Everyone Intelligence in the SW

19. Leverage commodity HW

20. Scale-out elastically

21. Replication for reliability

22. Software enables virtualization

23. GlusterFS – FUSE Architecture Kernel Userland Kernel Userland VFS Glibc Applications FUSE GlusterFS GlusterFS Disk FS (ZFS / Ext3 / XFS) TCP, RDMA IB / 10GigE / 1GigE

24. volume photo-store type storage/posix option directory /data/export end-volume volume server type protocol/server option transport-type tcp/server option auth.ip.brick.allow * subvolumes photo-store end-volume Volume Specification

25. work.ods corporate.odp driver.c benchmark.pdf test.ogg initcore.c mylogo.xcf driver.c ether.c test.m4a Distribute Volume accounts-2007.ods backup.db.zip accounts-2006.ods accounts-2007.ods backup.db.zip accounts-2006.db accounts-2007.ods backup.db.zip accounts-2006.ods Replicated Volume north-pole-map dvd1.iso kvm-image north-pole-map dvd1.iso kvm-image north-pole-map dvd1.iso kvm-image Stripe Volume BRICK1 BRICK2 BRICK3

26. Stripe Volume Block 0 Block 1 Block 2 Block 3 Block 4 Block 5 Block 6 Block 7 Brick-A Brick-B Brick-C Brick-D

27. Thank You www.gluster.org