Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
GlusterFS                             Distributed Replicated Parallel File System                                         ...
Agenda                    • General Information on GlusterFS                    • Architecture Overview                   ...
General InformationThursday, November 4, 2010
General Information I                                                  File System Solutions                        Shared...
General Information II                                                  File System Solutions                         Dist...
Customer Platform                                                 Shared Storage Issues                         Bad perfor...
Why GlusterFS ?                                                     Decision basics                        Possibility to ...
Architecture OverviewThursday, November 4, 2010
GlusterFS Basics                                                       Hardware                        Any x86 Hardware   ...
GlusterFS Architecture Overview I                         Distribution                                         Replication...
GlusterFS Architecture Overview II                                            Image Copyright by Gluster.Inc.             ...
GlusterFS Architecture Overview III                        Recommended Server Setup                        GlusterFS daemo...
GlusterFS TranslatorsThursday, November 4, 2010
GlusterFS Translators                                            GlusterFS modular extension                        storag...
GlusterFS Translators                        performance                             •readahead – for sequential read perf...
GlusterFS Translators                        features                           •locks – POSIX locking                    ...
GlusterFS                             ConfigurationThursday, November 4, 2010
GlusterFS Configuration Location                                          Configuration files (path and names)               ...
GlusterFS Configuration Example                                                2 Servers – n Clients – replication         ...
GlusterFS Configuration Example                                             2 Servers – n Clients – replication            ...
GlusterFS Configuration @Customer                                                                Servers - both            ...
GlusterFS Configuration @Customer                                      Servers - both - continued                          ...
GlusterFS Configuration @Customer                                                             Clients                volume...
GlusterFS UsageThursday, November 4, 2010
GlusterFS Usage                                               Mounting GlusterFS on Clients                        manual ...
GlusterFS understood                        Links:                             •http://www.gluster.org/                   ...
GlusterFS                                                       Credits:                             Gluster Inc.         ...
Upcoming SlideShare
Loading in …5
×

Gluster fs buero20_presentation

3,500 views

Published on

Published in: Technology
  • If you are looking for trusted essay writing service I highly recommend ⇒⇒⇒WRITE-MY-PAPER.net ⇐⇐⇐ The service I received was great. I got an A on my final paper which really helped my grade. Knowing that I can count on them in the future has really helped relieve the stress, anxiety and workload. I recommend everyone to give them a try. You'll be glad you did.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Gluster fs buero20_presentation

  1. 1. GlusterFS Distributed Replicated Parallel File System Text Text Martin Alfke <martin.alfke@buero20.org>Thursday, November 4, 2010
  2. 2. Agenda • General Information on GlusterFS • Architecture Overview • GlusterFS Translators • GlusterFS ConfigurationThursday, November 4, 2010
  3. 3. General InformationThursday, November 4, 2010
  4. 4. General Information I File System Solutions Shared Disk File System •San or Block Access •Mostly used in HA setup (e.g. DRBD) Distributed File System •Network File System •NFS •SMB/CIFS •9P Distributed replicated File System •Replication •HA and offline operation •Coda •MS DFS •MooseFS 4Thursday, November 4, 2010
  5. 5. General Information II File System Solutions Distributed parallel File System •Setup across multiple servers •HPC Distributed replicated parallel File System •HPC and HA •Cosmos •MogileFS •GPFS (IBM) •GFS (Google) •Hadoop •GlusterFS 5Thursday, November 4, 2010
  6. 6. Customer Platform Shared Storage Issues Bad performance of NFS kernel stack Limitations of concurrent NFS accesses Customer data already on NFS system Environment and Requirements Debian GNU/Linux Version 4 (etch) – 3 years old Most D f-t p FS need complex data migration Solution has to be expandable 6Thursday, November 4, 2010
  7. 7. Why GlusterFS ? Decision basics Possibility to run NFS and GlusterFS in parallel No data migration necessary Easy setup Extendable (e.g. new storage nodes) min. Kernel 2.6.3x --> optimization for FUSE context switches ! 7Thursday, November 4, 2010
  8. 8. Architecture OverviewThursday, November 4, 2010
  9. 9. GlusterFS Basics Hardware Any x86 Hardware Direct attached storage, RAID FC, Infiniband or iSCSI SAN Gigabit or 10 Gigabit network or Infiniband OS Linux, Solaris, OpenSolaris, OS X, FreeBSD ext3 or ext4 Filesystem (tested) Other POSIX compliant filesystems should also work Architecture No Meta-Data Server (fully distributed architecture - Elastic Hash) Replication (RAID 1) Distribution (RAID 0) FUSE (Standard) NFS (unfs3 - depreciated) SMB/CIFS DAV 9Thursday, November 4, 2010
  10. 10. GlusterFS Architecture Overview I Distribution Replication Images Copyright by Gluster.Inc. 10Thursday, November 4, 2010
  11. 11. GlusterFS Architecture Overview II Image Copyright by Gluster.Inc. 11Thursday, November 4, 2010
  12. 12. GlusterFS Architecture Overview III Recommended Server Setup GlusterFS daemons GlusterFS Server Network *nix distribution FileSystem (ext3/ext4 or POSIX) Volume Manager (LVM2 only) HW RAID Disks Image Copyright by Gluster.Inc. 12Thursday, November 4, 2010
  13. 13. GlusterFS TranslatorsThursday, November 4, 2010
  14. 14. GlusterFS Translators GlusterFS modular extension storage •posix – for underlying filesystem •bdb – database storage system protocol •server – required for server config (e.g. Inifiniband or TCP) •client – required for client config (e.g. Infiniband or TCP) cluster •distribute – storage spread to multiple servers •replicate – mirror content between servers •stripe – striping between multiple servers •unify – obsolete, use cluster/distribute •nufa – HPC - higher preference for a local volume encryption •rot-13 – sample code for encryption 14Thursday, November 4, 2010
  15. 15. GlusterFS Translators performance •readahead – for sequential read performance •writebehind – aggregate written blocks •io-threads – number of threads •io-cache – read cache block size •quickread – fetch small files in a single call •stat-prefetch – prefetch stats in readdir •symlink-cache – undocumented 15Thursday, November 4, 2010
  16. 16. GlusterFS Translators features •locks – POSIX locking •filter – filtering on user id or group id •access-control – undocumented •path-convertor – internal path converter •quota – don’t grow beyond disk space •read-only – included in feature/filter •trash – recycle bin (use on server) debug •trace – trace glusterfs functions and system calls •io-stats – collect performance data •error-gen – undocumented 16Thursday, November 4, 2010
  17. 17. GlusterFS ConfigurationThursday, November 4, 2010
  18. 18. GlusterFS Configuration Location Configuration files (path and names) Server •/etc/glusterfs/glusterfsd.vol Client •/etc/glusterfs/glusterfs.vol Possible location of config files for clients Local on disk Remote on glusterfs-Server 18Thursday, November 4, 2010
  19. 19. GlusterFS Configuration Example 2 Servers – n Clients – replication Server 1 + 2 volume posix type storage/posix option directory /data/export end-volume volume locks type features/locks subvolumes posix end-volume volume server volume brick type protocol/server type performance/io-threads option transport-type tcp option thread-count 8 option auth.addr.brick.allow 192.168.0.102 subvolumes locks subvolumes brick end-volume end-volume 19Thursday, November 4, 2010
  20. 20. GlusterFS Configuration Example 2 Servers – n Clients – replication Clients volume remote1 type protocol/client option transport-type tcp volume replicate option remote-host server1.example.com type cluster/replicate option remote-subvolume brick subvolumes remote1 remote2 end-volume end-volume volume remote2 volume writebehind type protocol/client type performance/write-behind option transport-type tcp option window-size 1MB option remote-host server2.example.com subvolumes replicate option remote-subvolume brick end-volume end-volume volume cache type performance/io-cache option cache-size 512MB subvolumes writebehind end-volume 20Thursday, November 4, 2010
  21. 21. GlusterFS Configuration @Customer Servers - both volume posix type storage/posix option directory /data End-volume volume iostats type debug/io-stats subvolumes posix volume iothreads end-volume type performance/io-threads option thread-count 16 volume locks subvolumes locks type features/locks end-volume subvolumes iostats end-volume volume writebehind type performance/write-behind option cache-size 64MB option flush-behind off subvolumes iothreads end-volume 21Thursday, November 4, 2010
  22. 22. GlusterFS Configuration @Customer Servers - both - continued volume brick type performance/io-cache option cache-size 2048MB option cache-timeout 5 subvolumes writebehind End-volume volume server-tcp type protocol/server option transport-type tcp option auth.addr.brick.allow * option transport.socket.listen-port 6996 option transport.socket.nodelay on subvolumes brick end-volume 22Thursday, November 4, 2010
  23. 23. GlusterFS Configuration @Customer Clients volume remote1 type protocol/client option transport-type tcp option remote-host <IP server1> option transport.socket.nodelay on option remote-port 6996 option remote-subvolume brick volume iothreads end-volume type performance/io-threads option thread-count 16 volume remote2 subvolumes distribute type protocol/client end-volume option transport-type tcp option remote-host <IP server2> volume writebehind option remote-subvolume brick type performance/write-behind end-volume option cache-size 32MB subvolumes iothreads volume distribute end-volume type cluster/distribute subvolumes remote1 remote2 volume cache end-volume type performance/io-cache option cache-size 256MB option cache-timeout 10 subvolumes writebehind end-volume 23Thursday, November 4, 2010
  24. 24. GlusterFS UsageThursday, November 4, 2010
  25. 25. GlusterFS Usage Mounting GlusterFS on Clients manual mount server-side configuration: mount -t glusterfs server_IP /mnt/glusterfs local (client) configuration mount -t glusterfs /etc/glusterfs/glusterfs.vol /mnt/glusterfs automatic mount (fstab) server-side configuration: server_IP /mnt/glusterfs glusterfs defaults,_netdev 0 0 local(client) configuration: /etc/glusterfs/glusterfs.vol /mnt/glusterfs glusterfs defaults,_netdev 0 0 25Thursday, November 4, 2010
  26. 26. GlusterFS understood Links: •http://www.gluster.org/ •http://www.howtoforge.com/trip_search •http://www.gluster.org/docs/index.php/GlusterFS •http://www.gluster.org/docs/index.php/GlusterFS_Volume_Specification •http://www.gluster.org/docs/index.php/GlusterFS_Translators •http://www.gluster.com/community/documentation/index.php/Translators_options •http://www.gluster.com/community/documentation/index.php/GlusterFS_Technical_FAQ Further information and examples: •apt-get install glusterfs-examples 26Thursday, November 4, 2010
  27. 27. GlusterFS Credits: Gluster Inc. Christian Gischewski <info@cgihome.de> Tobias Geiger <tobias.geiger@1und1.de> Questions ? 27Thursday, November 4, 2010

×