Your SlideShare is downloading. ×
0
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Marian Marinov Clusters With Glusterfs
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Marian Marinov Clusters With Glusterfs

1,020

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,020
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
37
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. HighLoad++ 2008 Moscow Clusters with GlusterFS Marian Marinov - mm@yuhu.biz System Architect - Siteground.com Moscow 06-07.Oct.2008
  • 2. Agenda Cluster Filesystems Some facts Gluster Design ➢ kernel ➢ gluster engine ➢ protocols ➢ translators ➢ storage ➢ performance ➢ others ➢ schedulers Some benchmarks 2 Moscow 06-07.Oct.2008 1/19
  • 3. Cluster Filesystems 3 Moscow 06-07.Oct.2008 2/19
  • 4. Facts GlusterFS project starts in August 2006 It is not actual Filesystem Server only for Linux Client running on Linux & FreeBSD Very scallable Very easy to install and maintain 4 Moscow 06-07.Oct.2008 3/19
  • 5. GlusterFS Desgin 5 Moscow 06-07.Oct.2008 4/19
  • 6. GFarm Desgin 6 Moscow 06-07.Oct.2008 5/19
  • 7. Gluster Filesystem Design In the kernel ➢ Requires FUSE ➢ FUSE as module ➢ GlusterFUSE The engine ➢ Server & Client ➢ Transport Modules ➢ Translators ➢ Scheduler Modules 7 Moscow 06-07.Oct.2008 6/19
  • 8. GlusterFS Desgin 8 Moscow 06-07.Oct.2008 7/19
  • 9. GlusterFS Desgin The picture explained: ClientX: volume serverX - defines a name for a remote server subvolumes brick0 - defines in which of all exported volumes from the remote server we are interested some performance translators volume unify - defines that we will use unify cluster translator subvolumes serverX serverY - defines which already connected storage volumes will be used 9 Moscow 06-07.Oct.2008 8/19
  • 10. Gluster Filesystem Design Transport Modules: For TCP/IP transport transport-type tcp/server For Infiniband SDP transport transport-type ib-sdp/server For Infiniband Verbs transport transport-type ib-verbs/server 10 Moscow 06-07.Oct.2008 9/19
  • 11. Gluster Filesystem Design The idea – GNU/Hurd Translators ➢ Performance ➢ Clustering ➢ Scheduling ➢ Storage ➢ Others 11 Moscow 06-07.Oct.2008 10/19
  • 12. Gluster Filesystem Design Performance translators ➢ Read Ahead ➢ Write Behind ➢ Threaded I/O ➢ IO-Cache ➢ Stat Pre-fetch – still not ported to the new versions ➢ Booster 12 Moscow 06-07.Oct.2008 11/19
  • 13. Gluster Filesystem Design Clustering translators ➢ Stripe ➢ Unify ➢ AFR 13 Moscow 06-07.Oct.2008 12/19
  • 14. Gluster Filesystem Design Scheduling translators ➢ Adaptive Least Usage (ALU) ➢ Non-uniform filesystem architecture (NUFA) ➢ Random ➢ Rand-Robin ➢ Switch 14 Moscow 06-07.Oct.2008 13/19
  • 15. Gluster Filesystem Design Other translators ➢ client ➢ server ➢ posix ➢ posix-locks ➢ bdb - very new ➢ rot-13 ➢ trace 15 Moscow 06-07.Oct.2008 14/19
  • 16. Gluster Filesystem Design In the feature ➢ Live addition/removal of nodes ➢ Automatic File Reordering ➢ Web GUI ➢ mod_glusterfs 16 Moscow 06-07.Oct.2008 15/19
  • 17. Gluster Design 17 Moscow 06-07.Oct.2008 16/19
  • 18. Benchmarks Aggregated Read Throughput Benchmark Multiple dd utility were executed simultaneously with different block sizes to read from GlusterFS filesystem. 4KB 16KB 128KB 256KB 512KB 1024KB Lustre 1,796 MB/s 5,782 MB/s 20,423 MB/s 21,582 MB/s 22,789 MB/s 23,731 MB/s GlusterFS 11,415 MB/s 11,424 MB/s 11,427 MB/s 11,419 MB/s 11,411 MB/s 11,409 MB/s Aggregated Write Throughput Benchmark Multiple dd utility were executed simultaneously with different block sizes to write to GlusterFS filesystem. 4KB 16KB 128KB 256KB 512KB 1024KB Lustre 969 MB/s 1,613 MB/s 1,988 MB/s 1,989 MB/s 1,984 MB/s 1,983 MB/s GlusterFS 1,886 MB/s 2,191 MB/s 2,237 MB/s 2,231 MB/s 2,236 MB/s 2,223 MB/s Note: Higher means faster. 18 Moscow 06-07.Oct.2008 17/19
  • 19. Benchmarks Apache Web Server Benchmark Apache served 12039 files (595 MB) over HTTP protocol. wget client fetched the files recursively. Time Lustre Failed after downloading 33 MB out of 585 MB in 11 mins. GlusterFS 3 mins 11 secs Archive Creation 'tar utility created an archive of 12039 files (595 MB) served through GlusterFS. Time Lustre 41 secs GlusterFS 25 secs Archive Extraction Time Lustre FAILED No space left on device. GlusterFS 43 secs Note: Lower means faster. 19 Moscow 06-07.Oct.2008 18/19
  • 20. Sources of Information Project's site: http://www.gluster.org Official GlusterFS documentation wiki: http://www.gluster.org/docs/index.php/GlusterFS On IRC: irc.freenode.net #gluster The mailing list: gluster-devel@nongnu.org 20 Moscow 06-07.Oct.2008 19/19
  • 21. Clusters with GlusterFS ? ? ? ? ? ? ? ? ? ?? ? ? ? ? ? Questions ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? 21 Moscow 06-07.Oct.2008

×