Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this presentation? Why not share!

Grid FS

on

  • 24,624 views

An overview of MongoDB's GridFS system for storing dynamic assets without the filesystem. I show the problems with the filesystem, the advantages of GridFS and how it compares to using AWS S3.

An overview of MongoDB's GridFS system for storing dynamic assets without the filesystem. I show the problems with the filesystem, the advantages of GridFS and how it compares to using AWS S3.

Statistics

Views

Total Views
24,624
Views on SlideShare
14,582
Embed Views
10,042

Actions

Likes
33
Downloads
323
Comments
2

35 Embeds 10,042

http://tokarchuk.ru 3491
http://blog.nosqlfan.com 3324
http://mobicon.tistory.com 1675
http://www.cnblogs.com 1185
http://www.oschina.net 133
http://www.kuqin.com 66
http://feed.feedsky.com 38
http://rg443blog.wordpress.com 31
http://xianguo.com 16
http://feeds.feedburner.com 15
http://xss.yandex.net 10
http://reader.youdao.com 9
http://zhuaxia.com 8
http://webcache.googleusercontent.com 5
http://wap.oschina.net 5
http://cache.baidu.com 4
http://archive.cnblogs.com 3
http://m.oschina.net 2
http://www.tuicool.com 2
http://linuxism.tistory.com 2
http://news.uplook.cn 2
http://translate.googleusercontent.com 2
http://paper.li 2
http://m.baidu.com 1
http://pagebook.iptime.org 1
http://cache.baiducontent.com 1
http://www.verydemo.com 1
http://www.w3c.com.cn 1
http://www.uplook.cn 1
https://twitter.com 1
http://hghltd.yandex.net 1
http://vm-192-168-12-28.shengyun.grandcloud.cn 1
http://mailreader.163.com 1
http://www.zhuaxia.com 1
http://www.xuebuyuan.com 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Thanks for sharing. There are several reasons to use GridFS on mongodb http://blog.mongodirector.com/when-to-use-gridfs/
    Are you sure you want to
    Your message goes here
    Processing…
  • Very interesting presentation! I did try to install gridfs-fuse in an Ubuntu server, but have no success in compiling it... Unfortunatelly the tips at https://github.com/mikejs/gridfs-fuse/ website are minimalist and I could not find any other place with more info about. Does anybody have a step by step install guide, with all necessary dependencies? Thank you very much.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

Grid FS Grid FS Presentation Transcript

  • GridFSDynamic Asset StorageWithout the Filesystem
  • On Today’s Menu...•Assess Problems with Assets on Filesystem• Suggest MongoDB’s GridFS as a Solution• Explain System Implementation• Compare GridFS with Amazon S3
  • Single Server Assets File Upload Resize ThumbnailsApache / Application ImageMagick Filesystem nginx Apache/nginx reads images directly from disk
  • Multi-Server Assets POTENTIAL App Server BOTTLENECK Load App Server NFS Asset ServerBalancer App Server
  • Sharded Assets Sharding Logic App Server Asset Server LoadBalancer App Server NFS Asset Server App Server Asset Server
  • Read-Only Filesystem Heroku Filesystem
  • While We’re Whining...•Disk Locality• No “Metadata” Support, No Querying• Slicing from the Middle• Naming Limits, Directory Limits• Backups and High Availability are Pain Points
  • GridFS
  • What Is GridFS?File GridFS MongoDB 256 KBFile GridFS MongoDB
  • No Writes? No Probs. Heroku GridFSFilesystem
  • Born to Shard MongoDB Sharding GridFSApp ServerApp Server GridFSApp Server GridFS
  • Separate Metadata Big File Little Metadata
  • Location, Location... Filesystem GridFS
  • No FS Worries It’s cool, baby, just take it like ! easy... Id on’t ames file n g! Too many fi GridFS your o lon in one les To directo Illegal ry! char acters! What suppos am I ed to d with th o ose?!?!Filesystem
  • Slice’n’Dice One Minute of the VideoVideo File
  • Recovery & Availability Failure GridFS GridFS to re es ReplicationBackup R Failover Grid FS GridFS Backup
  • Query & Map/Reduce Query
  • Two Great Tastes File FileServe from Nginx Serve from App
  • gridfs-fuse Apache/nginx ~1000 req/sec~6600 req/sec gridfs-fuse Filesystem
  • Beauty Ain’t CheapPretty URL URL Rewrite gridfs-fuse Request GridFS
  • There’s an App for That Asset Request Apache/ Application nginx Processed Asset Fetch Raw Cache Asset Processed Asset GridFS
  • Adding Some ShineApache/ Varnish Application nginx Fetch Raw Asset GridFS
  • What About S3?GridFS S3
  • when GridFS == S3 S3Filesystem S3 S3 ur ke yo n’t li es! I do nam file long! Too many Too in one files directo r y! Illegal charac ters! What suppos am I e with th d to do Filesystem ose?!?!
  • when GridFS > S3 One Minute of the Video Video File File
  • When GridFS < S3 S3 FileS3 Backup S3 Failover
  • else ... end$$$
  • Thanks!//obtiva.com/blogChris Powers@chrisjpowershttp://chrisjpowers.com