An overview of MongoDB's GridFS system for storing dynamic assets without the filesystem. I show the problems with the filesystem, the advantages of GridFS and how it compares to using AWS S3.
An overview of MongoDB's GridFS system for storing dynamic assets without the filesystem. I show the problems with the filesystem, the advantages of GridFS and how it compares to using AWS S3.
Edemilson Lima, Analista Desenvolvedor at Claro BrasilVery interesting presentation! I did try to install gridfs-fuse in an Ubuntu server, but have no success in compiling it... Unfortunatelly the tips at https://github.com/mikejs/gridfs-fuse/ website are minimalist and I could not find any other place with more info about. Does anybody have a step by step install guide, with all necessary dependencies? Thank you very much.1 year ago
On Today’s Menu...•Assess Problems with Assets on Filesystem• Suggest MongoDB’s GridFS as a Solution• Explain System Implementation• Compare GridFS with Amazon S3
Single Server Assets File Upload Resize ThumbnailsApache / Application ImageMagick Filesystem nginx Apache/nginx reads images directly from disk
Multi-Server Assets POTENTIAL App Server BOTTLENECK Load App Server NFS Asset ServerBalancer App Server
Sharded Assets Sharding Logic App Server Asset Server LoadBalancer App Server NFS Asset Server App Server Asset Server
Read-Only Filesystem Heroku Filesystem
While We’re Whining...•Disk Locality• No “Metadata” Support, No Querying• Slicing from the Middle• Naming Limits, Directory Limits• Backups and High Availability are Pain Points
GridFS
What Is GridFS?File GridFS MongoDB 256 KBFile GridFS MongoDB
No Writes? No Probs. Heroku GridFSFilesystem
Born to Shard MongoDB Sharding GridFSApp ServerApp Server GridFSApp Server GridFS
Separate Metadata Big File Little Metadata
Location, Location... Filesystem GridFS
No FS Worries It’s cool, baby, just take it like ! easy... Id on’t ames file n g! Too many fi GridFS your o lon in one les To directo Illegal ry! char acters! What suppos am I ed to d with th o ose?!?!Filesystem
Slice’n’Dice One Minute of the VideoVideo File
Recovery & Availability Failure GridFS GridFS to re es ReplicationBackup R Failover Grid FS GridFS Backup
Query & Map/Reduce Query
Two Great Tastes File FileServe from Nginx Serve from App
There’s an App for That Asset Request Apache/ Application nginx Processed Asset Fetch Raw Cache Asset Processed Asset GridFS
Adding Some ShineApache/ Varnish Application nginx Fetch Raw Asset GridFS
What About S3?GridFS S3
when GridFS == S3 S3Filesystem S3 S3 ur ke yo n’t li es! I do nam file long! Too many Too in one files directo r y! Illegal charac ters! What suppos am I e with th d to do Filesystem ose?!?!
when GridFS > S3 One Minute of the Video Video File File
Gena Denisov
1–1 of 1 previous next