Web20expo Filesystems

Beyond the File System Designing Large Scale File Storage and Serving Cal Henderson

Big file systems? ,[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],1

Four buckets Storage Serving BCP Cost

The storage stack File system Block protocol RAID Hardware ext, reiserFS, NTFS SCSI, SATA, FC Mirrors, Stripes Disks and stuff File protocol NFS, CIFS, SMB

Hardware overview ,[object Object],NAS SAN DAS Internal Higher Lower

Internal storage ,[object Object],[object Object],[object Object],[object Object]

DAS Direct attached storage Disk shelf, connected by SCSI/SATA HP MSA30 – 14 disks in 3U

SAN ,[object Object],[object Object],[object Object],[object Object],[object Object]

NAS ,[object Object],[object Object],[object Object],[object Object],[object Object]

Meet the LUN ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

NAS vs SAN ,[object Object],[object Object],[object Object]

SAN Advantages ,[object Object],[object Object],[object Object],[object Object]

Some Practical Examples ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

NetApp Filers Heads and shelves, up to 500TB in 6 Cabs FC SAN with 1 or 2 NAS heads

Isilon IQ ,[object Object],[object Object]

Vertical scaling ,[object Object],[object Object],[object Object],[object Object]

Horizontal scaling ,[object Object],[object Object],[object Object],[object Object]

Storage scaling approaches ,[object Object],[object Object],[object Object],[object Object],[object Object]

Huge FS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Huge FS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Physical nodes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Physical Nodes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Virtual nodes ,[object Object],[object Object],[object Object],[object Object],[object Object]

Virtual Nodes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Chunked space ,[object Object],[object Object],[object Object],[object Object]

Chunked space ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

GFS – Google File System ,[object Object],[object Object],[object Object],[object Object]

GFS – Google File System ,[object Object],[object Object],[object Object],[object Object],[object Object]

GFS – Google File System 1(a) 2(a) 1(b) Master

GFS – Google File System ,[object Object],[object Object],[object Object]

MogileFS – OMG Files ,[object Object],[object Object],[object Object]

MogileFS – OMG Files ,[object Object],[object Object],[object Object],[object Object]

MogileFS – OMG Files Tracker Tracker MySQL

Flickr File System ,[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object]

Amazon S3 ,[object Object],[object Object],[object Object],[object Object]

Amazon S3 Servers Amazon Users

The cost ,[object Object],[object Object],[object Object]

End costs ,[object Object],[object Object],[object Object]

Serving files ,[object Object],Apache Disk

Serving files ,[object Object],Apache Disk Apache Disk Apache Disk

Serving files ,[object Object],[object Object],[object Object],[object Object]

Caching ,[object Object],[object Object],[object Object],[object Object]

Why it works ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Two models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Replacement policies ,[object Object],[object Object],[object Object],[object Object],[object Object]

Cache Churn ,[object Object],[object Object],[object Object],[object Object]

Problems ,[object Object],[object Object],[object Object],[object Object]

CDN – Content Delivery Network ,[object Object],[object Object],[object Object],[object Object],[object Object]

Edge networks Origin Cache Cache Cache Cache Cache Cache Cache Cache

CDN Models ,[object Object],[object Object],[object Object],[object Object]

CDN Invalidation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Versioning ,[object Object],[object Object],[object Object]

Cache Invalidation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Cache versioning ,[object Object],[object Object],[object Object]

Virtual versioning ,[object Object],[object Object],[object Object],[object Object],Version 3 example.com/foo_3.jpg Cached: foo_3.jpg foo_3.jpg -> foo.jpg

Authentication ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Auth layer ,[object Object],[object Object],Cache Authenticator Origin

Auth sideline ,[object Object],[object Object],Cache Authenticator Origin

Auth by URL ,[object Object],[object Object],Cache Origin Web Server

Business Continuity Planning ,[object Object],[object Object],[object Object],[object Object]

Reality ,[object Object],[object Object],[object Object]

Reality ,[object Object],[object Object],[object Object],[object Object],[object Object]

Failure scenarios ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Reliable by design ,[object Object],[object Object],[object Object]

Tend to all points in the stack ,[object Object],[object Object],[object Object]

Recovery times ,[object Object],[object Object],[object Object],[object Object],[object Object]

Reliable Reads & Writes ,[object Object],[object Object],[object Object],[object Object],[object Object]

Dual writes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Judging cost ,[object Object],[object Object],[object Object],[object Object]

Hardware costs Cost of hardware Usable GB Single Cost

Power costs Cost of power per year Usable GB Recurring Cost

Power costs Power installation cost Usable GB Single Cost

Space costs Cost per U Usable GB [ ] U’s needed (inc network) x Recurring Cost

Network costs Cost of network gear Usable GB Single Cost

Misc costs Support contracts + spare disks Usable GB + bus adaptors + cables [ ] Single & Recurring Costs

Human costs Admin cost per node Node count x Recurring Cost Usable GB [ ]

TCO ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Photo credits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object]

Web20expo Filesystems

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Viewers also liked

Viewers also liked (6)

Similar to Web20expo Filesystems

Similar to Web20expo Filesystems (20)

Recently uploaded

Recently uploaded (20)

Web20expo Filesystems