Beyond the File System Designing Large Scale File Storage and Serving Cal Henderson

Hello!

Four buckets Storage Serving BCP Cost

Storage

The storage stack File system Block protocol RAID Hardware ext, reiserFS, NTFS SCSI, SATA, FC Mirrors, Stripes Disks and stuff File protocol NFS, CIFS, SMB

DAS Direct attached storage Disk shelf, connected by SCSI/SATA HP MSA30 – 14 disks in 3U

NetApp Filers Heads and shelves, up to 500TB in 260U FC SAN with 1 or 2 NAS heads

Real Life Case Studies

GFS – Google File System 1(a) 2(a) 1(b) Master

MogileFS – OMG Files Tracker Tracker MySQL

Flickr File System SM SM SM

Serving

Edge networks Origin

Edge networks Origin Cache Cache Cache Cache Cache Cache Cache Cache

BCP

Cost

Hardware costs Cost of hardware Usable GB Single Cost

Power costs Cost of power per year Usable GB Recurring Cost

Power costs Power installation cost Usable GB Single Cost

Space costs Cost per U Usable GB [ ] U’s needed (inc network) x Recurring Cost

Network costs Cost of network gear Usable GB Single Cost

Misc costs Support contracts + spare disks Usable GB + bus adaptors + cables [ ] Single & Recurring Costs

Human costs Admin cost per node Node count x Recurring Cost Usable GB [ ]

(fin)