CloudLab: A File System Friendly Key Value Store

A File-System Friendly Key Value Store Cloud-Scale File Serving and Storage MaxiScale FLEX Software Platform @garyorenstein | go@maxiscale.com April 2010 Page MaxiScale

The Era of Billions 10 billion Tweets 10 billion downloads 3 billion photos/month 12 billion views January April 2010 Page MaxiScale

Beyond Capacity to Users and Objects Everyone is a content consumer AND creator April 2010 Page MaxiScale

Impact of The Era of Billions
Companies face relentless pressure to store and serve data cost-effectively
April 2010 Page MaxiScale

Cloud Applications Requirements: Fast, Scalable, Affordable “Light” Structured Data Retrieval Page April 2010 MaxiScale

Basics Anatomy of a Key-Value Store April 2010 Page Source: http://dominicfallows.co.uk MaxiScale

MaxiScale Key Value Store Benefits Page April 2010 MaxiScale

Breakthrough FLEX Software Platform
Software Infrastructure
On commodity hardware
Targeted to
Web companies
Service Providers
Enterprises
Delivers file serving and storage to web and scale-out applications
Web / App Servers File Serving and Storage April 2010 Page Internet MaxiScale

MaxiScale FLEX Platform: Core Technologies Distributed Platform Single Namespace Distributed Metadata and Data Peer Sets Optimized File Serving
Unified Management
Distributed
MapReduce-enabled
Planned:
Custom apps (Hadoop)
Linux and Windows Clients Small File Performance (key-value store) High-Density Storage Scale-Out NAS April 2010 Page MaxiScale Storage I/O Bandwidth CPU

Simplicity of a Single Namespace April 2010 Page Small File Performance (key-value store) Scale-Out NAS Single mount point / /NFR/ /SFR/
Directories
Large files
Small objects
Flat hierarchy
Screaming performance
MaxiScale

FLEX Software Platform In Action Utmost system efficiency from client to network to cluster Peer Set April 2010 Page MaxiScale

Fast Lookups Directly from Disk
Return values up to 1MB in a single disk I/O operation
Automatically create file and index entry using POSIX open() call
Read index, then metadata and data in single disk I/O
Index maps to disk blocks for single disk I/O file retrieval
April 2010 Page Index (RAM) Metadata and Data (Disk) MaxiScale

Performance Counts
Customer results
4 nodes
80KB files
736 files/second
63.6 million per day
Files/spindle/sec Read tests with 32KB files and small file optimizations April 2010 Page MaxiScale

Selecting a Key Value Store April 2010 Page MaxiScale

Accelerating Web content serving Page Brute-force speed-up Hardware and development cost Performance Efficient key-value lookup without database queries Slash cost Fast lookup Web-scale April 2010 MaxiScale Do-it-yourself key value store RAM Cache RAM Cache Relational DB (MySQL …) Relational DB (MySQL …) MaxiScale key value store

Page Which key value store and file system are right for your application? High Availability? Key Length? Lookup Latency? Number of Keys? Cost? Size of Values? Data Storage Density? April 2010 MaxiScale

Key value store landscape Page Circles represent relative usable capacity at load Memcache High RAM cost in large quantities Cost MaxiScale Single disk I/O Reads Petabyte scale Relational DB Long lookup latency File systems Long read latency Solid state disk High flash cost in large quantities
Billions of keys; auto- expandable
Key length < 1000 characters
Lookup latency 5-10ms per key
Stored values up to 1MB
Highly available storage
Latency April 2010 MaxiScale

Placing Key Value Stores in Context April 2010 Page MaxiScale Relational Databases Key-Value Stores File System Friendly Key-Value Stores File Systems
SQL
Joins
ACID
Big Data
Billions of Small Objects
Application Flexibility (unique data access mechanism)
Big Data
Billions of Small Objects
Filename as key (or system generated key)
POSIX compliance
Same namespace as file system
Large Objects
Petabytes of content
Directory structures
POSIX compliance

Social Networking Case Study Page April 2010 MaxiScale

Social networking application example
Challenges
Expensive filer hardware
1000’s of mount points to manage
Difficult to scale at 30% year-over-year growth
Before MaxiScale
April 2010 Page 175 TB content repository across multiple NAS systems Sharded database instances for profiles, messages… Application Servers Web Servers MaxiScale

Social networking application example
Benefits
Single storage mount point per server
Serve photos and video clips in 5 milliseconds
With MaxiScale
April 2010 Page Application Servers Web Servers Financial savings Capital expense: 60% Operating expense: $105K First-year ROI: 187% News feed, message, and profile data Direct photo retrieval and upload MaxiScale Value

A Deeper Look at Photo Serving Case Study Page April 2010 MaxiScale

Examples of Photo Serving Requirements Page April 2010 MaxiScale

Originals in NFR POSIX-compliant hierarchy
/nfr/joe@maxiscale.com
/vacations
/florida
High-Resolution Original Images IMG_01234.JPG IMG_04567.JPG IMG_06789.JPG Page April 2010 MaxiScale

Generate thumbnails
/vacations.florida. thumb96 .img01234.jpg
Pre-Rendered Thumbnails IMG_01234.JPG 96 pixels wide 480 pixels wide 640 pixels wide Application Process Page April 2010 MaxiScale

User Profiles
Use Key Value Store in SFR to store user profiles
Single I/O file retrieval
Data record up to 1 MB
[email_address]
<id>joe@maxiscale.com
<password>*****
<album set>vacations
<album>florida
<images> IMG_01234.JPG, IMG_04567.JPG, IMG_06789.JPG
<thumbnail bundle 96 pixels>
vacations.florida.thumbs96
<album set>family
<album>kid
Page April 2010 MaxiScale

MaxiScale Photo Serving Features and Benefits Page April 2010 MaxiScale MaxiScale Feature Benefit POSIX-compliant file system hierarchy with NFR Segment users, album sets, and albums into traditional directory structure Small File Repository (SFR)
Single I/O file retrieval
Thumbnails
Profiles
Key Value Store
Single I/O profile retrieval
Billions of keys
Up to 1 MB value/record length
Photo serving feature set leads to reduced infrastructure costs to meet user demand.

Delivering Cloud-Scale File Serving and Storage
New scale-out application requirements
Horizontal scale, linear performance
Full availability and resiliency
Utmost cost-efficiency
MaxiScale delivers
Cloud-Scale file serving and storage software
Simple and always online
Game changing cost using commodity hardware
File System Friendly Key Value Store
Page MaxiScale helps companies handle relentless pressure to store and serve data cost-effectively April 2010 MaxiScale

Thank You @garyorenstein | go@maxiscale.com @maxiscale | www.MaxiScale.com Page April 2010 MaxiScale

http://blog.maxiscale.com	25
http://www.slideshare.net	12
http://www.typepad.com	1

CloudLab: A File System Friendly Key Value Store

by MaxiScale on Apr 27, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

3 Embeds 38

Statistics

CloudLab: A File System Friendly Key Value Store — Webinar Transcript