Scalable Web Architectures: Common Patterns and Approaches - Web 2.0 Expo NYC

Scalable Web Architectures Common Patterns & Approaches Cal Henderson

Flickr ,[object Object],[object Object],[object Object],[object Object],[object Object]

Scalable Web Architectures? ,[object Object],[object Object],[object Object]

[object Object],[object Object]

Scalability – myths and lies ,[object Object]

Scalability – myths and lies ,[object Object],[object Object],[object Object],[object Object],[object Object]

Scalability – myths and lies ,[object Object],[object Object],[object Object],[object Object]

Today ,[object Object],[object Object],[object Object]

Today ,[object Object],[object Object],[object Object],[object Object]

Scalability ,[object Object],[object Object],[object Object]

Big Irons Sunfire E20k $450,000 - $2,500,000 36x 1.8GHz processors PowerEdge SC1435 Dualcore 1.8 GHz processor Around $1,500

That’s OK ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The H & the V ,[object Object],[object Object]

Architectures then? ,[object Object],[object Object],[object Object]

LAMP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Simple web apps ,[object Object],[object Object],Interwebnet App server Database

Simple web apps ,[object Object],[object Object],Interwobnet App server Database Cache Storage array AJAX!!!1

App servers ,[object Object],[object Object]

App servers ,[object Object],[object Object],[object Object]

App servers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Local sessions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mobile local sessions ,[object Object],[object Object],[object Object],[object Object],[object Object]

Remote centralized sessions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

No sessions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Super slim sessions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

App servers ,[object Object],[object Object],[object Object],[object Object]

Trifle Sponge / Database Jelly / Business Logic Custard / Page Logic Cream / Markup Fruit / Presentation

Well, that was easy ,[object Object],[object Object],[object Object],[object Object],[object Object]

The others ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Amazon ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Load balancing ,[object Object],[object Object],[object Object]

Hardware LB ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software LB ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software LB ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The layers ,[object Object],[object Object],[object Object],[object Object],[object Object]

Parallelizable == easy! ,[object Object],[object Object],[object Object],[object Object],[object Object]

Databases ,[object Object],[object Object],[object Object]

More read power ,[object Object],[object Object],[object Object]

Master-Slave Replication Reads and Writes Reads

Caching ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Caching ,[object Object],[object Object],[object Object],[object Object]

Sideline cache ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Memcache schemes ,[object Object],[object Object],[object Object],[object Object]

Memcache schemes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SPOF! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Master-Master ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Rings ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Dual trees ,[object Object],[object Object],[object Object],[object Object]

Cost models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

N+M ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Meshed masters ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data federation ,[object Object],[object Object],[object Object],[object Object]

Simple things first ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data federation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Data federation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The wordpress.com approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Downsides ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Bottom line ,[object Object],[object Object],[object Object],[object Object],[object Object]

Multiple Datacenters ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

GSLB ,[object Object],[object Object],[object Object],[object Object],[object Object]

Serving lots of files ,[object Object],[object Object],[object Object],[object Object],[object Object]

Reverse proxy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Invalidation ,[object Object],[object Object],[object Object]

Invalidation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

CDN – Content Delivery Network ,[object Object],[object Object],[object Object],[object Object],[object Object]

Edge networks Origin Cache Cache Cache Cache Cache Cache Cache Cache

CDN Models ,[object Object],[object Object],[object Object],[object Object]

CDN Invalidation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Versioning ,[object Object],[object Object],[object Object]

Cache Invalidation ,[object Object],[object Object],[object Object],[object Object],[object Object]

Cache versioning ,[object Object],[object Object],[object Object]

Virtual versioning ,[object Object],[object Object],[object Object],[object Object],Version 3 example.com/foo_3.jpg Cached: foo_3.jpg foo_3.jpg -> foo.jpg

More reverse proxy ,[object Object],[object Object],[object Object]

High overhead serving ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Perlbal Re-proxying ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Perlbal Re-proxying ,[object Object],[object Object],[object Object]

Permission URLs ,[object Object],[object Object],[object Object],[object Object],[object Object]

Permission URLs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Storing lots of files ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Connecting to storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Multiple volumes ,[object Object],[object Object],[object Object],[object Object],[object Object]

Multiple hosts ,[object Object],[object Object],[object Object],[object Object]

HA Storage ,[object Object],[object Object],[object Object],[object Object],[object Object]

HA Storage ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Self repairing systems ,[object Object],[object Object],[object Object],[object Object],[object Object]

GFS – Google File System ,[object Object],[object Object],[object Object],[object Object]

GFS – Google File System ,[object Object],[object Object],[object Object],[object Object],[object Object]

GFS – Google File System 1(a) 2(a) 1(b) Master

GFS – Google File System ,[object Object],[object Object],[object Object]

MogileFS – OMG Files ,[object Object],[object Object],[object Object]

MogileFS – OMG Files ,[object Object],[object Object],[object Object],[object Object]

MogileFS – OMG Files Tracker Tracker MySQL

Flickr File System ,[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Flickr File System ,[object Object],[object Object]

Amazon S3 ,[object Object],[object Object],[object Object],[object Object]

Amazon S3 Servers Amazon Users

The cost ,[object Object],[object Object],[object Object]

End costs ,[object Object],[object Object],[object Object]

Real world examples ,[object Object],[object Object],[object Object],[object Object]

Awesome! ,[object Object],[object Object]

Scalable Web Architectures: Common Patterns and Approaches - Web 2.0 Expo NYC

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (10)

Similar to Scalable Web Architectures: Common Patterns and Approaches - Web 2.0 Expo NYC

Similar to Scalable Web Architectures: Common Patterns and Approaches - Web 2.0 Expo NYC (20)

More from Cal Henderson

More from Cal Henderson (9)

Recently uploaded

Recently uploaded (20)

Scalable Web Architectures: Common Patterns and Approaches - Web 2.0 Expo NYC