tofu - COOKPAD's image system

tofuCOOKPAD’s image systemIssei NarutaCOOKPAD Inc.2 Nov 2011

about meIssei Naruta ( )Engineer, COOKPAD Inc.Infrastructure Team image system / high performance webtwitter: @mirakui

cookpad.com900 million PV/monthOver 1 million recipesRails 3AWS(Amazon Web Services)

COOKPAD.has_many(:thumbnails) 280x280 144x216original image (1000x1000)

When/How do wegenerate thumbnails?

BEFORE TOFU (a year ago) User Generate thumbnailsuploadsan image app (rails) original thumbnails storage

ProblemWe should generate thumbnails ofall existing images as new sizewhen another size thumbnails are needed(We have 7 million original images!)

AFTER TOFU (now) User Store original imageuploadsan image app (rails) original original storage

AFTER TOFU (now)Store original image Generate thumbnails On demand tofu original storage

tofu architecture akamai (cdn) ELBApache Apache Apache(mod_tofu) (mod_tofu) … (mod_tofu) S3

mod_tofu.soC (Apache module)ApacheImageMagick

thumbnail url category thumbnail sizehttp://hostname/recipes/1/280/0e473ffbce0eb1e28a892fe4086b65b6.jpg id SHA1(category+id+size+SECRET_WORD)

resizing height=free width=280 /recipes/1/280/0e473ffbce0eb1e28a892fe4086b65b6.jpg

cropping 100 x 100 & center cropping/recipes/1/100x100c/819d7abe2a8b9261aa3c43e948abe7b3.jpg

jpeg quality (for mobile) low ‘100x100cq10’ ‘100x100cq30’ ‘100x100cq50’ ‘100x100cq70’ ‘100x100cq90’ high

On-demand resizing by urlFastScalable

Peak trafﬁc akamai (cdn) 7000 req/sec ELB 800 req/sec EC2 c1.xlargeApache Apache Apache(mod_tofu) (mod_tofu) … (mod_tofu) (8cores) 8 instances 100 req/sec per instance S3

fetch images from S3 resize byImageMagick

On-demand resizing by urlFastScalable

tofu scalability = AWS scalability akamai (cdn) autoscaling ELBmore instances, by itselfmore capacity Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) Oh yeah S3 It has a huge capacity!

tofu effect Our prototyping workﬂow became more fast and ﬂexible Save storage diskspace Maintenance becomes easily

Thank you for your listening

http://tech.cookpad.com	2074
http://webcache.googleusercontent.com	3
http://www.typepad.com	1
http://translate.googleusercontent.com	1

tofu - COOKPAD's image system

by Issei Naruta on Nov 09, 2011

Accessibility

Categories

Upload Details

Usage Rights

4 Embeds 2,079

Statistics

tofu - COOKPAD’s image system Presentation Transcript