AWS Summit 2011: Customer Presentation - Vimeo

  • 953 views
Uploaded on

 

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
953
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
12
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Vimeo on EC2 1
  • 2. Vimeo?The best place for video creators to put their videoThe best experience for everyone: • Video quality • Video player • Community • Tools for sharing and privacy Free Users Plus Users 500mb upload per week 5GB per week Advanced stats, customization, advanced Basic tools privacy options Wait for transcoding No wait for transcoding Free $60/year 2
  • 3. Why AWS?S3, 2007 It was there High cost, small servers in managed hosting S3 had more features (query string auth – store and serve)EC2, 2008 Everyone uploads on Sundays Needed auto-scaling: two peak days per week, peak was 4x normal encoding load Free & fast transfer between EC2 and S3 3
  • 4. The Workflow EC2 • Metadata User’s Raw Sourcefile Upload S3Browser sourcefile • Verified stored Machine • HD EC2 • SD Playable CDNTranscoder • Mobile video files • Thumbnails 4
  • 5. On-demand, ReservedReserved capacity is cheaper Reserve capacity for paying customers • Guaranteed availability, even when Amazon runs out of on-demand Reserve capacity for 100% utilization Reserve capacity for 75% utilization Still need on-demand for elasticity 5
  • 6. Upload/Transcoding InfrastructureUpload m1.large instances Nginx + nodejs + SQSTranscoding c1.xlarge instances Reserved, On demand and spots Spots for low priority jobs. Instances will shut down without warning 6
  • 7. Spots@VimeoLeverage open source libraries (boto in python)Keep it SimpleOnetime spot requests, One instance per request, across all availability zonesBidding strategy 7
  • 8. Conceptualization the ObviousThinking of spots for your Database and Web servers?Failover to On demand when spot market is saturatedNever kill spots. Let Amazon do it.Watch out for open spot requests. Add expiry to your requests.Keep tweaking your Algorithm. 8
  • 9. ResultsSome months we save 50% over pure on-demand instancesGuaranteed availability for our plus users 9