Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Vimeo on EC2<br />1<br />
Vimeo?<br />2<br />
Why AWS?<br />3<br />
The Workflow<br />4<br />
On-demand, Reserved<br />5<br />
Upload/Transcoding Infrastructure<br />6<br />
Our Bidding Strategy<br />Keep it simple<br />One time spot requests; one instance per request;across all availability zon...
Reserved Instance Utilization<br />8<br />on-demand<br />% busy<br />• 96.23% utilization with 54 instances on low-traffic...
Ondemandvs Spots<br />9<br />Happy Place<br /><br />#Ondemand<br />#On-demand<br />#spots<br />#Spots<br />
Pro Tips<br />Use Spots for your low priority and less time critical jobs<br />Never kill spots. Let Amazon do it.<br />Ha...
Result<br />Some months we save 50% over pure on-demand instances<br />11<br />
Upcoming SlideShare
Loading in …5
×

Vimeo EC2 transcoding

12,150 views

Published on

Presentation by Narendra Venkataraman and Peter McArthur at the AWS Summit in NYC 2011. How Vimeo uses on-demand, spot, and reserved instances in EC2 to do Video transcoding.

Published in: Technology
  • While reserching AWS Well-Architected Pill - Cost-Optimiatization found a reference to Vimeo's Key considerations. They're helpful in that they show what metrics they considered did lead to savings.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Vimeo EC2 transcoding

  1. 1. Vimeo on EC2<br />1<br />
  2. 2. Vimeo?<br />2<br />
  3. 3. Why AWS?<br />3<br />
  4. 4. The Workflow<br />4<br />
  5. 5. On-demand, Reserved<br />5<br />
  6. 6. Upload/Transcoding Infrastructure<br />6<br />
  7. 7. Our Bidding Strategy<br />Keep it simple<br />One time spot requests; one instance per request;across all availability zones<br />Spot requests expire in 10 minutes<br />Never bid more than threshold. It is currently set to 80% of on-demand price<br />Not more than 10 open spot requests at any time<br />Bid 10% more than the average price over last hour <br />Never bid more than threshold. It is currently set to 80% of on-demand price<br />7<br />
  8. 8. Reserved Instance Utilization<br />8<br />on-demand<br />% busy<br />• 96.23% utilization with 54 instances on low-traffic day<br />• High priority jobs: Buy reserve instance capacity to meet non-peak hour loads<br />
  9. 9. Ondemandvs Spots<br />9<br />Happy Place<br /><br />#Ondemand<br />#On-demand<br />#spots<br />#Spots<br />
  10. 10. Pro Tips<br />Use Spots for your low priority and less time critical jobs<br />Never kill spots. Let Amazon do it.<br />Have more retries for jobs running on spots.<br />Watch out for open spot requests. Add expiry to your requests.<br />Long running jobs, bid higher or use on-demand<br />Failover to on-demand when spot market is saturated<br />10<br />
  11. 11. Result<br />Some months we save 50% over pure on-demand instances<br />11<br />

×