Your SlideShare is downloading. ×
0
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
AWS Customer Presentation - How TubeMogul uses AWS
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

AWS Customer Presentation - How TubeMogul uses AWS

2,900

Published on

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,900
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. © 2010 TubeMogul Incorporated. All Rights Reserved. TubeMogul and AWS Cloudy Scaling
  • 2. What's a TubeMogul? © 2010 TubeMogul Incorporated. All Rights Reserved. OneLoad - The nexus of online video Hyper-syndication Upload video to 25 video sharing sites in one shot In-player video analytics Provides in-depth reporting back to site owner and content creators
  • 3. Challenges - Why AWS? Challenges AWS Solution Small Engineering / Ops teams No hardware to maintain Limited budget Linear scale cost Requirements constantly in flux Easy to change configurations System size unknown at outset Godsend here 24/7 SLAs Uptime perception was a concern (notorious S3 outages, etc.) -> Can you do better???
  • 4. Evaluation Process <ul><li>Already successful with our syndication platform </li></ul><ul><li>Disk I/O </li></ul><ul><ul><li>Bonnie i/o tests </li></ul></ul><ul><ul><li>MADM and LVM striping </li></ul></ul><ul><ul><li>EBS first-use penalty! </li></ul></ul><ul><li>Network throughput </li></ul><ul><ul><li>Long-running tests to ensure consistent performance </li></ul></ul><ul><li>Elastic Load-Balancer </li></ul><ul><ul><li>Had packet drops with traffic bursts </li></ul></ul><ul><li>Cost </li></ul><ul><ul><li>TCO analysis is complex – weight lower CapEx against additional OpEx and opportunity cost </li></ul></ul><ul><ul><li>http://aws.amazon.com/economics </li></ul></ul><ul><ul><li>AWS has regular cost reductions </li></ul></ul>
  • 5. InPlay Architecture August 24, 2009 Metacafe Dailymotion Brightcove App-01 App-02 App-nn LB-01 LB-02 Had-01 Had-02 Had-nn MySQL-01 MySQL-02 MySQL-nn Load Balancers App Servers Hadoop Cluster MySQL Cluster REST API EC2 WWW Video Players RAID0 striped EBS HAProxy Elastic IPs Needed web scale-out and resiliency!!
  • 6. Lessons Learned <ul><li>LDAP and DNS needed for large systems </li></ul><ul><li>Multi-EBS nodes require serious management </li></ul><ul><li>SSH auth only! Make sure this is bullet-proof!! </li></ul><ul><ul><li>May have dependencies on DNS, LDAP, etc. </li></ul></ul><ul><li>Ops guys need to be coders </li></ul><ul><li>Need deployment scripts on top of AMIs </li></ul><ul><li>EC2 instances can and do fail </li></ul><ul><ul><li>Make sure your architect accordingly! Make backups! </li></ul></ul><ul><li>Use elastic IPs for well-known addresses, even on private interfaces </li></ul><ul><li>Consider monitoring requirements – more is better! </li></ul>
  • 7. Lessons Learned <ul><li>ELB didn't work well for our application at the time </li></ul><ul><ul><li>Haven't re-evaluated this </li></ul></ul><ul><li>AWS does not provide free support </li></ul><ul><ul><li>Posting instance IDs on public forums! </li></ul></ul><ul><li>Network and CPU performance has been stable and consistent. :) </li></ul><ul><li>Overall as a startup, it's an amazing thing... </li></ul>
  • 8. <ul><li>Thanks! </li></ul><ul><li>Adam Rose </li></ul><ul><li>CTO, TubeMogul </li></ul><ul><li>[email_address] </li></ul>

×