AWS Customer Presentation - How TubeMogul uses AWS

3,298
-1

Published on

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,298
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

AWS Customer Presentation - How TubeMogul uses AWS

  1. 1. © 2010 TubeMogul Incorporated. All Rights Reserved. TubeMogul and AWS Cloudy Scaling
  2. 2. What's a TubeMogul? © 2010 TubeMogul Incorporated. All Rights Reserved. OneLoad - The nexus of online video Hyper-syndication Upload video to 25 video sharing sites in one shot In-player video analytics Provides in-depth reporting back to site owner and content creators
  3. 3. Challenges - Why AWS? Challenges AWS Solution Small Engineering / Ops teams No hardware to maintain Limited budget Linear scale cost Requirements constantly in flux Easy to change configurations System size unknown at outset Godsend here 24/7 SLAs Uptime perception was a concern (notorious S3 outages, etc.) -> Can you do better???
  4. 4. Evaluation Process <ul><li>Already successful with our syndication platform </li></ul><ul><li>Disk I/O </li></ul><ul><ul><li>Bonnie i/o tests </li></ul></ul><ul><ul><li>MADM and LVM striping </li></ul></ul><ul><ul><li>EBS first-use penalty! </li></ul></ul><ul><li>Network throughput </li></ul><ul><ul><li>Long-running tests to ensure consistent performance </li></ul></ul><ul><li>Elastic Load-Balancer </li></ul><ul><ul><li>Had packet drops with traffic bursts </li></ul></ul><ul><li>Cost </li></ul><ul><ul><li>TCO analysis is complex – weight lower CapEx against additional OpEx and opportunity cost </li></ul></ul><ul><ul><li>http://aws.amazon.com/economics </li></ul></ul><ul><ul><li>AWS has regular cost reductions </li></ul></ul>
  5. 5. InPlay Architecture August 24, 2009 Metacafe Dailymotion Brightcove App-01 App-02 App-nn LB-01 LB-02 Had-01 Had-02 Had-nn MySQL-01 MySQL-02 MySQL-nn Load Balancers App Servers Hadoop Cluster MySQL Cluster REST API EC2 WWW Video Players RAID0 striped EBS HAProxy Elastic IPs Needed web scale-out and resiliency!!
  6. 6. Lessons Learned <ul><li>LDAP and DNS needed for large systems </li></ul><ul><li>Multi-EBS nodes require serious management </li></ul><ul><li>SSH auth only! Make sure this is bullet-proof!! </li></ul><ul><ul><li>May have dependencies on DNS, LDAP, etc. </li></ul></ul><ul><li>Ops guys need to be coders </li></ul><ul><li>Need deployment scripts on top of AMIs </li></ul><ul><li>EC2 instances can and do fail </li></ul><ul><ul><li>Make sure your architect accordingly! Make backups! </li></ul></ul><ul><li>Use elastic IPs for well-known addresses, even on private interfaces </li></ul><ul><li>Consider monitoring requirements – more is better! </li></ul>
  7. 7. Lessons Learned <ul><li>ELB didn't work well for our application at the time </li></ul><ul><ul><li>Haven't re-evaluated this </li></ul></ul><ul><li>AWS does not provide free support </li></ul><ul><ul><li>Posting instance IDs on public forums! </li></ul></ul><ul><li>Network and CPU performance has been stable and consistent. :) </li></ul><ul><li>Overall as a startup, it's an amazing thing... </li></ul>
  8. 8. <ul><li>Thanks! </li></ul><ul><li>Adam Rose </li></ul><ul><li>CTO, TubeMogul </li></ul><ul><li>[email_address] </li></ul>

×