Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

AWS Customer Presentation - How TubeMogul uses AWS


Published on

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Published in: Technology
  • Be the first to comment

AWS Customer Presentation - How TubeMogul uses AWS

  1. 1. © 2010 TubeMogul Incorporated. All Rights Reserved. TubeMogul and AWS Cloudy Scaling
  2. 2. What's a TubeMogul? © 2010 TubeMogul Incorporated. All Rights Reserved. OneLoad - The nexus of online video Hyper-syndication Upload video to 25 video sharing sites in one shot In-player video analytics Provides in-depth reporting back to site owner and content creators
  3. 3. Challenges - Why AWS? Challenges AWS Solution Small Engineering / Ops teams No hardware to maintain Limited budget Linear scale cost Requirements constantly in flux Easy to change configurations System size unknown at outset Godsend here 24/7 SLAs Uptime perception was a concern (notorious S3 outages, etc.) -> Can you do better???
  4. 4. Evaluation Process <ul><li>Already successful with our syndication platform </li></ul><ul><li>Disk I/O </li></ul><ul><ul><li>Bonnie i/o tests </li></ul></ul><ul><ul><li>MADM and LVM striping </li></ul></ul><ul><ul><li>EBS first-use penalty! </li></ul></ul><ul><li>Network throughput </li></ul><ul><ul><li>Long-running tests to ensure consistent performance </li></ul></ul><ul><li>Elastic Load-Balancer </li></ul><ul><ul><li>Had packet drops with traffic bursts </li></ul></ul><ul><li>Cost </li></ul><ul><ul><li>TCO analysis is complex – weight lower CapEx against additional OpEx and opportunity cost </li></ul></ul><ul><ul><li> </li></ul></ul><ul><ul><li>AWS has regular cost reductions </li></ul></ul>
  5. 5. InPlay Architecture August 24, 2009 Metacafe Dailymotion Brightcove App-01 App-02 App-nn LB-01 LB-02 Had-01 Had-02 Had-nn MySQL-01 MySQL-02 MySQL-nn Load Balancers App Servers Hadoop Cluster MySQL Cluster REST API EC2 WWW Video Players RAID0 striped EBS HAProxy Elastic IPs Needed web scale-out and resiliency!!
  6. 6. Lessons Learned <ul><li>LDAP and DNS needed for large systems </li></ul><ul><li>Multi-EBS nodes require serious management </li></ul><ul><li>SSH auth only! Make sure this is bullet-proof!! </li></ul><ul><ul><li>May have dependencies on DNS, LDAP, etc. </li></ul></ul><ul><li>Ops guys need to be coders </li></ul><ul><li>Need deployment scripts on top of AMIs </li></ul><ul><li>EC2 instances can and do fail </li></ul><ul><ul><li>Make sure your architect accordingly! Make backups! </li></ul></ul><ul><li>Use elastic IPs for well-known addresses, even on private interfaces </li></ul><ul><li>Consider monitoring requirements – more is better! </li></ul>
  7. 7. Lessons Learned <ul><li>ELB didn't work well for our application at the time </li></ul><ul><ul><li>Haven't re-evaluated this </li></ul></ul><ul><li>AWS does not provide free support </li></ul><ul><ul><li>Posting instance IDs on public forums! </li></ul></ul><ul><li>Network and CPU performance has been stable and consistent. :) </li></ul><ul><li>Overall as a startup, it's an amazing thing... </li></ul>
  8. 8. <ul><li>Thanks! </li></ul><ul><li>Adam Rose </li></ul><ul><li>CTO, TubeMogul </li></ul><ul><li>[email_address] </li></ul>