• Save
AWS Customer Presentation - How TubeMogul uses AWS
 

AWS Customer Presentation - How TubeMogul uses AWS

on

  • 3,566 views

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Adam Rose, CTO of TubeMogul discusses how TobeMogul uses AWS at the AWS Startup Tour - SV - 2010

Statistics

Views

Total Views
3,566
Views on SlideShare
3,549
Embed Views
17

Actions

Likes
1
Downloads
0
Comments
0

1 Embed 17

http://www.slideshare.net 17

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

AWS Customer Presentation - How TubeMogul uses AWS AWS Customer Presentation - How TubeMogul uses AWS Presentation Transcript

  • © 2010 TubeMogul Incorporated. All Rights Reserved. TubeMogul and AWS Cloudy Scaling
  • What's a TubeMogul? © 2010 TubeMogul Incorporated. All Rights Reserved. OneLoad - The nexus of online video Hyper-syndication Upload video to 25 video sharing sites in one shot In-player video analytics Provides in-depth reporting back to site owner and content creators
  • Challenges - Why AWS? Challenges AWS Solution Small Engineering / Ops teams No hardware to maintain Limited budget Linear scale cost Requirements constantly in flux Easy to change configurations System size unknown at outset Godsend here 24/7 SLAs Uptime perception was a concern (notorious S3 outages, etc.) -> Can you do better???
  • Evaluation Process
    • Already successful with our syndication platform
    • Disk I/O
      • Bonnie i/o tests
      • MADM and LVM striping
      • EBS first-use penalty!
    • Network throughput
      • Long-running tests to ensure consistent performance
    • Elastic Load-Balancer
      • Had packet drops with traffic bursts
    • Cost
      • TCO analysis is complex – weight lower CapEx against additional OpEx and opportunity cost
      • http://aws.amazon.com/economics
      • AWS has regular cost reductions
  • InPlay Architecture August 24, 2009 Metacafe Dailymotion Brightcove App-01 App-02 App-nn LB-01 LB-02 Had-01 Had-02 Had-nn MySQL-01 MySQL-02 MySQL-nn Load Balancers App Servers Hadoop Cluster MySQL Cluster REST API EC2 WWW Video Players RAID0 striped EBS HAProxy Elastic IPs Needed web scale-out and resiliency!!
  • Lessons Learned
    • LDAP and DNS needed for large systems
    • Multi-EBS nodes require serious management
    • SSH auth only! Make sure this is bullet-proof!!
      • May have dependencies on DNS, LDAP, etc.
    • Ops guys need to be coders
    • Need deployment scripts on top of AMIs
    • EC2 instances can and do fail
      • Make sure your architect accordingly! Make backups!
    • Use elastic IPs for well-known addresses, even on private interfaces
    • Consider monitoring requirements – more is better!
  • Lessons Learned
    • ELB didn't work well for our application at the time
      • Haven't re-evaluated this
    • AWS does not provide free support
      • Posting instance IDs on public forums!
    • Network and CPU performance has been stable and consistent. :)
    • Overall as a startup, it's an amazing thing...
    • Thanks!
    • Adam Rose
    • CTO, TubeMogul
    • [email_address]