PutPlace's use of Amazon Cloud Services

2,279 views

Published on

Joe Drumgoole CTO of PutPlace talks about how PutPlace uses Amazon's web services.

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,279
On SlideShare
0
From Embeds
0
Number of Embeds
64
Actions
Shares
0
Downloads
44
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Welcome to our Investors briefing,
  • PutPlace's use of Amazon Cloud Services

    1. 1. Secure ● Organise ● Share …your Digital Lifetime
    2. 2. PutPlace <ul><li>Online Backup Service </li></ul><ul><li>Mac and Windows Clients </li></ul><ul><li>Provide Sharing integration with Flickr/YouTube (Real Soon!) </li></ul><ul><li>Original BP planned to spend 1m on data-centre in 2007 </li></ul>
    3. 3. PutPlace Grid
    4. 4. The PutPlace Grid
    5. 5. Key Stats <ul><li>Been using Amazon EC2/S3 in production since Jan ‘08 </li></ul><ul><li>Public paid service launched in Oct ’08 </li></ul><ul><li>Backing up around 15000 user files everyday </li></ul><ul><li>Spend </li></ul><ul><ul><li>EC2 – USD $ 1200 a month </li></ul></ul><ul><ul><li>S3 – USD $ 470 a month (S3 costs approximately double each month) </li></ul></ul><ul><ul><li>Elastic IP – Use it but its really slow to respond </li></ul></ul><ul><ul><li>No Simple DB (we use Postgres) </li></ul></ul><ul><ul><li>No SQS (slow, non-determininistic, pricey) </li></ul></ul><ul><ul><li>No EBS ( waiting and seeing how others perform) </li></ul></ul><ul><ul><li>Keen on CDN! </li></ul></ul>
    6. 6. Things We Use <ul><li>Perlbal – Load balancing </li></ul><ul><li>Postgres – Database </li></ul><ul><li>Django – App Servers and Task Managers </li></ul><ul><li>Nagios – Internal Monitoring </li></ul><ul><li>Monitis – External Monitoring </li></ul><ul><li>Hamachi – Virtual Private Network (but no more free  ) </li></ul><ul><li>Hudson – Build Service </li></ul><ul><li>Lots of Hosted Services </li></ul><ul><ul><li>Monitis </li></ul></ul><ul><ul><li>DynDNS </li></ul></ul><ul><ul><li>GoDaddy </li></ul></ul><ul><ul><li>Google Docs </li></ul></ul><ul><ul><li>Google Sites </li></ul></ul><ul><ul><li>Google Email </li></ul></ul>
    7. 7. How we cut costs <ul><li>Big chunk of EC2 cost is DB large instance </li></ul><ul><ul><li>Partition DB and run on smaller instances </li></ul></ul><ul><li>Storage is a variable cost </li></ul><ul><ul><li>compression and deduplication help </li></ul></ul><ul><li>We get hammered for puts, posts, lists </li></ul><ul><ul><li>Switch to MogileFS </li></ul></ul><ul><li>Dirty little secret of online backup – nobody downloads </li></ul><ul><ul><li>Bandwidth is a marginal cost </li></ul></ul><ul><li>Automation </li></ul><ul><ul><li>Can bring up (and down) a new grid in 10 minutes </li></ul></ul>
    8. 8. The Future <ul><li>Gearman for Task Management </li></ul><ul><li>CDN for static content </li></ul><ul><li>Choice of Storage/Grid in Europe or US </li></ul><ul><li>More use of regions for fault tolerance </li></ul><ul><li>More automation around monitoring and deployment </li></ul><ul><li>More stats </li></ul><ul><li>Archive Service? </li></ul>

    ×