Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

PutPlace's use of Amazon Cloud Services

Joe Drumgoole CTO of PutPlace talks about how PutPlace uses Amazon's web services.

  • Be the first to comment

PutPlace's use of Amazon Cloud Services

  1. 1. Secure ● Organise ● Share …your Digital Lifetime
  2. 2. PutPlace <ul><li>Online Backup Service </li></ul><ul><li>Mac and Windows Clients </li></ul><ul><li>Provide Sharing integration with Flickr/YouTube (Real Soon!) </li></ul><ul><li>Original BP planned to spend 1m on data-centre in 2007 </li></ul>
  3. 3. PutPlace Grid
  4. 4. The PutPlace Grid
  5. 5. Key Stats <ul><li>Been using Amazon EC2/S3 in production since Jan ‘08 </li></ul><ul><li>Public paid service launched in Oct ’08 </li></ul><ul><li>Backing up around 15000 user files everyday </li></ul><ul><li>Spend </li></ul><ul><ul><li>EC2 – USD $ 1200 a month </li></ul></ul><ul><ul><li>S3 – USD $ 470 a month (S3 costs approximately double each month) </li></ul></ul><ul><ul><li>Elastic IP – Use it but its really slow to respond </li></ul></ul><ul><ul><li>No Simple DB (we use Postgres) </li></ul></ul><ul><ul><li>No SQS (slow, non-determininistic, pricey) </li></ul></ul><ul><ul><li>No EBS ( waiting and seeing how others perform) </li></ul></ul><ul><ul><li>Keen on CDN! </li></ul></ul>
  6. 6. Things We Use <ul><li>Perlbal – Load balancing </li></ul><ul><li>Postgres – Database </li></ul><ul><li>Django – App Servers and Task Managers </li></ul><ul><li>Nagios – Internal Monitoring </li></ul><ul><li>Monitis – External Monitoring </li></ul><ul><li>Hamachi – Virtual Private Network (but no more free  ) </li></ul><ul><li>Hudson – Build Service </li></ul><ul><li>Lots of Hosted Services </li></ul><ul><ul><li>Monitis </li></ul></ul><ul><ul><li>DynDNS </li></ul></ul><ul><ul><li>GoDaddy </li></ul></ul><ul><ul><li>Google Docs </li></ul></ul><ul><ul><li>Google Sites </li></ul></ul><ul><ul><li>Google Email </li></ul></ul>
  7. 7. How we cut costs <ul><li>Big chunk of EC2 cost is DB large instance </li></ul><ul><ul><li>Partition DB and run on smaller instances </li></ul></ul><ul><li>Storage is a variable cost </li></ul><ul><ul><li>compression and deduplication help </li></ul></ul><ul><li>We get hammered for puts, posts, lists </li></ul><ul><ul><li>Switch to MogileFS </li></ul></ul><ul><li>Dirty little secret of online backup – nobody downloads </li></ul><ul><ul><li>Bandwidth is a marginal cost </li></ul></ul><ul><li>Automation </li></ul><ul><ul><li>Can bring up (and down) a new grid in 10 minutes </li></ul></ul>
  8. 8. The Future <ul><li>Gearman for Task Management </li></ul><ul><li>CDN for static content </li></ul><ul><li>Choice of Storage/Grid in Europe or US </li></ul><ul><li>More use of regions for fault tolerance </li></ul><ul><li>More automation around monitoring and deployment </li></ul><ul><li>More stats </li></ul><ul><li>Archive Service? </li></ul>

×