Scaling Drupal in the Amazon Cloud - Slides from DrupalconDC

3,428 views

Published on

Using the cloud to handle high peak traffic for limited times - without going broke.

Scaling Drupal using Amazon Web Services.

A talk by Frank Febbraro and Eric Johnson at Drupalcon DC.

http://dc2009.drupalcon.org/session/scaling-drupal-using-amazon-web-services-aws

http://el-studio.com/articles/scaling-drupal-amazon-cloud-drupalcon-presentation

Published in: Technology
0 Comments
7 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,428
On SlideShare
0
From Embeds
0
Number of Embeds
264
Actions
Shares
0
Downloads
143
Comments
0
Likes
7
Embeds 0
No embeds

No notes for slide

  • ERIC
  • ERIC
  • ERIC
  • ERIC
  • ERIC
  • ERIC
  • FRANK
  • ERIC
  • FF
  • FF persistent distributed storage for files via http post/get, high latency
  • FF servers
  • FF low latency, permanent storage, but not multi datacenter
  • FF
  • ERIC
  • ERIC
    multiple front ends
    master/slave database
    dedicated edit server
    ebs mounted filesystems (files & db)
    sync files to front ends every minute
    not ideal for large number of logged-in users
  • FF It is important to note that your deployment in cloud scenarios is often “developed” in much the same way your site is developed and it requires time, testing, review, etc. DO not underestimate this amount of time.
  • command line, aws console, puppet, etc.
  • EJ
  • EJ The one sentence summary is that the current EC2 console is a control panel that gives you access to all EC2 functions while RightScale is a complete management platform to design, deploy, and manage the life-cycle of mission critical cloud deployments.

  • EJ Leading provider of mangement console for entire server deployment environment. Their onsole
  • EJ
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • FF
  • EJ extract the variations and things that are required to be unique and provide them as input.

  • EJ done based on deployments. server + templates = deployment
    deployments only vary based on the inputs given
    to make these diff envs, just clone your deployment
  • FF test the hell out of it. This is where a ton of your work developing the deployment applies
  • FF you need sysadmin skills on staff, or cloud management. Depends on the usage profile of your site, kernel requirements, etc.

  • Scaling Drupal in the Amazon Cloud - Slides from DrupalconDC

    1. 1. SCALING DRUPAL IN THE CLOUD Eric Johnson - Case Foundation Frank Febbraro - Phase2 Technology Friday, March 6, 2009
    2. 2. THE CHALLENGE Super high peak traffic for just a few hours Without going broke Friday, March 6, 2009
    3. 3. FROM THIS Friday, March 6, 2009
    4. 4. TO THIS Friday, March 6, 2009
    5. 5. TO THIS Friday, March 6, 2009
    6. 6. WITH JUST A FEW CLICKS Friday, March 6, 2009
    7. 7. THE PEOPLE Eric at The Case Foundation • Was spending for boxes not always needed • Runs periodic campaigns (48,000 people donating for 6 month grant competition) • Likes to send press releases • Moved Drupal to AWS in December 2007 Friday, March 6, 2009
    8. 8. THE PEOPLE Frank at Phase2 Technology • Architect • First significant AWS deployments • Kickoff to deployment in 5 weeks • Team developed code & deployment scaling concurrently Friday, March 6, 2009
    9. 9. IN THE CLOUD The Promise The Challenge Servers when you need Configuration, please Multiple datacenters Filesystem sync $70/month/cpu + bandwidth Pay for what you need Friday, March 6, 2009
    10. 10. WHAT IS AWS? Amazon Web Services Friday, March 6, 2009
    11. 11. S3 super simple storage Friday, March 6, 2009
    12. 12. EC2 elastic compute cloud Friday, March 6, 2009
    13. 13. EBS elastic block storage Friday, March 6, 2009
    14. 14. SHUT UP ALREADY! how do I actually deploy & scale my site Friday, March 6, 2009
    15. 15. OUR SOLUTION • multiple front ends • master/slave database • dedicated edit server • ebs mounted filesystems (files & db) • sync files to front ends every minute • not ideal for large number of editors Friday, March 6, 2009
    16. 16. SOLUTION Load Balancer (or DNS) Edit Front-ends Master Slave Friday, March 6, 2009
    17. 17. now it is time to develop your deployment Friday, March 6, 2009
    18. 18. directly on on aws Friday, March 6, 2009
    19. 19. DO YOU NEED HELP? Friday, March 6, 2009
    20. 20. CLOUD MANAGEMENT RightScale, Scalr, etc. Friday, March 6, 2009
    21. 21. we chose RightScale Friday, March 6, 2009
    22. 22. WHY RIGHTSCALE? Friday, March 6, 2009
    23. 23. LETS GET TO IT Friday, March 6, 2009
    24. 24. Friday, March 6, 2009
    25. 25. EC2 Instance Boot Scripts Friday, March 6, 2009
    26. 26. EC2 Instance Boot Scripts AMI - O/S Friday, March 6, 2009
    27. 27. EC2 Instance Boot Scripts php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    28. 28. EC2 Instance Boot Scripts mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    29. 29. EC2 Instance Boot Scripts vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    30. 30. EC2 Instance Boot Scripts deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    31. 31. EC2 Instance Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    32. 32. EC2 Instance Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    33. 33. EC2 Instance Operational Scripts Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    34. 34. EC2 Instance Operational Scripts backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    35. 35. EC2 Instance Operational Scripts site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    36. 36. EC2 Instance Operational Scripts failover site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    37. 37. EC2 Instance Operational Scripts failover site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
    38. 38. EC2 Instance Operational Scripts M failover o n site deployment i t backup snapshot o r Boot Scripts i n register with load balancer g deploy site, restore db & vhost install, customize config A l e mount EBS, DNS r t php, httpd, apc, memcached s AMI - O/S Friday, March 6, 2009
    39. 39. template everything Friday, March 6, 2009
    40. 40. Friday, March 6, 2009
    41. 41. what about test, stage & production Friday, March 6, 2009
    42. 42. failover Friday, March 6, 2009
    43. 43. is the cloud right for you? Friday, March 6, 2009
    44. 44. QUESTIONS? Friday, March 6, 2009
    45. 45. OR DROP US A NOTE Eric Johnson • Director of Technology The Case Foundation @elstudio http://el-studio.com/tag/cloud/  Frank Febbraro • CTO Phase2 Technology @febbraro http://agileapproach.com Friday, March 6, 2009

    ×