SlideShare a Scribd company logo
1 of 45
SCALING DRUPAL
                         IN THE CLOUD
                          Eric Johnson - Case Foundation
                        Frank Febbraro - Phase2 Technology




Friday, March 6, 2009
THE CHALLENGE
                        Super high peak traffic for just a few hours
                                  Without going broke




Friday, March 6, 2009
FROM THIS




Friday, March 6, 2009
TO THIS




Friday, March 6, 2009
TO THIS




Friday, March 6, 2009
WITH JUST A FEW CLICKS




Friday, March 6, 2009
THE PEOPLE
                         Eric at The Case Foundation


    • Was               spending for boxes not always needed

    • Runs    periodic campaigns (48,000 people donating for 6 month
        grant competition)

    • Likes             to send press releases

    • Moved               Drupal to AWS in December 2007

Friday, March 6, 2009
THE PEOPLE
                          Frank at Phase2 Technology

    • Architect

    • First             significant AWS deployments

    • Kickoff             to deployment in 5 weeks

    • Team               developed code & deployment scaling concurrently



Friday, March 6, 2009
IN THE CLOUD

                        The Promise          The Challenge

        Servers when you need         Configuration, please


        Multiple datacenters          Filesystem sync


                                      $70/month/cpu + bandwidth
        Pay for what you need


Friday, March 6, 2009
WHAT IS AWS?
                         Amazon Web Services




Friday, March 6, 2009
S3
                        super simple storage




Friday, March 6, 2009
EC2
                        elastic compute cloud




Friday, March 6, 2009
EBS
                        elastic block storage




Friday, March 6, 2009
SHUT UP ALREADY!
                        how do I actually deploy & scale my site




Friday, March 6, 2009
OUR SOLUTION
                        • multiple   front ends

                        • master/slave   database

                        • dedicated   edit server

                        • ebs   mounted filesystems (files & db)

                        • sync   files to front ends every minute

                        • not   ideal for large number of editors


Friday, March 6, 2009
SOLUTION


                                          Load Balancer (or DNS)




                        Edit                                 Front-ends




                                Master   Slave




Friday, March 6, 2009
now it is time to develop your deployment




Friday, March 6, 2009
directly on on aws

Friday, March 6, 2009
DO YOU NEED HELP?




Friday, March 6, 2009
CLOUD MANAGEMENT
                            RightScale, Scalr, etc.




Friday, March 6, 2009
we chose RightScale




Friday, March 6, 2009
WHY RIGHTSCALE?




Friday, March 6, 2009
LETS GET TO IT




Friday, March 6, 2009
Friday, March 6, 2009
EC2 Instance




                        Boot Scripts




Friday, March 6, 2009
EC2 Instance




                        Boot Scripts




                                       AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts




                                php, httpd, apc, memcached

                                        AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts




                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts




                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts



                                  deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance




                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts




                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts




                                       backup snapshot


                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts


                                       site deployment

                                       backup snapshot


                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts
                                           failover

                                       site deployment

                                       backup snapshot


                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts
                                           failover

                                       site deployment

                                       backup snapshot


                        Boot Scripts

                                 register with load balancer

                                   deploy site, restore db

                               vhost install, customize config

                                       mount EBS, DNS

                                php, httpd, apc, memcached

                                         AMI - O/S

Friday, March 6, 2009
EC2 Instance
                        Operational Scripts
                                                                M
                                           failover
                                                                o
                                                                n
                                       site deployment
                                                                i
                                                                t
                                       backup snapshot
                                                                o
                                                                r
                        Boot Scripts                            i
                                                                n
                                 register with load balancer    g
                                   deploy site, restore db      &

                               vhost install, customize config   A
                                                                l
                                                                e
                                       mount EBS, DNS
                                                                r
                                                                t
                                php, httpd, apc, memcached
                                                                s
                                         AMI - O/S

Friday, March 6, 2009
template everything




Friday, March 6, 2009
Friday, March 6, 2009
what about test, stage & production

Friday, March 6, 2009
failover

Friday, March 6, 2009
is the cloud right for you?




Friday, March 6, 2009
QUESTIONS?




Friday, March 6, 2009
OR DROP US A NOTE
        Eric Johnson
    •
        Director of Technology
        The Case Foundation
        @elstudio

        http://el-studio.com/tag/cloud/ 

        Frank Febbraro
    •
        CTO
        Phase2 Technology
        @febbraro

        http://agileapproach.com

Friday, March 6, 2009

More Related Content

Viewers also liked

Drupal in the Cloud with Windows Azure
Drupal in the Cloud with Windows AzureDrupal in the Cloud with Windows Azure
Drupal in the Cloud with Windows Azure
Ford AntiTrust
 

Viewers also liked (10)

Moving In: how to port your content from * to Drupal
Moving In: how to port your content from * to DrupalMoving In: how to port your content from * to Drupal
Moving In: how to port your content from * to Drupal
 
Migrate
MigrateMigrate
Migrate
 
Using Drupal Features in B-Translator
Using Drupal Features in B-TranslatorUsing Drupal Features in B-Translator
Using Drupal Features in B-Translator
 
Moving Drupal to the Cloud
Moving Drupal to the CloudMoving Drupal to the Cloud
Moving Drupal to the Cloud
 
Drupal in the Cloud with Windows Azure
Drupal in the Cloud with Windows AzureDrupal in the Cloud with Windows Azure
Drupal in the Cloud with Windows Azure
 
Data migration to Drupal using the migrate module
Data migration to Drupal using the migrate moduleData migration to Drupal using the migrate module
Data migration to Drupal using the migrate module
 
Migraine Drupal - syncing your staging and live sites
Migraine Drupal - syncing your staging and live sitesMigraine Drupal - syncing your staging and live sites
Migraine Drupal - syncing your staging and live sites
 
Content Staging in Drupal 8
Content Staging in Drupal 8Content Staging in Drupal 8
Content Staging in Drupal 8
 
Managing Translation Workflows in Drupal 7
Managing Translation Workflows in Drupal 7Managing Translation Workflows in Drupal 7
Managing Translation Workflows in Drupal 7
 
Migration from Legacy CMS to Drupal
Migration from Legacy CMS to DrupalMigration from Legacy CMS to Drupal
Migration from Legacy CMS to Drupal
 

Recently uploaded

Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Choreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software EngineeringChoreo: Empowering the Future of Enterprise Software Engineering
Choreo: Empowering the Future of Enterprise Software Engineering
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 

Scaling Drupal in the Amazon Cloud - Slides from DrupalconDC

  • 1. SCALING DRUPAL IN THE CLOUD Eric Johnson - Case Foundation Frank Febbraro - Phase2 Technology Friday, March 6, 2009
  • 2. THE CHALLENGE Super high peak traffic for just a few hours Without going broke Friday, March 6, 2009
  • 6. WITH JUST A FEW CLICKS Friday, March 6, 2009
  • 7. THE PEOPLE Eric at The Case Foundation • Was spending for boxes not always needed • Runs periodic campaigns (48,000 people donating for 6 month grant competition) • Likes to send press releases • Moved Drupal to AWS in December 2007 Friday, March 6, 2009
  • 8. THE PEOPLE Frank at Phase2 Technology • Architect • First significant AWS deployments • Kickoff to deployment in 5 weeks • Team developed code & deployment scaling concurrently Friday, March 6, 2009
  • 9. IN THE CLOUD The Promise The Challenge Servers when you need Configuration, please Multiple datacenters Filesystem sync $70/month/cpu + bandwidth Pay for what you need Friday, March 6, 2009
  • 10. WHAT IS AWS? Amazon Web Services Friday, March 6, 2009
  • 11. S3 super simple storage Friday, March 6, 2009
  • 12. EC2 elastic compute cloud Friday, March 6, 2009
  • 13. EBS elastic block storage Friday, March 6, 2009
  • 14. SHUT UP ALREADY! how do I actually deploy & scale my site Friday, March 6, 2009
  • 15. OUR SOLUTION • multiple front ends • master/slave database • dedicated edit server • ebs mounted filesystems (files & db) • sync files to front ends every minute • not ideal for large number of editors Friday, March 6, 2009
  • 16. SOLUTION Load Balancer (or DNS) Edit Front-ends Master Slave Friday, March 6, 2009
  • 17. now it is time to develop your deployment Friday, March 6, 2009
  • 18. directly on on aws Friday, March 6, 2009
  • 19. DO YOU NEED HELP? Friday, March 6, 2009
  • 20. CLOUD MANAGEMENT RightScale, Scalr, etc. Friday, March 6, 2009
  • 23. LETS GET TO IT Friday, March 6, 2009
  • 25. EC2 Instance Boot Scripts Friday, March 6, 2009
  • 26. EC2 Instance Boot Scripts AMI - O/S Friday, March 6, 2009
  • 27. EC2 Instance Boot Scripts php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 28. EC2 Instance Boot Scripts mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 29. EC2 Instance Boot Scripts vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 30. EC2 Instance Boot Scripts deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 31. EC2 Instance Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 32. EC2 Instance Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 33. EC2 Instance Operational Scripts Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 34. EC2 Instance Operational Scripts backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 35. EC2 Instance Operational Scripts site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 36. EC2 Instance Operational Scripts failover site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 37. EC2 Instance Operational Scripts failover site deployment backup snapshot Boot Scripts register with load balancer deploy site, restore db vhost install, customize config mount EBS, DNS php, httpd, apc, memcached AMI - O/S Friday, March 6, 2009
  • 38. EC2 Instance Operational Scripts M failover o n site deployment i t backup snapshot o r Boot Scripts i n register with load balancer g deploy site, restore db & vhost install, customize config A l e mount EBS, DNS r t php, httpd, apc, memcached s AMI - O/S Friday, March 6, 2009
  • 41. what about test, stage & production Friday, March 6, 2009
  • 43. is the cloud right for you? Friday, March 6, 2009
  • 45. OR DROP US A NOTE Eric Johnson • Director of Technology The Case Foundation @elstudio http://el-studio.com/tag/cloud/  Frank Febbraro • CTO Phase2 Technology @febbraro http://agileapproach.com Friday, March 6, 2009

Editor's Notes

  1. ERIC
  2. ERIC
  3. ERIC
  4. ERIC
  5. ERIC
  6. ERIC
  7. FRANK
  8. ERIC
  9. FF
  10. FF persistent distributed storage for files via http post/get, high latency
  11. FF servers
  12. FF low latency, permanent storage, but not multi datacenter
  13. FF
  14. ERIC
  15. ERIC multiple front ends master/slave database dedicated edit server ebs mounted filesystems (files & db) sync files to front ends every minute not ideal for large number of logged-in users
  16. FF It is important to note that your deployment in cloud scenarios is often “developed” in much the same way your site is developed and it requires time, testing, review, etc. DO not underestimate this amount of time.
  17. command line, aws console, puppet, etc.
  18. EJ
  19. EJ The one sentence summary is that the current EC2 console is a control panel that gives you access to all EC2 functions while RightScale is a complete management platform to design, deploy, and manage the life-cycle of mission critical cloud deployments.
  20. EJ Leading provider of mangement console for entire server deployment environment. Their onsole
  21. EJ
  22. FF
  23. FF
  24. FF
  25. FF
  26. FF
  27. FF
  28. FF
  29. FF
  30. FF
  31. FF
  32. FF
  33. FF
  34. FF
  35. FF
  36. FF
  37. FF
  38. FF
  39. EJ extract the variations and things that are required to be unique and provide them as input.
  40. EJ done based on deployments. server + templates = deployment deployments only vary based on the inputs given to make these diff envs, just clone your deployment
  41. FF test the hell out of it. This is where a ton of your work developing the deployment applies
  42. FF you need sysadmin skills on staff, or cloud management. Depends on the usage profile of your site, kernel requirements, etc.