More Related Content
Drupal In The Cloud
- 1. Drupal in theCloud High Performance & High Availability © 2010 Freistil- Consulting http://www.freistil- consulting.de 1
- 2. 100% Buzzword compliant! Drupal in the Cloud High Performance & High Availability © 2010 Freistil- Consulting http://www.freistil- consulting.de 1
- 3. Why move tothe Cloud? 2
- 4. Why move tothe Cloud? 2
- 5.
- 6. Jochen Lillich @geewiz 3
- 7. Jochen Lillich @geewiz @freistil 3
- 8. Topics of thistalk 4
- 9. Topics of thistalk •High Performance Drupal 4
- 10. Topics of thistalk •High Performance Drupal •Cloud Computing 4
- 11. Topics of thistalk •High Performance Drupal •Cloud Computing •Drupal on Amazon EC2 4
- 12.
- 13. High Performance Drupal 5
- 14. Standard Installation LAMP 6
- 15. Vertical Scaling LAMP 7
- 16. Horizontal Scaling LAMP 8
- 17.
- 18. Separation of Concerns Web Frontend 9
- 19. Separation of Concerns Web Frontend Database 9
- 20. Separation of Concerns Web Frontend Database File Storage 9
- 21. Redundancy Web Frontend Database File Storage 10
- 22.
- 23. Frontend Scaling • LoadBalancing 11
- 24. Frontend Scaling • LoadBalancing • Caching 11
- 25. Frontend Scaling • LoadBalancing • Caching • Static files 11
- 26. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests 11
- 27. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests • Logged in users 11
- 28. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests • Logged in users • PHP code 11
- 29. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests 11
- 30. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests • CDN 11
- 31. Frontend Scaling • LoadBalancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests • CDN • Solr Search 11
- 32.
- 33.
- 34.
- 35.
- 36.
- 37. Storage Scaling •Proprietary StorageSystems 13
- 38. Storage Scaling •Proprietary StorageSystems •Central File Systems 13
- 39. Storage Scaling •Proprietary StorageSystems •Central File Systems •File System Cloning 13
- 40. Storage Scaling •Proprietary StorageSystems •Central File Systems •File System Cloning •Tool-based 13
- 41. Storage Scaling •Proprietary StorageSystems •Central File Systems •File System Cloning •Tool-based •Kernel-based 13
- 42. Storage Scaling •Proprietary StorageSystems •Central File Systems •File System Cloning •Tool-based •Kernel-based •Cluster FS 13
- 43. Summary 14
- 44.
- 45. Summary •Horizontal Scaling givesyou •high performance and 14
- 46. Summary •Horizontal Scaling givesyou •high performance and •high availability 14
- 47. Summary •Horizontal Scaling givesyou •high performance and •high availability •at the cost of 14
- 48. Summary •Horizontal Scaling givesyou •high performance and •high availability •at the cost of •more infrastructure 14
- 49.
- 50.
- 51.
- 52. Cloud Computing •Virtual computingresources 16
- 53. Cloud Computing •Virtual computingresources •highly abstracted 16
- 54. Cloud Computing •Virtual computingresources •highly abstracted •broadly shared 16
- 55. Cloud Computing •Virtual computingresources •highly abstracted •broadly shared •rapidly provisioned 16
- 56. Providers 17
- 57.
- 58. Providers •Infrastructure Platforms •AmazonWeb Services 17
- 59. Providers •Infrastructure Platforms •AmazonWeb Services •Rackspace Cloud 17
- 60. Providers •Infrastructure Platforms •AmazonWeb Services •Rackspace Cloud •GoGrid 17
- 61. Providers •Infrastructure Platforms •AmazonWeb Services •Rackspace Cloud •GoGrid •Application Platforms 17
- 62. Providers •Infrastructure Platforms •AmazonWeb Services •Rackspace Cloud •GoGrid •Application Platforms •Google App Engine 17
- 63. Providers •Infrastructure Platforms •AmazonWeb Services •Rackspace Cloud •GoGrid •Application Platforms •Google App Engine •EngineYard 17
- 64.
- 65. Pros & Cons 19
- 66.
- 67. Pros & Cons •Advantages •Minimal CapEx 19
- 68. Pros & Cons •Advantages •Minimal CapEx •Easy resource management 19
- 69. Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges 19
- 70. Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges •Automation 19
- 71. Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges •Automation •Legal issues 19
- 72.
- 73.
- 74.
- 75.
- 76. Instance Creation •User Interface •AWS Console 21
- 77. Instance Creation •User Interface •AWS Console •EC2 CLI 21
- 78. Instance Creation •User Interface •AWS Console •EC2 CLI •AMI 21
- 79. Instance Creation •User Interface •AWS Console •EC2 CLI •AMI •Ubuntu 21
- 80. Instance Creation •User Interface •AWS Console •EC2 CLI •AMI •Ubuntu •Mercury 21
- 81. Deployment 22
- 82.
- 83.
- 84. Deployment •Manual •SFTP •SSH+ Drush 22
- 85. Deployment •Manual •SFTP •SSH+ Drush •VCS 22
- 86. Deployment •Manual •SFTP •SSH+ Drush •VCS •Automatic 22
- 87. Deployment •Manual •SFTP •SSH+ Drush •VCS •Automatic •Puppet / Chef / BCFG2 22
- 88. Deployment •Manual •SFTP •SSH+ Drush •VCS •Automatic •Puppet / Chef / BCFG2 22
- 89.
- 90.
- 91. System Management •Monitoring •Nagios/ ICINGA 23
- 92. System Management •Monitoring •Nagios/ ICINGA •Amazon CloudWatch 23
- 93. System Management •Monitoring •Nagios/ ICINGA •Amazon CloudWatch •Failover / Scaling 23
- 94. System Management •Monitoring •Nagios/ ICINGA •Amazon CloudWatch •Failover / Scaling •DIY 23
- 95. System Management •Monitoring •Nagios/ ICINGA •Amazon CloudWatch •Failover / Scaling •DIY •Clustering software 23
- 96. System Management •Monitoring •Nagios/ ICINGA •Amazon CloudWatch •Failover / Scaling •DIY •Clustering software •Amazon Auto Scaling 23
- 97. Example infrastructure Firewall Load Balancer Application Repository Frontend Servers Staging Webserver Production Webserver Cluster Backend Servers Database Storage Search Cluster Cluster Cluster 24
- 98.
- 99. Conclusion 25
- 100. Summary 26
- 101.
- 102. Summary •Flexible resource handling •Minimalcapital expenses 26
- 103. Summary •Flexible resource handling •Minimalcapital expenses •Efficiency needs automation 26
- 104. Summary •Flexible resource handling •Minimalcapital expenses •Efficiency needs automation •Effectiveness needs experience 26
- 105. Get the book! What‘s the name of the Amazon Machine Image that provides you with a complete Drupal installation including APC, Varnish and Solr Search? 27
- 106. Your questions? jochen@freistil-consulting.de http://www.freistil-consulting.de 28
- 107. Your questions? jochen@freistil-consulting.de http://www.freistil-consulting.de Thank you. 28
Editor's Notes
- #2 How to use agile Cloud infrastructure resources to obtain optimal efficiency in Drupal operations.
- #3 As always, Dilbert has the answer.
- #4 40 yrs, computer science. Linux 1994, Drupal 2007. IT manager at two of the biggest ISPs in Germany, WEB.DE and 1&1. Today Head Honcho at Freistil-Consulting: Services for IT Management, both in the infrastructure + leadership sense
- #5 40 yrs, computer science. Linux 1994, Drupal 2007. IT manager at two of the biggest ISPs in Germany, WEB.DE and 1&1. Today Head Honcho at Freistil-Consulting: Services for IT Management, both in the infrastructure + leadership sense
- #6 Every topic could be a seperate talk. Book raffle: After talk question whose answer is hidden in my talk.
- #7 Every topic could be a seperate talk. Book raffle: After talk question whose answer is hidden in my talk.
- #8 Every topic could be a seperate talk. Book raffle: After talk question whose answer is hidden in my talk.
- #9 What‘s important when your Drupal website grows?
- #10 Standard installation: LAMP stack and Drupal all on one server. When you need more performance, you‘ll have two options.
- #11 Vertical scaling means using a bigger server.
- #12 Distributing the load Seperate the different functions of the LAMP+Drupal stack.
- #16 More than one server for each function not only gives even more performance, but also higher availability.
- #17 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #18 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #19 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #20 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #21 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #22 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #23 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #24 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #25 perlbal, IPVS Squid, HAproxy Varnish, Boost, AuthCache, Memcache Akamai, Amazon CloudFront
- #29 DRBD (Distributed Replicated Block Device)
- #30 DRBD (Distributed Replicated Block Device)
- #31 DRBD (Distributed Replicated Block Device)
- #32 DRBD (Distributed Replicated Block Device)
- #33 DRBD (Distributed Replicated Block Device)
- #34 DRBD (Distributed Replicated Block Device)
- #35 Infrastructure you have to maintain and pay for!
- #36 Infrastructure you have to maintain and pay for!
- #37 Infrastructure you have to maintain and pay for!
- #38 Infrastructure you have to maintain and pay for!
- #39 Infrastructure you have to maintain and pay for!
- #41 Abstraction of a) IT infrastructure, b) locations
- #42 Abstraction of a) IT infrastructure, b) locations
- #43 Abstraction of a) IT infrastructure, b) locations
- #44 Abstraction of a) IT infrastructure, b) locations
- #52 EC2 instance types: On-demand, Reserved, Spot
- #60 Instance parameters: Location, Size, EBS and AMI.
- #61 Instance parameters: Location, Size, EBS and AMI.
- #62 Instance parameters: Location, Size, EBS and AMI.
- #63 Instance parameters: Location, Size, EBS and AMI.
- #64 Instance parameters: Location, Size, EBS and AMI.
- #65 Instance parameters: Location, Size, EBS and AMI.
- #73 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #74 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #75 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #76 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #77 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #78 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #79 To operate a cluster infrastructure like I described, you‘ll also need additional services, for ex...
- #82 Running Drupal on a Cloud service gets you... But to operate a more complex Drupal infrastructure efficiently, you‘ll need... Let‘s spend the rest of the time for questions! First, my question...
- #83 Running Drupal on a Cloud service gets you... But to operate a more complex Drupal infrastructure efficiently, you‘ll need... Let‘s spend the rest of the time for questions! First, my question...
- #84 Running Drupal on a Cloud service gets you... But to operate a more complex Drupal infrastructure efficiently, you‘ll need... Let‘s spend the rest of the time for questions! First, my question...
- #85 Running Drupal on a Cloud service gets you... But to operate a more complex Drupal infrastructure efficiently, you‘ll need... Let‘s spend the rest of the time for questions! First, my question...