• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Drupal In The Cloud
 

Drupal In The Cloud

on

  • 2,395 views

My talk for DrupalCamp Essen in February 2010 about high performance Drupal infrastructure.

My talk for DrupalCamp Essen in February 2010 about high performance Drupal infrastructure.

Statistics

Views

Total Views
2,395
Views on SlideShare
2,350
Embed Views
45

Actions

Likes
1
Downloads
0
Comments
0

4 Embeds 45

http://www.freistil-consulting.de 33
http://www.slideshare.net 9
https://www.linkedin.com 2
http://travelink.com.de 1

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • How to use agile Cloud infrastructure resources to obtain optimal efficiency in Drupal operations. <br />
  • As always, Dilbert has the answer. <br />
  • 40 yrs, computer science. Linux 1994, Drupal 2007. <br /> IT manager at two of the biggest ISPs in Germany, WEB.DE and 1&1. <br /> Today Head Honcho at Freistil-Consulting: Services for IT Management, both in the infrastructure + leadership sense <br />
  • 40 yrs, computer science. Linux 1994, Drupal 2007. <br /> IT manager at two of the biggest ISPs in Germany, WEB.DE and 1&1. <br /> Today Head Honcho at Freistil-Consulting: Services for IT Management, both in the infrastructure + leadership sense <br />
  • Every topic could be a seperate talk. <br /> Book raffle: After talk question whose answer is hidden in my talk. <br />
  • Every topic could be a seperate talk. <br /> Book raffle: After talk question whose answer is hidden in my talk. <br />
  • Every topic could be a seperate talk. <br /> Book raffle: After talk question whose answer is hidden in my talk. <br />
  • What&#x2018;s important when your Drupal website grows? <br />
  • Standard installation: LAMP stack and Drupal all on one server. <br /> When you need more performance, you&#x2018;ll have two options. <br />
  • Vertical scaling means using a bigger server. <br />
  • Distributing the load <br /> Seperate the different functions of the LAMP+Drupal stack. <br />
  • <br />
  • <br />
  • <br />
  • More than one server for each function not only gives even more performance, <br /> but also higher availability. <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • perlbal, IPVS <br /> Squid, HAproxy <br /> Varnish, Boost, AuthCache, Memcache <br /> Akamai, Amazon CloudFront <br />
  • <br />
  • <br />
  • <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • DRBD (Distributed Replicated Block Device) <br />
  • Infrastructure you have to maintain and pay for! <br />
  • Infrastructure you have to maintain and pay for! <br />
  • Infrastructure you have to maintain and pay for! <br />
  • Infrastructure you have to maintain and pay for! <br />
  • Infrastructure you have to maintain and pay for! <br />
  • <br />
  • Abstraction of a) IT infrastructure, b) locations <br />
  • Abstraction of a) IT infrastructure, b) locations <br />
  • Abstraction of a) IT infrastructure, b) locations <br />
  • Abstraction of a) IT infrastructure, b) locations <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • EC2 instance types: On-demand, Reserved, Spot <br /> <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • Instance parameters: Location, Size, EBS and AMI. <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • To operate a cluster infrastructure like I described, you&#x2018;ll also need additional services, for ex... <br />
  • <br />
  • <br />
  • Running Drupal on a Cloud service gets you... <br /> But to operate a more complex Drupal infrastructure efficiently, you&#x2018;ll need... <br /> Let&#x2018;s spend the rest of the time for questions! First, my question... <br />
  • Running Drupal on a Cloud service gets you... <br /> But to operate a more complex Drupal infrastructure efficiently, you&#x2018;ll need... <br /> Let&#x2018;s spend the rest of the time for questions! First, my question... <br />
  • Running Drupal on a Cloud service gets you... <br /> But to operate a more complex Drupal infrastructure efficiently, you&#x2018;ll need... <br /> Let&#x2018;s spend the rest of the time for questions! First, my question... <br />
  • Running Drupal on a Cloud service gets you... <br /> But to operate a more complex Drupal infrastructure efficiently, you&#x2018;ll need... <br /> Let&#x2018;s spend the rest of the time for questions! First, my question... <br />
  • <br />
  • <br />
  • <br />
  • <br />

Drupal In The Cloud Drupal In The Cloud Presentation Transcript

  • Drupal in the Cloud High Performance & High Availability © 2010 Freistil- Consulting http://www.freistil- consulting.de 1
  • 100% Buzzword compliant! Drupal in the Cloud High Performance & High Availability © 2010 Freistil- Consulting http://www.freistil- consulting.de 1
  • Why move to the Cloud? 2
  • Why move to the Cloud? 2
  • Jochen Lillich 3
  • Jochen Lillich @geewiz 3
  • Jochen Lillich @geewiz @freistil 3
  • Topics of this talk 4
  • Topics of this talk •High Performance Drupal 4
  • Topics of this talk •High Performance Drupal •Cloud Computing 4
  • Topics of this talk •High Performance Drupal •Cloud Computing •Drupal on Amazon EC2 4
  • 5
  • High Performance Drupal 5
  • Standard Installation LAMP 6
  • Vertical Scaling LAMP 7
  • Horizontal Scaling LAMP 8
  • Separation of Concerns 9
  • Separation of Concerns Web Frontend 9
  • Separation of Concerns Web Frontend Database 9
  • Separation of Concerns Web Frontend Database File Storage 9
  • Redundancy Web Frontend Database File Storage 10
  • Frontend Scaling 11
  • Frontend Scaling • Load Balancing 11
  • Frontend Scaling • Load Balancing • Caching 11
  • Frontend Scaling • Load Balancing • Caching • Static files 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests • Logged in users 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests • Logged in users • PHP code 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests • CDN 11
  • Frontend Scaling • Load Balancing • Caching • Static files • Anonymous requests • Logged in users • PHP code • Database requests • CDN • Solr Search 11
  • Database Scaling 12
  • Database Scaling •Replication 12
  • Database Scaling •Replication •MySQL Proxy 12
  • Database Scaling •Replication •MySQL Proxy •MySQL Cluster 12
  • Storage Scaling 13
  • Storage Scaling •Proprietary Storage Systems 13
  • Storage Scaling •Proprietary Storage Systems •Central File Systems 13
  • Storage Scaling •Proprietary Storage Systems •Central File Systems •File System Cloning 13
  • Storage Scaling •Proprietary Storage Systems •Central File Systems •File System Cloning •Tool-based 13
  • Storage Scaling •Proprietary Storage Systems •Central File Systems •File System Cloning •Tool-based •Kernel-based 13
  • Storage Scaling •Proprietary Storage Systems •Central File Systems •File System Cloning •Tool-based •Kernel-based •Cluster FS 13
  • Summary 14
  • Summary •Horizontal Scaling gives you 14
  • Summary •Horizontal Scaling gives you •high performance and 14
  • Summary •Horizontal Scaling gives you •high performance and •high availability 14
  • Summary •Horizontal Scaling gives you •high performance and •high availability •at the cost of 14
  • Summary •Horizontal Scaling gives you •high performance and •high availability •at the cost of •more infrastructure 14
  • 15
  • Cloud Computing 15
  • Cloud Computing 16
  • Cloud Computing •Virtual computing resources 16
  • Cloud Computing •Virtual computing resources •highly abstracted 16
  • Cloud Computing •Virtual computing resources •highly abstracted •broadly shared 16
  • Cloud Computing •Virtual computing resources •highly abstracted •broadly shared •rapidly provisioned 16
  • Providers 17
  • Providers •Infrastructure Platforms 17
  • Providers •Infrastructure Platforms •Amazon Web Services 17
  • Providers •Infrastructure Platforms •Amazon Web Services •Rackspace Cloud 17
  • Providers •Infrastructure Platforms •Amazon Web Services •Rackspace Cloud •GoGrid 17
  • Providers •Infrastructure Platforms •Amazon Web Services •Rackspace Cloud •GoGrid •Application Platforms 17
  • Providers •Infrastructure Platforms •Amazon Web Services •Rackspace Cloud •GoGrid •Application Platforms •Google App Engine 17
  • Providers •Infrastructure Platforms •Amazon Web Services •Rackspace Cloud •GoGrid •Application Platforms •Google App Engine •EngineYard 17
  • Amazon Web Services 18
  • Pros & Cons 19
  • Pros & Cons •Advantages 19
  • Pros & Cons •Advantages •Minimal CapEx 19
  • Pros & Cons •Advantages •Minimal CapEx •Easy resource management 19
  • Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges 19
  • Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges •Automation 19
  • Pros & Cons •Advantages •Minimal CapEx •Easy resource management •Challenges •Automation •Legal issues 19
  • 20
  • Drupal on EC2 20
  • Instance Creation 21
  • Instance Creation •User Interface 21
  • Instance Creation •User Interface •AWS Console 21
  • Instance Creation •User Interface •AWS Console •EC2 CLI 21
  • Instance Creation •User Interface •AWS Console •EC2 CLI •AMI 21
  • Instance Creation •User Interface •AWS Console •EC2 CLI •AMI •Ubuntu 21
  • Instance Creation •User Interface •AWS Console •EC2 CLI •AMI •Ubuntu •Mercury 21
  • Deployment 22
  • Deployment •Manual 22
  • Deployment •Manual •SFTP 22
  • Deployment •Manual •SFTP •SSH + Drush 22
  • Deployment •Manual •SFTP •SSH + Drush •VCS 22
  • Deployment •Manual •SFTP •SSH + Drush •VCS •Automatic 22
  • Deployment •Manual •SFTP •SSH + Drush •VCS •Automatic •Puppet / Chef / BCFG2 22
  • Deployment •Manual •SFTP •SSH + Drush •VCS •Automatic •Puppet / Chef / BCFG2 22
  • System Management 23
  • System Management •Monitoring 23
  • System Management •Monitoring •Nagios / ICINGA 23
  • System Management •Monitoring •Nagios / ICINGA •Amazon CloudWatch 23
  • System Management •Monitoring •Nagios / ICINGA •Amazon CloudWatch •Failover / Scaling 23
  • System Management •Monitoring •Nagios / ICINGA •Amazon CloudWatch •Failover / Scaling •DIY 23
  • System Management •Monitoring •Nagios / ICINGA •Amazon CloudWatch •Failover / Scaling •DIY •Clustering software 23
  • System Management •Monitoring •Nagios / ICINGA •Amazon CloudWatch •Failover / Scaling •DIY •Clustering software •Amazon Auto Scaling 23
  • Example infrastructure Firewall Load Balancer Application Repository Frontend Servers Staging Webserver Production Webserver Cluster Backend Servers Database Storage Search Cluster Cluster Cluster 24
  • 25
  • Conclusion 25
  • Summary 26
  • Summary •Flexible resource handling 26
  • Summary •Flexible resource handling •Minimal capital expenses 26
  • Summary •Flexible resource handling •Minimal capital expenses •Efficiency needs automation 26
  • Summary •Flexible resource handling •Minimal capital expenses •Efficiency needs automation •Effectiveness needs experience 26
  • Get the book! What‘s the name of the Amazon Machine Image that provides you with a complete Drupal installation including APC, Varnish and Solr Search? 27
  • Your questions? jochen@freistil-consulting.de http://www.freistil-consulting.de 28
  • Your questions? jochen@freistil-consulting.de http://www.freistil-consulting.de Thank you. 28