Performance and Scalability

Performance & Scalability Andy Thornton

[object Object],An opening Apology However, I added some fun pictures, to hopefully compensate ... And yes, these slides will be available for download.

Who's this presentation for? Who's this presentation for?

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],Capacity Planning “ However Beautiful the strategy, you should occasionally look at the results ” - Winston Churchill

Testing Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],XHProf Profiler for PHP providing some valuable metrics and reporting. http://mirror.facebook.net/facebook/xhprof/doc.htm l

Acquia & Soasta ,[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Varnish Varnish stores web pages in memory so the web servers don't have to create the same web page over and over again. The web server only recreates a page when it is changed. Reporting from Varnish can provide some good data to help with capacity planning.

Investigating Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Pain points? Apache PHP MySQL

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],PHP parses and compiles all code into an intermediary series of opcodes, or more accurately an intermediary series of opcodes for each request. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],When Drupal Attacks! Sometimes, a cache setup can slow things down!

Andy's Page of Weird Apache Commands ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Maxclients Setting in Apache Whats a good way to find the maxclients number? MaxClients ≈ (Ram - size of all other processes) / (size of the apache process) We are making an educated guess based on dividing the system memory (our physical RAM) by the maximum size of an apache process, with enough wiggle room to have the operating system run smoothly. To find the size of a running process; ps -ylC apache2 --sort:rss Divide the size by 1024 to get the process size in meg. You can also use pmap, use top to find the pid, then use; pmap -x <pid id> Another handy way of seeing how your memory is doing. free -m and good old VMSTAT to see if your memory is being paged vmstat 5 60

Huge List of Apache Tips ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Reduce DNS Lookups You can tell Apache to not perform a DNS lookup on files by their mime type. HostnameLookups Off <Files ~"(html/cgi)$"> HostnameLookup On </Files> File Negotiation Be specific when specifying filenames rather than wildcards (when possible). Instead of: DirectoryIndex index Use: DirectoryIndex index.cgi index.php

More Apache Tips ... ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],htaccess If you have access to your VirtualHosts in Apache, move your directives out of htaccess and move them in to the VirtualHost for your website. The reason for this is that Apache loads your virtual host once when started but Drupal searches for htaccess files in multiple directories at runtime. Disable htaccess lookups with: <Directory /> AllowOveride None </Directory>

Webserver ,[object Object],[object Object],[object Object],[object Object],Alternatives to Apache Nginx (engine-X) Faster than Apache and has more predictable memory usage. Not as straight forward to setup (rewrite rules for example). LIGHTHTTPD Good performance. Although there has been discussion on the drupal forums as to its ability to cleanly run Drupal 7. Not for the feint of heart. Microsoft Web Matrix Runs Drupal under IIS with PHP, good for Microsoft shops. http://www.microsoft.com/web/drupal/ Apache supports pluggable concurrency modules, called M ulti P rocessing M odules. So which is a good fit for my website?

[object Object],Database Optimisations Enable Query Cache This feature is generally disabled by default. To enable it, assign a value to query_cache_size in your mysql configuration file. [mysqld] query_cache_size = 64M You can query the setting as it's a variable. SHOW VARIABLES LIKE 'have_query_cache'; You may have to do some testing to find the best value to use. Logging Slow Queries You can instruct MySQL to log all queries that take too long to run, for later analysis. [mysqld] log_slow_queries=/var/log/slow-queries.log log_query_time=5 Leaving off the query time will default it to 10 seconds. Analysing Slow Queries Prepend your query with EXPLAIN and run it for more information, or analyse your query with MAATKIT. EXPLAIN will show which indices are being used, sometime just indexing the table can be a good fix.

[object Object],More Database Tips MyISAM and InnoDb Performance wise, they both stand up well, but whats the difference for Drupal? Table Locking MyISAM = Table Level Locking InnoDB = Row level Locking How do I know if I need to make a change? Take a look at SHOW STATUS LIKE 'Table%'; Table_locks_immediate 1151552 Table_locks_waited 15324 How do I change a table type? ALTER TABLE accesslog TYPE='InnoDB'; ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Drupal 6 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Drupal Performance Module Options Normal: Drupal bootstraps in phases, when normal is selected it uses just enough phases to load a page from cache. Keeping db queries to a minimum . Aggressive : Completely bypasses loading of all modules. Boot and Exit hooks are never called for cached pages. This means less PHP is parsed since no modules are loaded. There's are also fewer database calls. Fastpath : Not enabled from the admin panel, this option is enabled from settings.php. The idea is that a call to the file system is faster as there's no ramping up for a database query. This may not scale across load balanced hosting..

Drupal 6 ,[object Object],Garbage Collection Default value for garbage collection is a little over 2 days, you can also increase the frequency of collection with session.gc_maxlifetime (seconds) session.cache_expire (minutes) Note : When you adjust maxlifetime, adjust cache_expire to be the same. Tip: As Drupal can serve cached pages to anonymous users and anonymous users don't normally use interactive features of Drupal. How about reducing the time they are logged in or log them out when they close their browser. # 86400 seconds = 24 hours session.cookie_lifetime, 86400 # Logout on browser close session.cookie_lifetime, 0 Pruning Sessions Drupal controls when session start by turning off PHP's session autostart functionality in htaccess. php_value session.auto_start 0 The session table is cleared out when PHP's garbage collection runs. The lifetime of a session record is determined by session.gc.maxlifetime (seconds) Other settings you can experiment with: session.cache_expire session.cache_limiter session.cookie_lifetime session.save_handler session.use_only_cookies session.use_trans_sid

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Whats Changed in Drupal 7

[object Object],[object Object],[object Object],Alternatives to Search Acquia Search Built upon Lucene and Solr from Apache, hosted service with easy integration with Drupal. All administration tasks are built in to the admin panel. A very powerful alternative to Drupal's built in search. http://acquia.com/products-services/acquia-search Apache Solr Java based open source enterprise search platform from the Apache Lucene project. http://lucene.apache.org/solr/

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],More Tweaks ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Handy Tools YSlow (Firebug) http://developer.yahoo.com/yslow/ Performance Articles (Google Code) http://code.google.com/speed/articles/ Devel Module (Drupal) http://drupal.com/project/devel Ubuntu, Landscape http://www.canonical.com/enterprise-services/landscape SOASTA CloudTest http://acquia.com/SOASTA/next-steps Client (browser based tools) Boomerang / Firebug / Chrome Dev Tools / MAATKIT http://www.maatkit.org/

[object Object],[object Object],[object Object],Further Reading High Performance MySQL High Performance MySQL is the definitive guide to building fast, reliable systems with MySQL. This book covers every aspect of MySQL performance in detail and focuses on robustness, security and data integrity. O'Reilley Media : Amazon Even Faster Websites Steve Sounders works on the performance team at Google and has written a couple of great books on performance. O'Reilley Media : Bio

Questions? ,[object Object],[object Object]

Performance and Scalability

Recommended

Recommended

More Related Content

What's hot

What's hot (19)

Similar to Performance and Scalability

Similar to Performance and Scalability (20)

More from Mediacurrent

More from Mediacurrent (20)

Recently uploaded

Recently uploaded (20)

Performance and Scalability