SlideShare a Scribd company logo
1 of 16
Download to read offline
MySQL Conference
  2008 Edition
     Chris Barber
   http://www.cb1inc.com
Who, What, When?
●   April 14-17, 2008
●   Santa Clara, CA
●   Over 2000 people (more than last year)
●   160 speakers
●   16 tutorials
●   128 sessions
What's New?
●   Sun
●   MySQL 5.1 GA (still)
●   MySQL Workbench GA
    –   Windows only right now
●   Hot backup extension         http://www.theopenforce.com/2008/04/burning-the-
                                 boa.html
●   Monty's talk:
    –   http://monty-says.blogspot.com/2008/04/mysql-
        conference-good-bad-and-ugly.html
    –   http://www.scribd.com/doc/2575733/The-future-of-
        MySQL-The-Project
memcached
●   Memcached storage engine
●   Memcached functions for MySQL
    –   SELECT memc_set('fruit', 'apple');
    –   SELECT memc_get('fruit');
Testing
●   DBUnit for database - http://www.dbunit.org
    –   PHPUnit for PHP - http://phpunit.de
    –   phpUnderControl - http://www.phpundercontrol.org




                             v
EC2
●   New! Persistent storage
●   Storage caching mysteries
●   High availability is difficult
    –   Can't do heartbeat
●   Previous machine's host remnants
    –   Need to zero out drive... can take 5 hours!
Gearman
●   Server daemon than can do back-end stuff
●   http://www.danga.com/gearman/
    –   From the people that made memcached
●   netgearman – PHP library for Gearman
    –   http://code.google.com/p/netgearman/
Query Cache
●   Only SELECT statements
●   Viewing cache statistics:
    –   SHOW GLOBAL STATUS LIKE 'qcache%';
    –   SHOW GLOBAL STATUS LIKE 'query_cache%';
●   16MB by default
●   Invalidates easily
●   Can become fragmented
LVM Snapshots for Backups
●   Linux                             ●   mylvmbackup
●   Procedure                             –   http://lenz.homelinux.
                                              org/mylvmbackup/
    –   flush tables
    –   flush tables with read lock
                                          –   Perl script
    –   lvcreate -s
    –   show master/slave status
    –   unlock tables
    –   mount snapshot, perform
        backup
    –   unmount and discard the
        snapshot
innodb
●   Google actively improving it
    –   Updated mutex code (CAS instead of mutex)
●   New release! 1.0!
    –   Data compression
    –   Fast index creation
    –   information_schema tables
Flickr Stats – Massive Inserts
●   Tracks images
●   HTTP_REFERRER
●   Custom Java daemon to pool, bulk insert
Hardware Stuff
●   Use 64-bit                ●   Storage
●   Use lots of RAM               –   SAN, DAS, NAS
    –   32GB is cheap             –   Independent storage
    –   Allocate all RAM to       –   RAID 10
        innodb except 2GB         –   SAS vs. SATA
●   2 x dual core or 1 x          –   Battery backed cache
    quad core                          ●   Write through vs. write
                                           back
Hardware Stuff
  ●   Violin Memory                                      ●   Kickfire
  ●   500GB RAM Drive                                    ●   Database appliance
  ●   PCI-Express                                        ●   SQL chip
  ●   Linux support                                      ●   Custom storage engine
  ●   84 x 6GB sticks                                    ●   Transparent




http://www.flickr.com/photos/fallenpegasus/2424290836/
Scaling MySQL: Up or Out?
●   MySQL, Sun, Flickr,
    FotoLog, Wikipedia,
    Facebook, YouTube
●   Facebook has over 1800
    MySQL servers!


                             http://www.flickr.com/photos/x180/2419466880/
Other stuff
●   High Availability – DRBD
●   information_schema
    –   Alternative to MySQL's SHOW command
    –   Make plugins
●   PrimeBase – PBXT Storage Engine
●   High Performance MySQL
    –   June 19, 2008
Questions?




 Thank you!

More Related Content

What's hot

Grabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the TrunkGrabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the Trunk
Harold GimΓ©nez
Β 
Django book15 caching
Django book15 cachingDjango book15 caching
Django book15 caching
Shih-yi Wei
Β 
Optimize drupal
Optimize drupalOptimize drupal
Optimize drupal
Le Thanh Sang
Β 
Engage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data CollectionEngage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data Collection
Webtrends
Β 

What's hot (20)

Grabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the TrunkGrabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the Trunk
Β 
Using memcache to improve php performance
Using memcache to improve php performanceUsing memcache to improve php performance
Using memcache to improve php performance
Β 
HA with Galera
HA with GaleraHA with Galera
HA with Galera
Β 
Cache hcm-topdev
Cache hcm-topdevCache hcm-topdev
Cache hcm-topdev
Β 
Django book15 caching
Django book15 cachingDjango book15 caching
Django book15 caching
Β 
MySQL always-up with Galera Cluster
MySQL always-up with Galera ClusterMySQL always-up with Galera Cluster
MySQL always-up with Galera Cluster
Β 
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
Β 
Speeding Up The Snail
Speeding Up The SnailSpeeding Up The Snail
Speeding Up The Snail
Β 
Memcache
MemcacheMemcache
Memcache
Β 
7 Ways To Crash Postgres
7 Ways To Crash Postgres7 Ways To Crash Postgres
7 Ways To Crash Postgres
Β 
Optimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_PerformanceOptimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_Performance
Β 
Optimize drupal
Optimize drupalOptimize drupal
Optimize drupal
Β 
Shootout at the PAAS Corral
Shootout at the PAAS CorralShootout at the PAAS Corral
Shootout at the PAAS Corral
Β 
Engage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data CollectionEngage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data Collection
Β 
Scaling WordPress
Scaling WordPressScaling WordPress
Scaling WordPress
Β 
PERFORMANCE_SCHEMA and sys schema
PERFORMANCE_SCHEMA and sys schemaPERFORMANCE_SCHEMA and sys schema
PERFORMANCE_SCHEMA and sys schema
Β 
Drupal feature proposal: two new stream-wrappers
Drupal feature proposal: two new stream-wrappersDrupal feature proposal: two new stream-wrappers
Drupal feature proposal: two new stream-wrappers
Β 
High performance WordPress
High performance WordPressHigh performance WordPress
High performance WordPress
Β 
GUC Tutorial Package (9.0)
GUC Tutorial Package (9.0)GUC Tutorial Package (9.0)
GUC Tutorial Package (9.0)
Β 
5 things MySql
5 things MySql5 things MySql
5 things MySql
Β 

Similar to 2008 MySQL Conference Recap

From One to a Cluster
From One to a ClusterFrom One to a Cluster
From One to a Cluster
guestd34230
Β 
Scaling Rails with memcached
Scaling Rails with memcachedScaling Rails with memcached
Scaling Rails with memcached
elliando dias
Β 
My Sql And Search At Craigslist
My Sql And Search At CraigslistMy Sql And Search At Craigslist
My Sql And Search At Craigslist
MySQLConference
Β 
Os Wilhelm
Os WilhelmOs Wilhelm
Os Wilhelm
oscon2007
Β 
Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)
WordCamp Cape Town
Β 
Cassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_deCassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_de
mahalomeetup
Β 
UKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL TuningUKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL Tuning
FromDual GmbH
Β 
Make Your Life Easier With Maatkit
Make Your Life Easier With MaatkitMake Your Life Easier With Maatkit
Make Your Life Easier With Maatkit
MySQLConference
Β 

Similar to 2008 MySQL Conference Recap (20)

From One to a Cluster
From One to a ClusterFrom One to a Cluster
From One to a Cluster
Β 
20080611accel
20080611accel20080611accel
20080611accel
Β 
MySQL Tuning
MySQL TuningMySQL Tuning
MySQL Tuning
Β 
Scaling Rails with memcached
Scaling Rails with memcachedScaling Rails with memcached
Scaling Rails with memcached
Β 
MySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery PlanningMySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery Planning
Β 
My Sql And Search At Craigslist
My Sql And Search At CraigslistMy Sql And Search At Craigslist
My Sql And Search At Craigslist
Β 
Os Wilhelm
Os WilhelmOs Wilhelm
Os Wilhelm
Β 
OpenSolaris Web Stack MySQL BOF
OpenSolaris Web Stack MySQL BOFOpenSolaris Web Stack MySQL BOF
OpenSolaris Web Stack MySQL BOF
Β 
20081022cca
20081022cca20081022cca
20081022cca
Β 
Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)
Β 
Memcached Study
Memcached StudyMemcached Study
Memcached Study
Β 
Spark 2.x Troubleshooting Guide
Spark 2.x Troubleshooting GuideSpark 2.x Troubleshooting Guide
Spark 2.x Troubleshooting Guide
Β 
Shootout at the AWS Corral
Shootout at the AWS CorralShootout at the AWS Corral
Shootout at the AWS Corral
Β 
Cassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_deCassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_de
Β 
UKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL TuningUKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL Tuning
Β 
Make Your Life Easier With Maatkit
Make Your Life Easier With MaatkitMake Your Life Easier With Maatkit
Make Your Life Easier With Maatkit
Β 
OSDC 2016 - Tuning Linux for your Database by Colin Charles
OSDC 2016 - Tuning Linux for your Database by Colin CharlesOSDC 2016 - Tuning Linux for your Database by Colin Charles
OSDC 2016 - Tuning Linux for your Database by Colin Charles
Β 
Hong Qiangning in QConBeijing
Hong Qiangning in QConBeijingHong Qiangning in QConBeijing
Hong Qiangning in QConBeijing
Β 
M|18 How Facebook Migrated to MyRocks
M|18 How Facebook Migrated to MyRocksM|18 How Facebook Migrated to MyRocks
M|18 How Facebook Migrated to MyRocks
Β 
Optimize Your Hardware for Drupal
Optimize Your Hardware for DrupalOptimize Your Hardware for Drupal
Optimize Your Hardware for Drupal
Β 

More from Chris Barber

Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Chris Barber
Β 

More from Chris Barber (11)

Remote IP Power Switches
Remote IP Power SwitchesRemote IP Power Switches
Remote IP Power Switches
Β 
Node.js/io.js Native C++ Addons
Node.js/io.js Native C++ AddonsNode.js/io.js Native C++ Addons
Node.js/io.js Native C++ Addons
Β 
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Β 
Exploring the Titanium CLI - Codestrong 2012
Exploring the Titanium CLI - Codestrong 2012Exploring the Titanium CLI - Codestrong 2012
Exploring the Titanium CLI - Codestrong 2012
Β 
Intro to PECL/mysqlnd_ms (4/7/2011)
Intro to PECL/mysqlnd_ms (4/7/2011)Intro to PECL/mysqlnd_ms (4/7/2011)
Intro to PECL/mysqlnd_ms (4/7/2011)
Β 
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Β 
Debugging Dojo Applications (2/10/2010)
Debugging Dojo Applications (2/10/2010)Debugging Dojo Applications (2/10/2010)
Debugging Dojo Applications (2/10/2010)
Β 
Titanium Powered Desktop & Mobile Apps (11/21/2009)
Titanium Powered Desktop & Mobile Apps (11/21/2009)Titanium Powered Desktop & Mobile Apps (11/21/2009)
Titanium Powered Desktop & Mobile Apps (11/21/2009)
Β 
Dojo - Javascript's Swiss Army Knife (7/15/2009)
Dojo - Javascript's Swiss Army Knife (7/15/2009)Dojo - Javascript's Swiss Army Knife (7/15/2009)
Dojo - Javascript's Swiss Army Knife (7/15/2009)
Β 
High Availability With DRBD & Heartbeat
High Availability With DRBD & HeartbeatHigh Availability With DRBD & Heartbeat
High Availability With DRBD & Heartbeat
Β 
Memcached And MySQL
Memcached And MySQLMemcached And MySQL
Memcached And MySQL
Β 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
Β 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
Β 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
Β 

Recently uploaded (20)

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Β 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Β 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Β 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
Β 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
Β 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Β 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Β 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
Β 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
Β 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Β 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Β 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
Β 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
Β 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
Β 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
Β 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
Β 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
Β 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
Β 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Β 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
Β 

2008 MySQL Conference Recap

  • 1. MySQL Conference 2008 Edition Chris Barber http://www.cb1inc.com
  • 2. Who, What, When? ● April 14-17, 2008 ● Santa Clara, CA ● Over 2000 people (more than last year) ● 160 speakers ● 16 tutorials ● 128 sessions
  • 3. What's New? ● Sun ● MySQL 5.1 GA (still) ● MySQL Workbench GA – Windows only right now ● Hot backup extension http://www.theopenforce.com/2008/04/burning-the- boa.html ● Monty's talk: – http://monty-says.blogspot.com/2008/04/mysql- conference-good-bad-and-ugly.html – http://www.scribd.com/doc/2575733/The-future-of- MySQL-The-Project
  • 4. memcached ● Memcached storage engine ● Memcached functions for MySQL – SELECT memc_set('fruit', 'apple'); – SELECT memc_get('fruit');
  • 5. Testing ● DBUnit for database - http://www.dbunit.org – PHPUnit for PHP - http://phpunit.de – phpUnderControl - http://www.phpundercontrol.org v
  • 6. EC2 ● New! Persistent storage ● Storage caching mysteries ● High availability is difficult – Can't do heartbeat ● Previous machine's host remnants – Need to zero out drive... can take 5 hours!
  • 7. Gearman ● Server daemon than can do back-end stuff ● http://www.danga.com/gearman/ – From the people that made memcached ● netgearman – PHP library for Gearman – http://code.google.com/p/netgearman/
  • 8. Query Cache ● Only SELECT statements ● Viewing cache statistics: – SHOW GLOBAL STATUS LIKE 'qcache%'; – SHOW GLOBAL STATUS LIKE 'query_cache%'; ● 16MB by default ● Invalidates easily ● Can become fragmented
  • 9. LVM Snapshots for Backups ● Linux ● mylvmbackup ● Procedure – http://lenz.homelinux. org/mylvmbackup/ – flush tables – flush tables with read lock – Perl script – lvcreate -s – show master/slave status – unlock tables – mount snapshot, perform backup – unmount and discard the snapshot
  • 10. innodb ● Google actively improving it – Updated mutex code (CAS instead of mutex) ● New release! 1.0! – Data compression – Fast index creation – information_schema tables
  • 11. Flickr Stats – Massive Inserts ● Tracks images ● HTTP_REFERRER ● Custom Java daemon to pool, bulk insert
  • 12. Hardware Stuff ● Use 64-bit ● Storage ● Use lots of RAM – SAN, DAS, NAS – 32GB is cheap – Independent storage – Allocate all RAM to – RAID 10 innodb except 2GB – SAS vs. SATA ● 2 x dual core or 1 x – Battery backed cache quad core ● Write through vs. write back
  • 13. Hardware Stuff ● Violin Memory ● Kickfire ● 500GB RAM Drive ● Database appliance ● PCI-Express ● SQL chip ● Linux support ● Custom storage engine ● 84 x 6GB sticks ● Transparent http://www.flickr.com/photos/fallenpegasus/2424290836/
  • 14. Scaling MySQL: Up or Out? ● MySQL, Sun, Flickr, FotoLog, Wikipedia, Facebook, YouTube ● Facebook has over 1800 MySQL servers! http://www.flickr.com/photos/x180/2419466880/
  • 15. Other stuff ● High Availability – DRBD ● information_schema – Alternative to MySQL's SHOW command – Make plugins ● PrimeBase – PBXT Storage Engine ● High Performance MySQL – June 19, 2008