SlideShare a Scribd company logo
1 of 16
Download to read offline
MySQL Conference
  2008 Edition
     Chris Barber
   http://www.cb1inc.com
Who, What, When?
●   April 14-17, 2008
●   Santa Clara, CA
●   Over 2000 people (more than last year)
●   160 speakers
●   16 tutorials
●   128 sessions
What's New?
●   Sun
●   MySQL 5.1 GA (still)
●   MySQL Workbench GA
    –   Windows only right now
●   Hot backup extension         http://www.theopenforce.com/2008/04/burning-the-
                                 boa.html
●   Monty's talk:
    –   http://monty-says.blogspot.com/2008/04/mysql-
        conference-good-bad-and-ugly.html
    –   http://www.scribd.com/doc/2575733/The-future-of-
        MySQL-The-Project
memcached
●   Memcached storage engine
●   Memcached functions for MySQL
    –   SELECT memc_set('fruit', 'apple');
    –   SELECT memc_get('fruit');
Testing
●   DBUnit for database - http://www.dbunit.org
    –   PHPUnit for PHP - http://phpunit.de
    –   phpUnderControl - http://www.phpundercontrol.org




                             v
EC2
●   New! Persistent storage
●   Storage caching mysteries
●   High availability is difficult
    –   Can't do heartbeat
●   Previous machine's host remnants
    –   Need to zero out drive... can take 5 hours!
Gearman
●   Server daemon than can do back-end stuff
●   http://www.danga.com/gearman/
    –   From the people that made memcached
●   netgearman – PHP library for Gearman
    –   http://code.google.com/p/netgearman/
Query Cache
●   Only SELECT statements
●   Viewing cache statistics:
    –   SHOW GLOBAL STATUS LIKE 'qcache%';
    –   SHOW GLOBAL STATUS LIKE 'query_cache%';
●   16MB by default
●   Invalidates easily
●   Can become fragmented
LVM Snapshots for Backups
●   Linux                             ●   mylvmbackup
●   Procedure                             –   http://lenz.homelinux.
                                              org/mylvmbackup/
    –   flush tables
    –   flush tables with read lock
                                          –   Perl script
    –   lvcreate -s
    –   show master/slave status
    –   unlock tables
    –   mount snapshot, perform
        backup
    –   unmount and discard the
        snapshot
innodb
●   Google actively improving it
    –   Updated mutex code (CAS instead of mutex)
●   New release! 1.0!
    –   Data compression
    –   Fast index creation
    –   information_schema tables
Flickr Stats – Massive Inserts
●   Tracks images
●   HTTP_REFERRER
●   Custom Java daemon to pool, bulk insert
Hardware Stuff
●   Use 64-bit                ●   Storage
●   Use lots of RAM               –   SAN, DAS, NAS
    –   32GB is cheap             –   Independent storage
    –   Allocate all RAM to       –   RAID 10
        innodb except 2GB         –   SAS vs. SATA
●   2 x dual core or 1 x          –   Battery backed cache
    quad core                          ●   Write through vs. write
                                           back
Hardware Stuff
  ●   Violin Memory                                      ●   Kickfire
  ●   500GB RAM Drive                                    ●   Database appliance
  ●   PCI-Express                                        ●   SQL chip
  ●   Linux support                                      ●   Custom storage engine
  ●   84 x 6GB sticks                                    ●   Transparent




http://www.flickr.com/photos/fallenpegasus/2424290836/
Scaling MySQL: Up or Out?
●   MySQL, Sun, Flickr,
    FotoLog, Wikipedia,
    Facebook, YouTube
●   Facebook has over 1800
    MySQL servers!


                             http://www.flickr.com/photos/x180/2419466880/
Other stuff
●   High Availability – DRBD
●   information_schema
    –   Alternative to MySQL's SHOW command
    –   Make plugins
●   PrimeBase – PBXT Storage Engine
●   High Performance MySQL
    –   June 19, 2008
Questions?




 Thank you!

More Related Content

What's hot

Grabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the TrunkGrabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the Trunk
Harold GimΓ©nez
Β 
Django book15 caching
Django book15 cachingDjango book15 caching
Django book15 caching
Shih-yi Wei
Β 
Optimize drupal
Optimize drupalOptimize drupal
Optimize drupal
Le Thanh Sang
Β 
Engage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data CollectionEngage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data Collection
Webtrends
Β 

What's hot (20)

Grabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the TrunkGrabbing the PostgreSQL Elephant by the Trunk
Grabbing the PostgreSQL Elephant by the Trunk
Β 
Using memcache to improve php performance
Using memcache to improve php performanceUsing memcache to improve php performance
Using memcache to improve php performance
Β 
HA with Galera
HA with GaleraHA with Galera
HA with Galera
Β 
Cache hcm-topdev
Cache hcm-topdevCache hcm-topdev
Cache hcm-topdev
Β 
Django book15 caching
Django book15 cachingDjango book15 caching
Django book15 caching
Β 
MySQL always-up with Galera Cluster
MySQL always-up with Galera ClusterMySQL always-up with Galera Cluster
MySQL always-up with Galera Cluster
Β 
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
MySQL Storage Engines - which do you use? TokuDB? MyRocks? InnoDB?
Β 
Speeding Up The Snail
Speeding Up The SnailSpeeding Up The Snail
Speeding Up The Snail
Β 
Memcache
MemcacheMemcache
Memcache
Β 
7 Ways To Crash Postgres
7 Ways To Crash Postgres7 Ways To Crash Postgres
7 Ways To Crash Postgres
Β 
Optimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_PerformanceOptimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_Performance
Β 
Optimize drupal
Optimize drupalOptimize drupal
Optimize drupal
Β 
Shootout at the PAAS Corral
Shootout at the PAAS CorralShootout at the PAAS Corral
Shootout at the PAAS Corral
Β 
Engage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data CollectionEngage 2013 - Multi Channel Data Collection
Engage 2013 - Multi Channel Data Collection
Β 
Scaling WordPress
Scaling WordPressScaling WordPress
Scaling WordPress
Β 
PERFORMANCE_SCHEMA and sys schema
PERFORMANCE_SCHEMA and sys schemaPERFORMANCE_SCHEMA and sys schema
PERFORMANCE_SCHEMA and sys schema
Β 
Drupal feature proposal: two new stream-wrappers
Drupal feature proposal: two new stream-wrappersDrupal feature proposal: two new stream-wrappers
Drupal feature proposal: two new stream-wrappers
Β 
High performance WordPress
High performance WordPressHigh performance WordPress
High performance WordPress
Β 
GUC Tutorial Package (9.0)
GUC Tutorial Package (9.0)GUC Tutorial Package (9.0)
GUC Tutorial Package (9.0)
Β 
5 things MySql
5 things MySql5 things MySql
5 things MySql
Β 

Similar to 2008 MySQL Conference Recap

From One to a Cluster
From One to a ClusterFrom One to a Cluster
From One to a Cluster
guestd34230
Β 
Scaling Rails with memcached
Scaling Rails with memcachedScaling Rails with memcached
Scaling Rails with memcached
elliando dias
Β 
My Sql And Search At Craigslist
My Sql And Search At CraigslistMy Sql And Search At Craigslist
My Sql And Search At Craigslist
MySQLConference
Β 
Os Wilhelm
Os WilhelmOs Wilhelm
Os Wilhelm
oscon2007
Β 
Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)
WordCamp Cape Town
Β 
Cassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_deCassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_de
mahalomeetup
Β 
UKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL TuningUKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL Tuning
FromDual GmbH
Β 
Make Your Life Easier With Maatkit
Make Your Life Easier With MaatkitMake Your Life Easier With Maatkit
Make Your Life Easier With Maatkit
MySQLConference
Β 

Similar to 2008 MySQL Conference Recap (20)

From One to a Cluster
From One to a ClusterFrom One to a Cluster
From One to a Cluster
Β 
20080611accel
20080611accel20080611accel
20080611accel
Β 
MySQL Tuning
MySQL TuningMySQL Tuning
MySQL Tuning
Β 
Scaling Rails with memcached
Scaling Rails with memcachedScaling Rails with memcached
Scaling Rails with memcached
Β 
MySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery PlanningMySQL Server Backup, Restoration, and Disaster Recovery Planning
MySQL Server Backup, Restoration, and Disaster Recovery Planning
Β 
My Sql And Search At Craigslist
My Sql And Search At CraigslistMy Sql And Search At Craigslist
My Sql And Search At Craigslist
Β 
Os Wilhelm
Os WilhelmOs Wilhelm
Os Wilhelm
Β 
OpenSolaris Web Stack MySQL BOF
OpenSolaris Web Stack MySQL BOFOpenSolaris Web Stack MySQL BOF
OpenSolaris Web Stack MySQL BOF
Β 
20081022cca
20081022cca20081022cca
20081022cca
Β 
Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)Roy foubister (hosting high traffic sites on a tight budget)
Roy foubister (hosting high traffic sites on a tight budget)
Β 
Memcached Study
Memcached StudyMemcached Study
Memcached Study
Β 
Spark 2.x Troubleshooting Guide
Spark 2.x Troubleshooting GuideSpark 2.x Troubleshooting Guide
Spark 2.x Troubleshooting Guide
Β 
Shootout at the AWS Corral
Shootout at the AWS CorralShootout at the AWS Corral
Shootout at the AWS Corral
Β 
Cassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_deCassandra at mahalo_com_scale_la_meetup_de
Cassandra at mahalo_com_scale_la_meetup_de
Β 
UKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL TuningUKOUG 2011: Practical MySQL Tuning
UKOUG 2011: Practical MySQL Tuning
Β 
Make Your Life Easier With Maatkit
Make Your Life Easier With MaatkitMake Your Life Easier With Maatkit
Make Your Life Easier With Maatkit
Β 
OSDC 2016 - Tuning Linux for your Database by Colin Charles
OSDC 2016 - Tuning Linux for your Database by Colin CharlesOSDC 2016 - Tuning Linux for your Database by Colin Charles
OSDC 2016 - Tuning Linux for your Database by Colin Charles
Β 
Hong Qiangning in QConBeijing
Hong Qiangning in QConBeijingHong Qiangning in QConBeijing
Hong Qiangning in QConBeijing
Β 
M|18 How Facebook Migrated to MyRocks
M|18 How Facebook Migrated to MyRocksM|18 How Facebook Migrated to MyRocks
M|18 How Facebook Migrated to MyRocks
Β 
Optimize Your Hardware for Drupal
Optimize Your Hardware for DrupalOptimize Your Hardware for Drupal
Optimize Your Hardware for Drupal
Β 

More from Chris Barber

Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Chris Barber
Β 

More from Chris Barber (11)

Remote IP Power Switches
Remote IP Power SwitchesRemote IP Power Switches
Remote IP Power Switches
Β 
Node.js/io.js Native C++ Addons
Node.js/io.js Native C++ AddonsNode.js/io.js Native C++ Addons
Node.js/io.js Native C++ Addons
Β 
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Titanium 3.2 CLI - TiAppCamp2 - 11/2/2013
Β 
Exploring the Titanium CLI - Codestrong 2012
Exploring the Titanium CLI - Codestrong 2012Exploring the Titanium CLI - Codestrong 2012
Exploring the Titanium CLI - Codestrong 2012
Β 
Intro to PECL/mysqlnd_ms (4/7/2011)
Intro to PECL/mysqlnd_ms (4/7/2011)Intro to PECL/mysqlnd_ms (4/7/2011)
Intro to PECL/mysqlnd_ms (4/7/2011)
Β 
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Cassandra - Say Goodbye to the Relational Database (5-6-2010)
Β 
Debugging Dojo Applications (2/10/2010)
Debugging Dojo Applications (2/10/2010)Debugging Dojo Applications (2/10/2010)
Debugging Dojo Applications (2/10/2010)
Β 
Titanium Powered Desktop & Mobile Apps (11/21/2009)
Titanium Powered Desktop & Mobile Apps (11/21/2009)Titanium Powered Desktop & Mobile Apps (11/21/2009)
Titanium Powered Desktop & Mobile Apps (11/21/2009)
Β 
Dojo - Javascript's Swiss Army Knife (7/15/2009)
Dojo - Javascript's Swiss Army Knife (7/15/2009)Dojo - Javascript's Swiss Army Knife (7/15/2009)
Dojo - Javascript's Swiss Army Knife (7/15/2009)
Β 
High Availability With DRBD & Heartbeat
High Availability With DRBD & HeartbeatHigh Availability With DRBD & Heartbeat
High Availability With DRBD & Heartbeat
Β 
Memcached And MySQL
Memcached And MySQLMemcached And MySQL
Memcached And MySQL
Β 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
Β 

Recently uploaded (20)

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
Β 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Β 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Β 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
Β 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
Β 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
Β 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
Β 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
Β 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
Β 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
Β 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
Β 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Β 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
Β 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
Β 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
Β 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
Β 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
Β 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
Β 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
Β 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
Β 

2008 MySQL Conference Recap

  • 1. MySQL Conference 2008 Edition Chris Barber http://www.cb1inc.com
  • 2. Who, What, When? ● April 14-17, 2008 ● Santa Clara, CA ● Over 2000 people (more than last year) ● 160 speakers ● 16 tutorials ● 128 sessions
  • 3. What's New? ● Sun ● MySQL 5.1 GA (still) ● MySQL Workbench GA – Windows only right now ● Hot backup extension http://www.theopenforce.com/2008/04/burning-the- boa.html ● Monty's talk: – http://monty-says.blogspot.com/2008/04/mysql- conference-good-bad-and-ugly.html – http://www.scribd.com/doc/2575733/The-future-of- MySQL-The-Project
  • 4. memcached ● Memcached storage engine ● Memcached functions for MySQL – SELECT memc_set('fruit', 'apple'); – SELECT memc_get('fruit');
  • 5. Testing ● DBUnit for database - http://www.dbunit.org – PHPUnit for PHP - http://phpunit.de – phpUnderControl - http://www.phpundercontrol.org v
  • 6. EC2 ● New! Persistent storage ● Storage caching mysteries ● High availability is difficult – Can't do heartbeat ● Previous machine's host remnants – Need to zero out drive... can take 5 hours!
  • 7. Gearman ● Server daemon than can do back-end stuff ● http://www.danga.com/gearman/ – From the people that made memcached ● netgearman – PHP library for Gearman – http://code.google.com/p/netgearman/
  • 8. Query Cache ● Only SELECT statements ● Viewing cache statistics: – SHOW GLOBAL STATUS LIKE 'qcache%'; – SHOW GLOBAL STATUS LIKE 'query_cache%'; ● 16MB by default ● Invalidates easily ● Can become fragmented
  • 9. LVM Snapshots for Backups ● Linux ● mylvmbackup ● Procedure – http://lenz.homelinux. org/mylvmbackup/ – flush tables – flush tables with read lock – Perl script – lvcreate -s – show master/slave status – unlock tables – mount snapshot, perform backup – unmount and discard the snapshot
  • 10. innodb ● Google actively improving it – Updated mutex code (CAS instead of mutex) ● New release! 1.0! – Data compression – Fast index creation – information_schema tables
  • 11. Flickr Stats – Massive Inserts ● Tracks images ● HTTP_REFERRER ● Custom Java daemon to pool, bulk insert
  • 12. Hardware Stuff ● Use 64-bit ● Storage ● Use lots of RAM – SAN, DAS, NAS – 32GB is cheap – Independent storage – Allocate all RAM to – RAID 10 innodb except 2GB – SAS vs. SATA ● 2 x dual core or 1 x – Battery backed cache quad core ● Write through vs. write back
  • 13. Hardware Stuff ● Violin Memory ● Kickfire ● 500GB RAM Drive ● Database appliance ● PCI-Express ● SQL chip ● Linux support ● Custom storage engine ● 84 x 6GB sticks ● Transparent http://www.flickr.com/photos/fallenpegasus/2424290836/
  • 14. Scaling MySQL: Up or Out? ● MySQL, Sun, Flickr, FotoLog, Wikipedia, Facebook, YouTube ● Facebook has over 1800 MySQL servers! http://www.flickr.com/photos/x180/2419466880/
  • 15. Other stuff ● High Availability – DRBD ● information_schema – Alternative to MySQL's SHOW command – Make plugins ● PrimeBase – PBXT Storage Engine ● High Performance MySQL – June 19, 2008