MariaDB 5.5 and what comes next - Percona Live NYC 2012
MariaDB 5.5 and what comes next Colin Charles, Monty Program Ab firstname.lastname@example.org | email@example.com:/ /montyprogram.com/ | http:/ /mariadb.org/http:/ /bytebot.net/blog/ | @bytebot on Twitter Percona Live NYC, New York, USA 2 October 2012
whoamiMariaDB guy at Monty Program AbFormerly MySQL AB/Sun MicrosystemsPast lives included Fedora Project (FESCO),OpenOfﬁce.org
Aims32 months, four major releases(5.1,5.2,5.3,5.5) & more (Galera Cluster, 10.0)Discuss the broader MySQL ecosystemThe future of MariaDB
MariaDB is... (currently) Community developed Feature enhanced branch of MySQL with more Backwards compatible not a fork feature complete
OwnershipMySQL (database) owned by MySQL AB(company) -> Sun -> OracleMonty Program is just a (major) sponsor ofMariaDBmaria-captains: 50% MP, 50% communityincluding Sphinxsearch, Twitter, SkySQL,Taobao, Facebook, Percona, Codership, & more
Compatibility with MySQLNDB cluster included, XtraDB enabled bybut not enabled by default now. InnoDBdefault included too & may change to defaultClient libraries, clientserver protocol, SQL MariaDB Galera Clusterdialect, master-slave is a separate downloadreplication all same http://kb.askmonty.org/Data ﬁles supported as v/mariadb-versus-long as same versions mysql-compatibility
MariaDB 5.5GA April 2012https://kb.askmonty.org/en/what-is-mariadb-55/Current release: MariaDB 5.5.27By far the most popular release of MariaDBdownloaded, in use, today
MariaDB 5.5: anopensource threadpoolModiﬁed from 5.1 No minimization of(libevent based), great concurrent transactionsfor CPU bound loads with dynamic pool sizeand short runningqueriesWindows (threadpool),Linux (epoll), Solaris(event ports), FreeBSD/OSX (kevents)
MariaDB 5.5: Better for DBAs non-blocking client library SELECT now has LIMIT ROWS EXAMINED to start operation, do consume less resources work in thread, operation processed, SELECT * from t1, result travels back t2 LIMIT 10 ROWS EXAMINED 1000; use cases: multiple queries against single server (utilize more CPUs); queries against multiple servers (SHOW STATUS on many machines)
That’s it?From December 2010 to April 2012, 2 features for a 16 month delay?!?
MariaDB 5.3Biggest change in the optimizer since it waswrittenReplication improvementsReleased February 2012Based on the MySQL 5.1 codebase
Better replicationOriginal statements logged with row basedreplication (RBR) eventsChecksum for binlog eventsRBR works for tables with no primary keyConsistent snapshot between storage engines
Group commit in the binary logsync_binlog=1, http://kb.askmonty.org/en/group-innodb_ﬂush_log_at_trx_commit=1 commit-for-the-binary-loghttps://www.facebook.com/note.php?note_id=10150261692455933
MariaDB 5.3: GIS support!MySQL has OpenGIS SFS (Simple featureaccess, SQL access method)Now, SQL with full geometry typesST_ preﬁxhttp://kb.askmonty.org/en/gis-features-in-533
Optimizer enhancements Join additions block nested loop joins for outer-joins, block hash joins, Batched Key Access (BKA) Optimization for derived tables & views mergeable derived tables processed like VIEWs + optimizer creates indexes over materialized derived tables Disk access optimization ICP, MRR
Subquery optimizations Semi-join Goodbye rewriting as optimization, JOINs or separate materialization for queries non-correlated IN queries, subquery cache DBT-3, 60M rows, 29GB XtraDB
Welcome MySQL 5.6Instant EXPLAINhttps://kb.askmonty.org/en/optimizer-feature-comparison-matrix/Optimizer tracein 5.6?
Progress reportingFor ALTER TABLE or LOAD DATA INFILEMariaDB [mail]> alter table mail engine = maria;Stage: 1 of 2 copy to tmp table 17.55% of stage doneMariaDB [mail]> select id, user, db, command, state,-> time_ms, progress from information_schema.processlist;+---------+-------------------+-----------+----------+| command | state | time_ms | progress |+---------+-------------------+-----------+----------+| Query | copy to tmp table | 23407.131 | 17.551 |+---------+-------------------+-----------+----------+1 row in set (0.47 sec)
NoSQL access methodsComes with HandlerSocket direct access to XtraDB/InnoDB for CRUD operationsDynamic columns create columns with dynamic content basically a blob with handling functions
MariaDB 5.2Released November 2011Pluggable authentication w/PAM pluginUser statistics: CLIENT_STATISTICS,USER_STATISTICS, INDEX_STATISTICS,TABLE_STATISTICS (userstats=1)Virtual columns - PERSISTENT or VIRTUALSphinxSE storage engine started shipping
Still using MyISAM?Mitigates thread contention for key cachelock, with notable performance improvementsKey caches divided into different segments,allowing for better key cache concurrency1-64 segments
How do we support all this? Support LatestVersion Released MySQL till release5.1.42 Feb 2010 Feb 2015 5.1.62 5.1.63 5.2.3 Nov 2010 Nov 2015 5.2.12 5.1.63 5.3.5 Feb 2012 Feb 2017 5.3.8 5.1.655.5.23 Apr 2012 Apr 2017 5.5.27 5.5.27
Oh, and we’re fast Oracle loves MySQL performance on Microsoft Windows. So do weOLTP read-only OLTP write-only
How open is MariaDB?Mailing lists: Launchpad http:// launchpad.net/ maria- maria/ firstname.lastname@example.org nchpad.net Bugs database/feature worklog: Jira maria- email@example.com http:// ad.net mariadb.atlassian.ne t/Code hosting:Launchpad #maria on freenode
Deployments! happy users: pap.fr, wabtec, Paybox Services, “We made the switch on OLX, Jelastic, Web of Trust, SaltOS, ERP5, etc. Saturday -- and we’re seeing“MariaDB had these same bugs that we ran into beneﬁts already -- our dailywith MySQL. However the big difference was optimization time is down fromthat when we reported these bugs, they were 24 minutes to just 4 minutes” --quickly resolved within 48 hours!” -- Dreas van Ali Watters, CEO, travelblog.orgDonselaar, Chief Technology Ofﬁcer, SpamExpertsB.V. after migrating over 300 servers fromMySQL 5.0 to MariaDB 5.1. “Migrating from MySQL 5.1 to MariaDB 5.2 was as simple as removing MySQL RPMs and installing the MariaDB packages, then running mysql_upgrade.” - Panayot Belchev, proprietor, Host Bulgaria on providing MariaDB to over 7,000 of their web hosting customers.
Other branchesMySQL Percona MariaDB MySQL Percona MariaDB5.5.20 7.7M 61M 5.5.20 222299 15878435.5.22 16M 60M 5.5.22 438567 1540932
What are we missingfrom Percona Server?percona_innodb_buffer_pool_shm - requiresbig shmax not default on many systemspercona_log_slow_query_log-log_slow_verbosity - InnoDB ﬁlteringinformation not fully in MariaDBDisabled test suite is awesome resource :)
Faster even? read only? InnoDB/XtraDB is ﬁneInnoDB has higher throughput, but stalls & checkpoints w/ high write load
Track recordWe found the latest MySQL security bug and MariaDBwas ﬁrst to be patched (sql/password.c & memcmp())We don’t like regressions http://www.skysql.com/blogs/hartmut/nasty- innodb-regression-mysql-5525We care about backward compatibility & introducefeatures carefully XtraDB innodb_adaptive_checkpoint=none|reﬂex| estimate|keep_average (no more reﬂex...)
User stats plugin Disabled by default, consider enabling it to show use! http://mariadb.org/feedback_plugin/data from over 85 countries!
We love the community Tokutek’s TokuDB ships with MariaDB too groonga is to be merged We’re looking at spider next Multiple software packages talk about us (as an alternative to MySQL): Drupal, MediaWiki, Plone, phpMyAdmin, WordPress, etc.
FutureMySQL 5.6 just RC, we have most features in 5.5MariaDB 10.0 new InnoDB inside MariaDB (done) Global transaction ID support Multi-source replication (done) Enhanced semisync replication Persistent InnoDB statistics (done) Cassandra Storage Engine (done), HBase Storage Engine
MariaDB Galera Clusterhttp://kb.askmonty.org/en/galera/ Now in ALPHA!
Supportmariadb.org/service-providers/SkySQL, Percona, FromDual, PalominoDB,OpenQueryMonty Program does developer support &NRE http://montyprogram.com/developer- support/
We’re incredibly socialfacebook: fb.com/MariaDB.dbmstwitter: @mariadbgoogle plus: gplus.to/mariadbwe also have a LinkedIn group