MySQL Ecosystem in 2020

The MySQL Ecosystem
in 2020
Where can you be part of it?
ALKIN TEZUYSAL - Sr. Technical Manager
June 4th, 2020 - 2020 Webinar Series

@ask_dba © 2020 Percona2
Alkin Tezuysal - @ask_dba
– Sr. Technical Manager, Percona
– Global Operations – Managed Services
– 25+ years of IT experience in RDBMS domain
– Open Source Database Evangelist
– Enterprise background
– Speaker, mentor and coach
– Born to Sail, Forced to Work
@ask_dba

About This
Presentation
@ask_dba © 2020 Percona 3
Overview of Existing Solutions and History of
MySQLOverview
Discuss what we use at Percona and best
practicesDiscuss
Show what specific things to look at and
trending topics
Show

Inception of
MySQL
• Written by Monty Widenius (Monty) in 1995
• In 15 June 2001, NuSphere sued MySQL AB,
• In October 2005, Oracle Corporation
acquired Innobase
• In February 2006, Oracle Corporation
acquired Sleepycat Software
• In January 2008, Sun Microsystems bought MySQL
• In April 2009, Oracle Corporation entered into an
agreement to purchase Sun Microsystems

MySQL Stake
Holders
In January 2009, before Oracle's acquisition of MySQL,
Monty Widenius started a GPL-only fork, MariaDB.
In 2008 Peter Zaitsev found Percona with MySQL fork
In 2008 Drizzle lasted till 2012
In 2014 WebScaleSQL lasted till 2016
As of 2020 Oracle owns both Community and Enterprise
Editions of MySQL

MySQL Versions
History
Ref:https://elmcip.net/node/10280

MySQL 5.0 to 8.0
Ref:https://github.com/dveeden/mysql-history-graph

MySQL 5.7
• Over 150 new features in MySQL 5.7
• Group Replication
• InnoDB
• Optimizer
• Security
• Performance Schema
• GIS (Geographic Information System)
• JSON
Ref:http://www.thecompletelistoffeatures.com/

MySQL 8.0
• Native Data Dictionary
• Fast Information Schema
• Utf8mb4 as Default
Character Set
• Security
• Roles
• New Super Privileges
• Password history
• Log encryption
• Persistent Auto Increment
• Auto Undo Tablespace
• Self Tuning (pool, log, flush)
• Invisible Indexes
• Optimizer Histograms
• Performance Schema
• Innodb No Wait and Skip
Locked
• Descending Indexes
• Aggregate over JSON
• JSON to table (Labs)
• JSON Extraction
• CTE (Recursive and Non-
Recursive)
• Window Functions
• GIS Features Set
• Document Store
• MySQL Shell
Database Administration Software Development
Ref:https://mysqlserverteam.com/the-complete-list-of-new-features-in-mysql-8-0/

MySQL 8.0.20
• 8.0.0 to 8.0.5 Several Bugs Fixed
• 8.0.11 Deprecates uft8mb3
• 8.0.12 Improves performance_schema defaults
• 8.0.13 Major deprecations InnoDB, Partitioning
• 8.0.14 MySQL allows dual passwords
• 8.0.15 Major Bugs Fixed
• 8.0.16 Several changes made to account-management capabilities, deprecation of
mysql_upgrade.
• 8.0.17 Audit Log , C API , Character Set Support changes.
• MySQL Shell Plugins
• Parallel table import
• In InnoDB Cluster:
• Automatic instance provisioning through cloning
• Automatic server version compatibility handling
• Simplification of internal recovery accounts
• 8.0.18 MySQL Shell Plugins,
• 8.0.19 Innodb ReplicaSet Parallel Table Import, Innodb Cluster improvements
• 8.0.20 Binary Log Compression

Percona Server
5.7 to 8.0
Ref:https://github.com/dveeden/mysql-history-graph

Percona Server
for MySQL 8.0.19-
10
• Faster and more consistently run queries
• Enhanced security with binary log (binlog)
encryption and data-at-rest encryption
• MyRocks, TokuDB Storage Engines
• InnoDB Full-Text Search Improvements
• Extra Hast/Digest Functions
• Improved diagnostics with instrumentation and
troubleshooting features

Community
vs
Enterprise
vs Percona
Community Enterprise Percona
- MySQL Enterprise
Monitor
Percona Monitoring and
Management
- PAM Authentication PAM Authentication
- - RocksDB
- - Extra Hash/Digest
Functions
- - Extra Diagnostic
Features
- Performance &
Scalability
Performance &
Scalability
- MySQL Enterprise
Backup
Percona Xtrabackup
- MySQL Enterprise Audit Percona Audit Plugin
- - TokuDB
- Threadpool Threadpool

MariaDB 10.5.3
• Partitioned S3 tables are discoverable. This means that if you
create a partitioned S3 table, both the partitioned table and its
partitions can be directly used by another server that has access
to the S3 storage. (MDEV-22088)
• Optimizer flag rowid_filter leads to long query (MDEV-21794)
• WSREP_ON is unnecessarily expensive to evaluate (MDEV-22203
• Misc wsrep performance optimization (MDEV-7962)
• Modernise Linux Large Page support (multiplesizes) (MDEV-
18851)
• Added system user for user view which allows to remove root
(MDEV-19650)
• WolfSSL updated
• ALTER USER doesn't remove excess authentication plugins from
mysql.global_priv (MDEV-21928)
• mysql_upgrade creating empty global_priv table (MDEV-21244)

Percona /
MariaDB
MyRocks Engine
• MyRocks storage engine based of RocksDB
• RocksDB is key-value store fork of LevelDB
• Optimized for writes and disk space usage
• Log-Structured Merge Tree Database
• Compressed InnoDB is roughly 2x smaller than
uncompressed InnoDB, MyRocks/HBase are 4x
smaller
• Decompression cost on read is non zero. It matters
less on i/o bound workloads
• Write efficiency is 10X better

MyRocks Engine –
Read, Write and Space
Performance/Efficiency
– Ref:https://www.percona.com/live/e18/sessions/myrocks-in-
the-real-world

Other Major
Players
• Amazon Web Services (AWS) RDS MySQL & MariaDB
• Amazon Web Services (AWS) Aurora
• Google Cloud Platform
• Alibaba Cloud (AliSQL, PolarDB)
• Microsoft Azure MySQL & MariaDB
• Rackspace Cloud MySQL & MariaDB & Percona Server
• Linux distributions MariaDB default database

Popularity of Mysql vs …
https://db-engines.com/en/ranking_trend

Web Scale
– Social Media (Facebook,
Twitter)
– Content and Cloud
Providers (Google,
Dropbox, Box)
– Services (Uber, Booking)
– E-commerce (ebay,
amazon)
SaaS
– AWS , Salesforce, Slack,
Adobe
MySQL Use Cases
Ref: https://www.mysql.com/customers/ Ref: https://dzone.com/articles/2019-open-source-database-report-top-
databases-pub

What’s the most
used Database in
the world?
• Oracle ?
• SQL Server ?
• DB2 ?
• MySQL ?
• PostgreSQL ?
SQLite
• Every Android device
• Every iPhone and iOS device
• Every Mac
• Every Windows10 machine
• Every Firefox, Chrome, and Safari web
browser
• Every instance of Skype
• Every instance of iTunes
• Every Dropbox client
• Every TurboTax and QuickBooks
• PHP and Python
• Most television sets and set-top cable
boxes
• Most automotive multimedia systems
• Countless millions of other
applications
https://www.sqlite.org/mostdeployed.html

Edge Cases of
MySQL
• Very Large Clusters up to
10-15K MySQL instances.
• Sharded operations for
geographic zones and
customer base Vitess
• Usage beyond MySQL’s
initial design
• Not fit due to hardware
limitation
• Unexpected growth and
expansion
• One billion tables
http://bit.ly/2DCXfjI

Scalability and
Proxy Wars
What’s a proxy? – Lightweight application between client and server
• Known proxies and load balancers:
• Software
• Open Source
• ProxySQL
• HA Proxy
• MySQL Router
• Licenced
• ScaleArc
• MaxScale
• Netscaler (Virtual Appliance)
• Hardware
• Netscaler
• F5

Open Source
Proxy Options for
MySQL
ProxySQL 2.0.7 (GPLv3)
– Stable since December
2015
– ProxySQL - included with
PerconaXtraDB Cluster
5.7,8.0,
– Lots of features and use
cases
– ProxySQL Use Case
Scenarios
MariaDB MaxScale 1.0…1.4.x
– GA since January 2015
– The “Swiss Army Knife” -
pluggable router with an
extensible architecture
– Logging, writing to other
backends (besides MySQL),
firewall filter, routing via
hints, query rewriting
– Binlog Server - popularised
by booking.com to not have
intermediate masters
– Popular use case: sitting in
front of a 3-node Galera
Cluster

MySQL Proxy Vision
https://proxysql.com/blog/proxysql-native-galera-support https://tinyurl.com/y5fwde4z

MySQL HA
Solutions
On Premise
– MySQL
– Group Replication
– Innodb Cluster
– Based on Galera
– Percona Xtradb
– MariaDB
– Continuent Tungsten
– ScaleArc
– Vitess
– Native Replication
– MHA, Orchestrator,
MySQL Failover
Cloud
– AWS Aurora
– Google Cloud Platform
– Azure SQL
– Alibaba Cloud AliSQL
– Microsoft Azure

Tooling
Highlights
Percona Toolkit (pt-osc,pt-table-sync, XtraBackup)
MySQL Shell
Orchestrator, gh-ost
MHA
Tungsten Replicator
MySQL Built-in Utilities
ClusterControl
MySQL Sandbox aka Dbdeployer
Sysbench
GUI tools: MySQL Workbench, phpMyAdmin, SQLYog, etc
PMM , VividCortex

MySQL Trending
Topics
• Kubernetes Operators
• Vitess
• Group Replication
• Galera 4.0
• Percona XtraDB 8.X
• MySQL 8.0.X
• Observability & Monitoring
• ProxySQL 2.X
• Orchestrator

Percona Kubernetes
Operator for Percona
XtraDB Cluster
ü Deploy easily
ü Scale Percona XtraDB
Cluster
ü Automate Backups
ü Integrate with Percona
Monitoring and
Management (PMM)
ü Relies on ProxySQL to
Remove Single Point of
Failure
ü Automate node recovery
ü Provide data encryption
ü Support private data
registries
Kubernetes Operators for MySQL
Presslabs Kubernetes Operator
ü Integration with Google
Cloud Marketplace,
OperatorHub.io, AWS
Marketplace
ü CRD Validation and
webhooks
ü SSL support
ü Default integrated with
MySQL 8.0
ü Proxy SQL integration
ü Backup policies
ü Physical backups
ü HA Orchestrator
integration
ü Prometheus metrics
exporter
ü Lag mitigation
ü Query limits
Vitess Kubernetes Operator
ü Create a StatefulSet for
each VitessTablet in a
VitessCluster
ü Create a Job to elect the
initial master in each
VitessShard
ü Fix parenting and
normalization
ü Create vtctld Deployment
and Service
ü Create vttablet service
ü Create vtgate Deployment
and Service
ü Create
PodDisruptionBudgets
ü Reconcile all the things!
ü Label pods when they
become shard masters
ü Add the ability to
automatically merge/split
a shard
ü Add the ability to
automatically
export/import resources
from embedded objects to
separate objects and back

Vitess
• Scalability
• Performance
• Manageability
• Shard management
• Performance
• Connection pooling
• Shard management
• Workflow

MySQL Group
Replication
–Oracle MySQL shared-everything
–Developed in 2013 at 5.6 GA
since 5.7 at the end of 2016
–MySQL Plugin
–Paxos based consensus
algorithm Multi-Master
–InnoDB engine
–Performance Schema tables
–Enhanced in 8.0.X

Galera 4.0
– Galera Cluster uses an allocation algorithm that attempts to store write-sets.
– True Multi-master, Active-Active Cluster Read and write to any node at any
time.
– Synchronous Replication No slave lag, no data is lost at node crash.
– Tightly Coupled All nodes hold the same state. No diverged data between
nodes allowed.
– Multi-threaded Slave For better performance. For any workload.
– No Master-Slave Failover Operations or Use of VIP.
– Hot Standby No downtime during failover (since there is no failover).
– Automatic Node Provisioning No need to manually back up the database and
copy it to the new node.
– Supports InnoDB.
– Transparent to Applications Required no (or minimal changes) to the
application.
– No Read and Write Splitting Needed.
– Easy to Use and Deploy

Observability
and
Monitoring
PMM 2.X
SolarWinds
(VividCortex)

PMM
Highlights
Point-in-time visibility and historical trending of database performance
Data from the Performance Schema and MySQL slow query log
Specific Amazon RDS and Amazon Aurora metrics dashboards for AWS-
specific monitoring
Data from the MongoDB query profiler
Best-of-breed tools, including Grafana, Prometheus, and Consul, query
analytics, administration, API, agent and exporter components
DBTA TREND-SETTING PRODUCT 2019
https://pmmdemo.percona.com/

Vividcortex
Highlights
Network analyzer
Monitors MySQL Queries real time
Monitors MySQL metrics
Agent based auto discovery
Cloud hosted
Designed for teams

MySQL’s 25th Anniversary

https://www.eventbrite.com/e/proxysql-tech-talks-with-
percona-tickets-106255384716?aff=efbneb

Q&A
Open Source Database Experts

MySQL Ecosystem in 2020

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to MySQL Ecosystem in 2020

Similar to MySQL Ecosystem in 2020 (20)

More from Alkin Tezuysal

More from Alkin Tezuysal (20)

Recently uploaded

Recently uploaded (20)

MySQL Ecosystem in 2020