SkySQL uses best-of-breed software, and when it comes to metrics and monitoring that means Prometheus and Grafana. SkySQL Monitor is built on both, and provides customers with interactive dashboards for both real-time and historic metrics monitoring. In addition, it meets the same high availability and security requirements as other SkySQL components, ensuring metrics are always available and always secure.
In this session, we’ll explain how SkySQL Monitor works, walk through its dashboards and show how to monitor key metrics for performance and replication.
3. SKYSQL - ULTIMATE MARIADB CLOUD
1. SkySQL is the first and only database-as-a-service (DBaaS) to bring the full power of
MariaDB Platform to the cloud.
2. Combining powerful enterprise features, MariaDB expertise and world-class support.
3. Whether it’s a single development database or thousands of production databases.
4. Secure by default.
5. Works out of the box.
6. Includes SkySQL Monitoring
SKYSQL MONITORING
3
5. For more SkySQL
SKYSQL MONITORING
5
Introducing the ultimate MariaDB
cloud, SkySQL
Shane Johnson, Senior Director of Product
Marketing, MariaDB
Watch the recording
7. SKYSQL MONITORING
… is the observability and monitoring service SkySQL providers
to the customers.
SKYSQL MONITORING
7
8. SKYSQL MONITORING
Database services are vital component of your applications.
Tracking of the availability and the database performance is key to your
business operations.
We understand that. We added SkySQL Monitoring as observability tool to
our SkySQL product.
It provides single pane of glass for monitoring your database services.
SKYSQL MONITORING
8
9. LIVE MONITORING
1. Provides real time database statistics for the DB Administrators and
Application Developers
2. Allows focusing on a specific component or specific measure.
3. Detection of problems introduced by external factors.
SKYSQL MONITORING
9
10. LIVE MONITORING
1. Provides real time database statistics for the DB Administrators and
Application Developers
2. Allows focusing on a specific component or specific measure.
3. Detection of problems introduced by external factors.
SKYSQL MONITORING
10
11. RETROSPECTIVE MONITORING
1. Historical trends of all metrics.
2. Comparison between two separate periods in time.
3. Comparison between two separate services.
4. Comparison between two separate version of the application,
database or database configuration.
SKYSQL MONITORING
11
12. UNDER THE HOOD
1. SkySQL Monitoring utilizes the same monitoring infrastructure used by our own
support teams.
2. It is built on top of the already proven and supported Prometheus and Grafana
products.
3. Extensible. Allows addition of new features.
SKYSQL MONITORING
12
13. PROMETHEUS
SKYSQL MONITORING
1. Open Source monitoring and alerting platform.
2. Widely supported and has very active community.
3. Supports Kubernetes and auto discovery of pods.
4. Flexible dimensional query language.
5. Pull based monitoring agents.
6. Supports Prometheus Alert Manager to handle alerts.
13
14. GRAFANA
SKYSQL MONITORING
1. Open Source system for observability and analysis.
2. Great for presenting and analysing time series and especially metrics data
3. Widely supported, very active community.
4. Highly customisable dashboards and chart panels.
5. Pluggable architecture, allows development of visualisation plugins.
6. Works great wit Prometheus & PromQL.
14
17. MONITORING AGENTS
MariaDB Prometheus Exporter
Collects the monitoring data from all MariaDB Products.
It is designed and optimised specifically for the MariaDB components used in
SkySQL
● MariaDB Enterprise Server
● MariaDB MaxScale
● MariaDB ColumnStore
● MariaDB Platform
MariaDB Prometheus Exporter is supported by MariaDB and updated with the new
features as soon as they are developed in our database products.
SKYSQL MONITORING
17
18. MONITORING AGENTS
Kubernetes Exporters (kube-state-metrics)
Export relevant pod metrics from the kubernetes infrastructure.
● Pod statuses
● Pod system metrics
Container Exporter (cAdvisor)
Export relevant system metrics from the containers.
● Container system metrics
SKYSQL MONITORING
18
19. MONITORING INFRASTRUCTURE
● Collects, stores and optimizes collected database metrics.
● Starts collecting metrics as soon as the database is created.
● Stores the stats optimized for further use.
● Ensures monitoring data is collected only once with minimal
impact on the database performance.
● Serves the metrics data as often as needed for the monitoring
dashboards
SKYSQL MONITORING
19
20. MONITORING DASHBOARDS
● Present all database service performance statistics as a glance.
● Focus on a database service or deep dive to a specific server.
● Fullscreen (NOC) View to monitor live mission critical
applications.
● Modern Web Application which supports all modern browsers on
pc and most tablets.
SKYSQL MONITORING
20
22. OPEN SKYSQL MONITOR
1. Create at least one database service in SkySQL
2. Add your IP to the SkySQL Monitoring whitelist.
This allows you to control the IP access to your monitoring.
You can change the whitelist any time.
3. You can open SkySQL Monitor for the first time, pressing the
“Dashboard” button from the “Monitoring” menu.
SKYSQL MONITORING
22
26. DASHBOARDS SCREEN
WHAT’S NEW IN MARIADB 3.0
26
Service Name
Topology Type
And server Info
Server
Dashboards
Time Filter
NOC View
Dashboard Tabs
Metric Charts
27. SERVICE OVERVIEW DASHBOARDS
Status Tab
Set of dashboards vital for the
whole database service.
Charts
● Current SQL Commands
● QPS
● CPU Load
● Used Connections
● Aborted Connections
● Replication Status
SKYSQL MONITORING
27
28. SERVICE OVERVIEW DASHBOARDS
Database Tab
Displays information about the database
as historical charts.
Charts
● MaxScale Service Connections
● MaxScale Server Connections
● Aborted Connections
● Table Locks
● Open Tables
● Tables Opened
SKYSQL MONITORING
28
29. SERVICE OVERVIEW DASHBOARDS
Queries Tab
Displays information about queries as
historical charts.
Charts
● Top Commands (Recent/Hourly)
● Queries per Second
● Questions per Second
SKYSQL MONITORING
29
30. SERVICE OVERVIEW DASHBOARDS
Replication Lags
Displays replication lags in historical
charts.
Charts
● GTID Replication Lag
● Seconds behind primary
● Questions per Second
SKYSQL MONITORING
30
31. SERVICE OVERVIEW DASHBOARDS
System Tab
Displays system metrics in historical
charts.
Charts
● Top Commands (Recent/Hourly)
● Queries per Second
● Questions per Second
SKYSQL MONITORING
31
32. SERVER DASHBOARDS
Status Tab
Presents current server overview.
Charts
● SQL Commands Mix
● Queries per Second
● Current CPU, RAM, Buffer Pools
● Database and Network
throughput.
SKYSQL MONITORING
32
33. SERVER DASHBOARDS
Caches Tab
Displays historical charts about the
caches.
Charts
● Thread Cache
● Table Open Cache
● Table Definition Cache
● Query Cache and Activity.
SKYSQL MONITORING
33
34. SERVER DASHBOARDS
Database Tab
Displays historical charts about MariaDB
database parameters.
Charts
● MariaDB Active Connections
● MariaDB Aborted Connections
● Thread Activity
● Temporary Objects Created
● Table Locs
● Open Tables
● Open Files
SKYSQL MONITORING
34
35. SERVER DASHBOARDS
Queries Tab
Displays historical charts about MariaDB
running queries.
Charts
● Top commands by type
● Select and Sorts by Type
● Handler and Transactions
● Queries
● Slow Queries
SKYSQL MONITORING
35
36. SERVER DASHBOARDS
Queries Tab
Displays historical charts for the system
metrics.
Charts
● Memory distribution and overview
● CPU
● InnoDB MB/sec
● I/O and IOPS
● Networks
SKYSQL MONITORING
36
38. FOR EVERY DATABASE SERVICE
SKYSQL MONITORING
38
1. Available for all SkySQL customers.
2. Works out of the box
3. Based on recommendations from our MariaDB Remote DBAs.
4. Monitor all characteristic metrics for all standard SkySQL
database services.
Foundation Monitoring
39. EVERY DATABASE IS UNIQUE
SKYSQL MONITORING
39
Power Monitoring - Custom
1. Extends foundation tier.
2. Tailored monitoring solution to match the customer tailored power tier
service.
3. Supports custom topologies that might not be available for SkySQL
foundation tier.
4. Can support Alerts and Notifications.