SlideShare a Scribd company logo
1 of 38
Download to read offline
September 2018
Free monitoring for MySQL,
MariaDB, PostgreSQL and
MongoDB
Bartłomiej Oleś
Presenter
bart@severalnines.com
Copyright 2017 Severalnines AB
I'm Jean-Jérôme from the Severalnines Team and
I'm your host for today's webinar!
Feel free to ask any questions in the Questions
section of this application or via the Chat box.
You can also contact me directly via the chat box
or via email: info@severalnines.com during or
after the webinar.
Your host & some logistics
Copyright 2017 Severalnines AB
Copyright 2017 Severalnines AB
Free to download
Initial 30 days Enterprise trial
Converts into free Community Edition
Enterprise / paid versions available
Copyright 2017 Severalnines AB
Automation & Management
Deployment (Free Community)
● Deploy a Cluster in Minutes
○ On-Prem
○ Cloud (AWS/Azure/Google) - paid
Monitoring (Free Community)
● Systems View with 1 sec Resolution
● DB / OS stats & Performance Advisors
● Configurable Dashboards
● Query Analyzer
● Real-time / historical
Management (Paid Features)
● Backup Management
● Upgrades & Patching
● Security & Compliance
● Operational Reports
● Automatic Recovery & Repair
● Performance Management
● Automatic Performance Advisors
Copyright 2017 Severalnines AB
Supported Databases
Copyright 2017 Severalnines AB
Our Customers
Poll - Which of the following free monitoring tools
does your currently company use?
Copyright 2018 Severalnines AB
(choose many)
● Traditional (Nagios, Zabbix, ...)
● Saas based monitoring (MMS, ...)
● Specialized (PMM, MySQL OpsPack, ...)
● ClusterControl
● Other
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Monitoring distributed database systems
- Requirements
Most databases are somehow distributed today
● Services running on multiple hosts
○ Replication
○ Sharding
○ Clustering
● Multiple Data Centers
○ Cloud and/or On-prem
○ Disaster Recovery
● Load balancing and Single point of contact IP
○ For workload management, HA, query caching...
○ E.g., HAProxy, KeepAlived/VIP, ProxySQL, MaxScale
Why we need a database monitoring system
● Data is a key asset of the organisation
● Databases are important as they manage the source of truth
● Database is complex - IO, transaction engine, query optimizer,
caches, locks, versioning,...
● Very dependent on OS, IO subsystems, network
● Distribution across multiple instances makes it even more complex
● Good database monitoring helps make sense of all that
A “good” monitoring system involves
● Collection, Correlation
● Presentation
● Interpretation/analysis
● Interactions between concurrently
executing processes
● Integration with other platforms
Who uses database monitoring
● Managers
○ To improve project implementation
○ Keep track on internal or external SLA’s
○ Track team performance
○ Budgeting
○ Monitor KPIs
● Business
○ To inform and improve future programmes and projects
○ Inform stakeholders
● DBA, DevOps, SysOps
○ Prevent and event
○ Query caching
○ DB Firewall
Support for multiple DB platforms
Monitoring is not management
What is management?
Included in the free ClusterControl Community version
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Cloud-based vs On-prem monitoring
solutions
Comparing cloud-based vs on-prem
Cloud-based monitoring
● Benefits
○ Quick and easy configuration
○ Managing your solution over time
is also easier
○ Remote access from any location
or device with browsing
capabilities
● Drawbacks
○ Security
○ Reliability and stability
On-prem monitoring
● Benefits
○ A level of control that
cloud-based solutions just can't
provide
○ Performance reliability
○ Control over data, security
● Drawbacks
○ Installation and setup
○ Data access
Cloud monitoring
Poll - TBD
Copyright 2018 Severalnines AB
Which databases do you currently monitor?
● MySQL
● MariaDB
● PostgreSQL
● MongoDB
● Other
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Agent-based vs Agentless
Agentless vs Agent-based monitoring
Agentless Agent-based
Deployment
Software on ClusterControl host
only. Up and running within minutes
Agent installed on each monitored DB server
Admin. Overhead.
Only CC needs to be maintained Agents need to be maintained, updated, restarted in case of
failures
Configuration
Centralized Decentralized
Security
Controller to SSH into managed DBs,
requires certain privileges.
More secure. Agent communication to DB/OS is internal to
the server. No additional firewall rules.
Network Overhead
Additional traffic with more connections Local data collection, results processed and then shipped
to the server
Metrics resolution
High resolution at the cost of many
connections
High resolution, a lot of data can be collected locally by the
agent. No gaps in data if the network connection fails.
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Deepdive into
ClusterControl Community Edition
ClusterControl Requirements
Copyright 2018 Severalnines AB
● Installed on a single machine
○ 2GB of RAM, 2CPU and 20GB disk space
running on x86 architecture
● Can run on-prem or in the cloud
● Web-GUI or Command Line
● With or without agents
● Supported platforms:
○ RedHat/CentOS 6.x/7.x
○ Ubuntu 12.04/14.04/16.04 LTS
○ Debian 7.x/8.x
Monitoring is highly available
Copyright 2018 Severalnines AB
3 simple steps to deploy ClusterControl
Copyright 2018 Severalnines AB
Download and execute installation script
$ wget http://www.severalnines.com/downloads/cmon/install-cc
$ chmod +x install-cc
$ ./install-cc # as root or sudo user
Generate SSH keys
$ ssh-keygen -t rsa #generates ssh key
Copy SSH keys (on-prem monitoring)
ssh-copy-id root@clustercontrolhost # clustercontrol
ssh-copy-id root@dbhost1 #your database host
...
Cluster Control Architecture
Copyright 2018 Severalnines AB
Metrics Collection
Copyright 2018 Severalnines AB
SSH Host metrics collection (process, load balancers stats, resource usage and consumption, etc.) using
SSH library
Database client Database metrics collection (status, queries, variables, usage etc) using the respective database client
library
Advisor Mini programs written using ClusterControl Domain Specific Language (DSL)
Agent based uses Prometheus exporters to capture metrics data from the system it monitors. Statistics are then
stored in the time series DB
Technology specific dashboards
Copyright 2018 Severalnines AB
● MySQL
○ standalone, MySQL Replication, NDB
Cluster, InnoDB Cluster/Group
Replication
● MariaDB
○ standalone, Replication, Galera Cluster
● Percona Server for MySQL
○ standalone, Percona XtraDB Cluster
● PostgreSQL
○ standalone, Streaming Replication
● MongoDB Inc.
○ standalone, ReplicaSet, Sharded Cluster
● Percona Server for MongoDB
○ standalone, ReplicaSet, Sharded Cluster
Query Monitoring
Copyright 2018 Severalnines AB
● Top queries
● Running queries
● Query Outliers
Performance Advisors
Copyright 2018 Severalnines AB
● Predefined advisors
● Custom advisors and developer studio
Other features available to Community
users
Copyright 2018 Severalnines AB
● Deployment
○ 15+ DB topologies
○ Standalone
○ Replication setups
○ Cluster setups
● ClusterControl CLI
● Topology view
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Demo
Poll - TBD
Copyright 2018 Severalnines AB
Are you currently using ClusterControl for monitoring and management?
● Yes
● I’m going to download it
● Not convinced yet
Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Q & A
End of Year Promotion
Get Three Months Free
25% In
Savings
Just Sign By December 20th!
with an Annual Contract
Links & Resources
● Download / install ClusterControl
● ClusterControl Community Edition Page
● Contact us: info@severalnines.com

More Related Content

What's hot

Netflix Data Benchmark @ HPTS 2017
Netflix Data Benchmark @ HPTS 2017Netflix Data Benchmark @ HPTS 2017
Netflix Data Benchmark @ HPTS 2017
Ioannis Papapanagiotou
 

What's hot (20)

Introducing MagnetoDB, a key-value storage sevice for OpenStack
Introducing MagnetoDB, a key-value storage sevice for OpenStackIntroducing MagnetoDB, a key-value storage sevice for OpenStack
Introducing MagnetoDB, a key-value storage sevice for OpenStack
 
Building an open data platform with apache iceberg
Building an open data platform with apache icebergBuilding an open data platform with apache iceberg
Building an open data platform with apache iceberg
 
Presto Summit 2018 - 03 - Starburst CBO
Presto Summit 2018  - 03 - Starburst CBOPresto Summit 2018  - 03 - Starburst CBO
Presto Summit 2018 - 03 - Starburst CBO
 
Presto Summit 2018 - 10 - Qubole
Presto Summit 2018  - 10 - QubolePresto Summit 2018  - 10 - Qubole
Presto Summit 2018 - 10 - Qubole
 
Designing for operability and managability
Designing for operability and managabilityDesigning for operability and managability
Designing for operability and managability
 
From monolith to microservice with containers.
From monolith to microservice with containers.From monolith to microservice with containers.
From monolith to microservice with containers.
 
ClustrixDB at Samsung Cloud
ClustrixDB at Samsung CloudClustrixDB at Samsung Cloud
ClustrixDB at Samsung Cloud
 
The role of databases in modern application development
The role of databases in modern application developmentThe role of databases in modern application development
The role of databases in modern application development
 
InfluxDB Cloud Product Update
InfluxDB Cloud Product Update InfluxDB Cloud Product Update
InfluxDB Cloud Product Update
 
Presto talk @ Global AI conference 2018 Boston
Presto talk @ Global AI conference 2018 BostonPresto talk @ Global AI conference 2018 Boston
Presto talk @ Global AI conference 2018 Boston
 
Netflix Data Benchmark @ HPTS 2017
Netflix Data Benchmark @ HPTS 2017Netflix Data Benchmark @ HPTS 2017
Netflix Data Benchmark @ HPTS 2017
 
The architecture of SkySQL
The architecture of SkySQLThe architecture of SkySQL
The architecture of SkySQL
 
Introducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live FrankfurtIntroducing TiDB - Percona Live Frankfurt
Introducing TiDB - Percona Live Frankfurt
 
"Smooth Operator" [Bay Area NewSQL meetup]
"Smooth Operator" [Bay Area NewSQL meetup]"Smooth Operator" [Bay Area NewSQL meetup]
"Smooth Operator" [Bay Area NewSQL meetup]
 
Data Platform in the Cloud
Data Platform in the CloudData Platform in the Cloud
Data Platform in the Cloud
 
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
Paul Dix [InfluxData] | InfluxDays Opening Keynote | InfluxDays EMEA 2021
 
How Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDBHow Pixid dropped Oracle and went hybrid with MariaDB
How Pixid dropped Oracle and went hybrid with MariaDB
 
Getting started in the cloud for developers
Getting started in the cloud for developersGetting started in the cloud for developers
Getting started in the cloud for developers
 
How to shard MariaDB like a pro - FOSDEM 2021
How to shard MariaDB like a pro  - FOSDEM 2021How to shard MariaDB like a pro  - FOSDEM 2021
How to shard MariaDB like a pro - FOSDEM 2021
 
OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...
OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...
OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...
 

Similar to Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL and MongoDB

Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Severalnines
 
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDBWebinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Severalnines
 
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Severalnines
 
Webinar slides: DevOps Tutorial: how to automate your database infrastructure
Webinar slides: DevOps Tutorial: how to automate your database infrastructureWebinar slides: DevOps Tutorial: how to automate your database infrastructure
Webinar slides: DevOps Tutorial: how to automate your database infrastructure
Severalnines
 
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
Severalnines
 

Similar to Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL and MongoDB (20)

Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
Webinar slides: How to Achieve PCI Compliance for MySQL & MariaDB with Cluste...
 
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDBWebinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
Webinar slides: How to automate and manage MongoDB & Percona Server for MongoDB
 
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
Webinar slides: Backup Management for MySQL, MariaDB, PostgreSQL & MongoDB wi...
 
Serverless_with_MongoDB
Serverless_with_MongoDBServerless_with_MongoDB
Serverless_with_MongoDB
 
Webinar slides: DevOps Tutorial: how to automate your database infrastructure
Webinar slides: DevOps Tutorial: how to automate your database infrastructureWebinar slides: DevOps Tutorial: how to automate your database infrastructure
Webinar slides: DevOps Tutorial: how to automate your database infrastructure
 
在-MongoDB-Cloud-上構建無服務器化應用
在-MongoDB-Cloud-上構建無服務器化應用在-MongoDB-Cloud-上構建無服務器化應用
在-MongoDB-Cloud-上構建無服務器化應用
 
Enterprise Cloud Security
Enterprise Cloud SecurityEnterprise Cloud Security
Enterprise Cloud Security
 
How to Increase Performance in IBM Cognos
How to Increase Performance in IBM CognosHow to Increase Performance in IBM Cognos
How to Increase Performance in IBM Cognos
 
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
Webinar slides: Severalnines & MariaDB present: Automation & Management of Ma...
 
Solving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute finalSolving enterprise challenges through scale out storage & big compute final
Solving enterprise challenges through scale out storage & big compute final
 
From Mainframe to Microservices: Vanguard’s Move to the Cloud - ENT331 - re:I...
From Mainframe to Microservices: Vanguard’s Move to the Cloud - ENT331 - re:I...From Mainframe to Microservices: Vanguard’s Move to the Cloud - ENT331 - re:I...
From Mainframe to Microservices: Vanguard’s Move to the Cloud - ENT331 - re:I...
 
Disaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDBDisaster Recovery Planning for MySQL & MariaDB
Disaster Recovery Planning for MySQL & MariaDB
 
Overcoming Data Gravity in Multi-Cloud Enterprise Architectures
Overcoming Data Gravity in Multi-Cloud Enterprise ArchitecturesOvercoming Data Gravity in Multi-Cloud Enterprise Architectures
Overcoming Data Gravity in Multi-Cloud Enterprise Architectures
 
Horses for Courses: Database Roundtable
Horses for Courses: Database RoundtableHorses for Courses: Database Roundtable
Horses for Courses: Database Roundtable
 
Cloud-Native Patterns and the Benefits of MySQL as a Platform Managed Service
Cloud-Native Patterns and the Benefits of MySQL as a Platform Managed ServiceCloud-Native Patterns and the Benefits of MySQL as a Platform Managed Service
Cloud-Native Patterns and the Benefits of MySQL as a Platform Managed Service
 
New enhancements for security and usability in EDB 13
New enhancements for security and usability in EDB 13New enhancements for security and usability in EDB 13
New enhancements for security and usability in EDB 13
 
Tips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloudTips to drive maria db cluster performance for nextcloud
Tips to drive maria db cluster performance for nextcloud
 
Data Architecture at Vente-Exclusive.com - TOTM Exellys
Data Architecture at Vente-Exclusive.com - TOTM ExellysData Architecture at Vente-Exclusive.com - TOTM Exellys
Data Architecture at Vente-Exclusive.com - TOTM Exellys
 
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
Webinar slides: How to deploy and manage HAProxy, MaxScale or ProxySQL with C...
 
Azure SQL Database Managed Instance
Azure SQL Database Managed InstanceAzure SQL Database Managed Instance
Azure SQL Database Managed Instance
 

More from Severalnines

Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Severalnines
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Severalnines
 
Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?
Severalnines
 
Webinar slides: How to Get Started with Open Source Database Management
Webinar slides: How to Get Started with Open Source Database ManagementWebinar slides: How to Get Started with Open Source Database Management
Webinar slides: How to Get Started with Open Source Database Management
Severalnines
 

More from Severalnines (17)

Cloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaSCloud's future runs through Sovereign DBaaS
Cloud's future runs through Sovereign DBaaS
 
Working with the Moodle Database: The Basics
Working with the Moodle Database: The BasicsWorking with the Moodle Database: The Basics
Working with the Moodle Database: The Basics
 
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
(slides) Polyglot persistence: utilizing open source databases as a Swiss poc...
 
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
Webinar slides: How to Manage Replication Failover Processes for MySQL, Maria...
 
MariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash CourseMariaDB Performance Tuning Crash Course
MariaDB Performance Tuning Crash Course
 
Performance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDBPerformance Tuning Cheat Sheet for MongoDB
Performance Tuning Cheat Sheet for MongoDB
 
Advanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona ServerAdvanced MySql Data-at-Rest Encryption in Percona Server
Advanced MySql Data-at-Rest Encryption in Percona Server
 
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket KnifePolyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
Polyglot Persistence Utilizing Open Source Databases as a Swiss Pocket Knife
 
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQLWebinar slides: An Introduction to Performance Monitoring for PostgreSQL
Webinar slides: An Introduction to Performance Monitoring for PostgreSQL
 
Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance TuningWebinar slides: Our Guide to MySQL & MariaDB Performance Tuning
Webinar slides: Our Guide to MySQL & MariaDB Performance Tuning
 
Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?Webinar slides: How to Measure Database Availability?
Webinar slides: How to Measure Database Availability?
 
Webinar slides: How to Get Started with Open Source Database Management
Webinar slides: How to Get Started with Open Source Database ManagementWebinar slides: How to Get Started with Open Source Database Management
Webinar slides: How to Get Started with Open Source Database Management
 
MySQL on Docker - Containerizing the Dolphin
MySQL on Docker - Containerizing the DolphinMySQL on Docker - Containerizing the Dolphin
MySQL on Docker - Containerizing the Dolphin
 
Automating and Managing MongoDB: An Analysis of Ops Manager vs. ClusterControl
Automating and Managing MongoDB: An Analysis of Ops Manager vs. ClusterControlAutomating and Managing MongoDB: An Analysis of Ops Manager vs. ClusterControl
Automating and Managing MongoDB: An Analysis of Ops Manager vs. ClusterControl
 
MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A ...MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - MaxScale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
 
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
 
MySQL Cluster (NDB) - Best Practices Percona Live 2017
MySQL Cluster (NDB) - Best Practices Percona Live 2017MySQL Cluster (NDB) - Best Practices Percona Live 2017
MySQL Cluster (NDB) - Best Practices Percona Live 2017
 

Recently uploaded

audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkkaudience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
lolsDocherty
 
Production 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptxProduction 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptx
ChloeMeadows1
 

Recently uploaded (16)

iThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWebiThome_CYBERSEC2024_Drive_Into_the_DarkWeb
iThome_CYBERSEC2024_Drive_Into_the_DarkWeb
 
Development Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of appsDevelopment Lifecycle.pptx for the secure development of apps
Development Lifecycle.pptx for the secure development of apps
 
I’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 ShirtI’ll See Y’All Motherfuckers In Game 7 Shirt
I’ll See Y’All Motherfuckers In Game 7 Shirt
 
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkkaudience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
audience research (emma) 1.pptxkkkkkkkkkkkkkkkkk
 
How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?How Do I Begin the Linksys Velop Setup Process?
How Do I Begin the Linksys Velop Setup Process?
 
Bug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's GuideBug Bounty Blueprint : A Beginner's Guide
Bug Bounty Blueprint : A Beginner's Guide
 
Pvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdfPvtaan Social media marketing proposal.pdf
Pvtaan Social media marketing proposal.pdf
 
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
TORTOGEL TELAH MENJADI SALAH SATU PLATFORM PERMAINAN PALING FAVORIT.
 
Premier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdfPremier Mobile App Development Agency in USA.pdf
Premier Mobile App Development Agency in USA.pdf
 
Thank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirtsThank You Luv I’ll Never Walk Alone Again T shirts
Thank You Luv I’ll Never Walk Alone Again T shirts
 
Cyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital PresenceCyber Security Services Unveiled: Strategies to Secure Your Digital Presence
Cyber Security Services Unveiled: Strategies to Secure Your Digital Presence
 
Production 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptxProduction 2024 sunderland culture final - Copy.pptx
Production 2024 sunderland culture final - Copy.pptx
 
GOOGLE Io 2024 At takes center stage.pdf
GOOGLE Io 2024 At takes center stage.pdfGOOGLE Io 2024 At takes center stage.pdf
GOOGLE Io 2024 At takes center stage.pdf
 
Reggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirtsReggie miller choke t shirts
Reggie miller choke t shirtsReggie miller choke t shirts
 
The Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case StudyThe Use of AI in Indonesia Election 2024: A Case Study
The Use of AI in Indonesia Election 2024: A Case Study
 
Statistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdfStatistical Analysis of DNS Latencies.pdf
Statistical Analysis of DNS Latencies.pdf
 

Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL and MongoDB

  • 1. September 2018 Free monitoring for MySQL, MariaDB, PostgreSQL and MongoDB Bartłomiej Oleś Presenter bart@severalnines.com
  • 2. Copyright 2017 Severalnines AB I'm Jean-Jérôme from the Severalnines Team and I'm your host for today's webinar! Feel free to ask any questions in the Questions section of this application or via the Chat box. You can also contact me directly via the chat box or via email: info@severalnines.com during or after the webinar. Your host & some logistics
  • 3.
  • 5. Copyright 2017 Severalnines AB Free to download Initial 30 days Enterprise trial Converts into free Community Edition Enterprise / paid versions available
  • 6. Copyright 2017 Severalnines AB Automation & Management Deployment (Free Community) ● Deploy a Cluster in Minutes ○ On-Prem ○ Cloud (AWS/Azure/Google) - paid Monitoring (Free Community) ● Systems View with 1 sec Resolution ● DB / OS stats & Performance Advisors ● Configurable Dashboards ● Query Analyzer ● Real-time / historical Management (Paid Features) ● Backup Management ● Upgrades & Patching ● Security & Compliance ● Operational Reports ● Automatic Recovery & Repair ● Performance Management ● Automatic Performance Advisors
  • 7. Copyright 2017 Severalnines AB Supported Databases
  • 8. Copyright 2017 Severalnines AB Our Customers
  • 9. Poll - Which of the following free monitoring tools does your currently company use? Copyright 2018 Severalnines AB (choose many) ● Traditional (Nagios, Zabbix, ...) ● Saas based monitoring (MMS, ...) ● Specialized (PMM, MySQL OpsPack, ...) ● ClusterControl ● Other
  • 10. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Monitoring distributed database systems - Requirements
  • 11. Most databases are somehow distributed today ● Services running on multiple hosts ○ Replication ○ Sharding ○ Clustering ● Multiple Data Centers ○ Cloud and/or On-prem ○ Disaster Recovery ● Load balancing and Single point of contact IP ○ For workload management, HA, query caching... ○ E.g., HAProxy, KeepAlived/VIP, ProxySQL, MaxScale
  • 12. Why we need a database monitoring system ● Data is a key asset of the organisation ● Databases are important as they manage the source of truth ● Database is complex - IO, transaction engine, query optimizer, caches, locks, versioning,... ● Very dependent on OS, IO subsystems, network ● Distribution across multiple instances makes it even more complex ● Good database monitoring helps make sense of all that
  • 13. A “good” monitoring system involves ● Collection, Correlation ● Presentation ● Interpretation/analysis ● Interactions between concurrently executing processes ● Integration with other platforms
  • 14. Who uses database monitoring ● Managers ○ To improve project implementation ○ Keep track on internal or external SLA’s ○ Track team performance ○ Budgeting ○ Monitor KPIs ● Business ○ To inform and improve future programmes and projects ○ Inform stakeholders ● DBA, DevOps, SysOps ○ Prevent and event ○ Query caching ○ DB Firewall
  • 15. Support for multiple DB platforms
  • 16. Monitoring is not management
  • 17. What is management? Included in the free ClusterControl Community version
  • 18. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Cloud-based vs On-prem monitoring solutions
  • 19. Comparing cloud-based vs on-prem Cloud-based monitoring ● Benefits ○ Quick and easy configuration ○ Managing your solution over time is also easier ○ Remote access from any location or device with browsing capabilities ● Drawbacks ○ Security ○ Reliability and stability On-prem monitoring ● Benefits ○ A level of control that cloud-based solutions just can't provide ○ Performance reliability ○ Control over data, security ● Drawbacks ○ Installation and setup ○ Data access
  • 21. Poll - TBD Copyright 2018 Severalnines AB Which databases do you currently monitor? ● MySQL ● MariaDB ● PostgreSQL ● MongoDB ● Other
  • 22. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Agent-based vs Agentless
  • 23. Agentless vs Agent-based monitoring Agentless Agent-based Deployment Software on ClusterControl host only. Up and running within minutes Agent installed on each monitored DB server Admin. Overhead. Only CC needs to be maintained Agents need to be maintained, updated, restarted in case of failures Configuration Centralized Decentralized Security Controller to SSH into managed DBs, requires certain privileges. More secure. Agent communication to DB/OS is internal to the server. No additional firewall rules. Network Overhead Additional traffic with more connections Local data collection, results processed and then shipped to the server Metrics resolution High resolution at the cost of many connections High resolution, a lot of data can be collected locally by the agent. No gaps in data if the network connection fails.
  • 24. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Deepdive into ClusterControl Community Edition
  • 25. ClusterControl Requirements Copyright 2018 Severalnines AB ● Installed on a single machine ○ 2GB of RAM, 2CPU and 20GB disk space running on x86 architecture ● Can run on-prem or in the cloud ● Web-GUI or Command Line ● With or without agents ● Supported platforms: ○ RedHat/CentOS 6.x/7.x ○ Ubuntu 12.04/14.04/16.04 LTS ○ Debian 7.x/8.x
  • 26. Monitoring is highly available Copyright 2018 Severalnines AB
  • 27. 3 simple steps to deploy ClusterControl Copyright 2018 Severalnines AB Download and execute installation script $ wget http://www.severalnines.com/downloads/cmon/install-cc $ chmod +x install-cc $ ./install-cc # as root or sudo user Generate SSH keys $ ssh-keygen -t rsa #generates ssh key Copy SSH keys (on-prem monitoring) ssh-copy-id root@clustercontrolhost # clustercontrol ssh-copy-id root@dbhost1 #your database host ...
  • 29. Metrics Collection Copyright 2018 Severalnines AB SSH Host metrics collection (process, load balancers stats, resource usage and consumption, etc.) using SSH library Database client Database metrics collection (status, queries, variables, usage etc) using the respective database client library Advisor Mini programs written using ClusterControl Domain Specific Language (DSL) Agent based uses Prometheus exporters to capture metrics data from the system it monitors. Statistics are then stored in the time series DB
  • 30. Technology specific dashboards Copyright 2018 Severalnines AB ● MySQL ○ standalone, MySQL Replication, NDB Cluster, InnoDB Cluster/Group Replication ● MariaDB ○ standalone, Replication, Galera Cluster ● Percona Server for MySQL ○ standalone, Percona XtraDB Cluster ● PostgreSQL ○ standalone, Streaming Replication ● MongoDB Inc. ○ standalone, ReplicaSet, Sharded Cluster ● Percona Server for MongoDB ○ standalone, ReplicaSet, Sharded Cluster
  • 31. Query Monitoring Copyright 2018 Severalnines AB ● Top queries ● Running queries ● Query Outliers
  • 32. Performance Advisors Copyright 2018 Severalnines AB ● Predefined advisors ● Custom advisors and developer studio
  • 33. Other features available to Community users Copyright 2018 Severalnines AB ● Deployment ○ 15+ DB topologies ○ Standalone ○ Replication setups ○ Cluster setups ● ClusterControl CLI ● Topology view
  • 34. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Demo
  • 35. Poll - TBD Copyright 2018 Severalnines AB Are you currently using ClusterControl for monitoring and management? ● Yes ● I’m going to download it ● Not convinced yet
  • 36. Copyright 2017 Severalnines AB Copyright 2018 Severalnines AB Q & A
  • 37. End of Year Promotion Get Three Months Free 25% In Savings Just Sign By December 20th! with an Annual Contract
  • 38. Links & Resources ● Download / install ClusterControl ● ClusterControl Community Edition Page ● Contact us: info@severalnines.com