SkySQL uses best-of-breed software, and when it comes to metrics and monitoring that means Prometheus and Grafana. SkySQL Monitor is built on both, and provides customers with interactive dashboards for both real-time and historic metrics monitoring. In addition, it meets the same high availability and security requirements as other SkySQL components, ensuring metrics are always available and always secure.
In this session, we’ll explain how SkySQL Monitor works, walk through its dashboards and show how to monitor key metrics for performance and replication.
SkySQL implements a groundbreaking, state-of-the-art architecture based on Kubernetes and ServiceNow, and with a strong emphasis on cloud security – using compartmentalization and indirect access to secure and protect customer databases.
In this session, we’ll walk through the architecture of SkySQL and discuss how MariaDB leverages an advanced Kubernetes operator and powerful ServiceNow configuration/workflow management to deploy and manage databases on cloud infrastructure.
How Orwell built a geo-distributed Bank-as-a-Service with microservicesMariaDB plc
Orwell Group shares how they leveraged microservices, an event driven architecture and both master and reference data management methodologies to build a new banking system for high retail banking customers and corporate banks requiring cross border payments and cash flow management – and scaled it to handle customers with millions of clients. In particular they explain how they built a high availability, geo-distributed and consistent platform on top of MariaDB. The result was a secure and distributed platform with high cost efficiency, and the data accuracy and consistency needed to create high quality data pipelines from transactions to analytics and ensure regulatory compliance (e.g., GDPR).
In this day and age, data grows so fast it’s not uncommon for those of us using a relational database to reach the limits of its capacity. In this session, Kwangbock Lee explains how Samsung uses ClustrixDB to handle fast-growing data without manual database sharding. He highlights lessons learned, including a few hiccups along the way, and shares Samsung's experience migrating to ClustrixDB.
How Pixid dropped Oracle and went hybrid with MariaDBMariaDB plc
Pixid replaced Oracle Database with MySQL in 2011, then soon migrated to MariaDB to get better performance, more features and synchronous clustering for high availability. In addition to high-performance transactions, their customers needed access to fast analytics for self-service reporting and data exploration. Pixid started with a separate columnar database for analytics, but with the release of MariaDB ColumnStore, they found a more elegant solution – deploying a single database platform to handle both transactions and analytics. In this session, Antoine Gosset and Jérôme Mouret share how Pixid went from Oracle Database to handling both transactional and analytical workloads with MariaDB.
Introducing the ultimate MariaDB cloud, SkySQLMariaDB plc
SkySQL is the first and only database-as-a-service (DBaaS) engineered for MariaDB by MariaDB, to use a state-of-the-art multi-cloud architecture built on Kubernetes and ServiceNow, and to deploy databases and data warehouses for transactional, analytical and hybrid transactional/analytical workloads.
In this session, we’ll lay out the vision for SkySQL, provide an overview of its capabilities, take a tour of its architecture, and discuss the long-term roadmap. We’ll wrap things up with a live demo of SkySQL, including a preview of its deep learning–based workload analysis and visualization interface.
The capabilities and features of MariaDB Platform continue to expand, resulting in larger and more sophisticated production deployments – and the need for better tools. To provide DBAs with comprehensive, consolidating tooling, we created MariaDB Enterprise Tools: an easy-to-use, modular command-line interface for interacting with any part of MariaDB Platform.
In this session, we will provide a preview of the MariaDB Enterprise Client, walk through current and planned modules and discuss future plans for MariaDB Enterprise Tools – including SkySQL modules and the ability to create custom modules.
What to expect from MariaDB Platform X5, part 1MariaDB plc
MariaDB Platform X5 will be based on MariaDB Enterprise Server 10.5. This release includes Xpand, a fully distributed storage engine for scaling out, as well as many new features and improvements for DBAs and developers alike, including enhancements to temporal tables, additional JSON functions, a new performance schema, non-blocking schema changes with clustering and a Hashicorp Vault plugin for key management.
In this session, we’ll walk through all of the new features and enhancements available in MariaDB Enterprise Server 10.5. In addition, we will highlight those being backported to maintenance releases of MariaDB Enterprise Server 10.2, 10.3 and 10.4.
Introducing the R2DBC async Java connectorMariaDB plc
Not too long ago, a reactive variant of the JDBC driver was released, known as Reactive Relational Database Connectivity (R2DBC for short). While R2DBC started as an experiment to enable integration of SQL databases into systems that use reactive programming models, it now specifies a full-fledged service-provider interface that can be used to retrieve data from a target data source.
In this session, we’ll take a look at the new MariaDB R2DBC connector and examine the advantages of fully reactive, non-blocking development with MariaDB. And, of course, we’ll dive in and get a first-hand look at what it’s like to use the new connector with some live coding!
SkySQL implements a groundbreaking, state-of-the-art architecture based on Kubernetes and ServiceNow, and with a strong emphasis on cloud security – using compartmentalization and indirect access to secure and protect customer databases.
In this session, we’ll walk through the architecture of SkySQL and discuss how MariaDB leverages an advanced Kubernetes operator and powerful ServiceNow configuration/workflow management to deploy and manage databases on cloud infrastructure.
How Orwell built a geo-distributed Bank-as-a-Service with microservicesMariaDB plc
Orwell Group shares how they leveraged microservices, an event driven architecture and both master and reference data management methodologies to build a new banking system for high retail banking customers and corporate banks requiring cross border payments and cash flow management – and scaled it to handle customers with millions of clients. In particular they explain how they built a high availability, geo-distributed and consistent platform on top of MariaDB. The result was a secure and distributed platform with high cost efficiency, and the data accuracy and consistency needed to create high quality data pipelines from transactions to analytics and ensure regulatory compliance (e.g., GDPR).
In this day and age, data grows so fast it’s not uncommon for those of us using a relational database to reach the limits of its capacity. In this session, Kwangbock Lee explains how Samsung uses ClustrixDB to handle fast-growing data without manual database sharding. He highlights lessons learned, including a few hiccups along the way, and shares Samsung's experience migrating to ClustrixDB.
How Pixid dropped Oracle and went hybrid with MariaDBMariaDB plc
Pixid replaced Oracle Database with MySQL in 2011, then soon migrated to MariaDB to get better performance, more features and synchronous clustering for high availability. In addition to high-performance transactions, their customers needed access to fast analytics for self-service reporting and data exploration. Pixid started with a separate columnar database for analytics, but with the release of MariaDB ColumnStore, they found a more elegant solution – deploying a single database platform to handle both transactions and analytics. In this session, Antoine Gosset and Jérôme Mouret share how Pixid went from Oracle Database to handling both transactional and analytical workloads with MariaDB.
Introducing the ultimate MariaDB cloud, SkySQLMariaDB plc
SkySQL is the first and only database-as-a-service (DBaaS) engineered for MariaDB by MariaDB, to use a state-of-the-art multi-cloud architecture built on Kubernetes and ServiceNow, and to deploy databases and data warehouses for transactional, analytical and hybrid transactional/analytical workloads.
In this session, we’ll lay out the vision for SkySQL, provide an overview of its capabilities, take a tour of its architecture, and discuss the long-term roadmap. We’ll wrap things up with a live demo of SkySQL, including a preview of its deep learning–based workload analysis and visualization interface.
The capabilities and features of MariaDB Platform continue to expand, resulting in larger and more sophisticated production deployments – and the need for better tools. To provide DBAs with comprehensive, consolidating tooling, we created MariaDB Enterprise Tools: an easy-to-use, modular command-line interface for interacting with any part of MariaDB Platform.
In this session, we will provide a preview of the MariaDB Enterprise Client, walk through current and planned modules and discuss future plans for MariaDB Enterprise Tools – including SkySQL modules and the ability to create custom modules.
What to expect from MariaDB Platform X5, part 1MariaDB plc
MariaDB Platform X5 will be based on MariaDB Enterprise Server 10.5. This release includes Xpand, a fully distributed storage engine for scaling out, as well as many new features and improvements for DBAs and developers alike, including enhancements to temporal tables, additional JSON functions, a new performance schema, non-blocking schema changes with clustering and a Hashicorp Vault plugin for key management.
In this session, we’ll walk through all of the new features and enhancements available in MariaDB Enterprise Server 10.5. In addition, we will highlight those being backported to maintenance releases of MariaDB Enterprise Server 10.2, 10.3 and 10.4.
Introducing the R2DBC async Java connectorMariaDB plc
Not too long ago, a reactive variant of the JDBC driver was released, known as Reactive Relational Database Connectivity (R2DBC for short). While R2DBC started as an experiment to enable integration of SQL databases into systems that use reactive programming models, it now specifies a full-fledged service-provider interface that can be used to retrieve data from a target data source.
In this session, we’ll take a look at the new MariaDB R2DBC connector and examine the advantages of fully reactive, non-blocking development with MariaDB. And, of course, we’ll dive in and get a first-hand look at what it’s like to use the new connector with some live coding!
SkySQL is the first and only database-as-a-service (DBaaS) to perform workload analysis with advanced deep learning models, identifying and classifying discrete workload patterns so DBAs can better understand database workloads, identify anomalies and predict changes.
In this session, we’ll explain the concepts behind workload analysis and show how it can be used in the real world (and with sample real-world data) to improve database performance and efficiency by identifying key metrics and changes to cyclical patterns.
Faster, better, stronger: The new InnoDBMariaDB plc
For MariaDB Enterprise Server 10.5, the default transactional storage engine, InnoDB, has been significantly rewritten to improve the performance of writes and backups. Next, we removed a number of parameters to reduce unnecessary complexity, not only in terms of configuration but of the code itself. And finally, we improved crash recovery thanks to better consistency checks and we reduced memory consumption and file I/O thanks to an all new log record format.
In this session, we’ll walk through all of the improvements to InnoDB, and dive deep into the implementation to explain how these improvements help everything from configuration and performance to reliability and recovery.
In this session, Engineer Allen Herrera describes how SpendHQ made the move to a columnar database with MariaDB. He shares every aspect of the process from setting up their first cluster and testing it within their application to automating cluster deployment, analyzing performance and refining their data import process (i.e., ETL). He finishes by discussing future plans for MariaDB at SpendHQ.
What to expect from MariaDB Platform X5, part 2MariaDB plc
MariaDB Platform X5 will include MariaDB MaxScale 2.5 (with its brand-new web UI for configuration and monitoring) and MariaDB ColumnStore 1.5 (with cluster management reimplemented in MariaDB MaxScale for improved ease of use and deployment). In addition to the new web UI, MariaDB MaxScale 2.5 will be introducing support for distributed caches such as Redis, streaming to Apache Kafka, and a completely rewritten binlog router.
In this session, we’ll provide a short overview of MariaDB MaxScale and ColumnStore followed by a walkthrough of new features and a short discussion of plans for the next releases.
How QBerg scaled to store data longer, query it fasterMariaDB plc
The continuous increase in terms of services and countries to which QBerg delivers its services requires an ever-increasing load of resources. During the last year QBerg has reached a critical point, storing so much transactional data that standard relational databases were unable to meet the SLAs, or support the features, required by customers. As an example, they had to cap web analytics to running on a maximum of four months of history. The introduction of MariaDB ColumnStore, flanked by existing MariaDB Server databases, not only will allow them to store multiple years’ worth of historical data for analytics – it decreased overall processing time by one order of magnitude right off the bat. The move to a unified platform was incremental, using MariaDB MaxScale as both a router and a replicator. QBerg is now able to replicate full InnoDB schemas to MariaDB ColumnStore and incrementally update big tables without impacting the performance of ongoing transactions.
ClustrixDB: how distributed databases scale outMariaDB plc
ClustrixDB, now part of MariaDB, is a fully distributed and transactional RDBMS for applications with the highest scalability requirements. In this session Robbie Mihalyi, VP of Engineering for ClustrixDB, provides an introduction to ClustrixDB, followed by an in-depth technical overview of its architecture, with a focus on distributed storage, transactions and query processing – and its unique approach to index partitioning.
Getting started in the cloud for developersMariaDB plc
Looking to get up and running in the cloud, and start building applications with MariaDB as fast as possible? In this session, Thomas Boyd walks through the quick-start process of deploying MariaDB in the most popular public clouds. He then touches on some of the essential differences between cloud database services, helping you to create the cloud database strategy that best meets your needs.
How to power microservices with MariaDBMariaDB plc
Adoption of microservices is continuing at a rapid pace, but many deployments struggle when it comes to the database topology and data modeling. This session covers the pros and cons of different approaches (e.g., giving every microservice its own database or its own schema on a shared database) and various strategies for providing a consolidated view of data when different data is managed by different microservices.
Deploying MariaDB databases with containers at Nokia NetworksMariaDB plc
Nokia is focused on providing software and products that facilitate rapid development, deployment and scaling of products and services to customers. The Common Software Foundation (CSF) within Nokia develops and supports product reuse by multiple applications within Nokia, including MariaDB. Their focus over the last year has been to develop a containerized MariaDB solution supporting multiple architectures, including both clustering and primary/secondary replication with MariaDB MaxScale. In this talk, Rick Lane discusses this journey of these containerized solutions from development to customer trials, including problems encountered and solutions.
CCV: migrating our payment processing system to MariaDBMariaDB plc
CCV is a Dutch payment processor and loyalty provider. CCV's current payment processing platform is built on top of Microsoft SQL Server, but they are currently in the process of migrating it to MariaDB. This migration project is in progress and first production transactions are expected to run in 2020. In this session, Ernst Wernicke and Harry Dijkstra of CCV share how they are using MariaDB to meet critical high availability requirements, including geographic replication, zero data-loss, zero downtime (both planned and unplanned) and no single point of failure anywhere.
The role of databases in modern application developmentMariaDB plc
The rise of serverless microservices, event-driven application architecture and full-stack development with JavaScript and the MEAN stack is changing what application developers need from databases – and how they interact with them. In this session, MariaDB's Thomas Boyd discusses recent advancements in application development and architecture and explains how MariaDB supports them.
How THINQ runs both transactions and analytics at scaleMariaDB plc
THINQ provides a cloud-based Communications-Platform-as-a-Service (CPaaS) that routes tens of millions of phone calls per day for customers in enterprise and telecommunications industries. In this session Sasha Vaniachine, Senior Database Administrator at THINQ, explains how he combined MariaDB Server and MariaDB ColumnStore to support both high-performance transaction processing and scalable analytics. In addition, he shares some of THINQ's best practices and lessons learned from supporting an ever-increasing database workload that currently exceeds 10,000 transactions per second.
Caveats of hosting MariaDB on Microsoft Azure CloudMariaDB plc
Cloud service providers do not provide the same level of flexibility compared as an on-premises database. In this session, discover how Gaming Innovation Group (GiG) and MariaDB deployed a highly available setup on Microsoft Azure using the following technologies: Azure Load Balancer, CoroSync, Pacemaker, MariaDB MaxScale, MariaDB Cluster and MariaDB Server.
In 2018's user conference keynote MariaDB CEO, Michael Howard, announced an initiative to build a MariaDB DBaaS platform. In this session, the DBaaS team shares how MariaDB is approaching DBaaS, then discusses the role of containers and Kubernetes, the need for infrastructure-agnostic provisioning, support for day-two operations and enterprise requirements for large-scale DBaaS deployments.
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...jaxLondonConference
Presented at JAX London 2013
All too often I have observed infrastructure designs for deploying Java applications come as an afterthought by businesses, technical analysts, and application developers. Choices of technologies are frequently made with no final deployment infrastructures being discussed. The talk will cover the design considerations on building resilient applications, and application deployment platforms across multiple data centres, and how organisations can leverage technologies such as Apache Cassandra to achieve this.
Scylla Summit 2016: Why Kenshoo is about to displace Cassandra with ScyllaScyllaDB
Kenshoo is a leader in digital marketing with very heavy data usage. Learn about their big data challenges, the tools that they use, and their experience evaluating Scylla.
How to Secure Your Scylla Deployment: Authorization, Encryption, LDAP Authent...ScyllaDB
Scylla includes multiple features that collectively provide a robust security model. Most recently we announced support for encryption-at-rest in Scylla Enterprise. This enables you to lock-down your data even in multi-tenant and hybrid deployments of Scylla. Join Tzach and Dejan for an overview of security in Scylla and to see how you can approach it holistically using the array of Scylla capabilities. He will review Scylla Security features, from basic to more advanced, including:
Reducing your attack surface
Authorization & Authentication
Role-Based Access Control
Encryption at Transit
Encryption at Rest, in 2019.1.1 and beyond
LDAP authentication is a common requirement for any enterprise software. It gives users consistent login procedures across multiple components of the IT infrastructure, while centralizing the control of access rights. Scylla Enterprise now supports authentication via LDAP. We will look into how to configure Scylla Enterprise for LDAP interaction and how to fine-tune access control through it.
SkySQL is the first and only database-as-a-service (DBaaS) to perform workload analysis with advanced deep learning models, identifying and classifying discrete workload patterns so DBAs can better understand database workloads, identify anomalies and predict changes.
In this session, we’ll explain the concepts behind workload analysis and show how it can be used in the real world (and with sample real-world data) to improve database performance and efficiency by identifying key metrics and changes to cyclical patterns.
Faster, better, stronger: The new InnoDBMariaDB plc
For MariaDB Enterprise Server 10.5, the default transactional storage engine, InnoDB, has been significantly rewritten to improve the performance of writes and backups. Next, we removed a number of parameters to reduce unnecessary complexity, not only in terms of configuration but of the code itself. And finally, we improved crash recovery thanks to better consistency checks and we reduced memory consumption and file I/O thanks to an all new log record format.
In this session, we’ll walk through all of the improvements to InnoDB, and dive deep into the implementation to explain how these improvements help everything from configuration and performance to reliability and recovery.
In this session, Engineer Allen Herrera describes how SpendHQ made the move to a columnar database with MariaDB. He shares every aspect of the process from setting up their first cluster and testing it within their application to automating cluster deployment, analyzing performance and refining their data import process (i.e., ETL). He finishes by discussing future plans for MariaDB at SpendHQ.
What to expect from MariaDB Platform X5, part 2MariaDB plc
MariaDB Platform X5 will include MariaDB MaxScale 2.5 (with its brand-new web UI for configuration and monitoring) and MariaDB ColumnStore 1.5 (with cluster management reimplemented in MariaDB MaxScale for improved ease of use and deployment). In addition to the new web UI, MariaDB MaxScale 2.5 will be introducing support for distributed caches such as Redis, streaming to Apache Kafka, and a completely rewritten binlog router.
In this session, we’ll provide a short overview of MariaDB MaxScale and ColumnStore followed by a walkthrough of new features and a short discussion of plans for the next releases.
How QBerg scaled to store data longer, query it fasterMariaDB plc
The continuous increase in terms of services and countries to which QBerg delivers its services requires an ever-increasing load of resources. During the last year QBerg has reached a critical point, storing so much transactional data that standard relational databases were unable to meet the SLAs, or support the features, required by customers. As an example, they had to cap web analytics to running on a maximum of four months of history. The introduction of MariaDB ColumnStore, flanked by existing MariaDB Server databases, not only will allow them to store multiple years’ worth of historical data for analytics – it decreased overall processing time by one order of magnitude right off the bat. The move to a unified platform was incremental, using MariaDB MaxScale as both a router and a replicator. QBerg is now able to replicate full InnoDB schemas to MariaDB ColumnStore and incrementally update big tables without impacting the performance of ongoing transactions.
ClustrixDB: how distributed databases scale outMariaDB plc
ClustrixDB, now part of MariaDB, is a fully distributed and transactional RDBMS for applications with the highest scalability requirements. In this session Robbie Mihalyi, VP of Engineering for ClustrixDB, provides an introduction to ClustrixDB, followed by an in-depth technical overview of its architecture, with a focus on distributed storage, transactions and query processing – and its unique approach to index partitioning.
Getting started in the cloud for developersMariaDB plc
Looking to get up and running in the cloud, and start building applications with MariaDB as fast as possible? In this session, Thomas Boyd walks through the quick-start process of deploying MariaDB in the most popular public clouds. He then touches on some of the essential differences between cloud database services, helping you to create the cloud database strategy that best meets your needs.
How to power microservices with MariaDBMariaDB plc
Adoption of microservices is continuing at a rapid pace, but many deployments struggle when it comes to the database topology and data modeling. This session covers the pros and cons of different approaches (e.g., giving every microservice its own database or its own schema on a shared database) and various strategies for providing a consolidated view of data when different data is managed by different microservices.
Deploying MariaDB databases with containers at Nokia NetworksMariaDB plc
Nokia is focused on providing software and products that facilitate rapid development, deployment and scaling of products and services to customers. The Common Software Foundation (CSF) within Nokia develops and supports product reuse by multiple applications within Nokia, including MariaDB. Their focus over the last year has been to develop a containerized MariaDB solution supporting multiple architectures, including both clustering and primary/secondary replication with MariaDB MaxScale. In this talk, Rick Lane discusses this journey of these containerized solutions from development to customer trials, including problems encountered and solutions.
CCV: migrating our payment processing system to MariaDBMariaDB plc
CCV is a Dutch payment processor and loyalty provider. CCV's current payment processing platform is built on top of Microsoft SQL Server, but they are currently in the process of migrating it to MariaDB. This migration project is in progress and first production transactions are expected to run in 2020. In this session, Ernst Wernicke and Harry Dijkstra of CCV share how they are using MariaDB to meet critical high availability requirements, including geographic replication, zero data-loss, zero downtime (both planned and unplanned) and no single point of failure anywhere.
The role of databases in modern application developmentMariaDB plc
The rise of serverless microservices, event-driven application architecture and full-stack development with JavaScript and the MEAN stack is changing what application developers need from databases – and how they interact with them. In this session, MariaDB's Thomas Boyd discusses recent advancements in application development and architecture and explains how MariaDB supports them.
How THINQ runs both transactions and analytics at scaleMariaDB plc
THINQ provides a cloud-based Communications-Platform-as-a-Service (CPaaS) that routes tens of millions of phone calls per day for customers in enterprise and telecommunications industries. In this session Sasha Vaniachine, Senior Database Administrator at THINQ, explains how he combined MariaDB Server and MariaDB ColumnStore to support both high-performance transaction processing and scalable analytics. In addition, he shares some of THINQ's best practices and lessons learned from supporting an ever-increasing database workload that currently exceeds 10,000 transactions per second.
Caveats of hosting MariaDB on Microsoft Azure CloudMariaDB plc
Cloud service providers do not provide the same level of flexibility compared as an on-premises database. In this session, discover how Gaming Innovation Group (GiG) and MariaDB deployed a highly available setup on Microsoft Azure using the following technologies: Azure Load Balancer, CoroSync, Pacemaker, MariaDB MaxScale, MariaDB Cluster and MariaDB Server.
In 2018's user conference keynote MariaDB CEO, Michael Howard, announced an initiative to build a MariaDB DBaaS platform. In this session, the DBaaS team shares how MariaDB is approaching DBaaS, then discusses the role of containers and Kubernetes, the need for infrastructure-agnostic provisioning, support for day-two operations and enterprise requirements for large-scale DBaaS deployments.
Designing Resilient Application Platforms with Apache Cassandra - Hayato Shim...jaxLondonConference
Presented at JAX London 2013
All too often I have observed infrastructure designs for deploying Java applications come as an afterthought by businesses, technical analysts, and application developers. Choices of technologies are frequently made with no final deployment infrastructures being discussed. The talk will cover the design considerations on building resilient applications, and application deployment platforms across multiple data centres, and how organisations can leverage technologies such as Apache Cassandra to achieve this.
Scylla Summit 2016: Why Kenshoo is about to displace Cassandra with ScyllaScyllaDB
Kenshoo is a leader in digital marketing with very heavy data usage. Learn about their big data challenges, the tools that they use, and their experience evaluating Scylla.
How to Secure Your Scylla Deployment: Authorization, Encryption, LDAP Authent...ScyllaDB
Scylla includes multiple features that collectively provide a robust security model. Most recently we announced support for encryption-at-rest in Scylla Enterprise. This enables you to lock-down your data even in multi-tenant and hybrid deployments of Scylla. Join Tzach and Dejan for an overview of security in Scylla and to see how you can approach it holistically using the array of Scylla capabilities. He will review Scylla Security features, from basic to more advanced, including:
Reducing your attack surface
Authorization & Authentication
Role-Based Access Control
Encryption at Transit
Encryption at Rest, in 2019.1.1 and beyond
LDAP authentication is a common requirement for any enterprise software. It gives users consistent login procedures across multiple components of the IT infrastructure, while centralizing the control of access rights. Scylla Enterprise now supports authentication via LDAP. We will look into how to configure Scylla Enterprise for LDAP interaction and how to fine-tune access control through it.
MySQL 8.0 is the latest Generally Available version of MySQL. This session will give a brief introduction to MySQL 8.0 and help you upgrade from older versions, understand what utilities are available to make the process smoother and also understand what you need to bear in mind with the new version and considerations for possible behaviour changes and solutions. It really is a simple process.
OSMC 2023 | What’s new with Grafana Labs’s Open Source Observability stack by...NETWAYS
Open source is at the heart of what we do at Grafana Labs and there is so much happening! The intent of this talk to update everyone on the latest development when it comes to Grafana, Pyroscope, Faro, Loki, Mimir, Tempo and more. Everyone has had at least heard about Grafana but maybe some of the other projects mentioned above are new to you? Welcome to this talk 😉 Beside the update what is new we will also quickly introduce them during this talk.
According to service scale, there are hundreds or thousands of running containers in your service. Should we monitor each container by microscope or monitor each microservice by magnifier? This depends which granularity can help us find and solve the problems. In this sharing, I will introduce how to use cAdvisor, Icinga2, InfluxDB and Grafana to build a self-hosted monitoring system. In addition, I also discuss with how to embrace open source and share some practical experiences.
* Use cases of MySQL as well as edge cases of MySQL topologies using real-life examples and "war" stories
* How scalability and proxy wars make MySQL topologies more robust to serve webscale shops
* Open-source tools, utilities, and surrounding MySQL Ecosystem.
What's New in Apache Spark 2.3 & Why Should You CareDatabricks
The Apache Spark 2.3 release marks a big step forward in speed, unification, and API support.
This talk will quickly walk through what’s new and how you can benefit from the upcoming improvements:
* Continuous Processing in Structured Streaming.
* PySpark support for vectorization, giving Python developers the ability to run native Python code fast.
* Native Kubernetes support, marrying the best of container orchestration and distributed data processing.
Microservices @ Work - A Practice Report of Developing MicroservicesQAware GmbH
Cloud Native Night October 2016, Mainz: Talk by Simon Bäumler (Technical Chief Designer at QAware).
Join our Meetup: www.meetup.com/cloud-native-night
Abstract: This talk takes a practice oriented approach to examine microservice oriented architecture. It will show two real systems, one build from scratch in a microservice architecture, the other migrated from a monolithic system to a microservice architecture.
With the example of these two systems the pittfalls, advantages and lessons learned using microservice oriented architectures will be discussed.
While both systems use the java stack, including spring boot and spring cloud many topics will be kept general and will be of interest for all developers.
End-to-End, Source to Analytics, Data Lineage with Syncsort DMX-hPrecisely
Come see what new improvements we’ve made in Syncsort DMX-h, DataFunnel™ and DMX Change Data Capture.
Lineage is one thing that has been on the minds of a lot of our customers. This webinar will showcase new capabilities that allow deep tracking of field changes, transformations, merges and movement of data. Syncsort starts capturing lineage information at the moment of access with source systems, tracks all changes made, and data sources merged outside the cluster, and changes made on cluster. See how Syncsort helps you track your data’s changes from end to end, from source to analytics.
Confoo.ca conference talk February 24th 2021 on MySQL new features found in version 8.0 including server and supporting utility updates for those who may have missed some really neat new features
Beyond the basics: advanced SQL with MariaDBMariaDB plc
We've been writing SQL queries with WHERE, GROUP BY, ORDER BY, HAVING for decades, but we’re not using DOS 3.2 or Windows 1.0 anymore. Why limit yourself to SQL:86? In the past couple of releases, MariaDB has added support for features in the SQL:99 (common table expressions), SQL:2003 (window functions), SQL:2011 (system-versioned tables), and SQL:2016 (JSON) specifications – allowing you to build more complex data models (e.g., semi-structured or hierarchical) and write simpler, faster queries. In this session, Sergei Golubchik brings everyone up to speed on the latest SQL syntax supported in MariaDB.
Inside CynosDB: MariaDB optimized for the cloud at TencentMariaDB plc
Qinglin Zhang, Database Kernel Engineer at Tencent, introduces CynosDB, Tencent's self-developed database for the cloud. CynosDB is based on MariaDB Server, but separates computing and storage. Zhang goes on to provide a detailed explanation of the architecture with a focus on how Tencent implemented the computing and storage layers, and created Tencent’s MariaDB-based “Aurora”.
Migrating from InnoDB and HBase to MyRocks at FacebookMariaDB plc
Facebook created a new storage engine called MyRocks to optimize space and write performance, and recently migrated both UDB (a database for social activities, and our biggest in production) and Facebook Messenger to MyRocks. In this session, Yoshinori Matsunobu of Facebook talks about the challenges, benefits and lessons learned by migrating these applications from InnoDB to MyRocks.
Configuring workload-based storage and topologiesMariaDB plc
MariaDB has multiple workload-optimized storage engines, including InnoDB for mixed workloads, MyRocks for write-intensive workloads, Spider for scalable workloads and ColumnStore for analytical workloads. In this session, Kenny Geiselhart discusses how to choose the right storage engine for individual tables, and how replication and asymmetric topologies can be used to further optimize MariaDB and the hardware it runs on for specific workloads.
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
Techniques to optimize the pagerank algorithm usually fall in two categories. One is to try reducing the work per iteration, and the other is to try reducing the number of iterations. These goals are often at odds with one another. Skipping computation on vertices which have already converged has the potential to save iteration time. Skipping in-identical vertices, with the same in-links, helps reduce duplicate computations and thus could help reduce iteration time. Road networks often have chains which can be short-circuited before pagerank computation to improve performance. Final ranks of chain nodes can be easily calculated. This could reduce both the iteration time, and the number of iterations. If a graph has no dangling nodes, pagerank of each strongly connected component can be computed in topological order. This could help reduce the iteration time, no. of iterations, and also enable multi-iteration concurrency in pagerank computation. The combination of all of the above methods is the STICD algorithm. [sticd] For dynamic graphs, unchanged components whose ranks are unaffected can be skipped altogether.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
As Europe's leading economic powerhouse and the fourth-largest hashtag#economy globally, Germany stands at the forefront of innovation and industrial might. Renowned for its precision engineering and high-tech sectors, Germany's economic structure is heavily supported by a robust service industry, accounting for approximately 68% of its GDP. This economic clout and strategic geopolitical stance position Germany as a focal point in the global cyber threat landscape.
In the face of escalating global tensions, particularly those emanating from geopolitical disputes with nations like hashtag#Russia and hashtag#China, hashtag#Germany has witnessed a significant uptick in targeted cyber operations. Our analysis indicates a marked increase in hashtag#cyberattack sophistication aimed at critical infrastructure and key industrial sectors. These attacks range from ransomware campaigns to hashtag#AdvancedPersistentThreats (hashtag#APTs), threatening national security and business integrity.
🔑 Key findings include:
🔍 Increased frequency and complexity of cyber threats.
🔍 Escalation of state-sponsored and criminally motivated cyber operations.
🔍 Active dark web exchanges of malicious tools and tactics.
Our comprehensive report delves into these challenges, using a blend of open-source and proprietary data collection techniques. By monitoring activity on critical networks and analyzing attack patterns, our team provides a detailed overview of the threats facing German entities.
This report aims to equip stakeholders across public and private sectors with the knowledge to enhance their defensive strategies, reduce exposure to cyber risks, and reinforce Germany's resilience against cyber threats.
3. SKYSQL - ULTIMATE MARIADB CLOUD
1. SkySQL is the first and only database-as-a-service (DBaaS) to bring the full power of
MariaDB Platform to the cloud.
2. Combining powerful enterprise features, MariaDB expertise and world-class support.
3. Whether it’s a single development database or thousands of production databases.
4. Secure by default.
5. Works out of the box.
6. Includes SkySQL Monitoring
SKYSQL MONITORING
3
5. For more SkySQL
SKYSQL MONITORING
5
Introducing the ultimate MariaDB
cloud, SkySQL
Shane Johnson, Senior Director of Product
Marketing, MariaDB
Watch the recording
7. SKYSQL MONITORING
… is the observability and monitoring service SkySQL providers
to the customers.
SKYSQL MONITORING
7
8. SKYSQL MONITORING
Database services are vital component of your applications.
Tracking of the availability and the database performance is key to your
business operations.
We understand that. We added SkySQL Monitoring as observability tool to
our SkySQL product.
It provides single pane of glass for monitoring your database services.
SKYSQL MONITORING
8
9. LIVE MONITORING
1. Provides real time database statistics for the DB Administrators and
Application Developers
2. Allows focusing on a specific component or specific measure.
3. Detection of problems introduced by external factors.
SKYSQL MONITORING
9
10. LIVE MONITORING
1. Provides real time database statistics for the DB Administrators and
Application Developers
2. Allows focusing on a specific component or specific measure.
3. Detection of problems introduced by external factors.
SKYSQL MONITORING
10
11. RETROSPECTIVE MONITORING
1. Historical trends of all metrics.
2. Comparison between two separate periods in time.
3. Comparison between two separate services.
4. Comparison between two separate version of the application,
database or database configuration.
SKYSQL MONITORING
11
12. UNDER THE HOOD
1. SkySQL Monitoring utilizes the same monitoring infrastructure used by our own
support teams.
2. It is built on top of the already proven and supported Prometheus and Grafana
products.
3. Extensible. Allows addition of new features.
SKYSQL MONITORING
12
13. PROMETHEUS
SKYSQL MONITORING
1. Open Source monitoring and alerting platform.
2. Widely supported and has very active community.
3. Supports Kubernetes and auto discovery of pods.
4. Flexible dimensional query language.
5. Pull based monitoring agents.
6. Supports Prometheus Alert Manager to handle alerts.
13
14. GRAFANA
SKYSQL MONITORING
1. Open Source system for observability and analysis.
2. Great for presenting and analysing time series and especially metrics data
3. Widely supported, very active community.
4. Highly customisable dashboards and chart panels.
5. Pluggable architecture, allows development of visualisation plugins.
6. Works great wit Prometheus & PromQL.
14
17. MONITORING AGENTS
MariaDB Prometheus Exporter
Collects the monitoring data from all MariaDB Products.
It is designed and optimised specifically for the MariaDB components used in
SkySQL
● MariaDB Enterprise Server
● MariaDB MaxScale
● MariaDB ColumnStore
● MariaDB Platform
MariaDB Prometheus Exporter is supported by MariaDB and updated with the new
features as soon as they are developed in our database products.
SKYSQL MONITORING
17
18. MONITORING AGENTS
Kubernetes Exporters (kube-state-metrics)
Export relevant pod metrics from the kubernetes infrastructure.
● Pod statuses
● Pod system metrics
Container Exporter (cAdvisor)
Export relevant system metrics from the containers.
● Container system metrics
SKYSQL MONITORING
18
19. MONITORING INFRASTRUCTURE
● Collects, stores and optimizes collected database metrics.
● Starts collecting metrics as soon as the database is created.
● Stores the stats optimized for further use.
● Ensures monitoring data is collected only once with minimal
impact on the database performance.
● Serves the metrics data as often as needed for the monitoring
dashboards
SKYSQL MONITORING
19
20. MONITORING DASHBOARDS
● Present all database service performance statistics as a glance.
● Focus on a database service or deep dive to a specific server.
● Fullscreen (NOC) View to monitor live mission critical
applications.
● Modern Web Application which supports all modern browsers on
pc and most tablets.
SKYSQL MONITORING
20
22. OPEN SKYSQL MONITOR
1. Create at least one database service in SkySQL
2. Add your IP to the SkySQL Monitoring whitelist.
This allows you to control the IP access to your monitoring.
You can change the whitelist any time.
3. You can open SkySQL Monitor for the first time, pressing the
“Dashboard” button from the “Monitoring” menu.
SKYSQL MONITORING
22
26. DASHBOARDS SCREEN
WHAT’S NEW IN MARIADB 3.0
26
Service Name
Topology Type
And server Info
Server
Dashboards
Time Filter
NOC View
Dashboard Tabs
Metric Charts
27. SERVICE OVERVIEW DASHBOARDS
Status Tab
Set of dashboards vital for the
whole database service.
Charts
● Current SQL Commands
● QPS
● CPU Load
● Used Connections
● Aborted Connections
● Replication Status
SKYSQL MONITORING
27
28. SERVICE OVERVIEW DASHBOARDS
Database Tab
Displays information about the database
as historical charts.
Charts
● MaxScale Service Connections
● MaxScale Server Connections
● Aborted Connections
● Table Locks
● Open Tables
● Tables Opened
SKYSQL MONITORING
28
29. SERVICE OVERVIEW DASHBOARDS
Queries Tab
Displays information about queries as
historical charts.
Charts
● Top Commands (Recent/Hourly)
● Queries per Second
● Questions per Second
SKYSQL MONITORING
29
30. SERVICE OVERVIEW DASHBOARDS
Replication Lags
Displays replication lags in historical
charts.
Charts
● GTID Replication Lag
● Seconds behind primary
● Questions per Second
SKYSQL MONITORING
30
31. SERVICE OVERVIEW DASHBOARDS
System Tab
Displays system metrics in historical
charts.
Charts
● Top Commands (Recent/Hourly)
● Queries per Second
● Questions per Second
SKYSQL MONITORING
31
32. SERVER DASHBOARDS
Status Tab
Presents current server overview.
Charts
● SQL Commands Mix
● Queries per Second
● Current CPU, RAM, Buffer Pools
● Database and Network
throughput.
SKYSQL MONITORING
32
33. SERVER DASHBOARDS
Caches Tab
Displays historical charts about the
caches.
Charts
● Thread Cache
● Table Open Cache
● Table Definition Cache
● Query Cache and Activity.
SKYSQL MONITORING
33
34. SERVER DASHBOARDS
Database Tab
Displays historical charts about MariaDB
database parameters.
Charts
● MariaDB Active Connections
● MariaDB Aborted Connections
● Thread Activity
● Temporary Objects Created
● Table Locs
● Open Tables
● Open Files
SKYSQL MONITORING
34
35. SERVER DASHBOARDS
Queries Tab
Displays historical charts about MariaDB
running queries.
Charts
● Top commands by type
● Select and Sorts by Type
● Handler and Transactions
● Queries
● Slow Queries
SKYSQL MONITORING
35
36. SERVER DASHBOARDS
Queries Tab
Displays historical charts for the system
metrics.
Charts
● Memory distribution and overview
● CPU
● InnoDB MB/sec
● I/O and IOPS
● Networks
SKYSQL MONITORING
36
38. FOR EVERY DATABASE SERVICE
SKYSQL MONITORING
38
1. Available for all SkySQL customers.
2. Works out of the box
3. Based on recommendations from our MariaDB Remote DBAs.
4. Monitor all characteristic metrics for all standard SkySQL
database services.
Foundation Monitoring
39. EVERY DATABASE IS UNIQUE
SKYSQL MONITORING
39
Power Monitoring - Custom
1. Extends foundation tier.
2. Tailored monitoring solution to match the customer tailored power tier
service.
3. Supports custom topologies that might not be available for SkySQL
foundation tier.
4. Can support Alerts and Notifications.