Intro To The SkySQL Cloud Data Suite
Upcoming SlideShare
Loading in...5
×
 

Intro To The SkySQL Cloud Data Suite

on

  • 498 views

These are the slides that I presented at Percona Live London, 4th Dec 2012. ...

These are the slides that I presented at Percona Live London, 4th Dec 2012.
We have announced the new Administrator Console as part of the SkySQL Cloud Data Suite, now available for download on your laptops and linux desktops.

Statistics

Views

Total Views
498
Views on SlideShare
498
Embed Views
0

Actions

Likes
0
Downloads
13
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Intro To The SkySQL Cloud Data Suite Intro To The SkySQL Cloud Data Suite Presentation Transcript

  • SkySQL Data Suite A New Open Source Approach to MySQL Distributed Systems Ivan Zoratti V1212.01Wednesday, 5 December 12
  • Who is Ivan ?Wednesday, 5 December 12
  • SkySQL •#1 provider of MySQL-based solutions, for software and services •Backed by Monty Program AB and 3rd parties active in the MySQL ecosystem •Committed to provide the best solutions around MySQL for the Community and for the EnterpriseWednesday, 5 December 12
  • Agenda • SkySQL Cloud Data Suite Architecture • SkySQL Cloud Data Suite on Amazon EC2 • Components for automated provisioning in AWS • Components for high availability in EC2 • The Administration Console • Automated Backup/Restore with S3 PAGE 4Wednesday, 5 December 12
  • Agenda We WAR hav NIN e lo G! ts o • SkySQL Cloud Data Suite Architecture f sli de s • SkySQL Cloud Data Suite on Amazon EC2 • Components for automated provisioning in AWS • Components for high availability in EC2 • The Administration Console • Automated Backup/Restore with S3 PAGE 4Wednesday, 5 December 12
  • Intro to SkySQL Data SuiteWednesday, 5 December 12
  • SkySQL Data Suite Replication & MHA High Availability Online Apps. Galera Full-Text DRBD Shared Storage SkySQL Data Suite Analytics Carrier Grade PAGE 6Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Replication High Availability Online Apps. Galera Full-Text DRBD Shared Storage SkySQL Data Suite Analytics Carrier Grade PAGE 7Wednesday, 5 December 12
  • Cloud Data Suite vs Enterprise Data Suite Cloud Data Suite Enteprise Data Suite •Deployed in Amazon AWS •Deployed in Clouds, virtualised env. and bare OS •Automatic configuration and provisioning •Standard download packages •MariaDB 5.5 •MariaDB, MySQL, Percona Servers •MySQL Replication with Pacemaker/Corosync •MySQL Replication with MHA, DRBD, Galera or shared storage and Pacemaker/Corosync •Administration Console with Backup/Restore •ZManda Recovery Manager •SkySQL Enterprise Monitoring aka MONyog - Trial •SkySQL Enterprise Monitory aka MONyog •PhpMyAdmin •SQLyog •Community Support •Enterprise Technical Support •Development Release •Production Release •Fully OSS (with MONyog Trial) •Mix of OSS and Commercial PAGE 8Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 1 1. Configure your DB system on config.skysql.com or cloud.skysql.com 3 2. Deploy the DB system: 2 • Online • Configuration pull from AWS • Manually 3. Connect the DB system to your application PAGE 9Wednesday, 5 December 12
  • SkySQL Data Suite Dec 2012 • Rel. 1.1 with bug fixing • New Administration Console with: • rpm package and installation on Linux OS • Administration and monitoring of replicated and standalone servers • Customisable graphs • Customisable commands PAGE 10Wednesday, 5 December 12
  • SkySQL Data Suite ArchitectureWednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account AMI PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account Configuration Engine AMI Rules Repository PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account Configuration Engine AMI Rules Repository Provisioning Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account Configuration Provisioning Engine Engine AMI Rules Software Repository Repository Provisioning Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account Configuration Provisioning Engine Engine AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator User Account Configuration Provisioning Deployment Engine Engine Engine AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator Deployment triggered by the first boot of each instance User Account Database Database Database Database Database Configuration Provisioning Deployment Engine Engine Engine user da ta.s h AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Data Suite Configurator Deployment triggered by the first boot of each instance User Account Database Database Database Database Database Configuration Provisioning Deployment Engine Engine Engine user da ta.s h AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Terminal $ ssh -i SDS193500.pem ec2-user@174.129.202.133 [ec2-user@node1 ~]$ ps -ef UID PID PPID C STIME TTY TIME CMD root 1157 1 0 Nov29 ? 00:00:02 /usr/sbin/glusterd --pid-file=/var/run/glusterd.pid root 1840 1 2 Nov29 ? 00:11:34 /usr/sbin/glusterfsd -s localhost --volfile-id glust... root 1889 1 0 Nov29 ? 00:00:50 /usr/sbin/glusterfsd -s localhost --volfile-id glust... root 1895 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste... root 1901 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste... root 4484 1 8 Nov29 ? 00:36:13 /usr/sbin/glusterfs --volfile-id=/gluster-monyog --... ... root 1311 1 0 Nov29 ? 00:00:34 corosync 220 1317 1311 0 Nov29 ? 00:00:12 /usr/libexec/pacemaker/cib root 1318 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/stonithd root 1319 1311 0 Nov29 ? 00:00:12 /usr/lib64/heartbeat/lrmd 220 1320 1311 0 Nov29 ? 00:00:03 /usr/libexec/pacemaker/attrd 220 1321 1311 0 Nov29 ? 00:00:01 /usr/libexec/pacemaker/pengine 220 1322 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/crmd ... root 1534 1 0 Nov29 ? 00:00:00 sendmail: accepting connections smmsp 1542 1 0 Nov29 ? 00:00:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue ... root 2293 1 0 Nov29 ? 00:00:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --p... mysql 2791 2293 0 Nov29 ? 00:00:28 /usr/sbin/mysqld --defaults-file=/etc/my.cnf --basedir=/usr ... ... root 3467 1 0 Nov29 ? 00:00:01 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf apache 25416 3467 0 Nov29 ? 00:00:00 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf ... root 4578 1 1 Nov29 ? 00:07:56 /usr/local/MONyog/bin/MONyog-bin -s Admin Console PhpMyAdmin Database Database Database Database Database MONyog PAGE 13Wednesday, 5 December 12
  • SkySQL Data Suite Building Block Admin Data Store Console Database Database Database Database Database Replicator PAGE 14Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Technologies and Software FRONT END Apache Linux 3.2 Tomcat Admin Data Store Console (Amazon Distro) BACK END SQLite Database Database Database Database Database MONyog Trial Replicator MariaDB PHPMyAdmin MySQL Pacemaker Replication Xtrabackup GlusterFS Corosync PAGE 15Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Data Store Public SkySQL AMI Data Store MariaDB 5.5 MyISAM, InnoDB, XtraDB, Enhanced Optimizer, Virtual Columns Database Database Database Database Database Pacemaker controls the automatic failover System and Data file systems From standalone to 1 Master + 3 Slaves PAGE 16Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Administration Console GUI to monitor the status of the Cluster Admin Console Extended Monitoring from MONyog as a trial Database Database Database Database Database PhPMyAdmin as graphical user tool Automatic failover for Backup/Restore to/ the admin and from S3 using Start/Stop, Isolate, mysql command monitoring servers Xtrabackup Promote nodes line interface PAGE 17Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator PAGE 18Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in asynchronous and semi- synchronous mode PAGE 18Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in asynchronous and semi- GlusterFS on ext4 to replicate the synchronous mode data collection and monitoring PAGE 18Wednesday, 5 December 12
  • SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in Automatic failover of database asynchronous and semi- GlusterFS on ext4 to replicate the servers and console components synchronous mode data collection and monitoring PAGE 18Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning User Account Database Database Database Database Database user da ta.s h I AM PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user da ta.s h I AM PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning Adaptive, distributed setup User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning Elastic IP on the Master Server Adaptive, distributed setup User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Provisioning Elastic IP on the Master Server Adaptive, distributed Currently, the Administration Console setup is on the Master server User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  • SkySQL Data Suite Deployment PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment Database PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  • SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  • SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  • SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  • Automated Provisioning in AWSWednesday, 5 December 12
  • Starting Here! You can try it for FREE! Even without an AWS account PAGE 23Wednesday, 5 December 12
  • Simplified Interface Immediate Help Real Time Check PAGE 24Wednesday, 5 December 12
  • Advanced Configuration PAGE 25Wednesday, 5 December 12
  • Cost Estimation PAGE 26Wednesday, 5 December 12
  • Delivery Mechanism PAGE 27Wednesday, 5 December 12
  • Online Deployment The keys will be discarded immediately after the provisioning PAGE 28Wednesday, 5 December 12
  • Extra AWS & Contact Info PAGE 29Wednesday, 5 December 12
  • Welcome Email mysql command line Administration Console ssh connection How to remove SCDS An inventory of the AWS components IMPORTANT! Your pem key PAGE 30Wednesday, 5 December 12
  • Job Done! PAGE 31Wednesday, 5 December 12
  • SkySQL Cloud Data Suite in Amazon EC2Wednesday, 5 December 12
  • Security Identity Access Manager Roles • EIP Address • Associate/Disassociate, Describe • Instances • Start, Stop, Describe • Attributes, Status, Tags, Net IF • Create, Describe • S3 Buckets • List, Create, Delete • Objects • Get, Put, List, Delete PAGE 33Wednesday, 5 December 12
  • Security Security Groups • ssh • http • MySQL • MONyog PAGE 34Wednesday, 5 December 12
  • Storage PAGE 35Wednesday, 5 December 12
  • Components for High Availability in EC2Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  • Automatic Failover with Pacemaker CRM Configuration Elastic IP admin-console and [root@node2 init.d]# crm status Node 2 ============ MONyog group Last updated: Sat Dec 1 12:42:03 2012 Last change: Fri Nov 30 12:43:27 2012 via crm_attribute on node2 Stack: openais Current DC: node2 - partition with quorum Public IPs Version: 1.1.7-6.el6-148fccfd5985c5590cc601123c6c16e966b85d14 4 Nodes configured, 4 expected votes 14 Resources configured. ============ Online: [ node2 node3 node1 node4 ] Admin Data Store Console Master/Slave Set: ms_resMySQL [resMySQL] Masters: [ node2 ] Slaves: [ node1 node3 node4 ] AmazonEIP (lsb:amazon_master_eip): Started node2 Clone Set: apache-php-myadmin [ApachePhpMyAdmin] Started: [ node1 node2 node3 node4 ] Resource Group: monyog Database Database Database Database monyog-fs (ocf::custom:Filesystem): Started node2 monyog-service (lsb:MONyogd): Started node2 Resource Group: admin-console console-fs (ocf::custom:Filesystem): Started node2 SkySQL-monitor (lsb:skysql_monitor): Started node2 Tomcat7 (ocf::heartbeat:tomcat): Started node2 Replicator PAGE 38Wednesday, 5 December 12
  • The Administration ConsoleWednesday, 5 December 12
  • Admin Console Dec 2012 PAGE 40Wednesday, 5 December 12
  • Admin Console Dec 2012 Master Server Access to MONyog Context Sensitive Customisable Graphs PAGE 41Wednesday, 5 December 12
  • Admin Console Dec 2012 Backup/Restore Access to PhpMyAdmin Customisable Commands PAGE 42Wednesday, 5 December 12
  • Administration Console Dec 2012 Customizable Graphs Monitors Name SQL Icon Delta Avg Chart PAGE 43Wednesday, 5 December 12
  • Administration Console Dec 2012 Customizable Commands Commands Desc Icon Order CommandStep Steps Desc Icon Script PAGE 44Wednesday, 5 December 12
  • Automated Backup/Restore with S3Wednesday, 5 December 12
  • Automated Backup Using Xtrabackup from the Admin Console PAGE 46Wednesday, 5 December 12
  • Automated Backup Using Xtrabackup from the Admin Console PAGE 47Wednesday, 5 December 12
  • Automated Backup Using Xtrabackup from the Admin Console PAGE 48Wednesday, 5 December 12
  • Why is the SkySQL Cloud Data Suite important for you? • You can test MariaDB/MySQL on AWS for FREE • You can use and fully control a ready made highly available solution AWS • You can compare MySQL on EC2 and RDS • You can study/review security and availability aspects in AWS • You can use some of the SCDS components in your environment PAGE 49Wednesday, 5 December 12
  • For more information... • Try the Configurator and How-To Video: http:// cloud.skysql.com • The Admin Console: http://www.skysql.com/ downloads/community/skysql-console • Forums: https://www.skysql.com/forums/ skysql-cloud-data-suite • Web: https://www.skysql.com/cloud • Bugs: http://bugs.skysql.com • Try it! http://config.skysql.com • Free SkySQL account available for testing • Test on your account PAGE 50Wednesday, 5 December 12
  • Thank You! ivan@skysql.com www.skysql.com izoratti.blogspot.com www.slideshare.net/izorattiWednesday, 5 December 12