Intro To The SkySQL Cloud Data Suite

610 views

Published on

These are the slides that I presented at Percona Live London, 4th Dec 2012.
We have announced the new Administrator Console as part of the SkySQL Cloud Data Suite, now available for download on your laptops and linux desktops.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
610
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Intro To The SkySQL Cloud Data Suite

  1. 1. SkySQL Data Suite A New Open Source Approach to MySQL Distributed Systems Ivan Zoratti V1212.01Wednesday, 5 December 12
  2. 2. Who is Ivan ?Wednesday, 5 December 12
  3. 3. SkySQL •#1 provider of MySQL-based solutions, for software and services •Backed by Monty Program AB and 3rd parties active in the MySQL ecosystem •Committed to provide the best solutions around MySQL for the Community and for the EnterpriseWednesday, 5 December 12
  4. 4. Agenda • SkySQL Cloud Data Suite Architecture • SkySQL Cloud Data Suite on Amazon EC2 • Components for automated provisioning in AWS • Components for high availability in EC2 • The Administration Console • Automated Backup/Restore with S3 PAGE 4Wednesday, 5 December 12
  5. 5. Agenda We WAR hav NIN e lo G! ts o • SkySQL Cloud Data Suite Architecture f sli de s • SkySQL Cloud Data Suite on Amazon EC2 • Components for automated provisioning in AWS • Components for high availability in EC2 • The Administration Console • Automated Backup/Restore with S3 PAGE 4Wednesday, 5 December 12
  6. 6. Intro to SkySQL Data SuiteWednesday, 5 December 12
  7. 7. SkySQL Data Suite Replication & MHA High Availability Online Apps. Galera Full-Text DRBD Shared Storage SkySQL Data Suite Analytics Carrier Grade PAGE 6Wednesday, 5 December 12
  8. 8. SkySQL Cloud Data Suite Replication High Availability Online Apps. Galera Full-Text DRBD Shared Storage SkySQL Data Suite Analytics Carrier Grade PAGE 7Wednesday, 5 December 12
  9. 9. Cloud Data Suite vs Enterprise Data Suite Cloud Data Suite Enteprise Data Suite •Deployed in Amazon AWS •Deployed in Clouds, virtualised env. and bare OS •Automatic configuration and provisioning •Standard download packages •MariaDB 5.5 •MariaDB, MySQL, Percona Servers •MySQL Replication with Pacemaker/Corosync •MySQL Replication with MHA, DRBD, Galera or shared storage and Pacemaker/Corosync •Administration Console with Backup/Restore •ZManda Recovery Manager •SkySQL Enterprise Monitoring aka MONyog - Trial •SkySQL Enterprise Monitory aka MONyog •PhpMyAdmin •SQLyog •Community Support •Enterprise Technical Support •Development Release •Production Release •Fully OSS (with MONyog Trial) •Mix of OSS and Commercial PAGE 8Wednesday, 5 December 12
  10. 10. SkySQL Cloud Data Suite Sep 2012 1 1. Configure your DB system on config.skysql.com or cloud.skysql.com 3 2. Deploy the DB system: 2 • Online • Configuration pull from AWS • Manually 3. Connect the DB system to your application PAGE 9Wednesday, 5 December 12
  11. 11. SkySQL Data Suite Dec 2012 • Rel. 1.1 with bug fixing • New Administration Console with: • rpm package and installation on Linux OS • Administration and monitoring of replicated and standalone servers • Customisable graphs • Customisable commands PAGE 10Wednesday, 5 December 12
  12. 12. SkySQL Data Suite ArchitectureWednesday, 5 December 12
  13. 13. SkySQL Data Suite Configurator User Account AMI PAGE 12Wednesday, 5 December 12
  14. 14. SkySQL Data Suite Configurator User Account Configuration Engine AMI Rules Repository PAGE 12Wednesday, 5 December 12
  15. 15. SkySQL Data Suite Configurator User Account Configuration Engine AMI Rules Repository Provisioning Queue PAGE 12Wednesday, 5 December 12
  16. 16. SkySQL Data Suite Configurator User Account Configuration Provisioning Engine Engine AMI Rules Software Repository Repository Provisioning Queue PAGE 12Wednesday, 5 December 12
  17. 17. SkySQL Data Suite Configurator User Account Configuration Provisioning Engine Engine AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  18. 18. SkySQL Data Suite Configurator User Account Configuration Provisioning Deployment Engine Engine Engine AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  19. 19. SkySQL Data Suite Configurator Deployment triggered by the first boot of each instance User Account Database Database Database Database Database Configuration Provisioning Deployment Engine Engine Engine user da ta.s h AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  20. 20. SkySQL Data Suite Configurator Deployment triggered by the first boot of each instance User Account Database Database Database Database Database Configuration Provisioning Deployment Engine Engine Engine user da ta.s h AMI Rules Software Repository Repository Provisioning Deployment Queue Queue PAGE 12Wednesday, 5 December 12
  21. 21. SkySQL Cloud Data Suite Terminal $ ssh -i SDS193500.pem ec2-user@174.129.202.133 [ec2-user@node1 ~]$ ps -ef UID PID PPID C STIME TTY TIME CMD root 1157 1 0 Nov29 ? 00:00:02 /usr/sbin/glusterd --pid-file=/var/run/glusterd.pid root 1840 1 2 Nov29 ? 00:11:34 /usr/sbin/glusterfsd -s localhost --volfile-id glust... root 1889 1 0 Nov29 ? 00:00:50 /usr/sbin/glusterfsd -s localhost --volfile-id glust... root 1895 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste... root 1901 1 0 Nov29 ? 00:00:01 /usr/sbin/glusterfs -s localhost --volfile-id gluste... root 4484 1 8 Nov29 ? 00:36:13 /usr/sbin/glusterfs --volfile-id=/gluster-monyog --... ... root 1311 1 0 Nov29 ? 00:00:34 corosync 220 1317 1311 0 Nov29 ? 00:00:12 /usr/libexec/pacemaker/cib root 1318 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/stonithd root 1319 1311 0 Nov29 ? 00:00:12 /usr/lib64/heartbeat/lrmd 220 1320 1311 0 Nov29 ? 00:00:03 /usr/libexec/pacemaker/attrd 220 1321 1311 0 Nov29 ? 00:00:01 /usr/libexec/pacemaker/pengine 220 1322 1311 0 Nov29 ? 00:00:05 /usr/libexec/pacemaker/crmd ... root 1534 1 0 Nov29 ? 00:00:00 sendmail: accepting connections smmsp 1542 1 0 Nov29 ? 00:00:00 sendmail: Queue runner@01:00:00 for /var/spool/clientmqueue ... root 2293 1 0 Nov29 ? 00:00:00 /bin/sh /usr/bin/mysqld_safe --defaults-file=/etc/my.cnf --p... mysql 2791 2293 0 Nov29 ? 00:00:28 /usr/sbin/mysqld --defaults-file=/etc/my.cnf --basedir=/usr ... ... root 3467 1 0 Nov29 ? 00:00:01 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf apache 25416 3467 0 Nov29 ? 00:00:00 /usr/sbin/httpd -DSTATUS -f /etc/httpd/conf/httpd.conf ... root 4578 1 1 Nov29 ? 00:07:56 /usr/local/MONyog/bin/MONyog-bin -s Admin Console PhpMyAdmin Database Database Database Database Database MONyog PAGE 13Wednesday, 5 December 12
  22. 22. SkySQL Data Suite Building Block Admin Data Store Console Database Database Database Database Database Replicator PAGE 14Wednesday, 5 December 12
  23. 23. SkySQL Cloud Data Suite Sep 2012 Technologies and Software FRONT END Apache Linux 3.2 Tomcat Admin Data Store Console (Amazon Distro) BACK END SQLite Database Database Database Database Database MONyog Trial Replicator MariaDB PHPMyAdmin MySQL Pacemaker Replication Xtrabackup GlusterFS Corosync PAGE 15Wednesday, 5 December 12
  24. 24. SkySQL Cloud Data Suite Sep 2012 Data Store Public SkySQL AMI Data Store MariaDB 5.5 MyISAM, InnoDB, XtraDB, Enhanced Optimizer, Virtual Columns Database Database Database Database Database Pacemaker controls the automatic failover System and Data file systems From standalone to 1 Master + 3 Slaves PAGE 16Wednesday, 5 December 12
  25. 25. SkySQL Cloud Data Suite Sep 2012 Administration Console GUI to monitor the status of the Cluster Admin Console Extended Monitoring from MONyog as a trial Database Database Database Database Database PhPMyAdmin as graphical user tool Automatic failover for Backup/Restore to/ the admin and from S3 using Start/Stop, Isolate, mysql command monitoring servers Xtrabackup Promote nodes line interface PAGE 17Wednesday, 5 December 12
  26. 26. SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator PAGE 18Wednesday, 5 December 12
  27. 27. SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in asynchronous and semi- synchronous mode PAGE 18Wednesday, 5 December 12
  28. 28. SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in asynchronous and semi- GlusterFS on ext4 to replicate the synchronous mode data collection and monitoring PAGE 18Wednesday, 5 December 12
  29. 29. SkySQL Cloud Data Suite Sep 2012 Replicator Database Database Database Database Database Replicator Standard MySQL Replication in Automatic failover of database asynchronous and semi- GlusterFS on ext4 to replicate the servers and console components synchronous mode data collection and monitoring PAGE 18Wednesday, 5 December 12
  30. 30. SkySQL Data Suite Provisioning User Account Database Database Database Database Database user da ta.s h I AM PAGE 19Wednesday, 5 December 12
  31. 31. SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user da ta.s h I AM PAGE 19Wednesday, 5 December 12
  32. 32. SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM PAGE 19Wednesday, 5 December 12
  33. 33. SkySQL Data Suite Provisioning User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  34. 34. SkySQL Data Suite Provisioning Adaptive, distributed setup User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  35. 35. SkySQL Data Suite Provisioning Elastic IP on the Master Server Adaptive, distributed setup User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  36. 36. SkySQL Data Suite Provisioning Elastic IP on the Master Server Adaptive, distributed Currently, the Administration Console setup is on the Master server User Account Variable definition - they will be used later when other scripts are called Database Database Database Database Database user On-the-fly configuration da ta.s h files, such as my.cnf I AM Execute predefined scripts already in the AMI PAGE 19Wednesday, 5 December 12
  37. 37. SkySQL Data Suite Deployment PAGE 20Wednesday, 5 December 12
  38. 38. SkySQL Data Suite Deployment Database PAGE 20Wednesday, 5 December 12
  39. 39. SkySQL Data Suite Deployment Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  40. 40. SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  41. 41. SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  42. 42. SkySQL Data Suite Deployment Database Database Database Database Database Database Database Database Database Database Database Database Database Database PAGE 20Wednesday, 5 December 12
  43. 43. SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  44. 44. SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  45. 45. SkySQL Data Suite Deployment PAGE 21Wednesday, 5 December 12
  46. 46. Automated Provisioning in AWSWednesday, 5 December 12
  47. 47. Starting Here! You can try it for FREE! Even without an AWS account PAGE 23Wednesday, 5 December 12
  48. 48. Simplified Interface Immediate Help Real Time Check PAGE 24Wednesday, 5 December 12
  49. 49. Advanced Configuration PAGE 25Wednesday, 5 December 12
  50. 50. Cost Estimation PAGE 26Wednesday, 5 December 12
  51. 51. Delivery Mechanism PAGE 27Wednesday, 5 December 12
  52. 52. Online Deployment The keys will be discarded immediately after the provisioning PAGE 28Wednesday, 5 December 12
  53. 53. Extra AWS & Contact Info PAGE 29Wednesday, 5 December 12
  54. 54. Welcome Email mysql command line Administration Console ssh connection How to remove SCDS An inventory of the AWS components IMPORTANT! Your pem key PAGE 30Wednesday, 5 December 12
  55. 55. Job Done! PAGE 31Wednesday, 5 December 12
  56. 56. SkySQL Cloud Data Suite in Amazon EC2Wednesday, 5 December 12
  57. 57. Security Identity Access Manager Roles • EIP Address • Associate/Disassociate, Describe • Instances • Start, Stop, Describe • Attributes, Status, Tags, Net IF • Create, Describe • S3 Buckets • List, Create, Delete • Objects • Get, Put, List, Delete PAGE 33Wednesday, 5 December 12
  58. 58. Security Security Groups • ssh • http • MySQL • MONyog PAGE 34Wednesday, 5 December 12
  59. 59. Storage PAGE 35Wednesday, 5 December 12
  60. 60. Components for High Availability in EC2Wednesday, 5 December 12
  61. 61. Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  62. 62. Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  63. 63. Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  64. 64. Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  65. 65. Automatic Failover with Pacemaker CRM Configuration Admin Data Store Console Database Database Database Database Replicator PAGE 37Wednesday, 5 December 12
  66. 66. Automatic Failover with Pacemaker CRM Configuration Elastic IP admin-console and [root@node2 init.d]# crm status Node 2 ============ MONyog group Last updated: Sat Dec 1 12:42:03 2012 Last change: Fri Nov 30 12:43:27 2012 via crm_attribute on node2 Stack: openais Current DC: node2 - partition with quorum Public IPs Version: 1.1.7-6.el6-148fccfd5985c5590cc601123c6c16e966b85d14 4 Nodes configured, 4 expected votes 14 Resources configured. ============ Online: [ node2 node3 node1 node4 ] Admin Data Store Console Master/Slave Set: ms_resMySQL [resMySQL] Masters: [ node2 ] Slaves: [ node1 node3 node4 ] AmazonEIP (lsb:amazon_master_eip): Started node2 Clone Set: apache-php-myadmin [ApachePhpMyAdmin] Started: [ node1 node2 node3 node4 ] Resource Group: monyog Database Database Database Database monyog-fs (ocf::custom:Filesystem): Started node2 monyog-service (lsb:MONyogd): Started node2 Resource Group: admin-console console-fs (ocf::custom:Filesystem): Started node2 SkySQL-monitor (lsb:skysql_monitor): Started node2 Tomcat7 (ocf::heartbeat:tomcat): Started node2 Replicator PAGE 38Wednesday, 5 December 12
  67. 67. The Administration ConsoleWednesday, 5 December 12
  68. 68. Admin Console Dec 2012 PAGE 40Wednesday, 5 December 12
  69. 69. Admin Console Dec 2012 Master Server Access to MONyog Context Sensitive Customisable Graphs PAGE 41Wednesday, 5 December 12
  70. 70. Admin Console Dec 2012 Backup/Restore Access to PhpMyAdmin Customisable Commands PAGE 42Wednesday, 5 December 12
  71. 71. Administration Console Dec 2012 Customizable Graphs Monitors Name SQL Icon Delta Avg Chart PAGE 43Wednesday, 5 December 12
  72. 72. Administration Console Dec 2012 Customizable Commands Commands Desc Icon Order CommandStep Steps Desc Icon Script PAGE 44Wednesday, 5 December 12
  73. 73. Automated Backup/Restore with S3Wednesday, 5 December 12
  74. 74. Automated Backup Using Xtrabackup from the Admin Console PAGE 46Wednesday, 5 December 12
  75. 75. Automated Backup Using Xtrabackup from the Admin Console PAGE 47Wednesday, 5 December 12
  76. 76. Automated Backup Using Xtrabackup from the Admin Console PAGE 48Wednesday, 5 December 12
  77. 77. Why is the SkySQL Cloud Data Suite important for you? • You can test MariaDB/MySQL on AWS for FREE • You can use and fully control a ready made highly available solution AWS • You can compare MySQL on EC2 and RDS • You can study/review security and availability aspects in AWS • You can use some of the SCDS components in your environment PAGE 49Wednesday, 5 December 12
  78. 78. For more information... • Try the Configurator and How-To Video: http:// cloud.skysql.com • The Admin Console: http://www.skysql.com/ downloads/community/skysql-console • Forums: https://www.skysql.com/forums/ skysql-cloud-data-suite • Web: https://www.skysql.com/cloud • Bugs: http://bugs.skysql.com • Try it! http://config.skysql.com • Free SkySQL account available for testing • Test on your account PAGE 50Wednesday, 5 December 12
  79. 79. Thank You! ivan@skysql.com www.skysql.com izoratti.blogspot.com www.slideshare.net/izorattiWednesday, 5 December 12

×