Tungsten University: Introduction to Continuent Tungsten 2.0


Published on

Continuent Tungsten 2.0 is a major step forward that includes key feature improvements to help you manage very large datasets on MySQL. It also sets the stage for operation in cloud environments like Amazon.

We will cover the following details to help you plan for using the new release:

- Major improvements in Continuent Tungsten 2.0, including replication and connectivity upgrades
- Major improvements in cluster management for cross-site and cross-cloud operations, especially in Amazon AWS
- How to upgrade from Continuent Tungsten 2.0 from older Continuent Tungsten releases
- How to create multi-master, multi-site clusters
- How to use parallel replication to eliminate slave lag
- How to set connection pooling to boost connectivity throughput
- Showcase Continuent Tungsten roadmap for new features including our new Tungsten Management API and the upcoming Continuent Tungsten GUI.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Tungsten University: Introduction to Continuent Tungsten 2.0

  1. 1. ©Continuent 2013Tungsten University: Introduction toContinuent Tungsten 2.0Robert Hodges, CEOGiuseppe Maxia, Director of QA
  2. 2. ©Continuent 2013Introducing Continuent2• The leading provider of clustering andreplication for open source DBMS• Our Product: Continuent Tungsten• Clustering - Commercial-grade HA, performancescaling and data management for MySQL• Replication - Flexible, high-performance datamovement
  3. 3. ©Continuent 2013Continuent Tungsten 2.0 Topics3• What’s in Continuent Tungsten 2.0?• What is the release schedule?• How do I upgrade from 1.5.x?• What’s coming next?
  4. 4. ©Continuent 2013What’s in Continuent Tungsten 2.0?4
  5. 5. ©Continuent 2013New Feature Overview5• Tungsten 2.0 Replicator integrated intoclustering• TPM updates installations more e"ciently• Ability to create read-only slaves• Better connector load balancing andconnector management• Cookbook test for installed cluster• Documentation build-out
  6. 6. ©Continuent 2013Overall Replication Improvements6• Parallel apply to reduce slave lag• Transaction history log much more robust• Support for multiple replication services• Simpler integration with stand-alonereplication for multi-master
  7. 7. ©Continuent 2013Parallel Apply Concepts7cust1cust2cust3cust1cust2cust3appappappShardsChannelsMaster Slave
  8. 8. ©Continuent 2013Parallel Apply Intro8• Best for apps with many independent schemas• Enabling parallel apply and selecting channelstpm install --repl-svc-parallelization-type=disk --channels=10• Take replicator o#ine cleanly to make changes!• Restore is complicated if you change channels!• Changes position reporting on slave!• Up to 200x reduction in slave lag
  9. 9. ©Continuent 2013Replication Services9• Replicators support multiple services perreplicator (clusters use only one)• Service named after cluster• Catalog data in schema tungsten_<svcname>• THL stored in /opt/continuent/thl/<svcname>
  10. 10. ©Continuent 2013New Status Monitoring Commands10• Extensions to ‘trepctl status’• trepctl status -name shards - Transactions per shard• trepctl status -name stages - Stage con$guration• trepctl status -name stores - Log/queue info• trepctl status -name tasks - Task performance• trepctl services - Show replication services• relativeLatency setting to help detect stalls(also visible with cctrl ls -l)
  11. 11. ©Continuent 2013Transaction History Log11• THL has new metadata• ##charset property tracks SQL character set• Service property shows source of transaction• Shard property is derived from schema and enablesparallel apply• Epoch number printed on each transaction• Many improvements to log consistency checks• Easier to $x logs or regen from a particularpoint
  12. 12. ©Continuent 2013Multi-Master Operation12• Standalone 2.0 replicators link clusters• New standalone installation options for settingup multi-master clusters• Replicators track transaction source to cluster• Certi$ed multi-master topology for MySQL
  13. 13. ©Continuent 2013PARALLEL REPLICATION DEMO13
  14. 14. ©Continuent 2013TPM - Changing Properties14# Recover current settingsshell> ./tools/tpm reverse# Update to settings on all hostsshell> export CONTINUENT_PROFILES=/opt/continuent/software/confshell> cd /opt/continuent/software/continuent-tungsten-2.0.1-###shell> ./tools/tpm fetch --hosts=<hostname>,autodetect --user=tungsten --directory=autodetectshell> ./tools/tpm reverseshell> ./tools/tpm update mycluster --repl-java-mem-size=2048# Update to settings on a single hostshell> cd /opt/continuent/tungstenshell> ./tools/tpm update --repl-java-mem-size=2048
  15. 15. ©Continuent 2013Connectivity Upgrades15• Load balancing reads to most advanced slave(router.properties)dataSourceLoadBalancer_RO_RELAXED=com.continuent.tungsten.router.resource.loadbalancer.MostAdvancedSlaveLoadBalancer• Old password support (handles MySQL 4.1 libs)• Experimental connection pooling(router.properties)# c3p0 pool:#connectionProviderClass=com.continuent.tungsten.router.resource.C3P0PooledConnectionProvider
  16. 16. ©Continuent 2013Management Support - Archive Slaves16• Archive slave is for reads but not failover• Setting an archive slavedatasource pdrepl1 set archive• Clearing an archive slavedatasource pdrepl1 clear archive• Compare with standby slave (failover but noreads)
  17. 17. ©Continuent 2013Cookbook and Testing17• Cookbook allows simple setup of commoncluster and replication topologies• New command to test an installed cluster!cd $CONTINUENT_ROOT/tungsten/./cookbook/tungsten-cookbook --test-installed
  18. 18. ©Continuent 2013Documentation Build-Out18• Adding new quick-start guides• Adding new operations guides• Adding reference guides for all tools andutilities• Check out docs in Tungsten 2.0 section• Suggestions for improvement welcomed!
  19. 19. ©Continuent 2013MULTI-MASTERCLUSTERING AND TEST19
  20. 20. ©Continuent 2013What Is the Release Schedule?20
  21. 21. ©Continuent 2013Continuent Tungsten ReleaseSchedule21Release When What2.0.0 Feb 2013Controlled release toselected customers2.0.1 June 2013* GA release to everybody2.0.x Q3 2013Follow-on roadmapimprovements* We will release when 2.0.1 is fully baked
  22. 22. ©Continuent 2013How Do I Upgrade from TungstenEnterprise 1.5.x?22
  23. 23. ©Continuent 2013TPM Upgrade Procedure23shell> export CONTINUENT_PROFILES=/opt/continuent/software/confshell> cd /opt/continuent/softwareshell> tar -xf continuent-tungsten-2.0.1-149shell> cd continuent-tungsten-2.0.1-149shell> ./tools/tpm fetch --hosts=<hostname>,autodetect --user=tungsten --directory=autodetectshell> ./tools/tpm reverseshell> ./tools/tpm update
  24. 24. ©Continuent 2013What’s Coming Next in Tungsten?24
  25. 25. ©Continuent 2013Roadmap for Continuent Tungsten 2.0.x25• Backup/restore usability (master backups)• Connectivity performance (esp. login)• Security for untrusted environments• More multi-master support• Cluster management API• Graphical User Interface
  26. 26. ©Continuent 2013Preview of Administrative API26
  27. 27. ©Continuent 2013Preview of GUI Administration27
  28. 28. ©Continuent 2013Wrapping Up28
  29. 29. ©Continuent 2013Tungsten University Sessions29• Introduction to Continuent Tungsten 2.0 (May21)• Load a Vertica Data Warehouse with MySQLData (May 30 and June 4)Send any feedback to: tu@continuent.com
  30. 30. ©Continuent 2012.Continuent Web Page:http://www.continuent.comTungsten Replicator 2.0:http://code.google.com/p/tungsten-replicatorOur Blogs:http://scale-out-blog.blogspot.comhttp://datacharmer.org/bloghttp://!yingclusters.blogspot.comhttp://www.continuent.com/news/blogs560 S. Winchester Blvd., Suite 500San Jose, CA 95128Tel +1 (866) 998-3642Fax +1 (408) 668-1009e-mail: sales@continuent.com