OpenStack and Databases
Adding a database to OpenStack Trove
Tuesday, January 12th 2016
Amrith Kumar
What’s this presentation about?
• What is Trove?
– What is Tesora DBaaS Platform?
– A word from our sponsors
• What databases does Trove (currently) support?
– What does that mean?
– How does it work?
• What does it take to add a new database to Trove?
– … Let’s see this for real …
• Where do I go if I have questions?
1/13/2016 Tesora Introduction 2
What is Trove?
The OpenStack Open Source Database as a Service Mission: To provide
scalable and reliable Cloud Database as a Service provisioning
functionality for both relational and non-relational database engines,
and to continue to improve its fully-featured and extensible open
source framework.
https://wiki.openstack.org/wiki/Trove#Mission_Statement
1/13/2016 Tesora Introduction 3
Amazon is demonstrating the importance of DBaaS
• DynamoDB was the fastest growing service in AWS history in 2012
– Werner Vogels, Amazon CTO, AWS Blog June 2012
• Redshift is now the fastest growing AWS service ever
– Werner Vogels, Amazon CTO, The Register, April 2015
• 45% of Amazon customers have implemented and are expanding use of RDS
– Jeffrey Hammond, Forrester Blog, September 2013
• AWS database business currently on a $1 billion revenue run rate
– Andy Jassy, the SVP of AWS - TechCrunch, October 2015
• Amazon’s #1 hiring focus – 84 open positions in DBaaS in November 2015
– Deutsche Bank Markets Research - NetworkWorld, November 2015
1/13/2016 Tesora Introduction 4
What is Tesora DBaaS Platform?
• An enterprise hardened solution based on OpenStack Trove
– Two distributions
• A Community edition
• An Enterprise edition
– Certified Guest Images
– Support and Services
• For more information
– http://www.tesora.com
– Follow us on Twitter at @tesoracorp
1/13/2016 Tesora Introduction 5
• OpenStack Trove
– MySQL, MariaDB, Percona
– PostgreSQL
– MongoDB
– Cassandra
– CouchDB
– Couchbase
– DB2 Express
– Redis
– Vertica
– Percona Xtradb Cluster
– … more to come …
• Tesora DBaaS Platform
– Everything in Trove1
– Oracle 11g
– Oracle 12c
– MySQL Enterprise Edition
– DataStax Enterprise2
– … more to come …
What databases does Trove (currently) support?
1/13/2016 Tesora Introduction 6
1 Almost everything, e.g. PXC in Release 1.7
2 In release Release 1.7
How does this work?
1/13/2016 Tesora Introduction 7
Glance Storage
Guest Image
Operating System
Database Software
Trove Guest Agent
Trove
Trove API
Trove Conductor
Trove Task
Manager
Nova
Cinder
Swift
Neutron
Keystone
Glance
Application
Nova Instance
Operating System
Database
Software
Trove Guest Agent
Storage
What does it take to add a new database to Trove?
• Write a spec
• Implement a Guest Agent for the database
• Develop Image Elements (so you can build a guest image)
• Write a Press Release
1/13/2016 Tesora Introduction 8
Let’s see this for real …
• A current code review
– The spec: https://review.openstack.org/#/c/256079/
– The Guest Agent: https://review.openstack.org/#/c/262815/
– The Image Elements: https://review.openstack.org/#/c/262048/
• And a mailing list thread
– http://markmail.org/thread/jklreiukqaaoo4dc
1/13/2016 Tesora Introduction 9
The elements
1/13/2016 Tesora Introduction 10
The guest agent
1/13/2016 Tesora Introduction 11
We now illustrate Trove’s “backup” capability
• Trove “backup” is a mechanism to save all data in an instance onto
a Swift object
• Later you can launch a new instance with that data
• You can use this as a simple mechanism to dump and load data into
a new instance
1/13/2016 Tesora Introduction 13
What capabilities did are supported for HBase (now)?
• Create [and Delete]
• Restart
• Resize Instance and Disk
• Backup [and Create from Backup]
• In Standalone and Pseudo-Distributed Modes of Operation
1/13/2016 Tesora Introduction 15
Complete Database Lifecycle Management
1/13/2016 Tesora Introduction 16
Manage
• Manage schemas
• Create replicas for
scale & availability
• Backup/restore
Provision
• On demand
• Wide DB selection
• Clusters & single
instances
Tune
• Manage log files
• API’s to tune fleets of servers,
not just single instances
• Sane defaults
Secure
• Automated patch management
• Users/permissions
• Restricted root access
Questions and Answers
• For more information about Tesora or Trove
– http://www.tesora.com
– Follow us @tesoracorp
– Email info@tesora.com
– #openstack-trove on IRC
• Offices
– Cambridge (conveniently located near Alewife T-Station)
– Mississauga, ON, Canada
1/13/2016 Tesora Introduction 17

OpenStack and Databases

  • 1.
    OpenStack and Databases Addinga database to OpenStack Trove Tuesday, January 12th 2016 Amrith Kumar
  • 2.
    What’s this presentationabout? • What is Trove? – What is Tesora DBaaS Platform? – A word from our sponsors • What databases does Trove (currently) support? – What does that mean? – How does it work? • What does it take to add a new database to Trove? – … Let’s see this for real … • Where do I go if I have questions? 1/13/2016 Tesora Introduction 2
  • 3.
    What is Trove? TheOpenStack Open Source Database as a Service Mission: To provide scalable and reliable Cloud Database as a Service provisioning functionality for both relational and non-relational database engines, and to continue to improve its fully-featured and extensible open source framework. https://wiki.openstack.org/wiki/Trove#Mission_Statement 1/13/2016 Tesora Introduction 3
  • 4.
    Amazon is demonstratingthe importance of DBaaS • DynamoDB was the fastest growing service in AWS history in 2012 – Werner Vogels, Amazon CTO, AWS Blog June 2012 • Redshift is now the fastest growing AWS service ever – Werner Vogels, Amazon CTO, The Register, April 2015 • 45% of Amazon customers have implemented and are expanding use of RDS – Jeffrey Hammond, Forrester Blog, September 2013 • AWS database business currently on a $1 billion revenue run rate – Andy Jassy, the SVP of AWS - TechCrunch, October 2015 • Amazon’s #1 hiring focus – 84 open positions in DBaaS in November 2015 – Deutsche Bank Markets Research - NetworkWorld, November 2015 1/13/2016 Tesora Introduction 4
  • 5.
    What is TesoraDBaaS Platform? • An enterprise hardened solution based on OpenStack Trove – Two distributions • A Community edition • An Enterprise edition – Certified Guest Images – Support and Services • For more information – http://www.tesora.com – Follow us on Twitter at @tesoracorp 1/13/2016 Tesora Introduction 5
  • 6.
    • OpenStack Trove –MySQL, MariaDB, Percona – PostgreSQL – MongoDB – Cassandra – CouchDB – Couchbase – DB2 Express – Redis – Vertica – Percona Xtradb Cluster – … more to come … • Tesora DBaaS Platform – Everything in Trove1 – Oracle 11g – Oracle 12c – MySQL Enterprise Edition – DataStax Enterprise2 – … more to come … What databases does Trove (currently) support? 1/13/2016 Tesora Introduction 6 1 Almost everything, e.g. PXC in Release 1.7 2 In release Release 1.7
  • 7.
    How does thiswork? 1/13/2016 Tesora Introduction 7 Glance Storage Guest Image Operating System Database Software Trove Guest Agent Trove Trove API Trove Conductor Trove Task Manager Nova Cinder Swift Neutron Keystone Glance Application Nova Instance Operating System Database Software Trove Guest Agent Storage
  • 8.
    What does ittake to add a new database to Trove? • Write a spec • Implement a Guest Agent for the database • Develop Image Elements (so you can build a guest image) • Write a Press Release 1/13/2016 Tesora Introduction 8
  • 9.
    Let’s see thisfor real … • A current code review – The spec: https://review.openstack.org/#/c/256079/ – The Guest Agent: https://review.openstack.org/#/c/262815/ – The Image Elements: https://review.openstack.org/#/c/262048/ • And a mailing list thread – http://markmail.org/thread/jklreiukqaaoo4dc 1/13/2016 Tesora Introduction 9
  • 10.
  • 11.
    The guest agent 1/13/2016Tesora Introduction 11
  • 12.
    We now illustrateTrove’s “backup” capability • Trove “backup” is a mechanism to save all data in an instance onto a Swift object • Later you can launch a new instance with that data • You can use this as a simple mechanism to dump and load data into a new instance 1/13/2016 Tesora Introduction 13
  • 13.
    What capabilities didare supported for HBase (now)? • Create [and Delete] • Restart • Resize Instance and Disk • Backup [and Create from Backup] • In Standalone and Pseudo-Distributed Modes of Operation 1/13/2016 Tesora Introduction 15
  • 14.
    Complete Database LifecycleManagement 1/13/2016 Tesora Introduction 16 Manage • Manage schemas • Create replicas for scale & availability • Backup/restore Provision • On demand • Wide DB selection • Clusters & single instances Tune • Manage log files • API’s to tune fleets of servers, not just single instances • Sane defaults Secure • Automated patch management • Users/permissions • Restricted root access
  • 15.
    Questions and Answers •For more information about Tesora or Trove – http://www.tesora.com – Follow us @tesoracorp – Email info@tesora.com – #openstack-trove on IRC • Offices – Cambridge (conveniently located near Alewife T-Station) – Mississauga, ON, Canada 1/13/2016 Tesora Introduction 17