Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cassandra and DataStax Enterprise on PCF

376 views

Published on

SpringOne Platform 2016
Speakers: Ben Lackey; Partner Architect, Datastax. Cornelia Davis; Sr. Director of Technology, Pivotal.

DataStax Enterprise (DSE) is a distributed database built on Apache Cassandra with support for Spark, Solr and graph database. Bringing DSE support to the Pivotal Cloud Foundry application platform allows developers and operators to self-service provision DSE clusters and easily connect them to Spring Boot apps running in and managed by PCF. In this session we’ll start with the use cases for on-demand, dedicated DSE clusters, cover the solution design, and demo the system. The creation of on-demand clusters takes full advantage of BOSH 2.0 and we’ll go just a little bit under the covers to show you how these new BOSH features rock this use case. Finally, we’ll complete the story by looking at the support that Spring has for Cassandra.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Cassandra and DataStax Enterprise on PCF

  1. 1. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Cassandra and DataStax Enterprise on PCF Ben Lackey DataStax @benofben Cornelia Davis Pivotal @cdavisafc
  2. 2. PIVOTAL Brokered Services PARTNEREDUSERPROVIDED … … PIVOTAL BOSH Managed Services PARTNER … … Automated, Polyglot Build/ Package/Deploy Container Scheduling Elastic (Auto)Scale PCF Elastic Runtime z PCF Tools • Apps Manager UI (App Admin UI) • CLI • REST APIs • PCF Metrics Dashboard Ops Manager UI (Cloud Admin UI) Mobile Push Notifications Dingo PostgreSQL Gemfire Redis RabbitMQ Spring Cloud Services Single 
 Sign On MySQL HDB Greenplum DB VMware (vSphere + Photon) MS SQL Server … IBM DB/2 Active MQ Infrastructure OpenStack *Integration with various 3rd party visualization and management vendors Security (Application & Platform) Self-Healing & High Availability (Application & Platform) Zero Downtime Upgrades & Patches (Application & Platform) Integrated Logging/ Metrics* (Application & Platform) Dynamic Routing & Extensible Route Services Dev + Ops Role- Based Self-Service Access Amazon Web Services Microsoft Azure Google Cloud Platform Oracle DB Cluster Orchestration and Management (BOSH) Infrastructure Agnostic Software Packaging Multi-Cloud Orchestration of Infrastructure Provisioning Distributed Software Configuration and Health/Lifecycle Management Applications/APIs/Microservices Compiled, staged, containerized, deployed 
 and managed by platform Pre-packaged container deployed and managed 
 by platform Java  |  .NET  |  Ruby  |  Node.js  |  Python  |  PHP  |  Go Pivotal Cloud Foundry
  3. 3. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ How do we handle massive
 transactional data and never go down? 3© 2016 DataStax, All Rights Reserved. Schema Memtables Compaction SStables Commit Log
  4. 4. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/© 2016 DataStax, All Rights Reserved. Cassandra • Distributed self healing mesh • No active/passive • Peer to peer replication • No single point of failure • Writes are done to all nodes simultaneously • Data is safe from node, rack, 
 and datacenter failure • Optimized for high volume, 
 low latency operations 4
  5. 5. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 5 http://12factor.net/
  6. 6. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 6 Stateless apps allows the platform to do all sorts of things for you demo Factor 6 – Processes
  7. 7. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 7                      Router Cloud Controller CELL CELL Data Service PCF Elastic Runtime Data Service
  8. 8. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 8                      Router Cloud Controller CELL CELL PCF Elastic Runtime
  9. 9. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 9 demo
  10. 10. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Creating and Binding a DataStax Cassandra Service 10 Router PCF  Elastic   Runtime create resourcescreate service (HTTP) create service (HTTP) bind service (HTTP)bind service (HTTP) obtain connection data CLI Cloud Controller Service Broker
  11. 11. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 11 create service CLI Service Broker
  12. 12. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 12 create service CLI Service Broker BOSH Director create Manifest
  13. 13. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 13 create service CLI Service Broker BOSH Director create bosh deploy via BOSH Director API Manifest
  14. 14. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ On Demand Clusters 14 create service CLI Service Broker BOSH Director create VM VM VM bosh deploy via BOSH Director API Manifest
  15. 15. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 15 PCF Data Center 1 PCF Data Center 2
  16. 16. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 16 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments Active/Active
  17. 17. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 17 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments “Active/Active”
  18. 18. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 18 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments “Active/Active”
  19. 19. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 19 PCF Data Center 1 PCF Data Center 2 Pipelines Distribute Deployments Active/Active
  20. 20. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Summary • On-demand single tenant database-as-a-service on PCF • Supports DataStax Enterprise 5.0 (incl. OpsCentre 6.0) • Currently under active development • Early adopter program late Q3/early Q4 Vision: • DataStax multi-data center support We want to hear from you: • Damian O'Connor, daoconnor@pivotal.io (Product Manager for the Cassandra Service on PCF) • Cornelia Davis, cdavis@pivotal.io (Sr. Director of Technology, Platform) • Ben Lackey, ben.lackey@datastax.com (Partner Architect) 20
  21. 21. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ Learn More. Stay Connected. Cornelia Davis @cdavisafc Ben Lackey @benofben @springcentral spring.io/blog @pivotal pivotal.io/blog @pivotalcf http://engineering.pivotal.io

×