Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Containerizing Couchbase for microservice architecture with Mesosphere – Couchbase Connect New York 2017

306 views

Published on

Organizations focused on delivering exceptional customer experiences are building applications using microservice architectures because of the flexibility, speed of delivery, and maintainability that they provide. In this session, you will learn how Couchbase can fit into a microservice architecture using containers and orchestration. We will explore how Couchbase and Mesosphere work together to simplify application development and delivery. Additionally, you will see a demonstration of exactly how to create a Couchbase cluster on Mesosphere DC/OS Enterprise.

Published in: Software
  • Be the first to comment

Containerizing Couchbase for microservice architecture with Mesosphere – Couchbase Connect New York 2017

  1. 1. ©2017 Couchbase Inc. Containerizing Couchbase With Microservice Architecture On Mesosphere DC/OS 1
  2. 2. ©2017 Couchbase Inc. 2 Anil Kumar Principal Product Manager Couchbase, Inc. LinkedIn – https://www.linkedin.com/in/anilkumar29 Twitter – @anilkumar1129
  3. 3. ©2017 Couchbase Inc. 3 Ravi Yadav Technology Partnerships Lead, Ecosystem Development Mesosphere, Inc. Twitter: @RaaveYadav
  4. 4. ©2017 Couchbase Inc. Agenda • Containerizing Couchbase • Couchbase on Container Orchestration Technologies • Mesosphere DC/OS • Kubernetes / RedHat OpenShift Enterprise • Overview of Mesosphere DC/OS • DEMO !!! • Couchbase and Mesosphere: Better Together 4
  5. 5. ©2017 Couchbase Inc.©2017 Couchbase Inc. 5 Containerizing Couchbase
  6. 6. ©2017 Couchbase Inc. 6 Containers - Business Benefits • DevOps & Continuous Delivery • Low impact & risk; update one container at a time • Build Once & Run Anywhere • Instantiate clones for development, testing and production • Scalability • Scale-up or Scale-down containers easily based on demand • Isolation • Safely run multiple microservice containers with isolation • High Availability • Redundancy from multiple containers fulfilling a role • Performance • Minimal impact from container overhead
  7. 7. ©2017 Couchbase Inc. 7 Containerizing Couchbase Why Couchbase is Good-fit for Containers? COUCHBASE SERVER CLUSTER Container 1 Container 2 Container 3 Container 4 Container 5 Container 6 Container 7 Container 8 INDEX SERVICE QUERY SERVICE DATA SERVICE Microservice Architecture COUCHBASE SERVER CLUSTER Container 1 Container 2 Container 3 Container 4 Container 5 Container 6 Container 7 Container 8 Container 9 QUERY SERVICE INDEX SERVICE DATA SERVICE
  8. 8. ©2017 Couchbase Inc. 8 Containerizing Couchbase Couchbase Container Production Certified • We production certify Couchbase Docker image and RHEL image with every version (x.x.x) • New images gets published to https://hub.docker.com and https://access.redhat.com • Everything you want to know about ‘Running Couchbase in Container’ - https://www.couchbase.com/containers • Best Practices - http://developer.couchbase.com/documentation/serve r/current/install/deploy-with-docker-hub.html
  9. 9. ©2017 Couchbase Inc.©2017 Couchbase Inc. 9 Couchbase on Container Orchestration Technologies
  10. 10. ©2017 Couchbase Inc. Mesosphere DC/OS provides the built-in automation to manage the lifecycle of Couchbase Cluster using data services which includes - ● The deployment, placement, security, scalability, availability, failure recovery, and in-place upgrades of the services. DC/OS simplifies storage management for Couchbase Server with Stateful data service ● Couchbase can be easily deployed with only a few clicks from the DC/OS Universe or a single command from the DC/OS CLI ● Mesosphere DC/OS provides options for local persistent storage and external volumes 10 Benefits of Running Couchbase on Mesosphere DC/OS
  11. 11. ©2017 Couchbase Inc. 11 Common Customer - Verizon Labs IoT/ThingSpace & Couchbase
  12. 12. ©2017 Couchbase Inc. 12 Couchbase on Container Orchestration Technologies Run Couchbase cluster on Container Orchestration Technologies • [Developer Preview] Couchbase running on Mesosphere http://www.infoworld.com/article/3180698/data- center/mesosphere-dcos-brings-elastic-scale-to-redis- couchbase.html • [Developer Preview] Couchbase running on OpenShift Enterprise 3.5 (Kubernetes 1.5) https://www.youtube.com/watch?v=fxox6DD96HQ
  13. 13. ©2017 Couchbase Inc.©2017 Couchbase Inc. 13 Overview of Mesosphere DC/OS
  14. 14. ©2017 Couchbase Inc. THE WORLD HAS CHANGED AND WE ARE ALL NOW SOFTWARE COMPANIES. Software is eating the world. Marc Andreessen
  15. 15. WE LIVE IN THE ALWAYS CONNECTED ECONOMY. 3.7B Mobile Broadband Users 80% New Data is Unstructured 13 Connected Devices per Household (N. Amer) 40% Annual Enterprise Data Growth Sources: IHS Markit, IDG, KPCB, Ericsson
  16. 16. IN THE ALWAYS CONNECTED ECONOMY SOFTWARE IS YOUR BUSINESS. Build more apps. Personal and meaningful customer experiences Innovate faster. Capture value from new value streams and actionable data insights Modernize IT. Always-available services that are secure and cost effective
  17. 17. MODERN ENTERPRISE APPS REQUIRE NEW CAPABILITIES. Distributed computing expertise. Engineering and operations of secure & highly reliable services at scale DevOps process & culture. Frequent & reliable releases supported by an automated CI/CD toolchain Cloud-native technologies. Containers, microservices, data services (e.g., Spark, Kafka, Cassandra)
  18. 18. ©2017 Couchbase Inc. CLOUD BENEFITS + AGILITY + ELASTICITY + SCALE AWS PLATFORM SERVICES OPERATIONS & TOOLS ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH AWS INFRASTRUCTURE (EC2) BUSINESS APPS
  19. 19. ©2017 Couchbase Inc. BUSINESS APPS $ $ $ $ $ $ $ $ $ $ $ $ $$ $$ $ $ $ $ $ $ $ $ $ $ $ CLOUD LIMITATIONS - LOCK-IN - HIGH COST - NO CONTROL AWS PLATFORM SERVICES OPERATIONS & TOOLS ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH AWS INFRASTRUCTURE (EC2)
  20. 20. ©2017 Couchbase Inc. WHERE IS YOUR CUSTOMER DATA? WHO CONTROLS YOUR IT STRATEGY? WHAT IS THE COST OF NO CONTROL? BUSINESS APPS $ $ $ $ $ $ $ $ $ $ $ $ $$ $$ $ $ $ $ $ $ $ $ $ $ $ AWS PLATFORM SERVICES OPERATIONS & TOOLS ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH AWS INFRASTRUCTURE (EC2)
  21. 21. ©2017 Couchbase Inc. BUSINESS APPS MESOSPHERE ENTERPRISE DC/OS CONTAINER ORCHESTRATI ON CI/CD BIG DATA ANALYTICS MESSAGE QUEUE DISTRIBUTED DATABASE SEARCH PLATFORM SERVICES RESOURCE MANAGEMENT OPERATIONS SECURITY MULTI-TENANCY DATACENTER-CLOUD OPERATING SYSTEM APACHE MESOS PRIVATE CLOUD AWS INFRASTRUCTURE (EC2) GOOGLE CLOUD MICROSOFT AZURE THE POWER OF CLOUD PLATFORM SERVICES, THE FREEDOM TO USE ANY INFRASTRUCTURE
  22. 22. ©2017 Couchbase Inc. YOUR DATACENTER OR CLOUD IS NOW ONE GIANT COMPUTER
  23. 23. PLATFORM SERVICES INSTALLED ACROSS DATACENTER OR CLOUD IN A SINGLE COMMAND
  24. 24. ©2017 Couchbase Inc. We are building for the coming IoT market.. If I build everything in a silo, I have no chance... With Mesosphere DC/OS, I have one single contiguous cluster ... I can ingest data, store it and run all my apps as well, and that's a huge advantage Larry Rau Director Architecture & Infrastructure, Verizon Labs
  25. 25. ©2017 Couchbase Inc. We’re running real time analytics and visualization of data from connected sensors. Before DC/OS we had no where near the scale we had today, from thousands of to millions of events per second. Next, we’re doing predictive GIS. Adam Mollenkopf Real Time Geospatial Information Systems Capability Lead
  26. 26. Writing complex stateful services is hard...
  27. 27. © 2015 Mesosphere, Inc. All Rights Reserved. 27 Failure recovery (basic stickiness, for transient failures) Snowflake failure recovery (complicated semantics for permanent failures) Deployment preparation (often manual, infrequent tasks) Legacy software in a containerized world (pets vs cattle) Placement constraints (more Considerations
  28. 28. © 2016 Mesosphere, Inc. All Rights Reserved. 28 DC/OS SDK For Stateful Services github.com/mesosphere/dcos-commons
  29. 29. © 2016 Mesosphere, Inc. All Rights Reserved. 29 DC/OS SDK OVERVIEW DC/OS Documentation Tools and Utilities Apache Mesos API DC/OS Capabilities API Couchbase Update with Rollback Maintenance Plans Failure Recovery Packaging Configuration Networking Discovery Storage Security Observability Offer Evaluation Resource Accounting Task Reconciliation Developer Environment Integration Test Harness Developer Guide Tutorials Code Samples API Reference Application Lifecycle Value SDK Platform Problem ● How can we make it simple to integrate stateful workloads with Apache Mesos and DC/OS? Solution Create a "default scheduler" for stateful services with extensible interfaces Enable developers with simple-to-use declarative YAML and Java APIs Provide default interface implementations and allow developers to build their own in Java
  30. 30. © 2016 Mesosphere, Inc. All Rights Reserved. 30 Simple things should be simple; complicated things should be complicated ~1,000 LOC ~100 LOC 10K+ LOC ● Simple YAML interface ● Default, customizable behaviors ● Most services probably fall here ● Need to be a service expert ● Need to write a little Java code ● Don’t need to understand DC/OS ● Can’t use the defaults ● Don't mind writing a lot of Java ● Willing to understand DC/OS Custom Plans & Strategies Build Your Own Scheduler with commons libraries Defaults
  31. 31. © 2016 Mesosphere, Inc. All Rights Reserved. 31 Simple things should be simple; complicated things should be complicated ~1,000 LOC ~100 LOC 10K+ LOC ● Simple YAML interface ● Default, customizable behaviors ● Most services probably fall here ● Need to be a service expert ● Need to write a little Java code ● Don’t need to understand DC/OS ● Can’t use the defaults ● Don't mind writing a lot of Java ● Willing to understand DC/OS Custom Plans & Strategies Build Your Own Scheduler with commons libraries Defaults
  32. 32. 32 HOW DOES IT WORK? Component s Scheduler Task Persistent Volume Marathon [Scheduler of Schedulers] Task PV Task hello-world [Scheduler] PV hello-0-server [Task] PV Task PV Task PV world-0-server [Task] PV
  33. 33. © 2016 Mesosphere, Inc. All Rights Reserved. 33 DC/OS SDK ● Declarative ● Goal- oriented ● Foundation for ○ Couchba se ○ Kafka ○ HDFS ○ Elastic ○ And more Current Service Specification Updated Service Specification A B name: "hello-world" pods: hello: count: 1 tasks: server: cpus: 0.1 memory: 512 world: count: 1 tasks: server: cpus: 0.2 memory: 1024 name: "hello-world" pods: hello: count: 1 tasks: server: cpus: 0.3 memory: 512 world: count: 2 tasks: server: cpus: 0.2 memory: 1024
  34. 34. © 2016 Mesosphere, Inc. All Rights Reserved. Deployment Plan World PhaseHello Phase 34 DC/OS SDK ● Declarative ● Goal- oriented ● Foundation for ○ Couchba se ○ Kafka ○ HDFS ○ Elastic ○ And more Current Service Specification Updated Service Specification A B hello-0: update world-0: complete world-1: create
  35. 35. © 2016 Mesosphere, Inc. All Rights Reserved. 35 DEMO
  36. 36. ©2017 Couchbase Inc. © 2017 Mesosphere, Inc. All Rights Reserved. 36 WHY DATA SERVICES ON DC/OS? On-demand provisioning1 2 3 Simplified operations Elastic data infrastructure ● Single command install of services ● Runtime software upgrade ● Runtime application settings update ● Monitoring & metrics ● Managed persistent storage volumes ● Data services and containerized apps share resources ● Deploy instances with different versions on the same infra ● Resize instances ● Add more instances
  37. 37. ©2017 Couchbase Inc. © 2017 Mesosphere, Inc. All Rights Reserved. 37 COUCHBASE ON MESOSPHERE DC/OS Develop with agility, operate at any scale Couchbase Mesosphere Enterprise DC/OS Any Infrastructure Build apps once in DC/OS, and run anywhere Runs distributed apps anywhere as simply as running apps on your laptop Enable devs to build applications easier and faster
  38. 38. ©2017 Couchbase Inc. 38 The Couchbase Connect mobile app Take our in-app survey!
  39. 39. ©2017 Couchbase Inc. 39 Share your opinion on Couchbase 1. Go here: http://gtnr.it/2eRxYWn 2. Create a profile 3. Provide feedback (~15 minutes)
  40. 40. ©2017 Couchbase Inc.©2017 Couchbase Inc. Follow us on social media Twitter @couchbase Facebook /couchbase Instagram @couchbase Linkedin /company/couchbase
  41. 41. ©2017 Couchbase Inc.©2017 Couchbase Inc. Thank You! 41

×