Containerizing couchbase with microservice architecture on mesosphere.pptx

Containerizing Couchbase With Microservice
Architecture On Mesosphere DC/OS

Anil Kumar
Principal Product Manager
Couchbase, Inc.
LinkedIn – https://www.linkedin.com/in/anilkumar29
Twitter – @anilkumar1129

Ravi Yadav
Technology Partnerships Lead, Ecosystem
Development
Mesosphere, Inc.
Twitter: @RaaveYadav

Agenda
• Containerizing Couchbase
• Couchbase on Container Orchestration Technologies
• Mesosphere DC/OS
• Kubernetes / RedHat OpenShift Enterprise
• Overview of Mesosphere DC/OS
• DEMO !!!
• Couchbase and Mesosphere: Better Together

Containers - Business Benefits
● DevOps & Continuous Delivery
○ Low impact & risk; update one container at a time
● Build Once & Run Anywhere
○ Instantiate clones for development, testing and production
● Scalability
○ Scale-up or Scale-down containers easily based on demand
● Isolation
○ Safely run multiple microservice containers with isolation
● High Availability
○ Redundancy from multiple containers fulfilling a role
● Performance
○ Minimal impact from container overhead

Containerizing Couchbase
Why Couchbase is Good-fit for Containers?
Microservice Architecture
COUCHBASE SERVER CLUSTER
Container 3 Container 4 Container 5 Container 6 Container 7 Container 7 Container 9
Container
10
Container
11
QUERY SERVICE INDEX SERVICE
DATA SERVICE
Container
1
Container
2
SEARCH SERVICE

Containerizing Couchbase
Couchbase Container Production Certified
• We production certify Couchbase Docker image and
RHEL image with every version (x.x.x)
• New images gets published to https://hub.docker.com
and
• Everything you want to know about ‘Running
Couchbase in Container’ -
https://www.couchbase.com/containers
• Best Practices -
http://developer.couchbase.com/documentation/server
/current/install/deploy-with-docker-hub.html

Couchbase on Container
Orchestration Technologies

Mesosphere DC/OS provides the built-in automation to manage the lifecycle of Couchbase
Cluster using data services which includes -
● The deployment, placement, security, scalability, availability, failure recovery, and in-place
upgrades of the services.
DC/OS simplifies storage management for Couchbase Server with Stateful data service
● Couchbase can be easily deployed with only a few clicks from the DC/OS Universe or a single
command from the DC/OS CLI
● Mesosphere DC/OS provides options for local persistent storage and external volumes
Benefits of Running Couchbase on Mesosphere DC/OS

Common Customer - Verizon Labs IoT/ThingSpace & Couchbase

Couchbase on Container Orchestration Technologies
Run Couchbase cluster on Container Orchestration
Technologies
• [Developer Preview] Couchbase running on
Mesosphere
http://www.infoworld.com/article/3180698/data-center
/mesosphere-dcos-brings-elastic-scale-to-redis-couchb
ase.html
• [Developer Preview] Couchbase running on OpenShift
Enterprise 3.5 (Kubernetes 1.5)
https://www.youtube.com/watch?v=fxox6DD96HQ

THE WORLD HAS CHANGED AND WE
ARE ALL NOW SOFTWARE
COMPANIES.
Software is eating the world.
Marc Andreessen

WE LIVE IN THE
ALWAYS
CONNECTED
ECONOMY. 3.7BMobile Broadband Users
80%New Data is Unstructured
13Connected Devices per
Household
(N. Amer)
40%Annual Enterprise Data Growth
Sources: IHS Markit, IDG, KPCB, Ericsson

IN THE ALWAYS CONNECTED ECONOMY
SOFTWARE IS YOUR BUSINESS.
Build more apps.
Personal and meaningful customer
experiences
Innovate faster.
Capture value from new value
streams and actionable data insights
Modernize IT.
Always-available services that are
secure and cost effective

MODERN ENTERPRISE
APPS REQUIRE NEW
CAPABILITIES.
Distributed computing
expertise.
Engineering and operations of
secure & highly reliable services at
scale
DevOps process &
culture.
Frequent & reliable releases
supported by an automated CI/CD
toolchain
Cloud-native
technologies.
Containers, microservices, data
services (e.g., Spark, Kafka,
Cassandra)

CLOUD BENEFITS
+ AGILITY
+ ELASTICITY
+ SCALE
AWS
PLATFORM SERVICES
OPERATIONS & TOOLS
ADMINISTRATORS OPERATIONAL PROCESSES PROPRIETARY TECHNOLOGIES
CONTAINER
ORCHESTRATIO
N
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH
AWS INFRASTRUCTURE (EC2)
BUSINESS APPS

BUSINESS APPS
$
$ $
$
$ $
$
$
$
$
$
$
$$
$$
$ $
$
$ $
$
$
$
$
$
$
CLOUD LIMITATIONS
- LOCK-IN
- HIGH COST
- NO CONTROL
AWS
PLATFORM SERVICES
OPERATIONS & TOOLS
CONTAINER
ORCHESTRATIO
N
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH

WHERE IS YOUR
CUSTOMER
DATA?
WHO CONTROLS
YOUR IT
STRATEGY?
WHAT IS THE
COST OF NO
CONTROL?
BUSINESS APPS
$
$ $
$
$ $
$
$
$
$
$
$
$$
$$
$ $
$
$ $
$
$
$
$
$
$
AWS
PLATFORM SERVICES
OPERATIONS & TOOLS
CONTAINER
ORCHESTRATIO
N
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH

BUSINESS APPS
MESOSPHERE ENTERPRISE DC/OS
CONTAINER
ORCHESTRATIO
N
CI/CD
BIG DATA
ANALYTICS
MESSAGE
QUEUE
DISTRIBUTED
DATABASE
SEARCH
PLATFORM SERVICES
RESOURCE
MANAGEMENT
OPERATIONS SECURITY MULTI-TENANCY
DATACENTER-CLOUD OPERATING SYSTEM
APACHE MESOS
PRIVATE CLOUD AWS INFRASTRUCTURE
(EC2)
GOOGLE CLOUD MICROSOFT AZURE
THE POWER OF CLOUD
PLATFORM SERVICES,
THE FREEDOM TO USE
ANY INFRASTRUCTURE

YOUR DATACENTER OR CLOUD
IS NOW ONE GIANT COMPUTER

PLATFORM SERVICES
INSTALLED ACROSS
DATACENTER OR
CLOUD IN A SINGLE
COMMAND

We are building for the coming IoT market..
If I build everything in a silo, I have no chance...
With Mesosphere DC/OS, I have one single contiguous cluster ...
I can ingest data, store it and run all my apps as well,
and that's a huge advantage
Larry Rau
Director Architecture & Infrastructure, Verizon Labs

We’re running real time analytics and visualization of data from
connected sensors. Before DC/OS we had no where near the scale we
had today, from thousands of to millions of events per second.
Next, we’re doing predictive GIS.
Adam Mollenkopf
Real Time Geospatial Information Systems Capability Lead

Writing complex stateful services is
hard...

© 2015 Mesosphere, Inc. All Rights Reserved. 27
● Failure recovery (basic stickiness, for
transient failures)
● Snowflake failure recovery
(complicated semantics for
permanent failures)
● Deployment preparation (often
manual, infrequent tasks)
● Legacy software in a containerized
world (pets vs cattle)
● Placement constraints (more
complicated than stateless services)
Considerations

DC/OS SDK
For Stateful Services
github.com/mesosphere/dcos-commons

DC/OS SDK OVERVIEW
DC/OS
Documentation
Tools and Utilities
Apache Mesos API
DC/OS Capabilities API
Couchbase
Update with Rollback
Maintenance Plans
Failure Recovery
Packaging
Configuration
Networking
Discovery
Storage
Security
Observability
Offer Evaluation
Resource Accounting
Task Reconciliation
Developer Environment
Integration Test Harness
Developer Guide
Tutorials
Code Samples
API Reference
Application Lifecycle
Value
SDK
Platform
Problem
● How can we make it simple to integrate
stateful workloads with Apache Mesos
and DC/OS?
Solution
● Create a "default scheduler" for stateful
services with extensible interfaces
● Enable developers with simple-to-use
declarative YAML and Java APIs
● Provide default interface
implementations and allow developers
to build their own in Java

Simple things should be simple; complicated things should be complicated
~1,000 LOC
~100 LOC
10K+ LOC
● Simple YAML interface
● Default, customizable behaviors
● Most services probably fall here
● Need to be a service expert
● Need to write a little Java code
● Don’t need to understand DC/OS
● Can’t use the defaults
● Don't mind writing a lot of Java
● Willing to understand DC/OS
Custom
Plans & Strategies
Build Your Own Scheduler
with commons libraries
Defaults

32
HOW DOES IT
WORK?
Components
● Scheduler
● Task
● Persistent
Volume
Marathon
[Scheduler of Schedulers]
Task
PV
Task
hello-world
[Scheduler]
PV
hello-0-server
[Task]
PV
Task
PV
Task
PV
world-0-server
[Task]
PV

DC/OS SDK
● Declarative
● Goal-oriented
● Foundation for
○ Couchbase
○ Kafka
○ HDFS
○ Elastic
○ And more
Current
Service
Specification
Updated
Service
Specification
A B
name: "hello-world"
pods:
hello:
count: 1
tasks:
server:
cpus: 0.1
memory: 512
world:
count: 1
tasks:
server:
cpus: 0.2
memory: 1024
name: "hello-world"
pods:
hello:
count: 1
tasks:
server:
cpus: 0.3
memory: 512
world:
count: 2
tasks:
server:
cpus: 0.2
memory: 1024

DEMO

© 2017 Mesosphere, Inc. All Rights Reserved.
WHY DATA SERVICES ON DC/OS?
On-demand provisioning1
2
3
Simplified operations
Elastic data infrastructure
● Single command install of services
● Runtime software upgrade
● Runtime application settings update
● Monitoring & metrics
● Managed persistent storage volumes
● Data services and containerized apps share resources
● Deploy instances with different versions on the same
infra
● Resize instances
● Add more instances

© 2017 Mesosphere, Inc. All Rights Reserved.
COUCHBASE ON MESOSPHERE DC/OS
Develop with agility, operate at any scale
Couchbase
Mesosphere Enterprise DC/OS
Any Infrastructure
Build apps once in DC/OS, and run
anywhere
Runs distributed apps anywhere as simply
as running apps on your laptop
Enable devs to build applications
easier and faster

The Couchbase Connect
mobile app
Take our in-app survey!

Share your opinion on Couchbase
1. Go here: http://gtnr.it/2eRxYWn
2. Create a profile
3. Provide feedback (~15 minutes)

Follow us on social media
Twitter
@couchbase
Facebook
/couchbase
Instagram
@couchbase
Linkedin
/company/couchbase

Containerizing couchbase with microservice architecture on mesosphere.pptx

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Containerizing couchbase with microservice architecture on mesosphere.pptx

Similar to Containerizing couchbase with microservice architecture on mesosphere.pptx (20)

Recently uploaded

Recently uploaded (20)

Containerizing couchbase with microservice architecture on mesosphere.pptx