EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos

1© Copyright 2016 EMC Corporation. All rights reserved. 1© Copyright 2016 EMC Corporation. All rights reserved.
RUNNING STATEFUL SERVICES ON CLOUD
NATIVE PLATFORMS WITH MESOS
JONAS ROSLAND, EMC {code}
DEVELOPER ADVOCATE & COMMUNITY MANAGER

4© Copyright 2016 EMC Corporation. All rights reserved.
• How are Cloud Native Platforms managed?
• Handling stateless apps and stateful services
• Everything running in containers
• Making the platforms understand data persistence
AGENDA

• Clustered servers
• Manual deployments
• Redundancy, not necessarily high availability
BACK IN THE OLD DAYS

• Infrastructure as a Service
• Deploy virtual machines
• Manual/half-automated way of deploying apps
• Almost efficient
THEN SOME TIME AGO

• Collection of compute resources
• Spread out horizontally
• Brings scale to your deployments
NOW – CLOUD NATIVE PLATFORMS

Standard definitions

PAAS SITS ON TOP OF SCHEDULERS

• Manages all physical/virtual
resources
• Deploys and schedules apps
• Handles hardware failures
RESOURCE MANAGERS AND SCHEDULERS

SCHEDULING

• Enables apps and infra
to automatically find
parts of each other
• Keeps track of how to
connect and use the
application services
SERVICE DISCOVERY

SERVICE DISCOVERY

APPLICATIONS RUN IN CONTAINERS
Code
Code and
requirements
Container

You don’t have to
rewrite your apps!

• Storing data (state) is a critical component of any
application
• Where they store this state defines their class
– Connected database
– In memory
– Local disk
APPLICATION STATE DIFFERENCES

• Store no critical data locally
• Can be scaled as needed
• Recovers quickly
STATELESS APPLICATIONS

• Services that store state
• Have usually been treated as HA apps
• Can be scale-out or scale-up
STATEFUL SERVICES

FROM oraclelinux:latest
ENV PACKAGE_URL https://repo.mysql.com/yum/mysql-5.7-community/docker/x86_64/mysql-community-server-minimal-5.7.12-
1.el7.x86_64.rpm
RUN rpmkeys --import http://repo.mysql.com/RPM-GPG-KEY-mysql && yum install -y $PACKAGE_URL && yum install -y
libpwquality && rm -rf /var/cache/yum/*
RUN mkdir /docker-entrypoint-initdb.d
VOLUME /var/lib/mysql
COPY docker-entrypoint.sh /entrypoint.sh
ENTRYPOINT ["/entrypoint.sh"]
EXPOSE 3306 33060
CMD ["mysqld"]
MYSQL IN A CONTAINER

APPLICATIONS BUILT FROM SERVICES
Front End or Non-Persistent
Data Services (Persistent)
Scale-Up
Scale-Out
Cassandra
Postgres
Redis
CouchDB
Elastic Search
Hadoop
MariaDB
Mysql
Nginx
HAProxy
MongoDB
RabbitMQ
Tomcat
Memcached
ScaleIO ECS
ApacheRails
Language Specific HTTP

• No!
– Without proper storage mapped, the service will lose data
– Data doesn’t travel with the service if it’s stored on local
disk
• Yes!
– Automatically mapping modern storage backends such as
ScaleIO, VMAX, XtremIO, Isilon and others
enables your data to be stored safely
STATEFUL SERVICES IN CONTAINERS?

• Have been mostly focused on stateless apps
• Working hard on making stateful services part of
their inventory
• So how do you handle both types?
CLOUD NATIVE PLATFORMS

• Data is stored outside the platform
EXAMPLE 1

• Data is stored on the same platform
EXAMPLE 2

Virtual Machine
PERSISTENCE AND P3
Platform 2 Platform 3
High Availability
Live Migration
Highly Available
Container Platform
Lifecycle Management
Container Platform
Lifecycle Management

• Cloud native applications have no concept of local
storage
• They require state being stored somewhere else
• So we need our platform to understand storage
CLOUD NATIVE APPS AND STORAGE

Making the platform
understand storage

LET’S START WITH THE BASICS
GCE
?
AWSEMC OpenStack

SAY HELLO TO MY LITTLE FRIEND – REX-RAY

NOW WE’RE GETTING SOMEWHERE
GCEAWSEMC OpenStack

AND NOW IT’S GETTING INTERESTING
GCEAWSEMC OpenStack
Mesos Kubernetes

• Gives you the possibility to use any storage platform,
and even multiple platforms at the same time
• Always in sync with Docker’s development cycle
• Integrated with Docker, Mesos and Kubernetes
REX-RAY BENEFITS

How does Cloud Foundry
and Mesos work together?

• You already have your apps divided into stateless
and stateful
• Focus on your stateless apps first
• Make real decisions to move from archaic master-
slave clusters
• Move to new platforms to handle your old, new and
expanding apps
SUMMARY

@EMCcode
@jonasrosland
emccode.com
community.emccode.com
Questions?

EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos

EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (15)

Similar to EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos

Similar to EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos (20)

Recently uploaded

Recently uploaded (20)

EMC World 2016 - code.16 Running Stateful Services on Cloud Native Platforms with Mesos

Editor's Notes