Containers, cluster management, microservices, Kubernetes and many other buzzwords are flying around us all the time. Our team is building solutions that make it easy to cope with all the complexity around cluster infrastructure. In this talk we present the project we are working on, namely running Kubernetes on top of the Mesos cluster scheduler. Furthermore we show DCOS which makes it easy to deploy and run Kubernetes with a single command.

1. © 2015 Mesosphere, Inc. All Rights Reserved.

2. © 2015 Mesosphere, Inc. All Rights Reserved. 2
Kubernetes, Mesos, DCOS
Sergiusz Urbaniak, Stefan Schimanski

3. © 2015 Mesosphere, Inc. All Rights Reserved. 3
Engineers at: Mesosphere
Working on: - Kubernetes-Mesos (Open Source & fully upstream)
- DCOS integration
Who are we?
James Karl Tyler Stefan Sergiusz

4. © 2015 Mesosphere, Inc. All Rights Reserved. 4
The company behind:
● Apache Mesos (https://mesos.apache.org/)
A distributed systems kernel.
● Marathon (https://mesosphere.github.io/marathon/)
An Apache Mesos framework
for long-running applications.
● Chronos (http://mesos.github.io/chronos/)
A distributed cron replacement.
Who/What is Mesosphere?
DCOS
(https://mesosphere.com/)
A data center operating system.

5. © 2015 Mesosphere, Inc. All Rights Reserved. 5
The challenge: Warehouse Computing
Source: https://www.google.com/about/careers/teams/ops-support/data-center/

6. © 2015 Mesosphere, Inc. All Rights Reserved. 6
The reality today: Static Partitioning
Source: https://commons.wikimedia.org/wiki/File:Cern_datacenter.jpg

7. © 2015 Mesosphere, Inc. All Rights Reserved.
single PC
7
Single Computer
CPUMemory Storage
Kernel → Linux, Darwin, Windows, FreeBSD, …
init.d → SysV, systemd, ...
cron tty MySQL
docker-
compose
Container #1
Container #2
Container #3

8. © 2015 Mesosphere, Inc. All Rights Reserved.
>1000 PCs
8
DCOS - Data Center Operating System
CPUMemory Storage
Kernel → Apache Mesos
init.d → Marathon
Chronos
dcos
CLI
Cassandra
Riak, ...
Kubernetes
Pod #1
Pod #2
Pod #3

9. © 2015 Mesosphere, Inc. All Rights Reserved. 9
apiVersion: v1
kind: Pod
metadata:
name: nginx
spec:
containers:
- name: nginx
image: nginx
ports:
- containerPort: 80
apiVersion: v1
kind: Service
metadata:
name: nginx-service
spec:
ports:
- port: 8000
targetPort: 80
protocol: TCP
selector:
app: nginx
Kubernetes - the Data Center Userland API
Pod Service

10. © 2015 Mesosphere, Inc. All Rights Reserved. 10
The challenge: Warehouse Computing
Source: https://www.google.com/about/careers/teams/ops-support/data-center/

11. © 2015 Mesosphere, Inc. All Rights Reserved. 11
Placeholder - DCOS Services

12. © 2015 Mesosphere, Inc. All Rights Reserved. 12

13. © 2015 Mesosphere, Inc. All Rights Reserved. 13
$ dcos package install kubernetes
$ dcos kubectl create -f nginx.yml
pods/nginx
$ dcos kubectl get pods
NAME READY STATUS RESTARTS AGE
nginx 1/1 Running 0 1m
Demo:
Install
Kubernetes
on DCOS
nginx.yml:
apiVersion: v1
kind: Pod
metadata:
name: nginx
spec:
containers:
- name: nginx
image: nginx
ports:
- containerPort: 80

14. © 2015 Mesosphere, Inc. All Rights Reserved. 14
Kubernetes by Google
- Great for backend developers
DCOS by Mesosphere
- Great for datacenter operators
Mesos by Apache
- Great for low-level framework developers
The Stack

15. © 2015 Mesosphere, Inc. All Rights Reserved. 15
Mesos
Datacenter Kernel
- Cluster Resource Management
- Scheduling
- Process Isolation
- Task/Container Execution

16. © 2015 Mesosphere, Inc. All Rights Reserved. 16
Mesos
Architecture
FrameworkMesos
ZooKeeper
Node Node Node
Executors
Agent Agent Agent
Tasks Tasks
Executors
Tasks
Executors
SDK for Mesos:
HTTP/Protobuf API

17. © 2015 Mesosphere, Inc. All Rights Reserved. 17
Kubernetes
Userland API and System Services
- High Level Application Abstractions
- Cluster Containers Orchestration

18. © 2015 Mesosphere, Inc. All Rights Reserved. 18
Kubernetes
on Mesos
Architecture
Mesos
Masters
EtcdZooKeeper
Node Node Node
K8s Executor
Mesos Agent Mesos Agent Mesos Agent
Pods Pods
K8s Executor
Pods
K8s Executor
K8s Master
API Server
Scheduler
Controllers

19. © 2015 Mesosphere, Inc. All Rights Reserved. 19
Behind the
scenes ...
K8s Master
API Server
Scheduler
Controllers
$ dcos kubectl get pods
NAME READY STATUS RESTARTS
nginx 1/1 Running 0
GET /service/kubernetes/api/v1/pods
{
"kind": "List",
"apiVersion": "v1",
"metadata": {},
"items": [
{
"kind": "Pod",
"apiVersion": "v1",
"metadata": {
"name": "kube-dns-v9-ejq02",
"generateName": "kube-dns-v9-",
...

20. © 2015 Mesosphere, Inc. All Rights Reserved. 20
DCOS
- Package Repo
- Terminal Client
- Config Service
- Kernel
- Init System
- Dashboard
- Service Discovery
- Control Plane
- Public & Private Zones
Datacenter Operating System

21. © 2015 Mesosphere, Inc. All Rights Reserved. 21
https://mesosphere.com/amazon/Try it yourself

22. © 2015 Mesosphere, Inc. All Rights Reserved. 22

23. © 2015 Mesosphere, Inc. All Rights Reserved. 23
Kubernetes on DCOS:
http://kubernetes.io/v1.1/docs/getting-started-guides/dcos.html
Kubernetes-Mesos on your Laptop:
http://kubernetes.io/v1.1/docs/getting-started-guides/mesos-docker.html
DCOS:
https://mesosphere.com/product/
Github:
https://github.com/kubernetes/kubernetes/tree/master/contrib/mesos
Links

24. © 2015 Mesosphere, Inc. All Rights Reserved. 24
v0.7.0-v1.1.1 today
● Kubernetes 1.1
● 100% conformant docker-compose cluster
● major scheduler & executor refactoring
● lots of bugfixes
v0.7.1-v1.1.x Dec’ish
● resource roles ⇒ slave_public support
MVP v0.8.0-v1.1.x Feb’ish
● upgrade story, TLS support, no container leaks
● known and documented deficiencies
...
Prod Ready v1.0.0-v1.x.y
● proven scaling to e.g. 1000 nodes, at least as good as
upstream
● conformant DCOS package
Roadmap

25. © 2015 Mesosphere, Inc. All Rights Reserved. 25
Of course: we are hiring!

26. © 2015 Mesosphere, Inc. All Rights Reserved. 26
Kubernetes on DCOS:
http://kubernetes.io/v1.1/docs/getting-started-guides/dcos.html
Kubernetes-Mesos on your Laptop:
http://kubernetes.io/v1.1/docs/getting-started-guides/mesos-docker.html
DCOS:
https://mesosphere.com/product/
Github:
https://github.com/kubernetes/kubernetes/tree/master/contrib/mesos
Links

27. © 2015 Mesosphere, Inc. All Rights Reserved.