Ivan Zhuravel and Ihor Khlaponin "DC/OS vs Kubernetes. Let the Fight Begin!"

1. www.luxoft.com
23.05.2019
DC/OS vs. Kubernetes. Let the Fight Begin!

2. www.luxoft.com
Microservices and why do we need orchestration
2
- running thousands of services in the same infrastructure
- avoid manual restarting when service will be in failed state
- organization of service discovery (communication between services in
the cluster)
- 3rd party services (backup & restore, monitoring, logs rotation, etc.)

3. www.luxoft.com
Choose your fighter
3

4. www.luxoft.com
DC/OS Kubernetes
4
Let the fight begin!
* All examples and cloud dependencies in this presentation are
related to AWS

5. www.luxoft.com
Architecture - DC/OS (OS)
5

6. www.luxoft.com
Architecture - Kubernetes (API)
6

7. www.luxoft.com
Installation
7
Platform agnostic
1) get hosts from AWS
2) configure security groups
3) use ansible or shell for provisioning
nodes (some of them for master and
some - for agent)
4) install load balancer for accessing to
the main node (should be getting by
quorum)
Platform agnostic vs cloud dependent
1) for platform agnostic way is similar
to DC/OS
2) for cloud dependent - just find
implementation of K8S in cloud
console and click `RUN` button (EKS
for AWS)

8. www.luxoft.com
Deployment
8
- Catalog
- Marathon manual installation (JSON)
- Helm Charts (huge amount of YAML
files will be installed using one
command `helm install`)
- YAML manifests (yaml configuration
for resources)

9. www.luxoft.com
Service discovery
9
- Internals
e.g.
http://influxdb.marathon.mesos.com
- via message bus (async and
persistent)
- k8s native
e.g.
http://fooservice.foonamespace
- Istio (popular service mesh)
- via message bus (async and
persistent)

10. www.luxoft.com
Monitoring
10

11. www.luxoft.com
Docker registry
11
- Internal private (out of the box)
- ECR - requires login from nodes
- External (e.g. JFrog)
- Internal private
- ECR (working out of the box for
cloud dependent implementations)
- External (e.g. JFrog)

12. www.luxoft.com
Storage types
12
- Mount disk resources
- NFS Server
- Local Persistent Volume
- External Persistent Volumes
- Mount disk resources
- Network file system
- Local storage
- External Persistent Volumes from
different cloud vendors (EBS, PVC,
AzureFile, AzureDisk, Cinder, etc.)
- k8s native storages (secrets, config
maps, emptyDir, etc.)
*https://kubernetes.io/docs/concepts/storage/#types-of-volumes

13. www.luxoft.com
Security & permissions
13
Enterprise and open source versions
open-source: linux based users and groups
enterprise: public and private zones + linux
based users and groups
Main commands:
- dcos user …
- dcos auth
- dcos:mesos:container/path/endpoint/age
nt
Enterprise components:
- secrets
- public and private zones
- namespaces
- secrets
- roles
- cluster roles
- service accounts (RBAC)
- config maps
Bonus: You can set up your cloud user as a
user in k8s

14. www.luxoft.com
Backup & restore
14
Out of the box:
- The whole DC/OS cluster
- Cassandra
- MongoDB
Only external tools
- Velero
- Kasten

15. www.luxoft.com
Cluster federation & Hybrid cloud
15
- Federation does not supported
- Hybrid cloud available for enterprise
version
- Federation supported
- Hybrid clouds supported

16. www.luxoft.com
Logs rotation
16
- Out of the box (not commonly used)
- Docker and file system log rotation
(/var/log/dcos.log)
- Docker log rotation
- Fluentd - log aggregator
- Elasticsearch - NoSQL DB for logs

17. www.luxoft.com
Finish him!
17
Pros:
- many things are out of the box
- good possibilities of customization
- great support from developers side (in
case of enterprise version)
Pros:
- fast development in case of cloud
dependent installation
- proved scalability (google.com uses k8s)
- big open-source community
- cluster federation & hybrid clouds
Cons:
- no cloud dependent
- enterprise version is very expensive
- consist of different open-source
projects
- marathon
- hard to understand for ordinary
developer
Cons:
- open-source (wait for fix or contribute)
- no big data tools out of the box
- hard to understand for ordinary
developer

18. www.luxoft.com
Fatality: K8S instead of Marathon in DCOS
18

19. www.luxoft.com
Brutality: Internet activity
19

20. www.luxoft.com
Customer requirements win!
20

21. www.luxoft.com
Thank you
21