Operating apps at scale is the new normal. With Apache Mesos, a resource manager for clusters, and DC/OS, a cluster-management platform built around Mesos, complex distributed systems like Spark, Kafka, Cassandra become dramatically easier to install and more effective to operate. Together with containers, this modern technology lets companies focus on things that are differentiators to their business instead of investing lots of resources into setting up and maintaining the infrastructure. In this talk Alex will touch on prerequisites for success of containers and cluster managers and will share insights into the future of both. Mesos and DC/OS roadmaps will serve as an example. Par Alex Rukletsov (Apache committer @ Mesosphere) Toutes les vidéos des conférences seront disponibles sur Xebia.tv

1. @ContainerDay16
How cluster managers affect the landscape of
modern distributed computing
—why we decided to open source DC/OS
Alex Rukletsov <alexr@apache.org>
June 2016

2. @ContainerDay16
On this CD:
(1) Why containers? as seen by a Mesos guy
(2) What about Apache Mesos, DC/OS? and your business
(3) What’s ahead? free prophecies from that Mesos guy
(4) Bonus track: Beware of DC/OS? no, it is not Skynet (yet)

3. @ContainerDay16
Containers are great because...

4. @ContainerDay16
Containers are great because...

5. @ContainerDay16
Containers are great because...
Isolation Packaging

6. @ContainerDay16
All problems solved?
©creativemarket.com

7. @ContainerDay16
That’s how we run datacenters:
©unknown

8. @ContainerDay16
Treat a cluster as one big computer

9. @ContainerDay16
Apache Mesos vs. DC/OS

10. @ContainerDay16
“Every business will be a
software business”
we are helping by
letting companies focus on things that are
differentiators to their business instead of
investing lots of resources into setting up
and maintaining the infrastructure.
© Satya Nadella

11. @ContainerDay16
Autodesk’s report
A 66% reduction in AWS Instances
Cost Improvements up to 57%
An impressive 40 sec time to deploy a new build
with zero downtime
100% Uptime
Total Resources needed: 1 DevOps Engineer
Source: http://cloudengineering.autodesk.com/blog/2016/04/autodesk-is-forging-ahead-with-dcos.html
after one year of runnig event streaming and big data ingestion pipeline services in production on DC/OS

12. @ContainerDay16
©davidnprogress.com

13. @ContainerDay16
(1) Security & isolation
XSA-156, 2015: A bug which allows any VM to DoS its
host due to a bug in the exception delivery mechanism
AMD 0x06000836, 2016: A bug which not only allows a
VM to crash its host, it also allows a VM to take over
the host
Source: http://danluu.com/cpu-bugs/

14. @ContainerDay16
(1) Security & isolation
Priorities for tasks, applications, frameworks
Quality of resources, i.e. revocable, scarce, etc.
Improve multi-tenancy, i.e. CPI^2
Smarter, tailored allocator algorithms, remember
Autodesk?

15. @ContainerDay16
(2) Competition
© apple.wikia.com; droid-life.com; youtube.com

16. @ContainerDay16
(3) Growing the community
MESOS-1478, slave → agent rename
Kubernetes:
In mid-2015, goes V1 with 14,000 commits from
400 contributors
Docker:
In 2015, 58% of pull requests submitted to the
Docker Engine were authored by people who
are neither maintainers nor Docker employees

17. @ContainerDay16
(4) Unified stable APIs
Storage
REX-Ray
Flocker
Networking
CNI
VxLAN
Authentication & Authorization
…

18. @ContainerDay16
(4) Unified stable APIs
©nuberlin.com;indiamarkt.com

19. @ContainerDay16
container
(5) Simplified architecture
container
DC/OS
VM
Your Task
Borg
Hardware
container
VM
container
VM
container
VM
container
Your Task
container
Your Task
container
Your Task
container
Your Task
infra
cloud
app

20. @ContainerDay16
container
(5) Simplified architecture
container
DC/OS
VM
Your Task
Borg
Hardware
container
VM
container
VM
container
VM
container
Your Task
container
Your Task
container
Your Task
container
Your Task
infra
cloud
app
Seriously?

21. @ContainerDay16
© NASA; 3media.com
Reduce the skill and effort
required to operate clusters
(5) Simplified architecture

22. @ContainerDay16
(5) Simplified architecture
Resource
as a
Service
©wordpress.com

23. @ContainerDay16
(6) Higher utilization
No. of servers Agility Automation Cost Savings
10 000 + < 5 ~ 10 < 5
1 000 – 10 000 ~ 10 20 + ~ 5
100 – 1 000 ~ 70 100 + ~ 20
10 – 100 100 + ~250 ~ 40
Source: Mesosphere survey, 2016
Q: What do you value most?

24. @ContainerDay16
(6) Higher utilization
©mirianda.com

25. @ContainerDay16
Will DC/OS kill Apache Mesos?Bonus Q1:

26. @ContainerDay16
Bonus Q1:
©timheuer.com;fedoraproject.org
Will DC/OS kill Apache Mesos?

27. @ContainerDay16
Bonus Q2: Will Mesosphere kill Mesos?

28. @ContainerDay16
Bonus Q2:
©dartmoortreesurgeons.co.uk
Will Mesosphere kill Mesos?

29. @ContainerDay16
Will DC/OS kill Mesosphere?Bonus Q3:

30. @ContainerDay16
Will DC/OS kill Mesosphere?
© hitchhikers.wikia.com
Bonus Q3:

31. @ContainerDay16
Demo time!
©medium.com