1) The document discusses Docker Swarm and Docker Machine, which are tools for orchestrating and provisioning Docker containers across multiple hosts. 2) Docker Swarm exposes multiple Docker engines as a single virtual engine and includes fault tolerance features like leader election and replication of the swarm manager. 3) Docker Machine can provision VMs on various platforms and install and manage Docker Engine, enabling easy deployment and management of Docker clusters.

1. Orchestration
for
Sysadmins
Phu
Nguyen
Anh
– Einsights

2. Orchestration for Sysadmins
Andrea Luzzardi / Victor Vieux
Software Engineers @ docker
Source: Recap from DockerCon US 2015

3. Agenda
• Introduction to Docker Swarm
• Swarm Fault Tolerance: Replication
• Integrating Swarm with Mesos
• Provisioning Swarm with Docker Machine
Source: Recap from DockerCon US 2015

4. “Running containers on multiple hosts.”
Source: Recap from DockerCon US 2015

5. Swarm in a nutshell
• Exposes several Docker Engines as a single virtual Engine
• Serves the standard Docker API
• Extremely easy to get started
• Batteries includes but swappable
(PhuNA edited)
Source: Recap from DockerCon US 2015
(Added by Phu)

6. Timeline
Oct
Nov
Dec
Jan
Feb
Jun
Proof of Concept
DockerCon EU
Open Repository
First Release Candidate
Swarm Beta Release
Global Hack Day
Open Proposal
0.2.0 Release
0.3.0 Release
Apr
Source: Recap from DockerCon US 2015

7. Setting up Swarm
• Create a cluster:
- $ swarm create
• Add nodes to a cluster:
- $ swarm join --advertise=<node_ip> token://<token>
• Start Swarm:
- $ swarm manage -H <swarm_ip> token://<token>
Or you can use your own etcd, zookeeper or consul
Source: Recap from DockerCon US 2015

8. Swarm Scheduler
• Resource Management
- Memory, CPU, Network
• Fit containers
- Apply filters to exclude nodes
- Use a strategy to rank and pick the best node
• Scheduling Knobs
- Constraints
- Affinities
$ docker run -m 1g -c 2 -p 80:80 ...
$ docker run -e constraint:storage==ssd ...
$ docker run -e affinities:container!=redis* ...
(Constraint, Affifinity, Port, Dependency, Health)
(spread, binpack, random)
(PhuNA edited)
(PhuNA edited)
Source: Recap from DockerCon US 2015
(Added by Phu)
(Added by Phu)
(Added by Phu)

9. “Batteries Included but Swappable”
Source: Recap from DockerCon US 2015

10. Docker Swarm + Mesos
• Experimental
• Docker Swarm act as a Mesos Framework
• In collaboration with
$> swarm manage --cluster mesos-experimental <mesos_master_url>
Source: Recap from DockerCon US 2015

11. Mesos Cluster
+
Mesos
CLI
Mesos Slaves
+
+
+
+
+
+
+
+
+
+
+
+
+
Mesos Masters
Marathon
Source: Recap from DockerCon US 2015

12. Mesos Cluster + Docker Swarm
+
Mesos
CLI
Mesos Slaves
+
+
+
+
+
+
+
+
+
+
+
+
+
Mesos Masters
Marathon
Docker
CLI
Source: Recap from DockerCon US 2015

13. Mesos Cluster + Docker Swarm
+
Mesos
CLI
Mesos Slaves
+
+
+
+
+
+
+
+
+
+
+
+
+
Mesos Masters
Marathon
Docker
CLI
shipyard
kitematic compose
Source: Recap from DockerCon US 2015

14. BY
Source: Recap from DockerCon US 2015

15. Swarm Manager Replication
Source: Recap from DockerCon US 2015

16. Replication
Docker
CLI
Swarm Cluster
• Swarm Manager is a
Single Point of Failure
API Request
Manage
Source: Recap from DockerCon US 2015

17. Replication
Docker
CLI
Swarm Cluster
• Upon failure it
becomes impossible to
manage the cluster
• Cluster continues to
run un-managed
API Request
Manage
Source: Recap from DockerCon US 2015

18. Replica
Replication
Primary
Docker
CLI
Swarm Cluster
Forward
API Request
Manage
Replica
• One primary, many replicas
• Leader Election built on top
of Consul, etcd, ZooKeeper
• Replicas forward API calls to
primary
• CLI can talk to any instance
Source: Recap from DockerCon US 2015

19. Replica
Replication
Primary
Docker
CLI
Swarm Cluster
Forward
API Request
Manage
Replica
• Replicas monitor health
of primary instance
• Leader gets re-elected
upon primary failure
Source: Recap from DockerCon US 2015

20. PrimaryReplica
Replication
Replica
Docker
CLI
Swarm Cluster
Forward
API Request
Manage
• One replica promoted to
primary
• Other replicas notified of
leadership update
• CLI can continue talking to
same instance
Source: Recap from DockerCon US 2015

21. Demo
Source: Recap from DockerCon US 2015

22. “From Zero to Docker”
Source: Recap from DockerCon US 2015

23. Machine in a nutshell
• Host management for a container centric world
• Provisions Virtual Machines
• Installs & Manages Docker Engine
• Swarm Cluster Provisioning
Source: Recap from DockerCon US 2015

24. Machine Provisioning
5 Local Providers
9 Cloud Providers
7 Operating Systems
Source: Recap from DockerCon US 2015

25. Machine Management
• Install, Configure & Upgrade Docker Engine
- docker-machine upgrade node-{1,2,3}
• PKI Management
- TLS Encryption & Authentication by default
- CA generation, Key signing and Re-keying
- Seamless integration: Auto-configure the CLI
• Bring Your Own Machine - Generic Driver
Source: Recap from DockerCon US 2015

26. Machine Operations
• Operate
- List, Start, Stop and Kill machines
• Debug
- docker-machine ssh node-2
• Script
- docker-machine toolkit: ip, url, …
Source: Recap from DockerCon US 2015

27. Machine Clustering
• Integration with Docker Swarm
• Provision Swarm management nodes
• Pre-configure machines to join a Swarm cluster
• Tweak Swarm options
Source: Recap from DockerCon US 2015

28. Demo
Source: Recap from DockerCon US 2015

29. Thank you, Questions?
Andrea Luzzardi - @aluzzardi
Victor Vieux - @vieux
Source: Recap from DockerCon US 2015