1) The document discusses a presentation about Docker given by Quey-Liang Kao at SC14. It provides background on Kao and an overview of Docker's history and basic usage. 2) Details are given on setting up Docker environments for HPC and benchmarking Docker performance versus VMs using HPL. 3) Future work is discussed, including exploring GPU support in Docker and live migration capabilities.

1. Docker介紹& SC14
Speaker：高魁良
Date：2014/12/4
@新竹碼農

2. About Me
• Quey-Liang Kao
• Ph.D. Student
– SCOPE Lab, NTHU
– Advisor: Che-Rung Lee
• Research Interests
– Parallel Computing
– GPGPU

3. About This Project
• Experimental project with Dr. Chung and
Dr. Seelam in IBM Research
• Testing & benchmarking on HPC
clusters
• Since this July
• A poster at “Emerging Tech” session
of SC14
• Still ongoing

4. Outline
• Brief History of Docker
• Basic Docker Tutorial / Use Case
• HPC on Docker
• SC14 @ New Orleans, LA

5. Who
When
Why
HISTORY

6. Before March 2013
• A private project in dotCloud
– A PaaS company
– For internal use as an infrastructure

7. March 2013
• dotCloud released docker on github
• Written in Go
• 0.1.0

8. Sep 2013 [4]
• Merged into Openstack
• Partnership announced by Red Hat
• 0.6.3

9. Aug 2014
• Docker, Inc. sold dotCloud to
cloudControl [2]
– Another PaaS company
– “We want to concentrate on Docker”

10. Feb 2014
• Mac OS X support
• 0.8

11. Apr 2014
• Amazon provided the service of docker
containers [6]

12. Jun 2014
• DokcerCon @ San Francisco

13. Oct 2014
• Windows server, 7.1, and 8 support [5]
• I started to learn docker

14. Nov 2014
• Docker Global Hack Day #2
– Global Winner is in Taiwan! [8]
• 1.3

15. Why?
• As promising as java and git [1]
– “Write Once. Run Anywhere.”
– “Tiny footprint with lightning fast performance”
• Speed up deployment
• Eco system
– cloudControl, PaaS companies
– Red Hat, Microsoft, …
– Amazon
– etc.

16. What is Docker exactly? [12]
• Docker is a powerful tool to do with
containers and images
• What is container?
– Linux Container
– kernel feature: cgroup, namespace
– OS-level virtualization
• What is image?
– Which provides the content of file systems
for containers

17. Install & Run [7]
Manipulate Images [7]
Manipulate Containers [7]
TUTORIAL

18. Install
• From source: use docker to build docker
• From pre-built package [9]
– Depends on your linux distribution
– Mac, Windows are supported

19. Run
• Only one command: docker
– Both for daemon and CLI
• Daemon
– service docker start, or
– systemctl start docker
– common argument: -b=bridge0
• CLI

21. Manipulate Images
• docker images
– view images
• docker pull/push <image tag>
– pull/push images from docker hub
• docker search <keyword>
– search images matching keyword

22. Manipulate Images
• docker rmi <image tag>
– remove the image
– if there are containers using this image,
then this may not work
• docker rmi $(docker images -q --filter
"dangling=true")
– useful combo to eliminate zombie images

23. Images? Containers?
Active
(An Instance)
Static
(A Model)
Operating
System
Process Program
Docker
Infrastructure
Container Image

24. Manipulate Containers
• docker ps [|-a]
– check [alive|all] containers
• docker run -i -t <image> <exec>
– launch an instance of the image and run the
executable
– use ctrl-p ctrl-q to detach
– add -d argument to run in detach mode
• docker attach/detach <contID>
– as the command

25. Manipulate Containers
• docker top
– check running process
• docker start/stop <ContID>
– as the command
• docker rm <ContID>
– remove the container

26. Manipulate Containers:
git-style experience
• docker commit <contID> <Image>
– commit changed container to a new image
• docker diff <contID>
– comapre the changes of the container to
original image

27. Manipulate Containers:
java-style experience
• Dockerfile
– A text file that describes how to build an
image
– There have been many public Dockerfiles
• docker build -t <image>
<path/to/Dockerfile>
– build an image according to Dockerfile
– portable

28. Running sshd
USE CASE

29. Dockerfile for sshd

30. Environment Setup
Benchmark: HPL
HPC ON DOCKER

31. HPC on Cloud
• Cloud
– Isolation
– Resource control
– IaaS / Virtualization
• Containers
– OS-level Virtualization
– Light-weighted
– namespace
– cgroup

33. Motivation
• Examine the performance of container-based
cluster
• Experience the cost of deploying
containers (rather than VMs)
• Catch up with the trend

34. Environment Setup
• Native
– Four-node cluster, with 24 CPUs each
• VM
– Use qemu as the hardware simulator, and
accelerate with KVM kernel module
• Container
– Use docker

35. Benchmarks
• HPL(High Performance Linpack)
– LU decomp. For large matrix
– Benchmark for Top 500 SuperComputers
– Measured in G/T/PFLOPs

36. Benchmarks
• NPB(NAS Parallel Benchmark)
– Integer sort
– Embarrassingly parallel
– 3D Fourier transform
– etc.
• Network, I/O benchmarks
– not presented here

37. Conclusion
• Containers performs well for
computation-intensive apps
– since they are processes with namespaces
• We reproduce some of the experiment
results of an report from IBM [11]

38. Future Work
• IBM side
– Try their POWER-based
supercomputers/clusters
• My side
– GPU support? (Surveying)
– Migration? (Surveying)
– ?

39. Thank You !!
^~^

40. References
1. http://www.centurylinklabs.com/what-is-docker-
and-when-to-use-it/
2. http://techcrunch.com/2014/08/04/docke
r-sells-dotcloud-to-cloudcontrol-to-focus-
on-core-container-business/
3. Many Wikipedia pages, e.g. Docker, linux
containers, cgroups, namespace, etc.
4. http://www.slideshare.net/dotCloud/dock
er-resentation-meetupparis

41. References
5. http://azure.microsoft.com/blog/2014/10
/15/new-windows-server-containers-and-azure-
support-for-docker/
6. http://aws.amazon.com/cn/about-aws/
whats-new/2014/04/23/aws-elastic-beanstalk-
adds-docker-support/
7. All documents here:
http://docs.docker.com/
8. http://blog.docker.com/2014/11/announc
ing-docker-global-hack-day-2-winners/

42. References
9. https://docs.docker.com/installation/
10.http://www.nas.nasa.gov/publications/np
b.html
11.An Updated Performance Comparison of
Virtual Machines and Linux Containers
12.http://www.slideshare.net/adrianjotto/do
cker-101-38986794?qid=52aa9f3a-2dd1-
4b1f-811d-ff0b0f8cc20b&
v=qf1&b=&from_search=
6