Full Stack Docker CI for Stability and Scalability
IBM and Docker TechnologyIBM and Docker Technology
April 30th | Bangalore
Full stack docker CI for
stability and scalability
IBM Systems and Development Labs
A geographically distributed team working on container
technology with special focus on Power Platform.
End to end technology development right from the
firmware, Linux Kernel, Core Docker, Container Cluster
management using mesos, kubernetes etc.
Maintenance of Continuous Integration frameworks in
the community for IBM Platforms.
Platform enablement and platform feature
differentiation development for the community.
The shallow truth!
Running docker is more than just ensuring the docker daemon
Multiple software components are involved with varied
characteristics. Linux Kernel, toolchain, file systems
Changes in lower stack and impact on eventual scalibility
limits of a system not necessarily limited to docker.
How do we stay sane amongst all the chaos?
An overview of the complete technology stack involving
docker development and integration.
A brief look at various scalability/stability test
suites run via a continuous integration environment.
Innovation resulting from running scalability tests.
10k containers inside a BOX – Yes we aren't
ppc64le, x86 ppc64le, x86 HardwareHardware
ppc64le, x86_64ppc64le, x86_64 Architecture Dependent Kernel CodeArchitecture Dependent Kernel Code
System Call Interface
LTP syscall tests
Toolchain / User space Tools &Libs
golang tests,gcc,glibc tests
Integration tests/scalability tests/workload benchmarks
CI runs for full stack stability and scalability
Help identify and fix issues across the docker stack – kernel,
toolchain, docker, network etc.
Phases of doom – or the mother of invention?
Linux kernel limit
on number of ports
Increase ptys >4k
Kernel changes to
takes about 22
seconds to start
a new one
to increase ports
Go runtime limit
on number of
threads to 10,000
has 3 threads
This demo showcases the scalability/performance runs for multiple
blogbench and wordpress containers.
Test environment setup is made to scale upto 10K containers and
– Latest Docker master binary installed.
– Run container benchmark suite
– Periodically collect perf. Metrics and profiling data for
Docker at insane scale on IBM Power Systems https://goo.gl/ZIeAe9
IBM POWER8 with Docker: Delivers Superior Cloud Performance http://goo.gl/m0qwn0
Location of Docker Master Binary for various platforms https://master.dockerproject.org/
IBM and Docker https://www.docker.com/IBM
Setup Continuous Delivery for containers on IBM Bluemix https://goo.gl/PqKGLJ