DockerCon EU 2015: The Latest in Docker Engine

•

1 like•6,449 views

This document summarizes the latest developments in Docker Engine. It discusses the activity and releases since the previous DockerCon, highlights of the new Docker Engine 1.9.0 release including improvements to networking and volume management, and outlines the future plans including additional platform support, security enhancements, and continued decoupling of Engine components. It also includes a demonstration of Linux namespaces and how containers leverage them to provide isolation.

Technology

The latest in Docker Engine
Jessie Frazelle
Software Engineer, Docker
Arnaud Porterie
Senior Engineering Manager, Docker

The past
What happened since last DockerCon?

Engine recent history
3
Activity since last DockerCon
2,162 pull requests 
 
 
… from 438 contributors 
… we closed 420 😕 (sorry!) 
… we merged 1,615 😇 (80%)

(+) 311,780 lines of code added 
(-) 163,350 lines of code removed
Engine recent history
4
Activity since last DockerCon

Engine recent history
5
Releases since last DockerCon
2015-06-16 - Docker Engine 1.7 
ZFS support 
Experimental plugins 
Experimental multihost networking 
2015-06-22 - Open Container Initiative 
Runtime (libcontainer) donated to the Linux Foundation 
2015-08-11 - Docker Engine 1.8 
Docker Content Trust 
Docker daemon subcommand 
Many, many, many bugfixes

Docker Engine 1.9.0
7
Builder improvements
Build time arguments 
New ARG Dockerfile instruction 
Builtin support for HTTP_PROXY at build 
Custom stop signal 
New STOPSIGNAL Dockerfile instruction 
Configure which signal should terminate the entrypoint

Docker Engine 1.9.0
8
Networking
Multihost networking is out of experimental 
Out of the box overlay networking 
New docker network command 
Manage networks as a top-level object 
Extensibility through plugins 
Already 6 implementations done or under development

Docker Engine 1.9.0
9
Volume management
New docker volume command 
Manage volumes as a top-level object 
Extensibility through plugins 
Already several implementations (e.g., Flocker) 
See github.com/calavera/dkvolume for Go bootstrapping

Docker Engine 1.9.0
10
Experimental: user namespaces
GID/UID remap 
Root in the container != root on the host 
Key feature for multi-tenancy 
Doesn’t come without drawbacks! 
Storage dir is scoped by gid/uid 
No more --net=container or --net=host

The future
What’s next for Docker Engine?

What’s next?
12
Distribution rework
Motivations 
Ease maintenance 
Fix long running structural issues 
New manifest format 
Enable multi-architecture images (“fat manifests”) 
Few user visible changes 
Layers != image 
Images identified by sha256sum(manifest)

What’s next?
13
More platforms
Official ARM support 
Currently being worked on (thanks Hypriot!) 
Windows Server 2016 
Tech preview 3 was released in August 2015 
IBM Power Systems, IBM z Systems, Solaris, …

What’s next?
14
Security
Default Docker Content Trust 
Released in 1.8.0, currently opt-in 
Seccomp 
Syscall filtering 
Stable user namespaces 
Help us by testing in experimental 
API authorization / authentication 
Current working on a proposal from Twistlock

What’s next?
15
Split, split, split!
Ongoing effort to decouple pieces of the Engine 
Motivations 
Ease maintenance 
Get more dedication to subsystems (e.g., builder) 
Options! (e.g., remove/wrap pieces, drop privileges, …)
Split runtime 
RunC, standalone containers supervision 
Split builder 
Allow to build client-side

What’s next?
16
Converge, converge, converge!
Studying convergence of Swarm and Engine 
Motivations 
Lot of technical overlap 
Engine as a degenerated single-node cluster 
First hints in 1.9.0 
Engine node discovery (--cluster-advertise)

Demo
18
Linux namespaces
N
etw
ork
M
ount
PID
IPC
U
ser
U
TS

Demo
19
Linux namespaces
M
ount
PID
IPC
U
ser
U
TS
M
ount
PIDIPC
U
ser
U
TS
App Wireshark
Host
N
et
N
et
/tmp/.X11-unix/

Demo
20
Linux namespaces
M
ount
PID
IPC
U
ser
U
TS
Wireshark
N
et
M
ount
PID
IPC
U
ser
U
TS
N
et
App
M
ount
PID
IPC
U
ser
U
TS
VNC
N
et
/tmp/.X11-unix/
listen *:5901

Thank you!
@frazelledazzell 
princess@docker.com
Arnaud Porterie
@icecrime 
arnaud@docker.com
Jessie Frazelle

Agenda
The future
What’s next?
The demo!
The past
Numbers
Last releases
The present
Docker 1.9.0

What's hot

At Docker, we like to “eat our own dog food” or “drink our own champagne.” Whatever your favorite phrase, the importance of a software company using their own software is critical to relating to our customers. In this talk, we will discuss how the Docker Infrastructure and engineering teams have deployed and operationalized Docker Enterprise Edition (EE) for our staging and production environments, what we have learned in the process, and how it's making Docker EE better.

Docker on Docker

Docker, Inc.

Presentation by Michael Neale, co-founder, CloudBees In this presentation I will show how you can use and abuse namespaces to do things that you might not think were possible in docker. In doing this I will show how you can create a volume bind mount in a running container, and use "super privileged" containers to control other containers on the same machine. There are many uses for this, but at it also demystifies what some of the namespaces in linux are, and how they work (hint: everything is files, its unix!).

DockerCon EU 2015: Persistent, stateful services with docker cluster, namespa...

Docker, Inc.

Share the continuity of Société Générale's journey with Docker Enterprise from different points of view, from executives to devops, with CD platform as an enabler. Creating a Dockerfile that runs a container on a developer's laptop is pretty straightforward. But extending that to stacks of containers running on a dozen environments (development, integration, testing, staging, production, etc.) with different configuration and topologies can be a challenge. This talk will cover aspects of our journey to Docker Enterprise: What configuration should go in an image? Where to put different types of configuration? Images, environment variables, entrypoint, ...? How to store assets for building images and configuration for deployment in version control. We will discuss how Société Générale has implemented these, and what we plan next for Docker Enterprise deployment.

Configuration Management and Transforming Legacy Applications in the Enterpri...

Docker, Inc.

Docker leverages capabilities in Linux like namespaces and cgroups to enable containers and then builds tooling on top to enable users to build distributed apps. A common question is "What about Docker support for Windows?" In this session the Windows engineering leads will dive deep into the primitives within Windows to enable an awesome Docker experience on Windows. This session will also include a live demo of Docker and Windows Server.

Windows Server and Docker - The Internals Behind Bringing Docker and Containe...

Docker, Inc.

Tony Lee & Nelson Wang, Splunk Modern microservice-oriented software architectures evangelize the principles of infrastructure-as-code and declarative directives to manage and run applications. At Splunk, we wanted to marry these ideals with the majestic monolith, Splunk Enterprise, to simplify the use of our product through containerization. Without rearchitecting the entire product from the ground-up, which can be a costly investment, we focused on incorporating a flexible configuration management layer on top of the core application. This has enabled us to make running Splunk in Docker act and behave as a true microservice, greatly reducing the friction of migrating towards more container-native software. We not only concentrated on making our open-source Docker image initiative user-friendly and production-ready, but we also wanted to seamlessly integrate it back into our internal engineering process. Join us for this session as we discuss migrating a traditional application into a microservice ecosystem, developing a containerization strategy for both external customer usage and internal development, as well as learning about our internal container platform at scale.

DCSF19 CMD and Conquer: Containerizing the Monolith

Docker, Inc.

Presented by Sebastien Goasguen, VP, Apache CloudStack and Mathieu Buffenoir, co-founder, SBEX Bity is an internet money gateway built by Swiss Bitcoin Exchange ( SBEX ). To trade bitcoin the entire infrastructure of Bity is running in Docker containers. All the components of the infrastructure are using Docker, from the frontend applications and load balancer, the Django based backend, replicated Postgres database, Bitcoin daemon and remittance engine. All software goes through a CI pipeline that starts with Docker images being built on private repositories in Docker hub. Developers take also advantage of a docker-compose definition that allows them to run the entire infrastructure on a single laptop. Finally the production deployments happen thanks to the Ansible Docker module on a CloudStack based public cloud. Everything has been automated to ease re-deployment and operations. This presentation will go through every component and how Docker has enabled us to go production in 4 months.

DockerCon EU 2015: Trading Bitcoin with Docker

Docker, Inc.

Dockerfiles are great. They provide a zero-barrier-to-entry format for describing a single Docker image which is immediately clear to anyone reading them. But with that simplicity comes problems that become apparent as your adoption of Docker gathers pace. * Dockerfiles can inherit from other docker images, but images are not Dockerfiles * Dockerfile provides no built-in mechanism for creating abstractions, so as usage grows identical or similar instructions can be duplicated across many files * The Docker APi exposes a build endpoint, but the API is very course, taking Dockerfile as the transport rather than exposing the individual instructions * Dockerfiles are just that, files. So they can come from anywhere The one layer per line in a Dockerfile limitation can lead to an explosion of layers, which fail to take advantage of the promised space and performance benefits.

The Dockerfile Explosion and the Need for Higher Level Tools by Gareth Rushgrove

Docker, Inc.

DockerCon EU 2015: Day 1 General Session

Docker, Inc.

Porting Docker for Windows is no small feat. The technology behind Docker today takes advantage of Linux capabilities like namespaces and cgroups. For native containers to exist on Windows and to have a Docker Engine for Windows, first similar primitives needed to be developed into the Windows operating system. In this session we will explain these Windows primitives in relation to similar primitives in Linux and other architectural changes on the OS and Engine side to make containerization possible. The process of porting includes not only the technology but also open source community interactions and cultural changes to enable this development. And of course there will be a cool demo…

Windows Server Containers- How we hot here and architecture deep dive

Docker, Inc.

Docker Security Deep Dive by Ying Li and David Lawrence

Docker, Inc.

Docker Datacenter Overview and Production Setup Slides

Docker, Inc.

Core team member and release captain Victor Vieux will introduce us to what's new in Docker 1.13. Victor will first give an overview and demo some of the new features below: • Restructuration of CLI commands • Experimental build • CLI backward compatibility • Swarm default encryption at rest • Compose to Swarm • Data management commands • Brand new “init system” • Various orchestration enhancements

Online Meetup: What's new in docker 1.13.0

Docker, Inc.

Presented by Udo Seidel, Chief Architect and Digital Evangelist, Amadeus In the recent past there were quite some discussions about security in the context of introducing or using Docker. It is true that there are some gaps to be closed but the whole story does not start from square one either. At Amadeus we are using Docker to build our future-oriented services and to introduce devops culture. Due to the nature of our business we have to deal with Security certifications like PCI-DSS, SSAE 16 and ISO 27001. This talks described the challenges we were facing in that context and how we mastered them. The story has technical and non-technical aspects.

DockerCon EU 2015: Docker and PCI-DSS - Lessons learned in a security sensiti...

Docker, Inc.

DevOps in the Real World is far from perfect, yet we all dream of that amazing auto-healing fully-automated CI/CD micro-service infrastructure that we'll have "someday." But until then, how can you really start using containers today, and what decisions do you need to make to get there? This session is designed for practitioners who are looking for ways to get started now with Docker and Swarm in production. This is not a Docker 101, but rather it's to help you be successful on your way to Dockerizing your production systems. Attendees will get tactics, example configs, real working infrastructure designs, and see the (sometimes messy) internals of Docker in production today.

Taking Docker to Production: What You Need to Know and Decide

Docker, Inc.

The whole Docker ecosystem exists today because of every single developer who found ways of using Docker to improve how they build software; whether streamlining production deployments, speeding up continuous integration systems or standing up an application on your laptop to hack on. In this talk we want to take a step back and look at where Docker sits today from the software developers point of view - and then jump ahead and talk about where it might go in the future. In this talk, we’ll discuss: * Making Docker an everyday part of the developing software on the desktop, with Docker for Windows and Docker for Mac * Docker Compose, and the future of describing applications as code * How Docker provides the best tools for developing applications destined to run on any Kubernetes cluster This session should be of interest to anyone who writes software; from people who want to hack on a few personal projects, to polyglot open source programmers and to professional developers working in tightly controlled environments. Everyone deserves a better developer experience.

Docker for developers on mac and windows

Docker, Inc.

Docker 101 Checonf 2016

Patrick Chanezon

DockerCon EU 2015: Speed Up Deployment: Building a Distributed Docker Registr...

Docker, Inc.

Jean Rouge & David Yu, Docker Kubernetes has taken the technology industry by storm these last few years. It delivers powerful orchestration and container management capabilities that have been leveraged by cloud-scale companies and small startups alike. But for many organizations, the learning curve for Kubernetes can be steep and organizations can't build up their skills fast enough. Luckily Docker has always had a history of making the complex easy - first with Linux containers and now with Kubernetes - both in our Desktop and Enterprise platform. In this session, we'll highlight some of the innovation Docker has added to Kubernetes to simplify configuration and ongoing operations while still providing a fully conformant Kubernetes environment. We'll cover areas like deploying applications on Kubernetes, managing access controls and multi-tenancy, end-to-end security and improved troubleshooting. Demos will highlight key comparisons to show you that you don't have to build it yourself.

DCSF19 How Docker Simplifies Kubernetes for the Masses

Docker, Inc.

At DockerCon 2017 we introduced LinuxKit: A toolkit for building secure, lean and portable Linux subsystems. In this Online Meetup, we'll provide an introduction and some hands on examples on how to use LinuxKit. Speaker Biography: Rolf Neugebauer is a Member of the Technical Staff at Docker. He is one of the LinuxKit developers and previously worked on Docker for Mac and Windows. Rolf tweets at @neugebar

Online Meetup: Intro to LinuxKit

Docker, Inc.

Docker on docker leveraging kubernetes in docker ee

Docker, Inc.

What's hot (20)

Docker on Docker

DockerCon EU 2015: Persistent, stateful services with docker cluster, namespa...

Configuration Management and Transforming Legacy Applications in the Enterpri...

Windows Server and Docker - The Internals Behind Bringing Docker and Containe...

DCSF19 CMD and Conquer: Containerizing the Monolith

DockerCon EU 2015: Trading Bitcoin with Docker

The Dockerfile Explosion and the Need for Higher Level Tools by Gareth Rushgrove

DockerCon EU 2015: Day 1 General Session

Windows Server Containers- How we hot here and architecture deep dive

Docker Security Deep Dive by Ying Li and David Lawrence

Docker Datacenter Overview and Production Setup Slides

Online Meetup: What's new in docker 1.13.0

DockerCon EU 2015: Docker and PCI-DSS - Lessons learned in a security sensiti...

Taking Docker to Production: What You Need to Know and Decide

Docker for developers on mac and windows

Docker 101 Checonf 2016

DockerCon EU 2015: Speed Up Deployment: Building a Distributed Docker Registr...

DCSF19 How Docker Simplifies Kubernetes for the Masses

Online Meetup: Intro to LinuxKit

Docker on docker leveraging kubernetes in docker ee

Viewers also liked

DockerCon EU 2015: Deploying and Managing Containers for Developers

Docker, Inc.

DockerCon EU 2015: Official Repos and Project Nautilus

Docker, Inc.

DockerCon EU 2015: Docker Universal Control Plane (Gordon's Special Session)

Docker, Inc.

DockerCon EU 2015: What's New with Docker Trusted Registry

Docker, Inc.

Standalone Spark Deployment for Stability and Performance

Romi Kuntsman

O'Reilly Velocity Europe

Rekha Joshi

Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit

Rekha Joshi

CRM at capital one

Joshpin Bala.B

In my previous years’ talks at DevOps Enterprise Summit, I spoke about starting and scaling of DevOps at Capital One; importance of Open Source, Open Technology and Innovations in DevOps. This year, I will present Capital One’s journey of maturing in DevOps and Continuous Delivery. My presentation will cover our current areas of focus: Delivery Pipeline, Flow and Measurements. I will also share some of the problems we faced and what we did to solve them.

DOES SFO 2016 - Topo Pal - DevOps at Capital One

Gene Kim

Beautiful Monitoring With Grafana and InfluxDB

leesjensen

Capital One began moving to AWS just two years ago. Every day, the amount of traffic we serve from the cloud continues to grow. With development teams having the freedom to choose their own technology stacks, many teams have quickly started moving applications to Docker. In this session, learn how Capital One uses a combination of the Elastic Load Balancing service along with Application Load Balancer features to increase deployment speed and reliability.

AWS re:Invent 2016: From EC2 to ECS: How Capital One uses Application Load Ba...

Amazon Web Services

Docker 1.11 @ Docker SF Meetup

Docker, Inc.

DockerCon14 Performance Characteristics of Traditional VMs vs. Docker Containers

Docker, Inc.

New Relic went all-in with Docker very early, and has continued to stay on the forefront of the container ecosystem, both as a user of the technology and as a monitoring and analytics vendor. Today, a variety of teams utilize Docker in a variety of ways using a mix of home-grown and external OSS frameworks. The Container Fabric team is working on our next generation container platform utilizing Mesos/Marathon and a variety of other OSS tools, like Heka. We will briefly review our setup, and then discuss how we gather data that we care about from the ecosystem and inject it into the various tools we rely on for visibility and analytics. We love the functionality of what we’ve built, and we believe that you will find it useful too.

Monitoring Containers at New Relic by Sean Kane

Docker, Inc.

Building a Smarter Application Stack

Docker, Inc.

Docker, Innovation Accelerator

Docker, Inc.

DockerCon SF 2015: Maintaining the Official Node.js Docker Image

Docker, Inc.

Docker at Spotify

Docker, Inc.

Mobycraft:Docker in 8-bit (Meetup at Docker HQ 4/7)

Docker, Inc.

DockerCon14 Keynote

Docker, Inc.

Viewers also liked (20)

DockerCon EU 2015: Deploying and Managing Containers for Developers

DockerCon EU 2015: Official Repos and Project Nautilus

DockerCon EU 2015: Docker Universal Control Plane (Gordon's Special Session)

DockerCon EU 2015: What's New with Docker Trusted Registry

Standalone Spark Deployment for Stability and Performance

O'Reilly Velocity Europe

Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit

CRM at capital one

DOES SFO 2016 - Topo Pal - DevOps at Capital One

Beautiful Monitoring With Grafana and InfluxDB

AWS re:Invent 2016: From EC2 to ECS: How Capital One uses Application Load Ba...

Docker 1.11 @ Docker SF Meetup

DockerCon14 Performance Characteristics of Traditional VMs vs. Docker Containers

Monitoring Containers at New Relic by Sean Kane

Building a Smarter Application Stack

Docker, Innovation Accelerator

DockerCon SF 2015: Maintaining the Official Node.js Docker Image

Docker at Spotify

Mobycraft:Docker in 8-bit (Meetup at Docker HQ 4/7)

DockerCon14 Keynote

Similar to DockerCon EU 2015: The Latest in Docker Engine

DockerCon EU 2015 - The Latest on Docker Engine

Arnaud Porterie

Docker Ecosystem on Azure

Patrick Chanezon

Neues aus dem Docker-Universum

Nicholas Dille

Igalia Focus and Goals 2020 (2019 WebKit Contributors Meeting)

Igalia

Accelerate your development with Docker

Andrey Hristov

Accelerate your software development with Docker

Andrey Hristov

Detailed Introduction To Docker

nklmish

Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more. In this demo, I will show how to build a Apache image from a Dockerfile and deploy a PHP application which is present in an external folder using custom configuration files.

Docker - Demo on PHP Application deployment

Arun prasath

Demystifying Docker101

Ajeet Singh Raina

Demystifying Docker

Cloud Native Bangalore

Docker moves very fast, with an edge channel released every month and a stable release every 3 months. Patrick will talk about how Docker introduced Docker EE and a certification program for containers and plugins with Docker CE and EE 17.03 (from March), the announcements from DockerCon (April), and the many new features planned for Docker CE 17.05 in May. This talk will be about what's new in Docker and what's next on the roadmap

Weave User Group Talk - DockerCon 2017 Recap

Patrick Chanezon

Dockercon2015_paypal

ahunnargikar

DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.

Docker and Cloud - Enables for DevOps - by ACA-IT

Stijn Wijndaele

Sprekers: Stijn Van den Enden & Stijn Wijndaele (ACA IT-Solutions) DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe. In deze avondconferentie werd, na een korte toelichting over DevOps, nagegaan wat Docker en de Cloud kunnen betekenen voor uw business, en hoe zij als enablers kunnen dienen voor het tot stand brengen van een DevOps-cultuur. Het container-landschap waarvan tools zoals Kubernetes, Docker Swarm, ...een belangrijk onderdeel vormen, wordt toegelicht en er wordt ingegaan op de wijze waarop deze tools aangewend kunnen worden om 'development' en 'operations' efficiënt te laten samenwerken.

'DOCKER' & CLOUD: ENABLERS For DEVOPS

ACA IT-Solutions

Introduction to Docker

Nissan Dookeran

Cont0519

Samuel Dratwa

Docker 101

Kevin Nord

What's New in Docker - February 2017

Patrick Chanezon

Building specialized container-based systems with Moby: a few use cases This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios. We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary. Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.

Moby Open Source Summit North America 2017

Patrick Chanezon

Kubernetes is designed to be an extensible system. But what is the vision for Kubernetes Extensibility? Do you know the difference between webhooks and cloud providers, or between CRI, CSI, and CNI? In this talk we will explore what extension points exist, how they have evolved, and how to use them to make the system do new and interesting things. We’ll give our vision for how they will probably evolve in the future, and talk about the sorts of things we expect the broader Kubernetes ecosystem to build with them.

Kubernetes extensibility

Docker, Inc.

Similar to DockerCon EU 2015: The Latest in Docker Engine (20)

DockerCon EU 2015 - The Latest on Docker Engine

Docker Ecosystem on Azure

Neues aus dem Docker-Universum

Igalia Focus and Goals 2020 (2019 WebKit Contributors Meeting)

Accelerate your development with Docker

Accelerate your software development with Docker

Detailed Introduction To Docker

Docker - Demo on PHP Application deployment

Demystifying Docker101

Demystifying Docker

Weave User Group Talk - DockerCon 2017 Recap

Dockercon2015_paypal

Docker and Cloud - Enables for DevOps - by ACA-IT

'DOCKER' & CLOUD: ENABLERS For DEVOPS

Introduction to Docker

Cont0519

Docker 101

What's New in Docker - February 2017

Moby Open Source Summit North America 2017

Kubernetes extensibility

More from Docker, Inc.

Raymond Arifianto, AccelByte and Mark Mandel, Google - We have been deploying containerized micro-services for our Game Backend Services for a while. Now we are tackling the challenge to scale up fleets of game dedicated servers in multiple regions, multiple data centers and multiple providers - some in bare metal, some in Cloud. So we leverage docker containerization to deploy Game Servers to achieve Portability, Fast Deployment and Predictability, enabling us to scale up to thousands of servers, on demand, without a sweat.

Containerize Your Game Server for the Best Multiplayer Experience

Docker, Inc.

Nicholas Dille, Haufe-Lexware + Docker Captain - Docker continues to be the standard tool for building container images. For more than a year Docker ships with BuildKit as an alternative image builder, providing advanced features for secret and cache management. These features help to make image builds faster and more secure. In this session, Docker Captain Nicholas Dille will teach you how to use Buildkit features to your advantage.

How to Improve Your Image Builds Using Advance Docker Build

Docker, Inc.

Lukonde Mwila, Entelect - As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Kevin Jones, NGNIX - NGINX is one of the most popular images on Docker Hub and has been at the forefront of the web since the early 2000's. In this talk we will discuss how and why NGINX's lightweight and powerful architecture makes it a very popular choice for securing containerized applications as a sidecar reverse proxy within containers. We will highlight important aspects of application security that NGINX can help with, such as TLS, HTTP, AuthN, AuthZ and traffic control.

Securing Your Containerized Applications with NGINX

Docker, Inc.

Kathleen Juell, Digital Ocean - Containers are an essential part of today's microservice ecosystem, as they allow developers and operators to maintain standards of reliability and reproducibility in fast-paced deployment scenarios. And while there are best practices that extend across stacks in containerized environments, there are also things that make each stack distinct, starting with the application image itself. This talk will dive into some of these particularities, both at the image and service level, while also covering general best practices for building and running Node applications with database backends using Docker and Compose.

How To Build and Run Node Apps with Docker and Compose

Docker, Inc.

Hands-on Helm

Docker, Inc.

Jeff Hajewski, Salesforce - There is a wealth of information on building deep learning models with PyTorch or TensorFlow. Anyone interested in building a deep learning model is only a quick search away from a number of clear and well written tutorials that will take them from zero knowledge to having a working image classifier. But what happens when you need to deploy these models in a production setting? At Salesforce, we use TensorFlow models to help us provide customers with insights into their data, and we do this as close to real-time as possible. Designing these systems in a scalable manner requires overcoming a number of design challenges, but the core component is Docker. Docker enables us to design highly scalable systems by allowing us to focus on service interactions, rather than how our services will interact with the hardware. Docker is also at the core of our test infrastructure, allowing developers and data scientists to build and test the system in an end to end manner on their local machines. While some of this may sound complex, the core message is simplicity - Docker allows us to focus on the aspects of the system that matter, greatly simplifying our lives.

Distributed Deep Learning with Docker at Salesforce

Docker, Inc.

James Fuller, webcomposite s.r.o. - Curl is the venerable (yet very modern) 'swiss army knife' command line tool and library for transferring data with URLs. Recently we (the Curl team) decided to build a release for Docker Hub. This talk will outline our current development workflow with respect to the docker image and provide insights on what it takes to build a docker image for mass public consumption. We are also keen to learn from users and other developers how we might improve and enhance the official curl docker image.

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Docker, Inc.

Fabian Stäber, Instana - In recent years, we saw a great paradigm shift in software engineering away from static monolithic applications towards dynamic distributed horizontally scalable architectures. Docker is one of the key technologies enabling this development. This shift poses a lot of new challenges for application monitoring, ranging from practical issues (need for automation) to technical challenges (Docker networking) to organizational topics (blurring line between software engineers and operations) to fundamental questions (define what is an application). In this talk we show how Docker changed the way we do monitoring, how modern application monitoring systems work, and what future developments we expect.

Monitoring in a Microservices World

Docker, Inc.

Clemente Biondo, Engineering Ingegneria Informatica - When the COVID 19 pandemic started, Engineering Ingegneria Informatica Group (1.25 billion euros of revenues, 65 offices around the world, 12.000 employees) was forced to put their digital transformation to the test in order to maintain operational continuity. In this session, Clemente Biondo, the Tech Lead of the Information Systems Department, will share how his company is reacting to this unforeseeable scenario and how Docker-driven digital transformation had paved the path for work to continue remotely. Clemente will discuss learnings moving from colocated teams, manual approaches, email based-business processes, and a monolithic application to a mature DevOps culture characterized by a distributed autonomous workforce and a continuous deployment process that deploys backward-compatible Docker containerized microservices into hybrid multi cloud datacenters an average of twice a day with zero-downtime. He will detail how they use Docker to unify dev, test and production environments, and as an efficient and automated mechanism for deploying applications. Lastly, Clemente shares how, in our darkest hour, he and others are working to shine their brightest light.

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Docker, Inc.

Chris Lauer, NOAA Space Weather Prediction Center - This is the story of how adopting a containerized workflow changed the way our small software team works at NOAA’s Space Weather Prediction Center. Our old architecture, a big ball of mud shared-database integration, just wasn’t cutting it - it was killing our agility. Over the past two years, our small team has adopted a microservice style architecture, using Docker with docker-compose and environment files as our deployment strategy for all new development. We’ve discovered the joys of using containers for identical dev, staging, and production environments. We work closely with scientists: much of the code we’re running has complicated and conflicting library dependencies. Docker captures these beautifully - we’ve even had some success teaching our scientists to use it! I’ll share what we’ve learned, some of the persistent challenges we face, and one place we really got it wrong. This talk builds off of a popular hallway track from DockerCon 2019.

Predicting Space Weather with Docker

Docker, Inc.

Brian Christner, 56k + Docker Captain - In this session, we will unlock the full potential of using Microsoft Visual Studio Code (VS Code) and Docker Desktop to turn you into a Docker Power User. When we expand and utilize the VS Code Docker plugin, we can take our projects and Docker skills to the next level. In addition to using VS Code, we streamline our Docker Desktop development workflow with less context switching and built-in shortcuts. You will learn how to bootstrap new projects, quickly write Dockerfiles utilizing templates, build, run, and interact with containers all from VS Code.

Become a Docker Power User With Microsoft Visual Studio Code

Docker, Inc.

How to Use Mirroring and Caching to Optimize your Container Registry

Docker, Inc.

Ashish Sharma, SS&C Eze - SS&C Eze provides various products in the stock market domain. We spent the last couple of years building Eclipse which is an investment suite born in cloud. The journey so far has been very interesting. The very first version of the product were a bunch of monolithic windows services and deployed using Octopus tool. We successfully managed to bring all the monolithic problem to the cloud and created a nightmare for ourselves. We then started applying microservices architecture principles and started breaking the monolithic into small services. Very soon we realized that we need a better packaging/deployment tool. Docker looked like a magical solution to our problem. Since its adoption, It has not only solved the deployment problem for us but has made a deep impact on different aspects of SDLC. It allowed us to use heterogeneous technology stacks, simplified development environment setup, simplified our testing strategy, improved our speed of delivery, and made our developers more productive. In this talk I would like to share our experience of using Docker and its positive impact on our SDLC.

Monolithic to Microservices + Docker = SDLC on Steroids!

Docker, Inc.

Ara Pulido, Datadog - Container technologies, although not new, have increased their popularity in the past few years, with container orchestrators allowing companies around the world to adopt these technologies to help them ship and scale microservices with precision and velocity. Kubernetes is currently the most popular container orchestration platform, and while many organizations are migrating their workloads to it, Kubernetes is still relatively immature. New corner cases, errors, and quirks are regularly discovered as users push the boundaries of size and scale. When Datadog adopted Kubernetes we discovered some of these boundaries the hard way, and we continuously challenge and modify our infrastructure decisions in order to fit our use case. Join me in this talk for our story on what we learned while we scaled our Kubernetes clusters, the contributions to Kubernetes we made along the way, and how you can apply those learnings when growing your Kubernetes clusters from a handful to hundreds or thousands of nodes.

Kubernetes at Datadog Scale

Docker, Inc.

Andy Clemenko, StackRox - One underutilized, and amazing, thing about the docker image scheme is labels. Labels are a built in way to document all aspects about the image itself. Think about all the information that the tags inside your clothing carry. If you care to look you can find out everything about the garment. All that information can be very valuable. Now think about how we can leverage labels to carry similar information. We can even use the labels to contain Docker Compose or even Kubernetes Yaml. We can even include labels into the CI/CD process making things more secure and smoother. Come find out some fun techniques on how to leverage labels to do some fun and amazing things.

Labels, Labels, Labels

Docker, Inc.

Patrick Deloulay, Micro Focus - Micro Focus started their digital transformation 3 years ago, moving the entire portfolio into hundreds of container images. Leveraging Docker Hub as our primary registry service, we will cover how we ended up building a simple but secure push/pull model to publish and deliver our premium assets to our customers and partners to both meet the high agility of our DevOps teams while greatly simplifying the deployment of our applications.

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Docker, Inc.

Lukonde Mwila, Entelect As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Elton Stoneman, Docker Captain + Container Consultant and Trainer How do you provide a SaaS offering when your product is a 10-year old Fortran app, currently built to run on Windows 10? With Docker and Kubernetes of course - and you can do it in a week (... to prototype level at least). In this session I'll walk through the processes and practicalities of taking an older Windows app, making it run in containers with Kubernetes, and then building a simple API wrapper to host the whole stack as a cloud-based SaaS product. There's a lot of technology here from a real world case study, and I'll focus on: - running Windows apps in Docker containers - building a .NET Core API which can run in Linux or Windows containers - running the stack in Kubernetes with Docker Desktop locally and AKS in the cloud - configuring AKS workloads in Azure to burst out to Azure Container Instances And there's a core theme to this session: Docker and Kubernetes are complex technologies, but they're the key to modern development. If you invest time learning them, they make projects like this simple, portable, fast and fun.

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Docker, Inc.

This virtual meetup introduces the concepts and best practices of using Docker containers for software development for the Arm architecture across a variety of hardware systems. Using Docker Desktop on Windows or Mac, Amazon Web Services (AWS) A1 instances, and embedded Linux, we will demonstrate the latest Docker features to build, share, and run multi-architecture images with transparent support for Arm.

Developing with Docker for the Arm Architecture

Docker, Inc.

More from Docker, Inc. (20)

Containerize Your Game Server for the Best Multiplayer Experience

How to Improve Your Image Builds Using Advance Docker Build

Build & Deploy Multi-Container Applications to AWS

Securing Your Containerized Applications with NGINX

How To Build and Run Node Apps with Docker and Compose

Hands-on Helm

Distributed Deep Learning with Docker at Salesforce

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Monitoring in a Microservices World

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Predicting Space Weather with Docker

Become a Docker Power User With Microsoft Visual Studio Code

How to Use Mirroring and Caching to Optimize your Container Registry

Monolithic to Microservices + Docker = SDLC on Steroids!

Kubernetes at Datadog Scale

Labels, Labels, Labels

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Build & Deploy Multi-Container Applications to AWS

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Developing with Docker for the Arm Architecture

Recently uploaded

WebAssembly is Key to Better LLM Performance

Samy Fodil

WebRTC and SIP not just audio and video @ OpenSIPS 2024

Lorenzo Miniero

Webinar Recording: https://www.panagenda.com/webinars/alles-neu-macht-der-mai-wir-durchleuchten-den-verbesserten-notes-eigenschaftendialog/ Haben Sie sich schon einmal über den zu kleinen Eigenschaftendialog in Notes geärgert? Mussten Sie einen Agenten oder eine Aktion erstellen, um schnell mal ein Feld zu ändern? Haben Sie jedes mal endlos nach dem zu vergleichenden Feld gesucht, nachdem Sie ein neues Dokument ausgewählt haben? Wollten Sie das verdammte Ding einfach nur größer machen? Zum Glück gibt es dafür eine Lösung – und sie ist wahrscheinlich bereits installiert! Mit dem kostenlosen panagenda Document Properties (Pro) erhalten Sie den Eigenschaftendialog, den Sie schon immer haben wollten. Größer, anpassbar, und im Volltext durchsuchbar. Sehen Sie mehrere Dokumente gleichzeitig oder vergleichen Sie mit einem Diff-Viewer. Ändern Sie beliebige Felder und haben Sie endlich eine einfache Möglichkeit, Profildokumente für alle Benutzer zu verwalten. Entdecken Sie mit HCL Ambassador Marc Thomas, wie Document Properties Ihre Arbeit vereinfachen und Sie bei der täglichen Verwendung von Domino-Anwendungen unterstützen kann – im Client oder im Designer. Sie werden es nicht bereuen! Für Sie in diesem Webinar - Was Document Properties ist, welche Editionen es gibt und wo es in Notes und Domino Designer zu finden ist - Wie Sie nach einem beliebigen Feld suchen und es bearbeiten, Dokumente vergleichen oder alle Daten per CSV exportieren können - Suchen, Bearbeiten und auch Löschen von Profildokumenten - Welche Konfigurationseinstellungen verfügbar sind, um Funktionen anzupassen - Wie Ihre Endbenutzer davon profitieren - Sehen Sie alles in einer Live-Demo

Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...

panagenda

Working together SRE & Platform Engineering

Marcus Vechiato

Google I/O Extended 2024 Warsaw

GDSC PJATK

Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx

MasterG

Join me in this session where I'll share our journey of building a fully serverless application that flawlessly managed check-ins for an event with a staggering 80 thousand registrations. We'll dive into three key strategies that made this possible. Firstly, by harnessing DynamoDB global tables, we ensured global service availability and data replication across regions, boosting performance and disaster recovery. Next, we'll explore how we seamlessly integrated real-time updates into the app using Appsync subscriptions, making the experience dynamic and engaging for users. Finally, I'll discuss how provisioned concurrency not only improved performance but also kept costs in check, highlighting the cost-effectiveness of serverless architectures. Through these strategies and the inherent scalability of serverless technology, our application effortlessly handled massive user loads without manual intervention. This session is a real world example to the power and efficiency of modern cloud-based solutions in enabling seamless scalability and robust performance with Serverless

How we scaled to 80K users by doing nothing!.pdf

Srushith Repakula

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...

marcuskenyatta275

Generative AI refers to a class of machine learning algorithms that are designed to generate new data samples that are similar to those in the training data. Unlike traditional AI models that are trained to recognize patterns and make predictions, generative AI models have the ability to create entirely new data based on the patterns they have learned. This is achieved through techniques such as generative adversarial networks (GANs), variational autoencoders (VAEs), and transformer architectures, among others.

Generative AI Use Cases and Applications.pdf

alexjohnson7307

Introduction to FIDO Authentication and Passkeys.pptx

FIDO Alliance

AI mind or machine power point presentation

yogeshlabana357357

JohnPollard-hybrid-app-RailsConf2024.pptx

JohnPollard37

Event-Driven Architecture Masterclass: Challenges in Stream Processing

ScyllaDB

How to Check CNIC Information Online with Pakdata cf

danishmna97

الأمن السيبراني - ما لا يسع للمستخدم جهله

Mohamed Sweelam

Design and Development of a Provenance Capture Platform for Data Science

Paolo Missier

Discover the top CodeIgniter development companies that can elevate your project to new heights. Our blog explores the best firms known for their expertise in CodeIgniter framework development. From robust web applications to scalable solutions, these companies deliver excellence. Whether you're a startup or an enterprise, find the perfect match for your development needs on Top CSS Gallery's blog.

Top 10 CodeIgniter Development Companies

TopCSSGallery

At Skynet Technologies, our team of accessibility experts performs automated, semi-automated, and manual audits of websites and web applications as per WCAG 2.2 level AA, ADA, and section 508. Based on evaluations of the accessibility compliance level of the website’s UI, design, source code, navigation, interactive elements, and overall usability, we will provide a digital accessibility evaluation report with in-depth details of potential accessibility barriers and remediation recommendations. Get a manual website WCAG audit (2.0, 2.1, 2.2 level AA) for a small website: 10 pages: $2,500 within 7 business days 30 pages: $7,500 within 14 business days 50 pages: $12,500 within 28 business days For medium websites: 100 pages: $25,000 within 70 business days For larger websites or audits of all pages, please reach out hello@skynettechnologies.com.

Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...

Skynet Technologies

Portal Kombat : extension du réseau de propagande russe

中央社

Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf

AnubhavMangla3

Recently uploaded (20)

WebAssembly is Key to Better LLM Performance

WebRTC and SIP not just audio and video @ OpenSIPS 2024

Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...

Working together SRE & Platform Engineering

Google I/O Extended 2024 Warsaw

Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx

How we scaled to 80K users by doing nothing!.pdf

TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...

Generative AI Use Cases and Applications.pdf

Introduction to FIDO Authentication and Passkeys.pptx

AI mind or machine power point presentation

JohnPollard-hybrid-app-RailsConf2024.pptx

Event-Driven Architecture Masterclass: Challenges in Stream Processing

How to Check CNIC Information Online with Pakdata cf

الأمن السيبراني - ما لا يسع للمستخدم جهله

Design and Development of a Provenance Capture Platform for Data Science

Top 10 CodeIgniter Development Companies

Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...

Portal Kombat : extension du réseau de propagande russe

Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf

DockerCon EU 2015: The Latest in Docker Engine

1. The latest in Docker Engine Jessie Frazelle Software Engineer, Docker Arnaud Porterie Senior Engineering Manager, Docker

2. The past What happened since last DockerCon?

3. Engine recent history 3 Activity since last DockerCon 2,162 pull requests      … from 438 contributors  … we closed 420 😕 (sorry!)  … we merged 1,615 😇 (80%)

4. (+) 311,780 lines of code added  (-) 163,350 lines of code removed Engine recent history 4 Activity since last DockerCon

5. Engine recent history 5 Releases since last DockerCon 2015-06-16 - Docker Engine 1.7  ZFS support  Experimental plugins  Experimental multihost networking  2015-06-22 - Open Container Initiative  Runtime (libcontainer) donated to the Linux Foundation  2015-08-11 - Docker Engine 1.8  Docker Content Trust  Docker daemon subcommand  Many, many, many bugfixes

6. The present Docker Engine 1.9.0

7. Docker Engine 1.9.0 7 Builder improvements Build time arguments  New ARG Dockerfile instruction  Builtin support for HTTP_PROXY at build  Custom stop signal  New STOPSIGNAL Dockerfile instruction  Configure which signal should terminate the entrypoint

8. Docker Engine 1.9.0 8 Networking Multihost networking is out of experimental  Out of the box overlay networking  New docker network command  Manage networks as a top-level object  Extensibility through plugins  Already 6 implementations done or under development

9. Docker Engine 1.9.0 9 Volume management New docker volume command  Manage volumes as a top-level object  Extensibility through plugins  Already several implementations (e.g., Flocker)  See github.com/calavera/dkvolume for Go bootstrapping

10. Docker Engine 1.9.0 10 Experimental: user namespaces GID/UID remap  Root in the container != root on the host  Key feature for multi-tenancy  Doesn’t come without drawbacks!  Storage dir is scoped by gid/uid  No more --net=container or --net=host

11. The future What’s next for Docker Engine?

12. What’s next? 12 Distribution rework Motivations  Ease maintenance  Fix long running structural issues  New manifest format  Enable multi-architecture images (“fat manifests”)  Few user visible changes  Layers != image  Images identified by sha256sum(manifest)

13. What’s next? 13 More platforms Official ARM support  Currently being worked on (thanks Hypriot!)  Windows Server 2016  Tech preview 3 was released in August 2015  IBM Power Systems, IBM z Systems, Solaris, …  

14. What’s next? 14 Security Default Docker Content Trust  Released in 1.8.0, currently opt-in  Seccomp  Syscall filtering  Stable user namespaces  Help us by testing in experimental  API authorization / authentication  Current working on a proposal from Twistlock

15. What’s next? 15 Split, split, split! Ongoing effort to decouple pieces of the Engine  Motivations  Ease maintenance  Get more dedication to subsystems (e.g., builder)  Options! (e.g., remove/wrap pieces, drop privileges, …) Split runtime  RunC, standalone containers supervision  Split builder  Allow to build client-side

16. What’s next? 16 Converge, converge, converge! Studying convergence of Swarm and Engine  Motivations  Lot of technical overlap  Engine as a degenerated single-node cluster  First hints in 1.9.0  Engine node discovery (--cluster-advertise)

17. Demo Containers are not lightweight VMs

18. Demo 18 Linux namespaces N etw ork M ount PID IPC U ser U TS

19. Demo 19 Linux namespaces M ount PID IPC U ser U TS M ount PIDIPC U ser U TS App Wireshark Host N et N et /tmp/.X11-unix/

20. Demo 20 Linux namespaces M ount PID IPC U ser U TS Wireshark N et M ount PID IPC U ser U TS N et App M ount PID IPC U ser U TS VNC N et /tmp/.X11-unix/ listen *:5901

21. Thank you! @frazelledazzell  princess@docker.com Arnaud Porterie @icecrime  arnaud@docker.com Jessie Frazelle

22. 22

23. Agenda The future What’s next? The demo! The past Numbers Last releases The present Docker 1.9.0