Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker

•

2 likes•252 views

This document outlines Docker Cloud's capabilities for managing multiple Docker swarms. It discusses how Docker Cloud allows users to provision new swarms across different cloud providers quickly and consistently, securely access swarms, share access with other users, and manage swarms from desktop clients. The presentation covers Docker Cloud's overview, managing multiple swarms, swarm provisioning, swarm management and collaboration features, technical architecture, and future roadmap. It concludes with a reminder for users to provide feedback on Docker Cloud.

Technology

Fernando Mayo
Sr Engineering Manager,  
Docker
Marcus Martins
Sr Engineering Manager,  
Docker
Automation and Collaboration across
multiple Swarms using Docker Cloud

Agenda
1. Docker Cloud overview
2. Managing multiple swarms
3. Swarm provisioning
4. Swarm management and collaboration
5. Technical architecture
6. What’s next?
7. Q&A

Integrated tools and services for teams to
build, ship, and run Docker applications faster
Docker Cloud overview
Build Ship Run

Integrated tools and services for teams to
build, ship, and run Docker applications faster
Docker Cloud overview
Continuous
Integration (CI)
Hosted Docker
Registry
Swarm
Management
• Automated Builds
• Automated Tests
• Image Repository
• Security Scanning
• Swarm Provisioning
• Secure Access
beta

Managing multiple swarms
Provisioning: how do I deploy new swarms quickly and consistently?
?

Managing multiple swarms
Access: how do I securely discover and connect to my swarms?
?

Managing multiple swarms
Collaboration: how can I share access to my swarm with other users?
?

Docker for Cloud Providers
• Native to Docker on your cloud provider of choice
• Docker for AWS
• Docker for Azure
• Docker for GCP (in beta)
• Native integration with the provider platform
• Skip the boilerplate and maintenance work
• Minimal, Docker-focused Linux distribution

Swarm provisioning
Docker Cloud provisions Docker CE Editions
Docker CE
for AWS
Docker CE
for Azure
Docker CE
for GCP
• Coming soon • Coming soon
beta

Swarm management
Swarm discovery and secure connectivity
myuser/myswarm
swarmid.direct.docker.cloud
• All your swarms in one place
• Provides secure connectivity to swarm managers

Swarm management
Authentication and Authorization
myuser/myswarm
• Use your Docker Cloud account to authenticate
• Share swarm access with other users
myuser

Swarm management
Sharing access to swarms with your team using Docker Cloud
myorg/staging
myorg/production
developers
operators

Swarm management
Desktop to Cloud
• Easily connect to remote
swarms from Docker for
Mac/Windows
• Keep access to your local
files and credentials

Technical architecture
End-to-end
encryption
Authentication Authorization

Technical architecture
proxy
proxy
manager

• Docker for Azure and Docker for GCP support
• Ability to select different Docker versions:
• Docker CE Stable
• Docker CE Edge
• Docker EE Basic
Roadmap
• Docker Cloud Swarm UI

Don’t forget to vote!
cloud@docker.com
cloud.docker.com

Docker Engine 1.12 can be rightly called ” A Next Generation Docker Clustering & Distributed System”. Though Docker Engine 1.12 Final Release is around corner but the recent RC3 brings lots of improvements and exciting features. One of the major highlight of this release is Docker Swarm Mode which provides powerful yet optional ability to create coordinated groups of decentralized Docker Engines. Swarm Mode combines your engine in swarms of any scale. It’s self-organizing and self-healing. It enables infrastructure-agnostic topology.The newer version democratizes orchestration with out-of-box capabilities for multi-container on multi-host app deployments.

Building a Secure App with Docker - Ying Li and David Lawrence, Docker

Docker, Inc.

Built-in security is one of the most important features in Docker. But to build a secure app, you have to understand how to take advantage of these features. Security begins with the platform, but also requires conscious secure design at all stages of app development. In this session, we'll cover the latest features in Docker security, and how you can leverage them. You'll learn how to add them to your existing development pipeline, as well as how you can and streamline your workflow while making it more secure.

Docker serverless v1.0

Thomas Chacko

Networking Overview for Docker Platform

Aditya Patawari

Docker swarm-mike-goelzer-mv-meetup-45min-workshop 02242016 (1)

Michelle Antebi

Docker Online Meetup: Infrakit update and Q&A

Docker, Inc.

While working on Docker for AWS and Azure, we realized the need for a standard way to create and manage infrastructure state that was portable across any type of infrastructure, from different cloud providers to on-prem. One challenge is that each vendor has differentiated IP invested in how they handle certain aspects of their cloud infrastructure. It is not enough to just provision five servers; what IT ops teams need is a simple and consistent way to declare the number of servers, what size they should be, and what sort of base software configuration is required. And in the case of server failures (especially unplanned), that sudden change needs to be reconciled against the desired state to ensure that any required servers are re-provisioned with the necessary configuration. We started InfraKit to solves these problems and to provide the ability to create a self healing infrastructure for distributed systems.

Docker Swarm 45-min Workshop (Mountain View Docker Meetup 2/24/2016)

Mike Goelzer

Docker storage designing a platform for persistent data

Docker, Inc.

Docker containers have popularised the concept of read-only/immutable infrastructure and lead to changes in system and application architecture across the IT industry. However nearly every application generates some data that will need to persist long after the life-span of the container that generated it. This talk will look at the best practices around persistent storage with containers, from providing design advice around the construction of your application/container to the functionality provided from storage vendors through the Docker Volume driver plugins.

Since its first 1.12 release on July 2016, Docker Swarm Mode has matured enough as a clustering and scheduling tool for IT administrators and developers who can easily establish and manage a cluster of Docker nodes as a single virtual system. Swarm mode integrates the orchestration capabilities of Docker Swarm into Docker Engine itself and help administrators and developers with the ability to add or subtract container iterations as computing demands change. With sophisticated but easy to implement features like built-in Service Discovery, Routing Mesh, Secrets, declarative service model, scaling of the services, desired state reconciliation, scheduling, filters, multi-host networking model, Load-Balancing, rolling updates etc. Docker 17.06 is all set for production-ready product today. Join me webinar organised by Docker Izmir, to get familiar with the current Swarm Mode capabilities & functionalities across the heterogeneous environments.

Docker Security Overview

Sreenivas Makam

A Survey of Container Security in 2016: A Security Update on Container Platforms

Salman Baset

DockerCon EU 2015: Shipping Manifests, Bill of Lading and Docker Metadata and...

Docker, Inc.

Presented by Gareth Rushgrove, Sr. Software Engineer, Puppet Labs The shipping container metaphor for Docker points to many of the advantages of building and running software using containers. But what about other essential parts of the shipping container ecosystem like the shipping manifest and bill of lading? Many of the most powerful features of traditional package management tools like apt or yum are based on metadata associated with the packages. You can find out who created a package and when, check where a particular file came from, whether the package has a known vulnerability and more. What would this capability look like for Docker containers? This talk will look at the power of metadata for containers, in particular: * Docker provides labels for associating metadata with images and containers but how best to use them?* What problems can be solved by agreeing on standards for container metadata?* Exposing standard commands and endpoints to expose metadata about what is inside a container* Demo some open source toolings and also look at the sort of tools we might build atop those standards and low-level tools.

Devops in Networking

Sreenivas Makam

Docker Networking : 0 to 60mph slides

Docker, Inc.

Swarm docker bangalore_meetup

Arunan Rabindran

On-Demand Image Resizing from Part of the monolith to Containerized Microserv...

Docker, Inc.

In this talk I will cover our experience moving CNET, from an in-house monolith image resizing application, to a containerized open source micro-service. I will detail the planning and development phases of the micro-service, which utilizes Thumbor. I will also cover the testing, deployment and monitoring strategies used in the process. Running in Docker Swarm Mode and delivering millions of image requests a day, the service has greatly improved stability and reduced infrastructure needs by 80%.

Global Operations with Docker for the Enterprise - Nico Kabar, Docker

Docker, Inc.

Enterprises often have hundreds or even thousands of applications spread across hundreds of development teams, business units and geographies. This presents challenges to IT teams as they architect an environment to run Docker apps on globally distributed hybrid cloud infrastructure, developed by distributed dev teams and consumed by customers around the world. Docker Datacenter provides the technology and framework to implement a global software supply chain. This session will dig into the design considerations, tools and best practices to address this type of environment with Docker Datacenter. And there will be data, demos and tools! Results from various performance tests will be presented in conjunction with recommendations for high-availability configurations, content cache use cases for faster developer workflow and scheduling strategies for improving application resilience.

Libnetwork update at Moby summit June 2017

Docker, Inc.

Container Orchestration with Docker Swarm

Frederik Mogensen

The Golden Ticket: Docker and High Security Microservices by Aaron Grattafiori

Docker, Inc.

True microservices are more than simply bolting a REST interface on your legacy application, packing it in a Docker container and hoping for the best. Security is a key component when designing and building out any new architecture, and it must be considered from top to bottom. Umpa Lumpas might not be considered "real" microservices, but Willy Wonka still has them locked down tight! In this talk, Aaron will briefly touch on the idea and security benefits of microservices before diving into practical and real world examples of creating a secure microservices architecture. We'll start with designing and building high security Docker containers, using and examining the latest security features in Docker (such as User Namespaces and seccomp-bpf) as well as examine some typically forgotten security principals. Aaron will end on exploring related challenges and solutions in the areas of network security, secrets management and application hardening. Finally, while this talk is geared towards Microservices, it should prove informational for all Docker users, building a PaaS or otherwise.

virtualization-vs-containerization-paas

rajdeep

Docker Orchestration at Production Scale

Docker, Inc.

DockerCon EU 2015 Barcelona

Roman Dembitsky

Docker Introduction

Peng Xiao

What's hot

Troubleshooting Tips from a Docker Support Engineer

Jeff Anderson

Docker 1.9 Feature Overview

Sreenivas Makam

What’s New in Docker - Victor Vieux, Docker

Docker, Inc.

What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi

Mike Goelzer

Fluentd and docker monitoring

Vinay Krishna

Beginning mesos

Aditya Patawari

Deep Dive into Docker Swarm Mode

Ajeet Singh Raina

Docker Security Overview

Sreenivas Makam

A Survey of Container Security in 2016: A Security Update on Container Platforms

Salman Baset

DockerCon EU 2015: Shipping Manifests, Bill of Lading and Docker Metadata and...

Docker, Inc.

Devops in Networking

Sreenivas Makam

Docker Networking : 0 to 60mph slides

Docker, Inc.

Swarm docker bangalore_meetup

Arunan Rabindran

On-Demand Image Resizing from Part of the monolith to Containerized Microserv...

Docker, Inc.

Global Operations with Docker for the Enterprise - Nico Kabar, Docker

Docker, Inc.

Libnetwork update at Moby summit June 2017

Docker, Inc.

Container Orchestration with Docker Swarm

Frederik Mogensen

The Golden Ticket: Docker and High Security Microservices by Aaron Grattafiori

Docker, Inc.

virtualization-vs-containerization-paas

rajdeep

Docker Orchestration at Production Scale

Docker, Inc.

What's hot (20)

Troubleshooting Tips from a Docker Support Engineer

Docker 1.9 Feature Overview

What’s New in Docker - Victor Vieux, Docker

What's New in Docker 1.12 (June 20, 2016) by Mike Goelzer & Andrea Luzzardi

Fluentd and docker monitoring

Beginning mesos

Deep Dive into Docker Swarm Mode

Docker Security Overview

A Survey of Container Security in 2016: A Security Update on Container Platforms

DockerCon EU 2015: Shipping Manifests, Bill of Lading and Docker Metadata and...

Devops in Networking

Docker Networking : 0 to 60mph slides

Swarm docker bangalore_meetup

On-Demand Image Resizing from Part of the monolith to Containerized Microserv...

Global Operations with Docker for the Enterprise - Nico Kabar, Docker

Libnetwork update at Moby summit June 2017

Container Orchestration with Docker Swarm

The Golden Ticket: Docker and High Security Microservices by Aaron Grattafiori

virtualization-vs-containerization-paas

Docker Orchestration at Production Scale

Similar to Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker

DockerCon EU 2015 Barcelona

Roman Dembitsky

Docker Introduction

Peng Xiao

Container on azure

Vishwas N

Webinar : Docker in Production

Newt Global Consulting LLC

DCEU 18: Docker Container Security

Docker, Inc.

Yuvraj Mehta - Group Product Manager, Docker Steve Richards - Solutions Architect, Docker Creating a Secure Supply Chain for your applications is vitally important for a compliant and smooth-running application development organization. Every organization needs to understand where their container images come from, who has access to them, understand the security risks to weigh ALL options available before deploying . In this session, we will take a closer look at how Docker Enterprise helps developers, DevOps and DevSecOps teams securely Build and Ship applications through the software pipeline. We’ll dive into security features of the platform’s private registry Image Signing which provides authenticity for image sources and Image Scanning which provides insight into any vulnerabilities. We’ll also look at how this can be automated by policy and seamlessly integrated with your software pipeline to provide a succinct audit trail.

Use Docker to Deliver Cognitive Services Running Cross Platform and Multi Clo...

Docker, Inc.

Watson developer cloud delivers Watson Cognitive services as micro services on the cloud that are being used by many IBM Watson customers. The micro services were packaged in ova at the first release. There were some drawbacks in ova deployment in the cloud. We gradually switched to use docker. As a result, the service deployment time and start up time are significantly improved. It also greatly simplified our continuous delivery process since our services run on both Intel and Power platform and we have offerings on our public cloud, dedicated cloud as well as customers’ on premise cloud. With minimal deployment time and quick startup time, Docker makes our dynamic creation of service instance on the fly per customer request possible.

Docker and Microsoft - Windows Server 2016 Technical Deep Dive

Docker, Inc.

Docker slides

Jyotsna Raghuraman

Docker Dublin Meetup | 22 Feb 2018 | Docker + Kubernetes

Thomas Barlow

Introduction Docker and Kubernetes | Docker & Kubernetes Tutorial | Dot Net T...

Dot Net Tricks

Introduction to Docker | Docker and Kubernetes Training

Shailendra Chauhan

Devoxx 2016 - Docker Nuts and Bolts

Patrick Chanezon

Docker is the developer-friendly container technology that enables creation of your application stack: OS, JVM, app server, app, database and all your custom configuration. So you are a Java developer but how comfortable are you and your team taking Docker from development to production? Are you hearing developers say, “But it works on my machine!” when code breaks in production? And if you are, how many hours are then spent standing up an accurate test environment to research and fix the bug that caused the problem? This workshop/session explains how to package, deploy, and scale Java applications using Docker.

You, and Me, and Docker Makes Three

Christopher Grayson

Evénement Docker Paris: Anticipez les nouveaux business model et réduisez vos...

Docker, Inc.

Dockercon eu tour 2015 - Devoxx Casablanca

Michel Courtine

DockerPenang Meetup#1

Sujay Pillai

A curtain-raiser to the container world Docker & Kubernetes

zekeLabs Technologies

Agenda 1. The changing landscape of IT Infrastructure 2. Containers - An introduction 3. Container management systems 4. Kubernetes 5. Containers and DevOps 6. Future of Infrastructure Mgmt About the talk In this talk, you will get a review of the components & the benefits of Container technologies - Docker & Kubernetes. The talk focuses on making the solution platform-independent. It gives an insight into Docker and Kubernetes for consistent and reliable Deployment. We talk about how the containers fit and improve your DevOps ecosystem and how to get started with containerization. Learn new deployment approach to effectively use your infrastructure resources to minimize the overall cost.

Docker

Tomy Rhymond

Introduction to docker

Frederik Mogensen

SS Introduction to Docker

Stephane Woillez

Similar to Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker (20)

DockerCon EU 2015 Barcelona

Docker Introduction

Container on azure

Webinar : Docker in Production

DCEU 18: Docker Container Security

Use Docker to Deliver Cognitive Services Running Cross Platform and Multi Clo...

Docker and Microsoft - Windows Server 2016 Technical Deep Dive

Docker slides

Docker Dublin Meetup | 22 Feb 2018 | Docker + Kubernetes

Introduction Docker and Kubernetes | Docker & Kubernetes Tutorial | Dot Net T...

Introduction to Docker | Docker and Kubernetes Training

Devoxx 2016 - Docker Nuts and Bolts

You, and Me, and Docker Makes Three

Evénement Docker Paris: Anticipez les nouveaux business model et réduisez vos...

Dockercon eu tour 2015 - Devoxx Casablanca

DockerPenang Meetup#1

A curtain-raiser to the container world Docker & Kubernetes

Docker

Introduction to docker

SS Introduction to Docker

More from Docker, Inc.

Containerize Your Game Server for the Best Multiplayer Experience

Docker, Inc.

Raymond Arifianto, AccelByte and Mark Mandel, Google - We have been deploying containerized micro-services for our Game Backend Services for a while. Now we are tackling the challenge to scale up fleets of game dedicated servers in multiple regions, multiple data centers and multiple providers - some in bare metal, some in Cloud. So we leverage docker containerization to deploy Game Servers to achieve Portability, Fast Deployment and Predictability, enabling us to scale up to thousands of servers, on demand, without a sweat.

How to Improve Your Image Builds Using Advance Docker Build

Docker, Inc.

Nicholas Dille, Haufe-Lexware + Docker Captain - Docker continues to be the standard tool for building container images. For more than a year Docker ships with BuildKit as an alternative image builder, providing advanced features for secret and cache management. These features help to make image builds faster and more secure. In this session, Docker Captain Nicholas Dille will teach you how to use Buildkit features to your advantage.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Lukonde Mwila, Entelect - As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

Securing Your Containerized Applications with NGINX

Docker, Inc.

Kevin Jones, NGNIX - NGINX is one of the most popular images on Docker Hub and has been at the forefront of the web since the early 2000's. In this talk we will discuss how and why NGINX's lightweight and powerful architecture makes it a very popular choice for securing containerized applications as a sidecar reverse proxy within containers. We will highlight important aspects of application security that NGINX can help with, such as TLS, HTTP, AuthN, AuthZ and traffic control.

How To Build and Run Node Apps with Docker and Compose

Docker, Inc.

Kathleen Juell, Digital Ocean - Containers are an essential part of today's microservice ecosystem, as they allow developers and operators to maintain standards of reliability and reproducibility in fast-paced deployment scenarios. And while there are best practices that extend across stacks in containerized environments, there are also things that make each stack distinct, starting with the application image itself. This talk will dive into some of these particularities, both at the image and service level, while also covering general best practices for building and running Node applications with database backends using Docker and Compose.

Hands-on Helm

Docker, Inc.

Distributed Deep Learning with Docker at Salesforce

Docker, Inc.

Jeff Hajewski, Salesforce - There is a wealth of information on building deep learning models with PyTorch or TensorFlow. Anyone interested in building a deep learning model is only a quick search away from a number of clear and well written tutorials that will take them from zero knowledge to having a working image classifier. But what happens when you need to deploy these models in a production setting? At Salesforce, we use TensorFlow models to help us provide customers with insights into their data, and we do this as close to real-time as possible. Designing these systems in a scalable manner requires overcoming a number of design challenges, but the core component is Docker. Docker enables us to design highly scalable systems by allowing us to focus on service interactions, rather than how our services will interact with the hardware. Docker is also at the core of our test infrastructure, allowing developers and data scientists to build and test the system in an end to end manner on their local machines. While some of this may sound complex, the core message is simplicity - Docker allows us to focus on the aspects of the system that matter, greatly simplifying our lives.

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Docker, Inc.

James Fuller, webcomposite s.r.o. - Curl is the venerable (yet very modern) 'swiss army knife' command line tool and library for transferring data with URLs. Recently we (the Curl team) decided to build a release for Docker Hub. This talk will outline our current development workflow with respect to the docker image and provide insights on what it takes to build a docker image for mass public consumption. We are also keen to learn from users and other developers how we might improve and enhance the official curl docker image.

Monitoring in a Microservices World

Docker, Inc.

Fabian Stäber, Instana - In recent years, we saw a great paradigm shift in software engineering away from static monolithic applications towards dynamic distributed horizontally scalable architectures. Docker is one of the key technologies enabling this development. This shift poses a lot of new challenges for application monitoring, ranging from practical issues (need for automation) to technical challenges (Docker networking) to organizational topics (blurring line between software engineers and operations) to fundamental questions (define what is an application). In this talk we show how Docker changed the way we do monitoring, how modern application monitoring systems work, and what future developments we expect.

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Docker, Inc.

Clemente Biondo, Engineering Ingegneria Informatica - When the COVID 19 pandemic started, Engineering Ingegneria Informatica Group (1.25 billion euros of revenues, 65 offices around the world, 12.000 employees) was forced to put their digital transformation to the test in order to maintain operational continuity. In this session, Clemente Biondo, the Tech Lead of the Information Systems Department, will share how his company is reacting to this unforeseeable scenario and how Docker-driven digital transformation had paved the path for work to continue remotely. Clemente will discuss learnings moving from colocated teams, manual approaches, email based-business processes, and a monolithic application to a mature DevOps culture characterized by a distributed autonomous workforce and a continuous deployment process that deploys backward-compatible Docker containerized microservices into hybrid multi cloud datacenters an average of twice a day with zero-downtime. He will detail how they use Docker to unify dev, test and production environments, and as an efficient and automated mechanism for deploying applications. Lastly, Clemente shares how, in our darkest hour, he and others are working to shine their brightest light.

Predicting Space Weather with Docker

Docker, Inc.

Chris Lauer, NOAA Space Weather Prediction Center - This is the story of how adopting a containerized workflow changed the way our small software team works at NOAA’s Space Weather Prediction Center. Our old architecture, a big ball of mud shared-database integration, just wasn’t cutting it - it was killing our agility. Over the past two years, our small team has adopted a microservice style architecture, using Docker with docker-compose and environment files as our deployment strategy for all new development. We’ve discovered the joys of using containers for identical dev, staging, and production environments. We work closely with scientists: much of the code we’re running has complicated and conflicting library dependencies. Docker captures these beautifully - we’ve even had some success teaching our scientists to use it! I’ll share what we’ve learned, some of the persistent challenges we face, and one place we really got it wrong. This talk builds off of a popular hallway track from DockerCon 2019.

Become a Docker Power User With Microsoft Visual Studio Code

Docker, Inc.

Brian Christner, 56k + Docker Captain - In this session, we will unlock the full potential of using Microsoft Visual Studio Code (VS Code) and Docker Desktop to turn you into a Docker Power User. When we expand and utilize the VS Code Docker plugin, we can take our projects and Docker skills to the next level. In addition to using VS Code, we streamline our Docker Desktop development workflow with less context switching and built-in shortcuts. You will learn how to bootstrap new projects, quickly write Dockerfiles utilizing templates, build, run, and interact with containers all from VS Code.

How to Use Mirroring and Caching to Optimize your Container Registry

Docker, Inc.

Monolithic to Microservices + Docker = SDLC on Steroids!

Docker, Inc.

Ashish Sharma, SS&C Eze - SS&C Eze provides various products in the stock market domain. We spent the last couple of years building Eclipse which is an investment suite born in cloud. The journey so far has been very interesting. The very first version of the product were a bunch of monolithic windows services and deployed using Octopus tool. We successfully managed to bring all the monolithic problem to the cloud and created a nightmare for ourselves. We then started applying microservices architecture principles and started breaking the monolithic into small services. Very soon we realized that we need a better packaging/deployment tool. Docker looked like a magical solution to our problem. Since its adoption, It has not only solved the deployment problem for us but has made a deep impact on different aspects of SDLC. It allowed us to use heterogeneous technology stacks, simplified development environment setup, simplified our testing strategy, improved our speed of delivery, and made our developers more productive. In this talk I would like to share our experience of using Docker and its positive impact on our SDLC.

Kubernetes at Datadog Scale

Docker, Inc.

Ara Pulido, Datadog - Container technologies, although not new, have increased their popularity in the past few years, with container orchestrators allowing companies around the world to adopt these technologies to help them ship and scale microservices with precision and velocity. Kubernetes is currently the most popular container orchestration platform, and while many organizations are migrating their workloads to it, Kubernetes is still relatively immature. New corner cases, errors, and quirks are regularly discovered as users push the boundaries of size and scale. When Datadog adopted Kubernetes we discovered some of these boundaries the hard way, and we continuously challenge and modify our infrastructure decisions in order to fit our use case. Join me in this talk for our story on what we learned while we scaled our Kubernetes clusters, the contributions to Kubernetes we made along the way, and how you can apply those learnings when growing your Kubernetes clusters from a handful to hundreds or thousands of nodes.

Labels, Labels, Labels

Docker, Inc.

Andy Clemenko, StackRox - One underutilized, and amazing, thing about the docker image scheme is labels. Labels are a built in way to document all aspects about the image itself. Think about all the information that the tags inside your clothing carry. If you care to look you can find out everything about the garment. All that information can be very valuable. Now think about how we can leverage labels to carry similar information. We can even use the labels to contain Docker Compose or even Kubernetes Yaml. We can even include labels into the CI/CD process making things more secure and smoother. Come find out some fun techniques on how to leverage labels to do some fun and amazing things.

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Docker, Inc.

Patrick Deloulay, Micro Focus - Micro Focus started their digital transformation 3 years ago, moving the entire portfolio into hundreds of container images. Leveraging Docker Hub as our primary registry service, we will cover how we ended up building a simple but secure push/pull model to publish and deliver our premium assets to our customers and partners to both meet the high agility of our DevOps teams while greatly simplifying the deployment of our applications.

Build & Deploy Multi-Container Applications to AWS

Docker, Inc.

Lukonde Mwila, Entelect As the cloud-native approach to development and deployment becomes more prevalent, it's an exciting time for software engineers to be equipped on how to dockerize multi-container applications and deploy them to the cloud. In this talk, Lukonde Mwila, Software Engineer at Entelect, will cover the following topics: - Docker Compose - Containerizing an Nginx Server - Containerizing an React App - Containerizing an Node.JS App - Containerizing anMongoDB App - Runing Multi-Container App Locally - Creating a CI/CD Pipeline - Adding a build stage to test containers and push images to Docker Hub - Deploying Multi-Container App to AWS Elastic Beanstalk Lukonde will start by giving an overview of how Docker Compose works and how it makes it very easy and straightforward to startup multiple Docker containers at the same time and automatically connect them together with some form of networking. After that, Lukonde will take a hands on approach to containerize an Nginx server, a React app, a NodeJS app and a MongoDB instance to demonstrate the power of Docker Compose. He'll demonstrate usage of two Docker files for an application, one production grade and the other for local development and running of tests. Lastly, he'll demonstrate creating a CI/CD pipeline in AWS to build and test our Docker images before pushing them to Docker Hub or AWS ECR, and finally deploying our multi-container application AWS Elastic Beanstalk.

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Docker, Inc.

Elton Stoneman, Docker Captain + Container Consultant and Trainer How do you provide a SaaS offering when your product is a 10-year old Fortran app, currently built to run on Windows 10? With Docker and Kubernetes of course - and you can do it in a week (... to prototype level at least). In this session I'll walk through the processes and practicalities of taking an older Windows app, making it run in containers with Kubernetes, and then building a simple API wrapper to host the whole stack as a cloud-based SaaS product. There's a lot of technology here from a real world case study, and I'll focus on: - running Windows apps in Docker containers - building a .NET Core API which can run in Linux or Windows containers - running the stack in Kubernetes with Docker Desktop locally and AKS in the cloud - configuring AKS workloads in Azure to burst out to Azure Container Instances And there's a core theme to this session: Docker and Kubernetes are complex technologies, but they're the key to modern development. If you invest time learning them, they make projects like this simple, portable, fast and fun.

Developing with Docker for the Arm Architecture

Docker, Inc.

This virtual meetup introduces the concepts and best practices of using Docker containers for software development for the Arm architecture across a variety of hardware systems. Using Docker Desktop on Windows or Mac, Amazon Web Services (AWS) A1 instances, and embedded Linux, we will demonstrate the latest Docker features to build, share, and run multi-architecture images with transparent support for Arm.

More from Docker, Inc. (20)

Containerize Your Game Server for the Best Multiplayer Experience

How to Improve Your Image Builds Using Advance Docker Build

Build & Deploy Multi-Container Applications to AWS

Securing Your Containerized Applications with NGINX

How To Build and Run Node Apps with Docker and Compose

Hands-on Helm

Distributed Deep Learning with Docker at Salesforce

The First 10M Pulls: Building The Official Curl Image for Docker Hub

Monitoring in a Microservices World

COVID-19 in Italy: How Docker is Helping the Biggest Italian IT Company Conti...

Predicting Space Weather with Docker

Become a Docker Power User With Microsoft Visual Studio Code

How to Use Mirroring and Caching to Optimize your Container Registry

Monolithic to Microservices + Docker = SDLC on Steroids!

Kubernetes at Datadog Scale

Labels, Labels, Labels

Using Docker Hub at Scale to Support Micro Focus' Delivery and Deployment Model

Build & Deploy Multi-Container Applications to AWS

From Fortran on the Desktop to Kubernetes in the Cloud: A Windows Migration S...

Developing with Docker for the Arm Architecture

Recently uploaded

How world-class product teams are winning in the AI era by CEO and Founder, P...

Product School

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Thierry Lestable

Bits & Pixels using AI for Good.........

Alison B. Lowndes

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

Elevating Tactical DDD Patterns Through Object Calisthenics

Dorra BARTAGUIZ

After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Paul Groth

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

DevOps and Testing slides at DASA Connect

Kari Kakkonen

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

Recently uploaded (20)

How world-class product teams are winning in the AI era by CEO and Founder, P...

Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...

Bits & Pixels using AI for Good.........

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

Elevating Tactical DDD Patterns Through Object Calisthenics

To Graph or Not to Graph Knowledge Graph Architectures and LLMs

Assuring Contact Center Experiences for Your Customers With ThousandEyes

Essentials of Automations: Optimizing FME Workflows with Parameters

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

DevOps and Testing slides at DASA Connect

Leading Change strategies and insights for effective change management pdf 1.pdf

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

JMeter webinar - integration with InfluxDB and Grafana

Securing your Kubernetes cluster_ a step-by-step guide to success !

PCI PIN Basics Webinar from the Controlcase Team

UiPath Test Automation using UiPath Test Suite series, part 3

Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker

1. Fernando Mayo Sr Engineering Manager,   Docker Marcus Martins Sr Engineering Manager,   Docker Automation and Collaboration across multiple Swarms using Docker Cloud

2. Agenda 1. Docker Cloud overview 2. Managing multiple swarms 3. Swarm provisioning 4. Swarm management and collaboration 5. Technical architecture 6. What’s next? 7. Q&A

3. Docker Cloud overview

4. Integrated tools and services for teams to build, ship, and run Docker applications faster Docker Cloud overview Build Ship Run

5. Integrated tools and services for teams to build, ship, and run Docker applications faster Docker Cloud overview Continuous Integration (CI) Hosted Docker Registry Swarm Management • Automated Builds • Automated Tests • Image Repository • Security Scanning • Swarm Provisioning • Secure Access beta

6. Managing multiple swarms

7. Managing multiple swarms Provisioning: how do I deploy new swarms quickly and consistently? ?

8. Managing multiple swarms Access: how do I securely discover and connect to my swarms? ?

9. Managing multiple swarms Collaboration: how can I share access to my swarm with other users? ?

10. Swarm provisioning

11. Docker for Cloud Providers • Native to Docker on your cloud provider of choice • Docker for AWS • Docker for Azure • Docker for GCP (in beta) • Native integration with the provider platform • Skip the boilerplate and maintenance work • Minimal, Docker-focused Linux distribution

12. Swarm provisioning Docker Cloud provisions Docker CE Editions Docker CE for AWS Docker CE for Azure Docker CE for GCP • Coming soon • Coming soon beta

13. Demo

14. Swarm management

15. Swarm management Swarm discovery and secure connectivity myuser/myswarm swarmid.direct.docker.cloud • All your swarms in one place • Provides secure connectivity to swarm managers

16. Swarm management Authentication and Authorization myuser/myswarm • Use your Docker Cloud account to authenticate • Share swarm access with other users myuser

17. Swarm management Sharing access to swarms with your team using Docker Cloud myorg/staging myorg/production developers operators

18. Swarm management Desktop to Cloud • Easily connect to remote swarms from Docker for Mac/Windows • Keep access to your local files and credentials

19. Demo

20. Technical architecture

21. Technical architecture End-to-end encryption Authentication Authorization

22. Technical architecture proxy proxy manager

23. What’s next?

24. • Docker for Azure and Docker for GCP support • Ability to select different Docker versions: • Docker CE Stable • Docker CE Edge • Docker EE Basic Roadmap • Docker Cloud Swarm UI

25. preview

26. Don’t forget to vote! cloud@docker.com cloud.docker.com

Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker

Similar to Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker (20)

More from Docker, Inc.

More from Docker, Inc. (20)

Recently uploaded

Recently uploaded (20)

Automation and Collaboration Across Multiple Swarms Using Docker Cloud - Marcus Martins and Fernando Mayo, Docker