This document provides an introduction to Docker and the need for orchestration tools when deploying multi-container applications. It discusses how Docker solves the problem of portability for software artifacts and defines key Docker concepts like images, containers, and registries. It also introduces orchestration tools like Docker Compose and Docker Swarm that automate deployment of interdependent services across clusters. The document argues for guidelines on Docker use at organizations to address questions around containerization strategies and orchestration platforms.
Efficient Parallel Testing with Docker by Laura FrankDocker, Inc.
Fast and efficient software testing is easy with Docker. We often
use containers to maintain parity across development, testing, and production environments, but we can also use containerization to significantly reduce time needed for testing by spinning up multiple instances of fully isolated testing environments and executing tests in parallel. This strategy also helps you maximize the utilization of infrastructure resources. The enhanced toolset provided by Docker makes this process simple and unobtrusive, and you’ll see how Docker Engine, Registry, Machine, and Compose can work together to make your tests fast.
DockerCon EU 2015: Continuous Integration with Jenkins, Docker and ComposeDocker, Inc.
Presented by Sandro Cirulli, Platform Tech Lead, Oxford University Press
Oxford University Press (OUP) recently started the Oxford Global Languages (OGL) initiative (http://www.oxforddictionaries.com/words/oxfordlanguages) which aims at providing language resources for digitally under represented languages. In August 2015 OUP launched two African languages websites for Zulu (http://zu.oxforddictionaries.com) and Northern Sotho (http://nso.oxforddictionaries.com). The backend of these websites is based on an API retrieving data in RDF from a triple store and delivering data to the frontend in JSON-LD.
The entire micro-service infrastructure for development, staging, and production runs on Docker containers in Amazon EC2 instances. In particular, we use Jenkins to rebuild the Docker image for the API based on a Python Flask application and Docker Compose to orchestrate the containers. A typical CI workflow is as follows:
- a developer commits code to the codebase
- Jenkins triggers a job to run unit tests
- if the unit tests are successful, the Docker image of the Python Flask application is rebuilt and the container is restarted via Docker Compose
- if the unit tests or the Docker build failed, the monitor view shows the Jenkins jobs in red and displays the name of the possible culprit who broke the build.
A demo of this CI workflow is available at http://www.sandrocirulli.net/continuous-integration-with-jenkins-docker-and-compose
DCSF 19 Building Your Development Pipeline Docker, Inc.
Oliver Pomeroy, Docker & Laura Tacho, Cloudbees
Enterprises often want to provide automation and standardisation on top of their container platform, using a pipeline to build and deploy their containerized applications. However this opens up new challenges; Do I have to build a new CI/CD Stack? Can I build my CI/CD pipeline with Kubernetes orchestration? What should my build agents look like? How do I integrate my pipeline into my enterprise container registry? In this session full of examples and how-to's, Olly and Laura will guide you through common situations and decisions related to your pipelines. We'll cover building minimal images, scanning and signing images, and give examples on how to enforce compliance standards and best practices across your teams.
Basic Idea
Develop a build system that leverages Docker for implementing continuous integration/deployment(CI/CD) pipeline. A git commit must kick off packaging a Docker Image and provisioning it in a VM.
A git based commit should be used for starting of a build for a docker image which would then be run and provisioned in a Virtual Machine. After every commit a series of test cases is then run on the code to ensure the correctness of the code. After all the test-cases pass, the image gets updated on docker-hub registry, and a VM gets provisioned which can then run the software directly (after pulling the image from the docker-hub).
This entire process ensures that the most recent and updated version of the code is available to the person who is using the software and this speeds up the overall process by at least 2-3 folds.
Continuous delivery is a powerful concept, but hard to achieve. One of the challenges is automating the setup of environments and the deployment of the Java EE applications. We have looked at and used quite some tools like for instance Chef, Puppet, Vagrant and Nolio. All tools had one thing in common: we had never used them. Why should we invest time in mastering those tools? There is a perfect alternative in Jenkins, a tool most developers are familiar with. Besides the basic Jenkins buildserver capabilities it offers quite some useful plugins like the Build Pipeline plugin. To setup environments the popular Docker project is used. Docker allows you to create containers from any application. Only some knowledge is required for the setup of the containers. The rest of the configuration is done through commands most people are quite familiar with.
Containerizing Hardware Accelerated ApplicationsDocker, Inc.
Many applications allow you to use hardware such as GPUs and FPGAs for acceleration. Common examples include media processing and offloading highly parallel work to a GPU. Applications that use accelerators are resource heavy and have stacks spanning kernel and user space; accelerators often have their own requirements for operating system support and kernel versions. While it may not seem intuitive to containerize this type of application, the use of containers provides benefits such as reduced setup time from container reuse, reduction in dependency conflicts and dependency on a specific operating system, and easier updates.
In this session I show a media processing stack, making use of containers alongside a GPU. Specifically, I explain the kernel and user space divide of a hardware-accelerated transcode application using a device exposed to the container. This specific stack is an interesting case because of its dependency on hardware, use of a custom kernel and libraries, and operating system requirements. Our investigations have shown the use of containers has minimal performance overhead compared to running natively. Furthermore, we can quickly deploy on other machines with reduced configuration effort. There are some aspects of the application not suited to containerization, however. Since the application relies on a custom kernel, the use of containers does not necessarily increase portability. Improvement in this area would require rethinking how the applications are developed and distributed. Other areas of innovation include things such as Docker plugins to check for compatibility between the container software and host kernel.
DockerCon EU 2015: Placing a container on a train at 200mphDocker, Inc.
Presented by Casper S. Jensen, Software Engineer, Uber
At Uber, we've been introducing Docker to give service owners more control over their environments. However, everything at Uber is moving very fast so we have had to do it a way such that Docker fitted into the existing infrastructure and services could be migrated seamlessly to Docker without any service interruptions. In this talk we will talk about the challenges we faced while doing this, such as handling both non-Docker and Docker builds, image replication, integration with our deployment systems and other challenges when deploying Docker at scale.
In this talk, we will discuss the construction of a CI/CD pipeline consisting of Docker Engine, GitHub, Jenkins, Docker Registry and calm.io. The pipeline will be kicked off by a commit to a GitHub repository. The commit will cause Jenkins to run a build job and, upon successful completion of that job, push a Docker image up to Docker Registry. Once the new docker image is made available, Jenkins will trigger calm.io to deploy the new images on staging and production systems.
Efficient Parallel Testing with Docker by Laura FrankDocker, Inc.
Fast and efficient software testing is easy with Docker. We often
use containers to maintain parity across development, testing, and production environments, but we can also use containerization to significantly reduce time needed for testing by spinning up multiple instances of fully isolated testing environments and executing tests in parallel. This strategy also helps you maximize the utilization of infrastructure resources. The enhanced toolset provided by Docker makes this process simple and unobtrusive, and you’ll see how Docker Engine, Registry, Machine, and Compose can work together to make your tests fast.
DockerCon EU 2015: Continuous Integration with Jenkins, Docker and ComposeDocker, Inc.
Presented by Sandro Cirulli, Platform Tech Lead, Oxford University Press
Oxford University Press (OUP) recently started the Oxford Global Languages (OGL) initiative (http://www.oxforddictionaries.com/words/oxfordlanguages) which aims at providing language resources for digitally under represented languages. In August 2015 OUP launched two African languages websites for Zulu (http://zu.oxforddictionaries.com) and Northern Sotho (http://nso.oxforddictionaries.com). The backend of these websites is based on an API retrieving data in RDF from a triple store and delivering data to the frontend in JSON-LD.
The entire micro-service infrastructure for development, staging, and production runs on Docker containers in Amazon EC2 instances. In particular, we use Jenkins to rebuild the Docker image for the API based on a Python Flask application and Docker Compose to orchestrate the containers. A typical CI workflow is as follows:
- a developer commits code to the codebase
- Jenkins triggers a job to run unit tests
- if the unit tests are successful, the Docker image of the Python Flask application is rebuilt and the container is restarted via Docker Compose
- if the unit tests or the Docker build failed, the monitor view shows the Jenkins jobs in red and displays the name of the possible culprit who broke the build.
A demo of this CI workflow is available at http://www.sandrocirulli.net/continuous-integration-with-jenkins-docker-and-compose
DCSF 19 Building Your Development Pipeline Docker, Inc.
Oliver Pomeroy, Docker & Laura Tacho, Cloudbees
Enterprises often want to provide automation and standardisation on top of their container platform, using a pipeline to build and deploy their containerized applications. However this opens up new challenges; Do I have to build a new CI/CD Stack? Can I build my CI/CD pipeline with Kubernetes orchestration? What should my build agents look like? How do I integrate my pipeline into my enterprise container registry? In this session full of examples and how-to's, Olly and Laura will guide you through common situations and decisions related to your pipelines. We'll cover building minimal images, scanning and signing images, and give examples on how to enforce compliance standards and best practices across your teams.
Basic Idea
Develop a build system that leverages Docker for implementing continuous integration/deployment(CI/CD) pipeline. A git commit must kick off packaging a Docker Image and provisioning it in a VM.
A git based commit should be used for starting of a build for a docker image which would then be run and provisioned in a Virtual Machine. After every commit a series of test cases is then run on the code to ensure the correctness of the code. After all the test-cases pass, the image gets updated on docker-hub registry, and a VM gets provisioned which can then run the software directly (after pulling the image from the docker-hub).
This entire process ensures that the most recent and updated version of the code is available to the person who is using the software and this speeds up the overall process by at least 2-3 folds.
Continuous delivery is a powerful concept, but hard to achieve. One of the challenges is automating the setup of environments and the deployment of the Java EE applications. We have looked at and used quite some tools like for instance Chef, Puppet, Vagrant and Nolio. All tools had one thing in common: we had never used them. Why should we invest time in mastering those tools? There is a perfect alternative in Jenkins, a tool most developers are familiar with. Besides the basic Jenkins buildserver capabilities it offers quite some useful plugins like the Build Pipeline plugin. To setup environments the popular Docker project is used. Docker allows you to create containers from any application. Only some knowledge is required for the setup of the containers. The rest of the configuration is done through commands most people are quite familiar with.
Containerizing Hardware Accelerated ApplicationsDocker, Inc.
Many applications allow you to use hardware such as GPUs and FPGAs for acceleration. Common examples include media processing and offloading highly parallel work to a GPU. Applications that use accelerators are resource heavy and have stacks spanning kernel and user space; accelerators often have their own requirements for operating system support and kernel versions. While it may not seem intuitive to containerize this type of application, the use of containers provides benefits such as reduced setup time from container reuse, reduction in dependency conflicts and dependency on a specific operating system, and easier updates.
In this session I show a media processing stack, making use of containers alongside a GPU. Specifically, I explain the kernel and user space divide of a hardware-accelerated transcode application using a device exposed to the container. This specific stack is an interesting case because of its dependency on hardware, use of a custom kernel and libraries, and operating system requirements. Our investigations have shown the use of containers has minimal performance overhead compared to running natively. Furthermore, we can quickly deploy on other machines with reduced configuration effort. There are some aspects of the application not suited to containerization, however. Since the application relies on a custom kernel, the use of containers does not necessarily increase portability. Improvement in this area would require rethinking how the applications are developed and distributed. Other areas of innovation include things such as Docker plugins to check for compatibility between the container software and host kernel.
DockerCon EU 2015: Placing a container on a train at 200mphDocker, Inc.
Presented by Casper S. Jensen, Software Engineer, Uber
At Uber, we've been introducing Docker to give service owners more control over their environments. However, everything at Uber is moving very fast so we have had to do it a way such that Docker fitted into the existing infrastructure and services could be migrated seamlessly to Docker without any service interruptions. In this talk we will talk about the challenges we faced while doing this, such as handling both non-Docker and Docker builds, image replication, integration with our deployment systems and other challenges when deploying Docker at scale.
In this talk, we will discuss the construction of a CI/CD pipeline consisting of Docker Engine, GitHub, Jenkins, Docker Registry and calm.io. The pipeline will be kicked off by a commit to a GitHub repository. The commit will cause Jenkins to run a build job and, upon successful completion of that job, push a Docker image up to Docker Registry. Once the new docker image is made available, Jenkins will trigger calm.io to deploy the new images on staging and production systems.
Use Docker to Deliver Cognitive Services Running Cross Platform and Multi Clo...Docker, Inc.
Watson developer cloud delivers Watson Cognitive services as micro services on the cloud that are being used by many IBM Watson customers. The micro services were packaged in ova at the first release. There were some drawbacks in ova deployment in the cloud. We gradually switched to use docker. As a result, the service deployment time and start up time are significantly improved. It also greatly simplified our continuous delivery process since our services run on both Intel and Power platform and we have offerings on our public cloud, dedicated cloud as well as customers’ on premise cloud. With minimal deployment time and quick startup time, Docker makes our dynamic creation of service instance on the fly per customer request possible.
Demo of how to dockerise and deploy your microservices application to the test environment, how to run selenium tests inside docker and how to put this all together to integrate your tests in your CI/CD pipeline using Jenkins.
Presented at ATA GTR 2016 in Pune.
The introduction of Docker about 3 years ago has significantly changed the way we think about continuous integration and continuous deployment. Docker has made software containers accessible to everyone. Today it is very easy to package an application or service into a container including all its dependencies and configurations. Since a container is immutable and (nearly) completely opaque to the outside world it can be deployed to any target host, be it the laptop of a developer, the build server, an integration server, staging or production. Gone are the days where we used to hear “runs on my machine”. DevOps has become much simpler because of containers, because of Docker.It’s a paradigm change and can be rightfully compared to the revolution shipping containers caused in logistics.
In this lecture you will learn what a CI/CD pipeline used to look like and how Docker changed this picture. The presenter will also demonstrate how an ASP.NET core application can be packaged into a Docker container locally on the developer laptop and then once the code is pushed to GitHub, pulled, built, tested and pushed to to Docker hub by a CI server from where it can be deployed to any target environment.
Continuous Delivery with Jenkins and Wildfly (2014)Tracy Kennedy
A presentation on a continuous delivery pipeline that leverages Jenkins Enterprise, Jenkins Operations Center, Nexus, HAProxy, and Wildfly. Pipeline components run in Docker containers along with SkyDock/SkyDNS for service discovery and NSEnter for command-line access to containers.
DockerCon SF 2015: Docker in the New York Times NewsroomDocker, Inc.
Eric Buth's Presentation at DockerCon SF 2015:
Talk Description: In the New York Times newsroom you’ll find a deeply heterogeneous technology environment that exists – by necessity – outside of the larger, more well-defined development pipelines of the rest of the organization. On the Interactive News team, part of our mission is providing a reliable path to production for designers/developers/reporters who need to be able to make their own technology choices on what can be extremely tight deadlines.
Containerization is becoming increasingly important to these efforts, and we’re ready to share our experience working with Docker and crafting complementary orchestration, communication, and organization solutions.
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)CloudBees
Continuous delivery pipelines are, by definition, workflows with parallel job executions, join points, retries of jobs (Selenium tests are fragile) and manual steps (validation by a QA team). Come and discover how the new workflow engine of Jenkins CI and its Groovy-based DSL will give another dimension to your continuous delivery pipelines and greatly simplify your life.
Sample workflow groovy script used in this presentation: https://gist.github.com/cyrille-leclerc/796085e19d9cec4a71ef
Jenkins workflow syntax reference card: https://github.com/cyrille-leclerc/workflow-plugin/blob/master/SYNTAX-REFERENCE-CARD.md
DockerCon EU 2015: Deploying and Managing Containers for DevelopersDocker, Inc.
Presentation by Fernando Mayo and Borja Burgos, co-founders of Tutum
As a developer, you want to build and deploying applications to be easy. Build it once and deploy it wherever you want. Tutum makes it easy. In this session, you’ll learn how Tutum can be part of your CI/CD pipeline.
A hands-on workshop that covers 18 best practices in 4 categories or in other words ✅️ Dos & Don'ts.
After a general introduction, we will have a look at the essential practices (aka must do), then move to the image practices, then we will go through the security practices, and finally, some general practices.
Please note, this workshop assumes that you have a basic knowledge of Docker.
Hands-on repo:
https://github.com/aabouzaid/docker-best-practices-workshop
Docker for Mac and Windows: The Insider's Guide by Justin CormackDocker, Inc.
Docker for Mac and Windows were released in beta in March, and provide lots of new features that users have been clamouring for including: file system notifications, simpler file sharing, and no Virtualbox hassles.
During this talk, I will give the inside guide to how these products work. We will look at all the major components and how they fit together to make up the product. This includes a technical deep dive covering the hypervisors for OSX and Windows, the custom file sharing code, the networking, the embedded Alpine Linux distribution, and more.
Building a Secure Supply Chain with DockerDocker, Inc.
Creating a Secure Supply Chain of images is vitally important. Every organization needs to weigh ALL options available and understand the security risks. With so many options for images, it is tough to pick the right ones or even to create your own. Ultimately, every organization needs to know the provenance of all the images. Then once the images are imported into the infrastructure, a vulnerability scan is vital. Docker Trusted Registry with Image Scanning will give organizations insight into any vulnerabilities. Better yet, its automated with a succinct audit trail, so you can still take that vacation you had planned and make your security team happy.
DCSF19 How To Build Your Containerization Strategy Docker, Inc.
Lee Namba, Docker
The Docker Enterprise container platform helps organizations deploy and manage applications faster and it secures the application pipeline at a lower cost than traditional application delivery models. But it takes more than just great technology to achieve the desired results. The organization and culture of your enterprise directly impacts what you transform, how it’s done, and who does it. Success requires a strategy for how you will govern the container platform environment, how to assess your application estate, what your delivery pipeline will look like, and how to ensure developers, operators, security teams and others play nicely together. In this talk I will cover topics such as different types of workloads (legacy, microservices, FaaS, big data and more), how your org chart can influence whether you deploy CaaS (Containers as a Service) vs CLaaS (Clusters as a Service), how "shifting left" can determine if you can outsource, centralized vs distributed CI/CD and how containers play a role, transforming your pets into cattle, how giant whale balloons are used for onboarding, and a prescriptive and comprehensive methodology for successfully deploying containers into your enterprise.
Your Auto-Scaling Bot - Volkan TufeckiDocker, Inc.
In this talk we will talk about a docker swarm architecture that scales automatically with the help of a Slack Bot. The talk will include - Docker Swarm and Docker Compose - Monitoring containers by cadvisor - Managing alerts with promotheus and alert manager - Running a slack bot that decides to deploy or undeploy services - Generating load with siege
DCSF19 Docker Containers & Java: What I Wish I Had Been ToldDocker, Inc.
Mohammed Aboullaite, xHub
Nowadays, containers are more than a cool new tool to play with - they've revolutionized the way we develop, architect and ship software and have become part of our day-to-day operations. On the other hand, Java has been around for more than 2 decades, dominating the entreprise world. Both advocate the "RUN anywhere" principal, but, is it that easy? No! Your perfect working local container will most probably fail on production because of MEMORY &/or CPU issues, since jvm apps assume they OWN the server they are running on.
This session will look at the gotchas of running JVM apps in containers & how to avoid costly pitfalls. We will cover:
_ what updates Java 10 brought to the table to improve container awareness and the issues related to prior versions, including how to address each one of them to avoid the mess.
- tips and tricks to obtain smaller images & best practices while writing your DockerFiles
- some plugins to helps non-containers experts integrate docker in their development process; and
- the concept of "Distroless" Docker Images and how to benefit from it.
Dell Trials and Triumphs using Docker on Client Systems by Sean McGinnis and ...Docker, Inc.
Join engineers from ClusterHQ and Dell Storage to learn about persistent storage integration with Docker. See how Flocker enables native support for enterprise storage infrastructure use in containers, enabling you to leverage Dell storage for new workloads.
Continuous Testing helps provide process improvements that can prevent future defects from occurring. It plays an important role in providing continuous feedback for your software.
Docker is not just about deploying containers to hundreds of servers. Developers need tools that help with day-to-day tasks and to do their job more effectively. Docker is a great addition to most workflows, from starting projects to writing utilities to make development less repetitive. Docker can help take care of many problems developers face during development such as “it works on my machine” as well as keeping tooling consistent between all of the people working on a project. See how easy it is to take an existing development setup and application and move it over to Docker, no matter your operating system.
Use Docker to Deliver Cognitive Services Running Cross Platform and Multi Clo...Docker, Inc.
Watson developer cloud delivers Watson Cognitive services as micro services on the cloud that are being used by many IBM Watson customers. The micro services were packaged in ova at the first release. There were some drawbacks in ova deployment in the cloud. We gradually switched to use docker. As a result, the service deployment time and start up time are significantly improved. It also greatly simplified our continuous delivery process since our services run on both Intel and Power platform and we have offerings on our public cloud, dedicated cloud as well as customers’ on premise cloud. With minimal deployment time and quick startup time, Docker makes our dynamic creation of service instance on the fly per customer request possible.
Demo of how to dockerise and deploy your microservices application to the test environment, how to run selenium tests inside docker and how to put this all together to integrate your tests in your CI/CD pipeline using Jenkins.
Presented at ATA GTR 2016 in Pune.
The introduction of Docker about 3 years ago has significantly changed the way we think about continuous integration and continuous deployment. Docker has made software containers accessible to everyone. Today it is very easy to package an application or service into a container including all its dependencies and configurations. Since a container is immutable and (nearly) completely opaque to the outside world it can be deployed to any target host, be it the laptop of a developer, the build server, an integration server, staging or production. Gone are the days where we used to hear “runs on my machine”. DevOps has become much simpler because of containers, because of Docker.It’s a paradigm change and can be rightfully compared to the revolution shipping containers caused in logistics.
In this lecture you will learn what a CI/CD pipeline used to look like and how Docker changed this picture. The presenter will also demonstrate how an ASP.NET core application can be packaged into a Docker container locally on the developer laptop and then once the code is pushed to GitHub, pulled, built, tested and pushed to to Docker hub by a CI server from where it can be deployed to any target environment.
Continuous Delivery with Jenkins and Wildfly (2014)Tracy Kennedy
A presentation on a continuous delivery pipeline that leverages Jenkins Enterprise, Jenkins Operations Center, Nexus, HAProxy, and Wildfly. Pipeline components run in Docker containers along with SkyDock/SkyDNS for service discovery and NSEnter for command-line access to containers.
DockerCon SF 2015: Docker in the New York Times NewsroomDocker, Inc.
Eric Buth's Presentation at DockerCon SF 2015:
Talk Description: In the New York Times newsroom you’ll find a deeply heterogeneous technology environment that exists – by necessity – outside of the larger, more well-defined development pipelines of the rest of the organization. On the Interactive News team, part of our mission is providing a reliable path to production for designers/developers/reporters who need to be able to make their own technology choices on what can be extremely tight deadlines.
Containerization is becoming increasingly important to these efforts, and we’re ready to share our experience working with Docker and crafting complementary orchestration, communication, and organization solutions.
Pimp your Continuous Delivery Pipeline with Jenkins workflow (W-JAX 14)CloudBees
Continuous delivery pipelines are, by definition, workflows with parallel job executions, join points, retries of jobs (Selenium tests are fragile) and manual steps (validation by a QA team). Come and discover how the new workflow engine of Jenkins CI and its Groovy-based DSL will give another dimension to your continuous delivery pipelines and greatly simplify your life.
Sample workflow groovy script used in this presentation: https://gist.github.com/cyrille-leclerc/796085e19d9cec4a71ef
Jenkins workflow syntax reference card: https://github.com/cyrille-leclerc/workflow-plugin/blob/master/SYNTAX-REFERENCE-CARD.md
DockerCon EU 2015: Deploying and Managing Containers for DevelopersDocker, Inc.
Presentation by Fernando Mayo and Borja Burgos, co-founders of Tutum
As a developer, you want to build and deploying applications to be easy. Build it once and deploy it wherever you want. Tutum makes it easy. In this session, you’ll learn how Tutum can be part of your CI/CD pipeline.
A hands-on workshop that covers 18 best practices in 4 categories or in other words ✅️ Dos & Don'ts.
After a general introduction, we will have a look at the essential practices (aka must do), then move to the image practices, then we will go through the security practices, and finally, some general practices.
Please note, this workshop assumes that you have a basic knowledge of Docker.
Hands-on repo:
https://github.com/aabouzaid/docker-best-practices-workshop
Docker for Mac and Windows: The Insider's Guide by Justin CormackDocker, Inc.
Docker for Mac and Windows were released in beta in March, and provide lots of new features that users have been clamouring for including: file system notifications, simpler file sharing, and no Virtualbox hassles.
During this talk, I will give the inside guide to how these products work. We will look at all the major components and how they fit together to make up the product. This includes a technical deep dive covering the hypervisors for OSX and Windows, the custom file sharing code, the networking, the embedded Alpine Linux distribution, and more.
Building a Secure Supply Chain with DockerDocker, Inc.
Creating a Secure Supply Chain of images is vitally important. Every organization needs to weigh ALL options available and understand the security risks. With so many options for images, it is tough to pick the right ones or even to create your own. Ultimately, every organization needs to know the provenance of all the images. Then once the images are imported into the infrastructure, a vulnerability scan is vital. Docker Trusted Registry with Image Scanning will give organizations insight into any vulnerabilities. Better yet, its automated with a succinct audit trail, so you can still take that vacation you had planned and make your security team happy.
DCSF19 How To Build Your Containerization Strategy Docker, Inc.
Lee Namba, Docker
The Docker Enterprise container platform helps organizations deploy and manage applications faster and it secures the application pipeline at a lower cost than traditional application delivery models. But it takes more than just great technology to achieve the desired results. The organization and culture of your enterprise directly impacts what you transform, how it’s done, and who does it. Success requires a strategy for how you will govern the container platform environment, how to assess your application estate, what your delivery pipeline will look like, and how to ensure developers, operators, security teams and others play nicely together. In this talk I will cover topics such as different types of workloads (legacy, microservices, FaaS, big data and more), how your org chart can influence whether you deploy CaaS (Containers as a Service) vs CLaaS (Clusters as a Service), how "shifting left" can determine if you can outsource, centralized vs distributed CI/CD and how containers play a role, transforming your pets into cattle, how giant whale balloons are used for onboarding, and a prescriptive and comprehensive methodology for successfully deploying containers into your enterprise.
Your Auto-Scaling Bot - Volkan TufeckiDocker, Inc.
In this talk we will talk about a docker swarm architecture that scales automatically with the help of a Slack Bot. The talk will include - Docker Swarm and Docker Compose - Monitoring containers by cadvisor - Managing alerts with promotheus and alert manager - Running a slack bot that decides to deploy or undeploy services - Generating load with siege
DCSF19 Docker Containers & Java: What I Wish I Had Been ToldDocker, Inc.
Mohammed Aboullaite, xHub
Nowadays, containers are more than a cool new tool to play with - they've revolutionized the way we develop, architect and ship software and have become part of our day-to-day operations. On the other hand, Java has been around for more than 2 decades, dominating the entreprise world. Both advocate the "RUN anywhere" principal, but, is it that easy? No! Your perfect working local container will most probably fail on production because of MEMORY &/or CPU issues, since jvm apps assume they OWN the server they are running on.
This session will look at the gotchas of running JVM apps in containers & how to avoid costly pitfalls. We will cover:
_ what updates Java 10 brought to the table to improve container awareness and the issues related to prior versions, including how to address each one of them to avoid the mess.
- tips and tricks to obtain smaller images & best practices while writing your DockerFiles
- some plugins to helps non-containers experts integrate docker in their development process; and
- the concept of "Distroless" Docker Images and how to benefit from it.
Dell Trials and Triumphs using Docker on Client Systems by Sean McGinnis and ...Docker, Inc.
Join engineers from ClusterHQ and Dell Storage to learn about persistent storage integration with Docker. See how Flocker enables native support for enterprise storage infrastructure use in containers, enabling you to leverage Dell storage for new workloads.
Continuous Testing helps provide process improvements that can prevent future defects from occurring. It plays an important role in providing continuous feedback for your software.
Docker is not just about deploying containers to hundreds of servers. Developers need tools that help with day-to-day tasks and to do their job more effectively. Docker is a great addition to most workflows, from starting projects to writing utilities to make development less repetitive. Docker can help take care of many problems developers face during development such as “it works on my machine” as well as keeping tooling consistent between all of the people working on a project. See how easy it is to take an existing development setup and application and move it over to Docker, no matter your operating system.
Docker introduction.
References : The Docker Book : Containerization is the new virtualization
http://www.amazon.in/Docker-Book-Containerization-new-virtualization-ebook/dp/B00LRROTI4/ref=sr_1_1?ie=UTF8&qid=1422003961&sr=8-1&keywords=docker+book
An overview on docker and container technology behind it. Lastly, we discuss few tools that might come handy when dealing with large number of containers management.
We talk about docker, what it is, why it matters, and how it can benefit us. This presentation is an introduction and delivered to local meetup in Indonesia.
Presentation on Pesantren Kilat Code Security
Tangerang, 2016-06-06
We talk about docker. What it is? Why it matters? and how it can benefit us?
This presentation is an introduction and delivered to local meetup in Indonesia.
Docker and Puppet for Continuous IntegrationGiacomo Vacca
Today developers want to change the code, build and deploy often, even several times per day.
New versions of software may need to be tested on different distributions, and with different configurations.
Achieving this with Virtual Machines it’s possible, but it’s very resource and time consuming. Docker provides an incredibly good solution for this, in particular if combined with Continuous Integration tools like Jenkins and Configuration Management tools like Puppet.
This presentation focuses on the opportunities to configure automatically Docker images, use Docker containers as disposable workers during your tests, and even running your Continuous Integration system inside Docker.
Orchestrating Linux Containers while tolerating failuresDocker, Inc.
lthough containers are bringing a refreshing flexibility when deploying services in production, the management of those containers in such an environment still requires special care in order to keep the application up and running. In this regard, orchestration platforms like Docker, Kubernetes and Nomad have been trying to alleviate this responsibility, facilitating the task of deploying and maintaining the entire application stack in its desired state. This ensures that a service will be always running, tolerating machine failures, network erratic behavior or software updates and downtime. The purpose of this talk is to explain the mechanisms and architecture of the Docker Engine orchestration platform (using a framework called swarmkit) to tolerate failures of services and machines, from cluster state replication and leader-election to container re-scheduling logic when a host goes down.
A beginners guide from my experience learning the ins and outs of Docker - the software that provides operating-system-level virtualization (also known as containerization).
Associated demo scripts can be found at https://github.com/PaperCutSoftware/DockerSimpleDemo
Presentation for introduction docker container concept and beginner of docker swarm
Finally, I'll demo monitor project with prometheus and show lab for any step.
Similar to 2015 05-06-elias weingaertner-docker-intro (20)
In this talk, Martin covers how an All-JavaScript approach with MongoDB, Express, React and Node.js (MERN) enables iterating fast, picking the example of the quickly growing product 'myOnboarding' by Haufe-Lexware. He touches on the pros and cons of this technology stack, how the technology ties in to the product's microservices architecture, and how the product team leverages CI/CD to be able to act, and react, fast and securely. The talk further touches on how the product team setup and customer feedback is crucial to iterate fast, in the right direction.
Our customers want a stable, performant application that delivers new features every week, and we discovered that leveraging the AWS Fargate service fits our customers' needs better. This talk covers our journey to Fargate, the changes we've made to our dev-workflow, and how the teams were able to deploy their application using GitLab CI/CD : everything from the code all the way to the customer.
Meetup presentation on Feb 27th 2019 at the Dock8s Meetup in Heidelberg/Rhein-Neckar, at the verivox campus.
The talk touches on all areas which involve a cloud journey of a major produkt (iDesk2) of the Haufe Group: Planning & Politics, Technology and doing Operations for that product as a DevOps team.
ONA ( organizational network analysis ) to enable individuals to impact their...Haufe-Lexware GmbH & Co KG
ONA - organizational network analysis - is becoming an important topic for HR-technology. Simply put, ONA provides insight into how organizations really function.
Embedding ONA capability has the potential to enable employers and employees to organize themselves more effectively, communicate more impactfully, and to lead their companies forward.
ONA ( organizational network analysis ) enabling individuals to impact their ...Haufe-Lexware GmbH & Co KG
ONA - organizational network analysis - is becoming an important topic for HR-technology. Simply put, ONA provides insight into how organizations really function.
Embedding ONA capability has the potential to enable employers and employees to organize themselves more effectively, communicate more impactfully, and to lead their companies forward.
One of the areas that can greatly improve the customer experience is a search that returns relevant content.
In this session, Hans presents the most current results on his research to extract a keyword vocabulary and use vectorized representations of these words to enable lawyer customers to find the content that helps them do their job.
It is a core demand of marketing & sales to segment their customer base. Join this session to learn to identify and prepare the data to perform this segmentation with machine learning.
An introduction to the concept of BDD and its implementation using the JGiven framework.
Presentation for the Java User Group Freiburg meetup on October 24, 2017.
Configuration of Spring Boot applications using Spring Cloud Config and Spring Cloud Vault.
Presentation given at the meeting of the Java User Group Freiburg on October 24, 2017
Presentation slides by Martin Danielsson (https://twitter.com/donmartin76) on the topic of how short lived production deployments can be managed, including how to solve some of the persistence issues associated with CI/CD and infrastructure-as-code.
Opportunities offered by Serverless Architecture: What are the offers from the big Cloud Providers and how you can build a 3-tier architecture app having no servers. See also http://dev.haufe.com/Serverless_with_AWS_at_DevTalks/
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxrickgrimesss22
Discover the essential features to incorporate in your Winzo clone app to boost business growth, enhance user engagement, and drive revenue. Learn how to create a compelling gaming experience that stands out in the competitive market.
3. What does Docker do technically?
So:ware
Container
Image
Containeriza>on
DataCenter
Developer
PC
Instan>a>on
Dockerfile
„docker-‐compose“
„docker
run“
Orchestra>on
of
Compound
Services
4. A
Dockerfile
describes
how
to
turn
any
so;ware
ar<fact
Into
a
Docker
Image
# A basic apache server. To use either add or bind mount content
under /var/www
FROM ubuntu:12.04
MAINTAINER Kimbro Staken version: 0.1
RUN apt-get update && apt-get install -y apache2 && apt-get clean
&& rm -rf /var/lib/apt/lists/*
ENV APACHE_RUN_USER www-data
ENV APACHE_RUN_GROUP www-data
ENV APACHE_LOG_DIR /var/log/apache2
EXPOSE 80
CMD ["/usr/sbin/apache2", "-D", "FOREGROUND"]
Install
Apache
into
Ubuntu
Image
Dockerfile by example
hEps://github.com/kstaken/dockerfile-‐examples
Base
Image
Metadata
Basic
Apache2
configura<on
Tell
Docker
that
the
container
exposes
HTTP
How
to
start
it
up
5. Docker Images
• Important:
Docker
executes
Docker
Images,
not
Dockerfiles
• A
Docker
image
contains
everything
to
run
the
so:ware
• Binaries
(Think
/usr/bin)
• Configura>on
(Think
/etc)
• System
Libraries,
Auxiliary
Files,
System
Content
• Layered
File
System
• Each
write
opera>on
adds
a
layer
to
the
file
system
• Image
Inheritance
6. Docker Registry
• Central
repository
for
Docker
images
• docker push <name>
• docker pull <name>
• Enables
sharing
of
executable
images
• Public
Docker
Registry:
Docker
Hub
(14000+
images)
• Enterprise
use:
Need
for
a
private
registry
7. Docker Links
• Wish:
Separa>on
of
Concerns
into
different
containers
• Manual
“composi>on”
via
Docker
Links:
à Containers
need
to
be
started
in
the
right
order
à Even
more
complexity
with
cross-‐host
links
mysql:3306
1) docker pull mysql:latest
docker pull httpd:latest
2) docker run -e MYSQL_ROOT_PASSWORD=123 --name mydb mysql
3) docker run –name web –link mydb:mydb httpd
8. The need for orchestra-on
Some
„Fic>on“:
13
Containers
with
15
links
Challenges
Container/Service
Dependencies
Star>ng
Order
Network
Dynamics
Ressource
Alloca>on
Let‘s
do
this
manually
with
Docker
9. Docker Orchestra-on Tools
Container
Instan>a>on
&
Order
Communica>on
between
containers
&
link
management
Wish
list:
• Transparent
Container
placement
on
infrastructure
• Support
for
service
redundancy
fail-‐over
Docker
orchestra>on
tools
automate
the
instan>a>on
of
service
landscapes.
16. CoreOS Example: High Availability Apache
$
fleetctl
submit
apache@.service
$
fleetctl
start
apache@1
$
fleetctl
start
apache@2
$
fleetctl
list-‐units
UNIT
MACHINE
ACTIVE
SUB
apache@1.service
491586a6.../10.10.1.2
ac>ve
running
apache@2.service
148a18ff.../10.10.1.1
ac>ve
running
Source:
CoreOS
Documenta>on
17.
18. Eight golden Rules for Docker Containers
1. One
Purpose:
Each
container
does
exactly
one
job
2. Working:
The
container
is
func>onal
3. Fix
Dependencies:
All
dependencies
of
the
container
are
sound
4. Minimal:
Contains
only
bare
essen>als
5. Whitebox
Sources
for
the
container
must
be
available
6. Secure
The
container
is
tested
and
checked
regularly
7. Limited
The
container
requires
only
limited
resource
8. Trust
The
maintainer
of
the
container
is
trustworthy.
Its
content
is
not
tampered.
19. Summary
• Docker
provides
mobility
for
so:ware
ar>facts
• „Build
once,
ship
anywhere“
• Deployment
of
compound
services:
Orchestra>on
needed!
• Different
toolchains
available.
• Claim:
We
need
guidelines
for
Docker
use
at
Haufe.
• Many
ques>ons
(unsorted)
• Use
of
private/public
Docker
registries?
• Should
we
containerize
everything?
• How
to
handle
cer>ficates?
• Which
orchestra>on
platorm
to
use?
Which
backend
to
use
for
container
management?