Continuous delivery with jenkins, docker and exoscale

•

4 likes•4,220 views

This document discusses using Docker, Jenkins, and Exoscale for continuous delivery. It defines continuous delivery and continuous deployment. Docker is presented as a way to deploy applications as containers to facilitate fast, robust deployments. The document demonstrates setting up a test environment with Jenkins, Docker plugins, and the Docker registry for continuous integration and delivery of a sample web application. It also discusses strategies for deploying to production environments like canary releasing and blue-green deployments using Docker.

Technology

Continuous Delivery with
Jenkins, Docker and
Exoscale
Julia Mateo
@juliamateodc
@duchessswiss http://jduchess.ch/
Thursday, April 16, 15

Continuous deployment vs
Continuous Delivery
• Continuous delivery : series of practices designed
to ensure that code can be rapidly and safely
deployed to production
• Continuous deployment is the next step of
continuous delivery: Every change that passes the
automated tests is deployed to production
automatically
Thursday, April 16, 15

Continuous Delivery
Source : http://xebia.github.io/cd-with-docker/#/
Thursday, April 16, 15

What is Docker ?
• Open platform for developers and
sysadmins to build, ship, and run distributed
applications.
From https://www.docker.com/whatisdocker/
Thursday, April 16, 15

Docker vsVMs
Server
Host OS
Hypervisor
Guest
OS
Guest
OS
Guest
OS
Guest
OS
Libs/
Bins
Libs/
Bins
Libs/
Bins
App 1 App 2 App 3 App 4
Libs/
Bins
Server
Host OS
Docker Engine
Libs/Bins
Libs/
Bins
App 1 App 2 App 3 App 4
c1 c2 c3 c4
VM1 VM2 VM3 VM4
Thursday, April 16, 15

Containers and images
Docker
Images
Docker
Images
libcontainer, Union Filesystem
Centos Ubuntu
Jetty
add App.war
Container 1
OracleDB
Container 2
Read
only
Writable
Writable
Read
only
Thursday, April 16, 15

Using Docker for
Continuous Delivery
• Simple : container as deployment unit
• Fast : Only need to build/upload the ∆ image
• Robust : less scope of error than custom
deployment scripts
• Other advantages : docker facilitates fast rollback
Thursday, April 16, 15

Deploy with Docker :
test environment
Localhost
docker publish plugin
ssh jenkins plugin
Node 1
Node 2
Thursday, April 16, 15

Deploy with Docker :
test environment
Localhost
docker publish plugin
ssh jenkins plugin
Node 1
Node 2
Container 1
Container 2
Container 3
Container 4
Container 5
Thursday, April 16, 15

The web app to deploy
Thursday, April 16, 15

Deploy with Docker :
test environment
Localhost
Thursday, April 16, 15

Deploy with Docker :
test environment
Localhost
docker publish plugin
Thursday, April 16, 15

Deploy with Docker :
test environment
Localhost
docker publish plugin
ssh jenkins plugin
Thursday, April 16, 15

Docker publish plugin
Thursday, April 16, 15

Using Docker into
Docker
Thursday, April 16, 15

Docker private
repository
• Add the registry’s location to the
repository name :
my.registry.address:port/repositoryname
Thursday, April 16, 15

Jenkins ssh plugin
Thursday, April 16, 15

SSH agent forward into
a docker container
>> docker run --privileged=true -i -t
-v $(readlink -f $SSH_AUTH_SOCK):/ssh-agent
-e SSH_AUTH_SOCK=/ssh-agent
-v /home/hortis/docker/jenkins:/jenkins -p 8900:8080
--link sonarMysql:sonar_mysql --link sonar:sonar
--link docker-registry:docker-registry -d hortis/jenkins:latest
Thursday, April 16, 15

Multi container apps
• Link containers with alias
docker run -v /home/hortis/docker/sonar/logs:/opt/sonar/logs/
-v /home/hortis/docker/sonar/extensions:/opt/sonar/extensions -p 9000:9000
--link sonarMysql:mysql --name sonar -d hortis/sonar:latest
• Use docker compose (old Fig)
Thursday, April 16, 15

Deploying to
production
• Canary releasing
• Blue Green deployment
Thursday, April 16, 15

Blue Green Deployment
DatabaseWeb app
DatabaseWeb appWeb app Database
Web app Database
User
requests
Router
OldVersion
NewVersion
Source : http://martinfowler.com/bliki/BlueGreenDeployment.html
Thursday, April 16, 15

Canary releasing
DatabaseWeb app
DatabaseWeb appWeb app Database
Web app Database
User
requests
Router
OldVersion
NewVersion
Most users
95%
Some users
5%
Source : http://martinfowler.com/bliki/CanaryRelease.html
Thursday, April 16, 15

Thank you !
QUESTIONS
?
Thursday, April 16, 15

In normal project work everybody will have heard the sentence: „On my local machine it worked“! The circumstances which lead to this statement are that there are usually minor inconsistencies within the setup of the different environments. Different operating systems, Java versions or installed hot fixes influent the behavior of the developed application and cause issues. This is where Docker comes in place. Docker automates the deployment of applications and isolates them inside software containers, by providing an additional layer of abstraction and automation but with out the overhead caused by a virtual machine. Ones set up, it limits the installation process to 5 minutes independent which environment. Furthermore, the same application can be reused to run on local machines, data centers or in the cloud. We will show you how we incorporated Docker in our continuous deployment process and how we facilitate it for our development and deployment chain.

Continuous delivery with Jenkins, Docker and Mesos/Marathon - jbcnconf

Julia Mateo

Continuous delivery uses practices like Docker, Jenkins, and Mesos/Marathon to ensure code changes can be rapidly and safely deployed to production. Docker provides containerization which allows fast and robust deployment using images. Jenkins can be configured with plugins to build, test, and deploy Docker images to a Mesos/Marathon cluster for production. Mesos/Marathon provide scalability, fault tolerance, and resource sharing across frameworks and applications in a cluster.

Delivering eBay's CI Solution with Apache Mesos & Docker - DockerCon 2014

ahunnargikar

This document discusses eBay's use of Apache Mesos, Docker, and Jenkins to improve their continuous integration (CI) solution. They were facing issues with thousands of underutilized VMs for running builds and managing different OSes and versions. Their new solution uses Mesos for cluster management, Marathon to launch Jenkins masters, and the Jenkins Mesos plugin to launch Dockerized build slaves. This allows them to standardize on Docker containers to isolate dependencies and OS flavors, improving utilization and maintenance while enabling polyglot builds.

Automating Docker Containers with Puppet 2014 10-13

kylog

Docker - Demo on PHP Application deployment

Arun prasath

Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more. In this demo, I will show how to build a Apache image from a Dockerfile and deploy a PHP application which is present in an external folder using custom configuration files.

Docker for Developers - Part 2 by Borja Burgos and Fernando Mayo

Docker, Inc.

Docker Continuous Delivery Workshop

Jirayut Nimsaeng

Docker and DevOps --- new IT culture

Terry Chen

This document discusses how Docker and DevOps introduce a new IT culture. It provides an overview of Docker and containers, explaining how Docker allows packaging applications and dependencies into standardized units. It then discusses aspects of the DevOps methodology like configuration management, continuous integration, and maintaining consistent environments across development and production. The document argues that Docker streamlines processes like environment setup, updates, integration testing, and infrastructure changes in a DevOps workflow.

This document discusses using Vagrant, Ansible, and Docker together to build portable infrastructure that avoids dependency issues, allows consistent workflows, and reduces risk. Vagrant is used to create and manage virtual environments from a configuration file. Ansible then provides configuration management through push-based execution of tasks without a client. Docker adds portability by allowing applications to run in lightweight isolated containers across machines. A sample project demonstrates Vagrant starting a VM, Ansible provisioning it by starting a Docker container, and an application running within the container.

From Arm to Z: Building, Shipping, and Running a Multi-platform Docker Swarm ...

Docker, Inc.

We live in a multi-platform world, and who doesn't want their project to run on all of them? The last few DockerCon events have covered the introduction of multi-platform image capabilities into the Docker registry and engine releases. Now it's time to put these features to good use building applications across architectures and running them all in a heterogeneous Docker Swarm! In this talk we'll cover the new `docker manifest` command for making multi-architecture images; how to emulate architectures in docker containers on your own machine; and give a live demonstration of these capabilities with a Docker Swarm consisting of workers of different CPU architectures, including armhf, ppc64le, s390x, and x86_64. We'll also share some pointers for making sure your project is multi-platform ready! Three Takeaways: 1. Attendees will be introduced to manifest lists and how to create multi-arch images using the new 'docker manifest' command. 2. Attendees will learn how to easily create and deploy a basic multi-arch service using multi-platform images. 3. Bonus: Attendees will learn how to run non-native docker containers on their systems.

Un jenkins amélioré avec docker mesos et marathon à Devoxx 2015

Publicis Sapient Engineering

Jenkins est aujourd’hui un outil d’intégration continue incontournable. Cependant, ses mises à jour peuvent rapidement devenir fastidieuses, la gestion des plugins chaotique et la configuration de vos slaves pas vraiment optimal. À travers ce Tools in Action, vous découvrirez comment en containérisant Jenkins et en utilisant les resources d’un cluster Mesos vous pouvez considérablement améliorer la stabilité et les performances de votre usine logicielle. Speaker : Jean-Louis Rigau à Devoxx France 2015

Enable Fig to deploy to multiple Docker servers by Willy Kuo

Docker, Inc.

Fig (http://www.fig.sh/) is an Docker-based development environment tool which is owned by Docker. Originally, we can only deploy to one host at one time. My hack in Docker Global Hack Day #2 is to enable Fig to deploy multiple hosts at one time. In this talk, I'll give a brief introduction to Fig first. Then describe my hack in the hack day. Finally I'll give a short demo about deploying apps to multi hosts at one time.

Dockerin10mins

Dawood M.S

Joomla Continuous Delivery with Docker

Jirayut Nimsaeng

The document discusses Jirayut Nimsaeng's presentation on using Docker for continuous delivery of Joomla projects. Some key points: - Jirayut is interested in cloud, open source, and has worked with Docker since version 0.6 - Docker allows for reliable, consistent, and efficient deployment across environments like development, testing, and production - The presentation covers using Dockerfiles to build images, Docker workflows, and examples of using Docker for development environments and continuous delivery pipelines.

Getting Started with Docker (For Developers)

ColdFusionConference

The Tale of a Docker-based Continuous Delivery Pipeline by Rafe Colton (ModCl...

Docker, Inc.

The ModCloth Platform team has been building a Docker-based continuous delivery pipeline. This presentation discusses that project and how we build containers at ModCloth. The topics include what goes into our containers; how to optimize builds to use the Docker build cache effectively; useful development workflows (including using fig); and the key decision to treat containers as processes instead of mini-vms. This presentation will also discuss (and demo!) the workflow we’ve adopted for building containers and how we’ve integrated container builds with our CI.

Learn docker in 90 minutes

Larry Cai

This document provides an introduction to Docker and includes instructions for several exercises to help users learn Docker in 90 minutes. The document covers downloading and running Docker containers, creating Docker images, understanding Docker layers, exposing container ports, using Dockerfiles to build images, and sharing images in Docker repositories. The exercises guide users through hands-on experience with common Docker commands and concepts.

Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire

dotCloud

This document provides an introduction and overview of Docker and containers. It discusses that Docker is an open source tool that allows applications to be packaged with all their dependencies and run as isolated processes on any machine. Containers provide lightweight virtualization that improves efficiency by sharing resources but still isolating processes. The document outlines how Docker uses containers powered by Linux namespaces and cgroups to package and deploy applications easily and consistently across environments.

Deployment Automation with Docker

Egor Pushkin

This document discusses deployment automation using Docker. It begins by introducing Docker terminology like images, containers, and registries. It then covers installing Docker, building images from Dockerfiles, tagging and pushing images to private registries, and running containers. The document also discusses mounting host directories in containers, cluster operations, and next steps around orchestration, monitoring, and continuous delivery.

CI, CD with Docker, Jenkins and Tutum

Sreenivas Makam

This presentation discusses using Docker, Jenkins, and Tutum for continuous integration and continuous delivery (CI/CD). Jenkins provides a complete CI/CD workflow and integrates well with Docker. Using Docker plugins, Jenkins can run build jobs within Docker containers for isolation and consistency. Tutum is a container platform that can also be used to build, deploy, and manage containers in a CI/CD pipeline. The presentation includes a demo of using these tools together and references additional resources.

Deploy django apps using docker

Thomas Kremmel

This document discusses deploying Django apps using Docker. Docker allows encapsulating apps from the host system in "containers" to make deployment repeatable without interfering with other host configurations. Key Docker terms include Dockerfile (commands to build images), images (snapshots of lightweight VMs), and containers (running instances of images). The document provides commands for building/running images and entering containers. It recommends getting a cheap VM from Digital Ocean with Docker preinstalled to easily test and use Docker.

Docker and Windows: The State of the Union

Elton Stoneman

Vagrant vs Docker

jchase50

Testing as a container

Irfan Ahmad

This document discusses using Docker containers to improve testing workflows. It outlines challenges with traditional testing approaches that can slow down deployments. Containers are presented as a solution by providing isolated, portable testing environments. The rest of the document demonstrates how to test applications using Docker containers, Docker Compose, and Selenium with examples of API, web, and Selenium Grid tests. Best practices are provided for containerizing tests along with a proposed continuous integration workflow using containers.

Testing with Docker

toffermann

This document discusses using Docker containers to test Python applications in varied environments. The proposed solution is to: 1. Create Docker images for dependencies like databases. 2. Build a test image with the source code and testing tools. 3. Run tests by launching a container from the test image linked to dependency containers. 4. The packnsend tool is used to initialize images, run tests across multiple environments, and clean up containers after testing.

Jenkins, pipeline and docker

AgileDenver

The Jenkins open source continuous integration server now provides a “pipeline” scripting language which can define jobs that persist across server restarts, can be stored in a source code repository and can be versioned with the source code they are building. By defining the build and deployment pipeline in source code, teams can take full control of their build and deployment steps. The Docker project provides lightweight containers and a system for defining and managing those containers. The Jenkins pipeline and Docker containers are a great combination to improve the portability, reliability, and consistency of your build process. This session will demonstrate Jenkins and Docker in the journey from continuous integration to DevOps.

Building and deploying a distributed application with Docker, Mesos and Marathon

Julia Mateo

Deploying Docker Containers at Scale with Mesos and Marathon

Discover Pinterest

Connor Doyle from Mesosphere. Deploying Docker Containers at Scale with Mesos and Marathon The norm these days is to operate apps at web scale. But that’s out of reach for most companies. Deploying Docker containers with Mesos and Marathon makes it easier. See how they help deploy and manage Docker containers at scale and how the Mesos cluster scheduler builds highly-available, fault-tolerant web scale apps.

What's hot

Vagrant + Docker provider [+Puppet]

Nicolas Poggi

From Zero Docker to Hackathon Winner - Marcos Lilljedahl and Jimena Tapia

Docker, Inc.

Vagrant + Ansible + Docker

Vijay Selvaraj

From Arm to Z: Building, Shipping, and Running a Multi-platform Docker Swarm ...

Docker, Inc.

Un jenkins amélioré avec docker mesos et marathon à Devoxx 2015

Publicis Sapient Engineering

Enable Fig to deploy to multiple Docker servers by Willy Kuo

Docker, Inc.

Dockerin10mins

Dawood M.S

Joomla Continuous Delivery with Docker

Jirayut Nimsaeng

Getting Started with Docker (For Developers)

ColdFusionConference

The Tale of a Docker-based Continuous Delivery Pipeline by Rafe Colton (ModCl...

Docker, Inc.

Learn docker in 90 minutes

Larry Cai

Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire

dotCloud

Deployment Automation with Docker

Egor Pushkin

CI, CD with Docker, Jenkins and Tutum

Sreenivas Makam

Deploy django apps using docker

Thomas Kremmel

Docker and Windows: The State of the Union

Elton Stoneman

Vagrant vs Docker

jchase50

Testing as a container

Irfan Ahmad

Testing with Docker

toffermann

Jenkins, pipeline and docker

AgileDenver

What's hot (20)

Vagrant + Docker provider [+Puppet]

From Zero Docker to Hackathon Winner - Marcos Lilljedahl and Jimena Tapia

Vagrant + Ansible + Docker

From Arm to Z: Building, Shipping, and Running a Multi-platform Docker Swarm ...

Un jenkins amélioré avec docker mesos et marathon à Devoxx 2015

Enable Fig to deploy to multiple Docker servers by Willy Kuo

Dockerin10mins

Joomla Continuous Delivery with Docker

Getting Started with Docker (For Developers)

The Tale of a Docker-based Continuous Delivery Pipeline by Rafe Colton (ModCl...

Learn docker in 90 minutes

Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire

Deployment Automation with Docker

CI, CD with Docker, Jenkins and Tutum

Deploy django apps using docker

Docker and Windows: The State of the Union

Vagrant vs Docker

Testing as a container

Testing with Docker

Jenkins, pipeline and docker

Viewers also liked

Building and deploying a distributed application with Docker, Mesos and Marathon

Julia Mateo

Deploying Docker Containers at Scale with Mesos and Marathon

Discover Pinterest

DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS

Julia Mateo

- Mesos is a cluster management platform that dynamically allocates resources to distributed applications running on Docker containers. It provides deployment, execution, resource sharing, and data locality capabilities. - Marathon is a Mesos framework that provides easy deployment and management of Docker containers running long-running applications on Mesos. It exposes a REST API. - MesosDNS provides service discovery by mapping Mesos tasks to DNS names, but has limitations around identifying ports, caching, health checking, and failover that alternative solutions like lb-marathon aim to address.

Mesos & Marathon - Piloter les services de votre système

Sylvain Hellegouarch

Container Orchestrator Smackdown @ContinousLifecycle

Michael Mueller

The document discusses and compares container orchestration platforms Docker Swarm Mode and Kubernetes. It provides an overview of the core concepts and features of each, including services, networks, and application deployment. Both platforms make it easy to install a basic cluster but Kubernetes is noted as having more advanced built-in features while Docker Swarm Mode has a simpler learning curve. There is no clear winner predicted as the platforms continue to improve and develop rapidly.

Orchestrate Continuous Delivery with Jenkins and Docker

Nicolas De Loof

le "Continuous Delivery" est un sacré buzz word, et "Docker" encore plus, mais les blog que j'ai pu lire sur sujet ne proposent qu'un pipelines naif et minimaliste : compile, test, push docker image, et voilà. En 2015 Jenkins adresse clairement plus que de l'Integration Continue, et avec le support récent du workflow plugin nous pouvons orchestrer avec un DSL des pipelines de grande complexité. L'integration avec Docker lui donne encore plus de puissance. Pendant cette session, je vais construire un pipeline de CD from scratch pour montrer l'utilisation du workflow et sa flexibilité, ainsi que le support de Docker.

Enterprise Docker Requires a Private Registry

Chris Riley ☁

Docker, Cloud Foundry, Bosh & Bluemix

IBM

Hero's Tookit: Start Your Rugged DevOps Journey with Nexus, Jenkins and Docker

SeniorStoryteller

This document discusses starting a Rugged DevOps journey using Nexus, Jenkins, and Docker. It presents a Rugged Software Factory model with continuous integration/continuous delivery (CI/CD) pipelines for building software from source code in public repositories, running builds and tests, and deploying to development, QA, user acceptance testing, and production environments. The model emphasizes early feedback, policy enforcement through trusted containers, and monitoring for new issues.

Culture Hacker: How to Herd CATTs and Inspire Rebels to Change the World! - S...

SeniorStoryteller

1) The document discusses how DevSecOps can help organizations achieve safer software sooner by shifting security left through a culture of collaboration, continuous learning, and taking responsibility. 2) It describes how forming a "C.A.T. Team" of diverse skills can help challenge traditional security models and drive innovation. 3) The key is establishing principles like checking egos, removing barriers, and measuring for success as a team in order to gain confidence and question norms.

Micro services and Containers

Richard Harvey

Microservices involve breaking up monolithic applications into smaller, independent services that work together. This allows for increased efficiency through scaling individual services as needed, easier updates by updating smaller code bases, and improved stability if one service fails. Containers are well-suited for microservices due to their lightweight nature and ability to easily move workloads.

Continuous Delivery Pipeline with Docker and Jenkins

Camilo Ribeiro

This document discusses using Docker and Jenkins to create a continuous delivery pipeline. It recommends using Docker to build, test, and deploy code in isolated environments at each stage. Jenkins can run in a Docker container and trigger Docker builds. The Job DSL plugin allows Jenkins jobs to be defined with Groovy scripts for easy automation and templating of jobs. The document provides resources for learning more about continuous delivery with Docker and Jenkins Job DSL.

Glusterfs for sysadmins-justin_clift

Gluster.org

This document provides an overview and introduction to GlusterFS for system administrators. It covers the key topics of GlusterFS technology, scaling, architecture, data distribution and redundancy features, administration tasks like adding nodes and volumes, and general use cases. The presentation is aimed at experienced sysadmins helping them understand and deploy GlusterFS distributed file systems.

GlusterFs Architecture & Roadmap - LinuxCon EU 2013

Gluster.org

GlusterFS is a scale-out distributed file system that aggregates storage over a network to provide a single unified namespace. It has a modular architecture and runs on commodity hardware without external metadata servers. Future directions for GlusterFS include distributed geo-replication, file snapshots, and erasure coding support. Challenges include improving scalability, supporting hard links and renames, reducing monitoring overhead, and lowering costs.

Introduction To Apache Mesos

Timothy St. Clair

Apache Mesos is a cluster manager that provides efficient resource sharing for distributed applications across a shared pool of nodes. It allows organizations to run applications like Hadoop, Spark, and Storm on large clusters with high utilization. Mesos addresses issues with prior solutions that constrained everything as "jobs" or required static partitioning. It has been adopted by companies like Twitter, Airbnb, and Hubspot to improve efficiency and allow applications to dynamically scale resources.

Modeling Microservices

Sander Hoogendoorn

This is the slide deck from my keynote at the EA User Event in Brussels, September 2015. Micro-services and micro-services architecture are the next hype in software development. Websites and blogs are full of introducing posts, the first books are being written and the first conferences organized. There’s big promises of scalability, flexibility and replaceability of individual elements in your landscape. However, when you are knee deep in the mud as a software architect at an insurance, it is very hard to find help on how to design applications and components in a micro-services architecture. During this talk Sander will show how he used Enterprise Architect to model the micro services architecture, and will explain the difficulties and the lessons learned, using many real-life examples.

Introduction à docker.io

Nicolas Hennion

Docker OpenStack Cloud Foundry

Animesh Singh

Growing a microservices landscape (with smart use cases)

Sander Hoogendoorn

Microservices and microservices architecture are the next hype in software development. Websites and blogs are full of introducing posts, the first books are being written and the first conferences organized. There’s big promises of scalability, flexibility and replaceability of individual elements in your landscape. However, when you are knee deep in the mud as a software architect at an insurance, it is very hard to find help on how to design applications and components in a microservices architecture. During this talk Sander Hoogendoorn, discusses the long and winding road the insurance company where he’s acting as the lead software architect has taken to implement their business processes in a microservices landscape. Sander will show how this company is modeling requirements in a microservices landscape using smart use cases, and will explain the difficulties and the lessons learned, using many real-life examples.

Mesos vs kubernetes comparison

Krishna-Kumar

The document compares the cluster management systems Mesos and Kubernetes. Mesos is an Apache project that provides efficient resource sharing across distributed applications. Kubernetes, developed by Google, provides cluster management capabilities for virtual machines and containers. Both support Docker containers and scheduling of workloads but Mesos gives more control while Kubernetes has easier setup and built-in scheduling. The document also discusses their architectures, major customers, and the future of these systems.

Viewers also liked (20)

Building and deploying a distributed application with Docker, Mesos and Marathon

Deploying Docker Containers at Scale with Mesos and Marathon

DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS

Mesos & Marathon - Piloter les services de votre système

Container Orchestrator Smackdown @ContinousLifecycle

Orchestrate Continuous Delivery with Jenkins and Docker

Enterprise Docker Requires a Private Registry

Docker, Cloud Foundry, Bosh & Bluemix

Hero's Tookit: Start Your Rugged DevOps Journey with Nexus, Jenkins and Docker

Culture Hacker: How to Herd CATTs and Inspire Rebels to Change the World! - S...

Micro services and Containers

Continuous Delivery Pipeline with Docker and Jenkins

Glusterfs for sysadmins-justin_clift

GlusterFs Architecture & Roadmap - LinuxCon EU 2013

Introduction To Apache Mesos

Modeling Microservices

Introduction à docker.io

Docker OpenStack Cloud Foundry

Growing a microservices landscape (with smart use cases)

Mesos vs kubernetes comparison

Similar to Continuous delivery with jenkins, docker and exoscale

Work shop - an introduction to the docker ecosystem

João Pedro Harbs

This document provides an overview and introduction to Docker including: - Docker allows creating isolated environments called containers for running applications. - Containers provide greater efficiency than virtual machines by sharing the host operating system kernel. - Docker images contain the files, dependencies, and configuration for an application. Containers are based on images. - The document then covers Docker commands for running, managing, and building containers and images.

Boston Code Dojo - Docker meetup slides

Calvin Froedge

The document discusses development environments using Docker containers. It notes that Docker can simplify collaboration by eliminating dependency issues and allowing for reusable, distributable images. Docker provides fast builds through caching and composability through linking and sharing data between containers. An example dev environment is provided that builds an API image with different branches. Challenges are posed around breaking projects into containerized pieces and sharing code between containers and hosts to enable live reloading as code changes.

How to easy deploy app into any cloud

Ladislav Prskavec

The document discusses how to easily deploy applications into any cloud using Docker containers. It provides an overview of Docker, including how it allows building applications once and running them anywhere without recompilation. Examples are given of using Docker for development, continuous integration, and deploying and managing applications across clouds with tools like Docker Compose, Docker Machine, and Docker Swarm.

Docker module 1

Liang Bo

This two-day training covers Docker concepts including installation, working with containers and images, building images with Dockerfiles, and integrating Docker with OpenStack. Day one focuses on the Docker introduction, installation, containers, images, Dockerfiles, and using Nova to run Docker containers as compute instances. It also covers using Glance as a Docker image registry. Day two covers Docker clustering with Kubernetes, networking, Docker Hub, case studies, and the Docker source code. It concludes with developing platforms and running Hadoop on Docker containers.

Introduction to Docker

Jirayut Nimsaeng

From Docker to Production - ZendCon 2016

Chris Tankersley

Congrats! You and your coworkers love Docker. Docker has become an increasingly helpful tool when it comes to DevOps. We can now build smaller, more robust local development setups with the promise of mirroring production. One thing that still plagues many situations is how to get those containers into production and update them over time. We'll explore different tools for setting up, configuring, and maintaining containers as they go live.

Why everyone is excited about Docker (and you should too...) - Carlo Bonamic...

Codemotion

In less than two years Docker went from first line of code to major Open Source project with contributions from all the big names in IT. Everyone is excited, but what's in for me - as a Dev or Ops? In short, Docker makes creating Development, Test and even Production environments an order of magnitude simpler, faster and completely portable across both local and cloud infrastructure. We will start from Docker main concepts: how to create a Linux Container from base images, run your application in it, and version your runtimes as you would with source code, and finish with a concrete example.

The Docker "Gauntlet" - Introduction, Ecosystem, Deployment, Orchestration

Erica Windisch

Docker Overview - Rise of the Containers

Ryan Hodgin

Enabling Hybrid Workflows with Docker/Mesos @Orbitz

Steve Hoffman

This document discusses using Mesos and Docker together at Orbitz to enable hybrid workflows. It describes three main use cases: 1) Using Mesos and Docker to run a microservices platform with multiple environments and datacenters, 2) Using Mesos and Docker slaves to build a Jenkins build farm, and 3) Using specialized Docker slaves to deploy apps from Jenkins to Marathon and other platforms. It provides examples of Dockerfiles used to create specialized slaves for building, deploying to AWS, and other tasks.

Docker - 15 great Tutorials

Julien Barbier

This document lists 15 tutorials about Docker, an open-source containerization platform. The tutorials cover topics such as installing Docker on various platforms like Ubuntu, Linux, Rackspace, and Digital Ocean; deploying applications like Java, Django, Drupal, and Redis using Docker containers; and using Docker to build services and applications. The tutorials are from 2013 and provide links to blog posts and resources about getting started with Docker.

docker installation and basics

Walid Ashraf

This document provides instructions on installing and using Docker on Linux (Ubuntu) and Windows. It discusses installing Docker on Ubuntu, basic Docker commands like images, ps, pull, run options for ports, volumes, and other commands. For Windows, it recommends using Docker Toolbox which includes Docker Machine, Engine, Compose and Kitematic GUI. It also covers installing the newer Docker for Windows which requires Windows 10 Pro/Enterprise with Hyper-V enabled.

codemotion-docker-2014

Carlo Bonamico

This document discusses Docker, an open source project that automates the deployment of applications inside software containers. It begins by describing common problems in application deployment and how virtual machines address some issues but introduce overhead. It then summarizes the history and rapid growth of Docker since its launch in 2013. The rest of the document dives into technical aspects of Docker like how images and containers work, comparisons to virtual machines, security considerations, the Docker workflow, and how Docker relates to DevOps and continuous delivery practices.

Getting Started with Docker

Geeta Vinnakota

The document provides an overview of getting started with Docker. It discusses what Docker is, how containerization differs from virtualization, and how to install Docker. It covers building Docker images using Dockerfiles, the difference between images and containers, and common Docker commands. The document also compares traditional deployment workflows to those using Docker, demonstrating how Docker can help ensure consistency across environments.

Apt get no more let Vagrant, Puppet and Docker take the stage

Alessandro Cinelli (cirpo)

Dockerfiles building docker images automatically v (workdir, env, add, and ...

ansonjonel

The document discusses Dockerfile instructions for building Docker images automatically. It covers the WORKDIR instruction for setting the working directory, the ENV instruction for defining environment variables, and the ADD instruction for copying files into an image. Examples are provided for each instruction to demonstrate how to use them in a Dockerfile to automate the image building process.

CI/CD with Jenkins and Docker - DevOps Meetup Day Thailand

Troublemaker Khunpech

This document discusses using Jenkins and Docker together for continuous integration and continuous delivery (CI/CD) workflows. It provides an overview of continuous integration, continuous delivery, Jenkins, and Docker. It then demonstrates setting up a CI/CD pipeline using Jenkins and Docker to build, test, and deploy a sample voting application across multiple Docker nodes. The pipeline includes building Docker images from source code in Jenkins, running builds and tests on commits, and deploying updated images to a Docker swarm cluster.

Using docker to develop NAS applications

Terry Chen

This document introduces using Docker to develop NAS applications. It begins with an overview of Docker and containers, then demonstrates how to build Docker images, run containers, and deploy NAS applications as Docker containers using Container Station. It also addresses some common questions about Docker including how to skip Container Station initialization, debug closed containers, backup container data, access NAS information from containers, and resources for learning Docker.

Docker Container As A Service - Mix-IT 2016

Patrick Chanezon

Bauen und Verteilen von Multi-Arch Docker Images für Linux und Windows

Stefan Scherer

Similar to Continuous delivery with jenkins, docker and exoscale (20)

Work shop - an introduction to the docker ecosystem

Boston Code Dojo - Docker meetup slides

How to easy deploy app into any cloud

Docker module 1

Introduction to Docker

From Docker to Production - ZendCon 2016

Why everyone is excited about Docker (and you should too...) - Carlo Bonamic...

The Docker "Gauntlet" - Introduction, Ecosystem, Deployment, Orchestration

Docker Overview - Rise of the Containers

Enabling Hybrid Workflows with Docker/Mesos @Orbitz

Docker - 15 great Tutorials

docker installation and basics

codemotion-docker-2014

Getting Started with Docker

Apt get no more let Vagrant, Puppet and Docker take the stage

Dockerfiles building docker images automatically v (workdir, env, add, and ...

CI/CD with Jenkins and Docker - DevOps Meetup Day Thailand

Using docker to develop NAS applications

Docker Container As A Service - Mix-IT 2016

Bauen und Verteilen von Multi-Arch Docker Images für Linux und Windows

Recently uploaded

dbms calicut university B. sc Cs 4th sem.pdf

Shinana2

Digital Marketing Trends in 2024 | Guide for Staying Ahead

Wask

https://www.wask.co/ebooks/digital-marketing-trends-in-2024 Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf

Chart Kalyan

5th LF Energy Power Grid Model Meet-up Slides

DanBrown980551

5th Power Grid Model Meet-up It is with great pleasure that we extend to you an invitation to the 5th Power Grid Model Meet-up, scheduled for 6th June 2024. This event will adopt a hybrid format, allowing participants to join us either through an online Mircosoft Teams session or in person at TU/e located at Den Dolech 2, Eindhoven, Netherlands. The meet-up will be hosted by Eindhoven University of Technology (TU/e), a research university specializing in engineering science & technology. Power Grid Model The global energy transition is placing new and unprecedented demands on Distribution System Operators (DSOs). Alongside upgrades to grid capacity, processes such as digitization, capacity optimization, and congestion management are becoming vital for delivering reliable services. Power Grid Model is an open source project from Linux Foundation Energy and provides a calculation engine that is increasingly essential for DSOs. It offers a standards-based foundation enabling real-time power systems analysis, simulations of electrical power grids, and sophisticated what-if analysis. In addition, it enables in-depth studies and analysis of the electrical power grid’s behavior and performance. This comprehensive model incorporates essential factors such as power generation capacity, electrical losses, voltage levels, power flows, and system stability. Power Grid Model is currently being applied in a wide variety of use cases, including grid planning, expansion, reliability, and congestion studies. It can also help in analyzing the impact of renewable energy integration, assessing the effects of disturbances or faults, and developing strategies for grid control and optimization. What to expect For the upcoming meetup we are organizing, we have an exciting lineup of activities planned: -Insightful presentations covering two practical applications of the Power Grid Model. -An update on the latest advancements in Power Grid -Model technology during the first and second quarters of 2024. -An interactive brainstorming session to discuss and propose new feature requests. -An opportunity to connect with fellow Power Grid Model enthusiasts and users.

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU

panagenda

Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/ DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen! Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell. Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten. Diese Themen werden behandelt - Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten - Wie funktionieren CCB- und CCX-Lizenzen wirklich? - Verstehen des DLAU-Tools und wie man es am besten nutzt - Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw. - Praxisbeispiele und Best Practices zum sofortigen Umsetzen

GNSS spoofing via SDR (Criptored Talks 2024)

Javier Junquera

In the realm of cybersecurity, offensive security practices act as a critical shield. By simulating real-world attacks in a controlled environment, these techniques expose vulnerabilities before malicious actors can exploit them. This proactive approach allows manufacturers to identify and fix weaknesses, significantly enhancing system security. This presentation delves into the development of a system designed to mimic Galileo's Open Service signal using software-defined radio (SDR) technology. We'll begin with a foundational overview of both Global Navigation Satellite Systems (GNSS) and the intricacies of digital signal processing. The presentation culminates in a live demonstration. We'll showcase the manipulation of Galileo's Open Service pilot signal, simulating an attack on various software and hardware systems. This practical demonstration serves to highlight the potential consequences of unaddressed vulnerabilities, emphasizing the importance of offensive security practices in safeguarding critical infrastructure.

Public CyberSecurity Awareness Presentation 2024.pptx

marufrahmanstratejm

Azure API Management to expose backend services securely

Dinusha Kumarasiri

Best 20 SEO Techniques To Improve Website Visibility In SERP

Pixlogix Infotech

Programming Foundation Models with DSPy - Meetup Slides

Zilliz

JavaLand 2024: Application Development Green Masterplan

Miro Wengner

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

ScyllaDB

June Patch Tuesday

Ivanti

Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.

Dandelion Hashtable: beyond billion requests per second on a commodity server

Antonios Katsarakis

This slide deck presents DLHT, a concurrent in-memory hashtable. Despite efforts to optimize hashtables, that go as far as sacrificing core functionality, state-of-the-art designs still incur multiple memory accesses per request and block request processing in three cases. First, most hashtables block while waiting for data to be retrieved from memory. Second, open-addressing designs, which represent the current state-of-the-art, either cannot free index slots on deletes or must block all requests to do so. Third, index resizes block every request until all objects are copied to the new index. Defying folklore wisdom, DLHT forgoes open-addressing and adopts a fully-featured and memory-aware closed-addressing design based on bounded cache-line-chaining. This design offers lock-free index operations and deletes that free slots instantly, (2) completes most requests with a single memory access, (3) utilizes software prefetching to hide memory latencies, and (4) employs a novel non-blocking and parallel resizing. In a commodity server and a memory-resident workload, DLHT surpasses 1.6B requests per second and provides 3.5x (12x) the throughput of the state-of-the-art closed-addressing (open-addressing) resizable hashtable on Gets (Deletes).

TrustArc Webinar - 2024 Global Privacy Survey

TrustArc

How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024? In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores. See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe. This webinar will review: - The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey - The top challenges for privacy leaders, practitioners, and organizations in 2024 - Key themes to consider in developing and maintaining your privacy program

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

saastr

GraphRAG for Life Science to increase LLM accuracy

Tomaz Bratanic

leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...

alexjohnson7307

Trusted Execution Environment for Decentralized Process Mining

LucaBarbaro3

Choosing The Best AWS Service For Your Website + API.pptx

Brandon Minnick, MBA

Have you ever been confused by the myriad of choices offered by AWS for hosting a website or an API? Lambda, Elastic Beanstalk, Lightsail, Amplify, S3 (and more!) can each host websites + APIs. But which one should we choose? Which one is cheapest? Which one is fastest? Which one will scale to meet our needs? Join me in this session as we dive into each AWS hosting service to determine which one is best for your scenario and explain why!

Recently uploaded (20)

dbms calicut university B. sc Cs 4th sem.pdf

Digital Marketing Trends in 2024 | Guide for Staying Ahead

How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf

5th LF Energy Power Grid Model Meet-up Slides

HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU

GNSS spoofing via SDR (Criptored Talks 2024)

Public CyberSecurity Awareness Presentation 2024.pptx

Azure API Management to expose backend services securely

Best 20 SEO Techniques To Improve Website Visibility In SERP

Programming Foundation Models with DSPy - Meetup Slides

JavaLand 2024: Application Development Green Masterplan

Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency

June Patch Tuesday

Dandelion Hashtable: beyond billion requests per second on a commodity server

TrustArc Webinar - 2024 Global Privacy Survey

Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...

GraphRAG for Life Science to increase LLM accuracy

leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...

Trusted Execution Environment for Decentralized Process Mining

Choosing The Best AWS Service For Your Website + API.pptx

Continuous delivery with jenkins, docker and exoscale

1. Continuous Delivery with Jenkins, Docker and Exoscale Julia Mateo @juliamateodc @duchessswiss http://jduchess.ch/ Thursday, April 16, 15

2. Goal Thursday, April 16, 15

3. Continuous deployment vs Continuous Delivery • Continuous delivery : series of practices designed to ensure that code can be rapidly and safely deployed to production • Continuous deployment is the next step of continuous delivery: Every change that passes the automated tests is deployed to production automatically Thursday, April 16, 15

4. Continuous Delivery Source : http://xebia.github.io/cd-with-docker/#/ Thursday, April 16, 15

5. What is Docker ? • Open platform for developers and sysadmins to build, ship, and run distributed applications. From https://www.docker.com/whatisdocker/ Thursday, April 16, 15

6. Docker vsVMs Server Host OS Hypervisor Guest OS Guest OS Guest OS Guest OS Libs/ Bins Libs/ Bins Libs/ Bins App 1 App 2 App 3 App 4 Libs/ Bins Server Host OS Docker Engine Libs/Bins Libs/ Bins App 1 App 2 App 3 App 4 c1 c2 c3 c4 VM1 VM2 VM3 VM4 Thursday, April 16, 15

7. Containers and images Docker Images Docker Images libcontainer, Union Filesystem Centos Ubuntu Jetty add App.war Container 1 OracleDB Container 2 Read only Writable Writable Read only Thursday, April 16, 15

8. Using Docker for Continuous Delivery • Simple : container as deployment unit • Fast : Only need to build/upload the ∆ image • Robust : less scope of error than custom deployment scripts • Other advantages : docker facilitates fast rollback Thursday, April 16, 15

9. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Node 1 Node 2 Thursday, April 16, 15

10. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Node 1 Node 2 Container 1 Container 2 Container 3 Container 4 Container 5 Thursday, April 16, 15

11. The web app to deploy Thursday, April 16, 15

12. Deploy with Docker : test environment Localhost Thursday, April 16, 15

13. Deploy with Docker : test environment Localhost Thursday, April 16, 15

14. Deploy with Docker : test environment Localhost Thursday, April 16, 15

15. Deploy with Docker : test environment Localhost Thursday, April 16, 15

16. Deploy with Docker : test environment Localhost Thursday, April 16, 15

17. Deploy with Docker : test environment Localhost docker publish plugin Thursday, April 16, 15

18. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

19. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

20. Docker publish plugin Thursday, April 16, 15

21. Using Docker into Docker Thursday, April 16, 15

22. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

23. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

24. Docker private repository • Add the registry’s location to the repository name : my.registry.address:port/repositoryname Thursday, April 16, 15

25. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

26. Deploy with Docker : test environment Localhost docker publish plugin ssh jenkins plugin Thursday, April 16, 15

27. Jenkins ssh plugin Thursday, April 16, 15

28. SSH agent forward into a docker container >> docker run --privileged=true -i -t -v $(readlink -f $SSH_AUTH_SOCK):/ssh-agent -e SSH_AUTH_SOCK=/ssh-agent -v /home/hortis/docker/jenkins:/jenkins -p 8900:8080 --link sonarMysql:sonar_mysql --link sonar:sonar --link docker-registry:docker-registry -d hortis/jenkins:latest Thursday, April 16, 15

29. SSH agent forward into a docker container >> docker run --privileged=true -i -t -v $(readlink -f $SSH_AUTH_SOCK):/ssh-agent -e SSH_AUTH_SOCK=/ssh-agent -v /home/hortis/docker/jenkins:/jenkins -p 8900:8080 --link sonarMysql:sonar_mysql --link sonar:sonar --link docker-registry:docker-registry -d hortis/jenkins:latest Thursday, April 16, 15

30. Demo Thursday, April 16, 15

31. Multi container apps • Link containers with alias docker run -v /home/hortis/docker/sonar/logs:/opt/sonar/logs/ -v /home/hortis/docker/sonar/extensions:/opt/sonar/extensions -p 9000:9000 --link sonarMysql:mysql --name sonar -d hortis/sonar:latest • Use docker compose (old Fig) Thursday, April 16, 15

32. Deploying to production • Canary releasing • Blue Green deployment Thursday, April 16, 15

33. Blue Green Deployment DatabaseWeb app DatabaseWeb appWeb app Database Web app Database User requests Router OldVersion NewVersion Source : http://martinfowler.com/bliki/BlueGreenDeployment.html Thursday, April 16, 15

34. Canary releasing DatabaseWeb app DatabaseWeb appWeb app Database Web app Database User requests Router OldVersion NewVersion Most users 95% Some users 5% Source : http://martinfowler.com/bliki/CanaryRelease.html Thursday, April 16, 15

35. Thank you ! QUESTIONS ? Thursday, April 16, 15

Continuous delivery with jenkins, docker and exoscale

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Continuous delivery with jenkins, docker and exoscale

Similar to Continuous delivery with jenkins, docker and exoscale (20)

Recently uploaded

Recently uploaded (20)

Continuous delivery with jenkins, docker and exoscale