Continuous delivery with Jenkins, Docker and Mesos/Marathon - jbcnconfJulia Mateo
Continuous delivery uses practices like Docker, Jenkins, and Mesos/Marathon to ensure code changes can be rapidly and safely deployed to production. Docker provides containerization which allows fast and robust deployment using images. Jenkins can be configured with plugins to build, test, and deploy Docker images to a Mesos/Marathon cluster for production. Mesos/Marathon provide scalability, fault tolerance, and resource sharing across frameworks and applications in a cluster.
Sreenivas Makam presented an overview of Docker 1.9 features at a Docker Meetup in Bangalore on December 5, 2015. Key features included multi-host networking going to production, Docker Swarm going to production, storage plugin improvements, and better integration of Docker orchestration tools like Compose and Swarm. The presentation covered Docker's container networking model, libnetwork, Overlay networking, volumes, Swarm, and other changes in Docker 1.9 like Compose support for Windows and integration with Toolbox. It concluded with a demo of a multi-container counter app using Docker CLI, Compose, and Swarm.
Catching up with what has happened with logging in Docker since late 2014 all the way up to the recently released Docker 0.10. Also, presenting my view on a comprehensive approach to monitoring Docker using the API to get events, logs, stats with a little bit of self promotion in pointing out that we have recently released an implementation of comprehensive monitoring as part of a Sumo Logic collector source.
OpenNebulaConf 2016 - Evolution of OpenNebula at Netways by Sebastian Saemann...OpenNebula Project
We at Netways are using OpenNebula in production for more than 4 years now. I will show you and talk about the evolution of our cloud infrastructure from the early days to now with focus on the actual setup and its components, including Ceph, Puppet/Foreman and Fog.
Are you still using FTP to deploy your code? Are you still manually performing the same steps of deploying a feature, again and again? How many hours have you spent on ssh-ing into the server, pulling the repo, migrating the database, reloading the web server and so on, for each deployment?? Ever wondered if there is a process as simple as a single click to perform all these steps for you?
Automated Deployment does exactly these things for you. It takes the burden of remembering all the steps required in each deployment process and execute it smoothly.
Delivering eBay's CI Solution with Apache Mesos & Docker - DockerCon 2014ahunnargikar
This document discusses eBay's use of Apache Mesos, Docker, and Jenkins to improve their continuous integration (CI) solution. They were facing issues with thousands of underutilized VMs for running builds and managing different OSes and versions. Their new solution uses Mesos for cluster management, Marathon to launch Jenkins masters, and the Jenkins Mesos plugin to launch Dockerized build slaves. This allows them to standardize on Docker containers to isolate dependencies and OS flavors, improving utilization and maintenance while enabling polyglot builds.
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...OpenNebula Project
Cloud providers are constantly addressing the technology limitations on their infrastructures, which must be overcome to meet customer needs. On this presentation, we will demonstrate how technological agnosticism and management flexibility of OpenNebula has allowed Todoencloud to provide the most efficient open source solution to the needs of its customers, choosing the most appropriate virtualization technology (Xen and KVM), storage approach (ZFS vs CEPH), Cloud Bursting solutions (Azure, Amazon) and customized networking topologies.
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebula Project
In this 90-minute hands-on workshop, some of the key contributors to OpenNebula will walk attendees through the configuration and integration aspects of the computing subsystem in OpenNebula. The session will also include lightning talks by community members describing aspects related to Hypervisors and Containers with OpenNebula:
Deployment scenarios
Integration
Tuning & debugging
Best practices
Continuous delivery with Jenkins, Docker and Mesos/Marathon - jbcnconfJulia Mateo
Continuous delivery uses practices like Docker, Jenkins, and Mesos/Marathon to ensure code changes can be rapidly and safely deployed to production. Docker provides containerization which allows fast and robust deployment using images. Jenkins can be configured with plugins to build, test, and deploy Docker images to a Mesos/Marathon cluster for production. Mesos/Marathon provide scalability, fault tolerance, and resource sharing across frameworks and applications in a cluster.
Sreenivas Makam presented an overview of Docker 1.9 features at a Docker Meetup in Bangalore on December 5, 2015. Key features included multi-host networking going to production, Docker Swarm going to production, storage plugin improvements, and better integration of Docker orchestration tools like Compose and Swarm. The presentation covered Docker's container networking model, libnetwork, Overlay networking, volumes, Swarm, and other changes in Docker 1.9 like Compose support for Windows and integration with Toolbox. It concluded with a demo of a multi-container counter app using Docker CLI, Compose, and Swarm.
Catching up with what has happened with logging in Docker since late 2014 all the way up to the recently released Docker 0.10. Also, presenting my view on a comprehensive approach to monitoring Docker using the API to get events, logs, stats with a little bit of self promotion in pointing out that we have recently released an implementation of comprehensive monitoring as part of a Sumo Logic collector source.
OpenNebulaConf 2016 - Evolution of OpenNebula at Netways by Sebastian Saemann...OpenNebula Project
We at Netways are using OpenNebula in production for more than 4 years now. I will show you and talk about the evolution of our cloud infrastructure from the early days to now with focus on the actual setup and its components, including Ceph, Puppet/Foreman and Fog.
Are you still using FTP to deploy your code? Are you still manually performing the same steps of deploying a feature, again and again? How many hours have you spent on ssh-ing into the server, pulling the repo, migrating the database, reloading the web server and so on, for each deployment?? Ever wondered if there is a process as simple as a single click to perform all these steps for you?
Automated Deployment does exactly these things for you. It takes the burden of remembering all the steps required in each deployment process and execute it smoothly.
Delivering eBay's CI Solution with Apache Mesos & Docker - DockerCon 2014ahunnargikar
This document discusses eBay's use of Apache Mesos, Docker, and Jenkins to improve their continuous integration (CI) solution. They were facing issues with thousands of underutilized VMs for running builds and managing different OSes and versions. Their new solution uses Mesos for cluster management, Marathon to launch Jenkins masters, and the Jenkins Mesos plugin to launch Dockerized build slaves. This allows them to standardize on Docker containers to isolate dependencies and OS flavors, improving utilization and maintenance while enabling polyglot builds.
OpenNebulaConf 2016 - OpenNebula, a story about flexibility and technological...OpenNebula Project
Cloud providers are constantly addressing the technology limitations on their infrastructures, which must be overcome to meet customer needs. On this presentation, we will demonstrate how technological agnosticism and management flexibility of OpenNebula has allowed Todoencloud to provide the most efficient open source solution to the needs of its customers, choosing the most appropriate virtualization technology (Xen and KVM), storage approach (ZFS vs CEPH), Cloud Bursting solutions (Azure, Amazon) and customized networking topologies.
OpenNebulaConf 2016 - Hypervisors and Containers Hands-on Workshop by Jaime M...OpenNebula Project
In this 90-minute hands-on workshop, some of the key contributors to OpenNebula will walk attendees through the configuration and integration aspects of the computing subsystem in OpenNebula. The session will also include lightning talks by community members describing aspects related to Hypervisors and Containers with OpenNebula:
Deployment scenarios
Integration
Tuning & debugging
Best practices
Microsoft Azure Container Service - DockerCHNguyen Anh Tu
This document provides an overview and agenda for a presentation on Microsoft Azure Container Service. The presentation will cover deploying to ACS, Mesosphere DC/OS and Marathon, Docker Swarm, and a demo. It will also provide more information on DC/OS and Docker integration with Windows.
Forget MAMP and WAMP, Use Virtual Box to Have a Real Ubuntu Serveraaroncouch
This document provides instructions for setting up a virtual Ubuntu server environment using VirtualBox for Drupal development. It discusses advantages of using VirtualBox over other options and recommends installing Drubuntu to easily configure LAMP. Step-by-step instructions are given for downloading VirtualBox and Ubuntu Server, configuring networking and LAMP, installing Drupal, adding databases and virtual hosts. Additional tips are included for managing packages, running headless, and using Vim.
VCCW - Vagrant based WordPress development environmentTakayuki Miyauchi
This document describes VCCW, a Vagrant-based development environment for WordPress theme and plugin developers. It includes details on what technologies are installed (like PHP, MySQL, WordPress, and tools), how to set up and use the environment, customization options, deployment with Wordmove, and tips for automated testing and continuous integration.
1. This document discusses Microsoft and Docker, including how to deploy Docker containers on Azure. It provides an overview of Azure and Microsoft's support for open source software.
2. Methods for deploying Docker containers on Azure include using a Docker VM extension template, Docker Machine with the Azure driver, and Azure Container Service.
3. The document also covers upcoming integrations between Docker and Windows, such as Windows Server containers, Hyper-V containers, and the Docker beta for Windows developers.
Docker Compose allows users to define and run multi-container Docker applications with a single command (docker up). It uses a YAML file to configure the application's services and Docker to automatically build images and link containers. With Compose, complex applications can be started and stopped with a single command, rather than multiple docker run commands. It also integrates with the Docker API, allowing it to work with tools like Docker Swarm for multi-host clusters.
This document provides an overview and agenda for getting started with Docker. It introduces the main Docker tools including Kitematic, Docker Machine, Docker Compose, Docker Registry, Docker Swarm, and Docker Engine. It explains that these tools each have a specific role in the Docker platform and allow users to build, ship, and run containerized applications. The document concludes by mentioning it will provide a demo walking through installing Docker Toolbox, building and running a Node.js app on Azure, and using Docker Compose to build a Python web app.
OpenNebulaConf 2016 - Networking, NFVs and SDNs Hands-on Workshop by Rubén S....OpenNebula Project
In this 90-minute hands-on workshop, some of the key contributors to OpenNebula will walk attendees through the configuration and integration aspects of the networking subsystem in OpenNebula. The session will also include lightning talks by community members describing aspects related to Networking, NFVs and SDNs with OpenNebula:
- Deployment scenarios
- Integration
- Tuning & debugging
- Best practices
Docker allows users to run applications in isolated containers using images from a registry similar to an app store. It simplifies deploying applications by allowing them to run without installing dependencies on the host machine. The docker architecture includes a client, host with docker daemon, images used to create containers which run applications, and a registry to store images. Users can install docker, search for images, run containers from images, check running containers, kill containers, and share data between containers and hosts.
Docker - Demo on PHP Application deployment Arun prasath
Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more.
In this demo, I will show how to build a Apache image from a Dockerfile and deploy a PHP application which is present in an external folder using custom configuration files.
In this session, we learnt about Docker ONBUILD triggers, how these triggers work and how to use them. In addition, we covered basic docker-compose introduction by demonstrating how to a mini microservices application (with 2 nodes). The session run for 30 minutes. the code sample used in the meetup can be found at github.com/Codefresh-Examples/express-angular-mongo
For any question please email us at contact@codefresh.io
Passionate about Docker technology and want to join our team? give us a shout at joinus@codefresh.io
Join our meetup to attend future sessions online @
meetup.com/Containers-101-online-meetup/
This document summarizes a presentation on Docker security and least-privilege microservices from DockerCon US 2015. It discusses the history and principles of least-privilege, how Docker supports fine-grained access controls for containers through features like namespaces, capabilities, and security profiles. It also covers making containers more secure by default and tools like Docker Bench for assessing container security. The conclusion is that Docker allows least-privilege microservices and better tools are still needed to define per-container security profiles.
Wocker provides a Docker-based rapid development environment for WordPress. It allows users to create new WordPress environments in just 3 seconds using Docker containers. Wocker containers run as isolated processes on the host operating system alongside other containers, sharing just the application and dependencies rather than an entire guest OS, making development more efficient compared to traditional virtual machines. Users can get started with Wocker by installing Vagrant, VirtualBox, cloning the Wocker GitHub repository, and running vagrant up to launch the environment.
The document discusses using OpenStack Ironic to provision bare metal servers. Key points include:
- Ironic allows provisioning of physical servers alongside virtual instances managed by Nova.
- Commands are provided to enroll bare metal nodes in Ironic, create ports, validate and power on nodes, and deploy an image using Nova.
- Tips discuss issues with large-scale deployments, PXE boot, and driver/library conflicts.
OSv presentation from Linux Foundation Collaboration SummitDon Marti
OSv is a lightweight operating system designed to improve performance and administration for applications deployed in the cloud. Learn about the speed and manageability wins from a brand-new OS that works on your private or public cloud.
DockerDay2015: Docker orchestration for sysadminDocker-Hanoi
1) The document discusses Docker Swarm and Docker Machine, which are tools for orchestrating and provisioning Docker containers across multiple hosts.
2) Docker Swarm exposes multiple Docker engines as a single virtual engine and includes fault tolerance features like leader election and replication of the swarm manager.
3) Docker Machine can provision VMs on various platforms and install and manage Docker Engine, enabling easy deployment and management of Docker clusters.
Dockerizing your applications - Docker workshop @TwitterdotCloud
This document discusses how to dockerize desktop applications like Firefox by running them in Docker containers with access to the host desktop, audio devices, and data volumes. It provides instructions for downloading Docker and example Dockerfiles, building images, and running Firefox in both ephemeral and stateful containers with various volume mounting techniques to access files on the host or in data containers.
This document discusses Docker solutions implemented at Hotelsoft to address various challenges in running a multi-tenant SaaS application on Docker across multiple data centers. Key solutions discussed include using Phusion Base image to run multiple processes in a container, securing containers, granting internal access to containers, transferring files, multi-host networking using Weave, and load balancing applications with HAProxy.
This document summarizes enhancements being made to the VMware Nova Compute Driver. It outlines key areas for improvement like launching OVF disk images, VNC console support, attaching/detaching iSCSI volumes, guest info, host operations, VLAN support, live and cold migration. It then provides details on specific driver enhancements like supporting sparse/streamOptimized disks, power on/off, getting VNC console, injecting network info, volume attachment/detachment, host resource info, and live migration functions. The document also discusses linked clones, custom image properties in Glance for VMware adapter/disk types and guest OS, and VNC configuration flags. Lastly, it includes a diagram showing the relationship between
- Docker can be integrated with CloudStack in several ways, including running Docker in CloudStack virtual machine guests, packaging CloudStack as Docker containers, and using Docker orchestrators to manage containers.
- CloudStack could potentially be re-architected to run its components in Docker containers and use Docker networking for isolation, with an orchestrator like Mesos or Kubernetes managing the CloudStack application.
- There are open questions around whether CloudStack or other orchestrators should schedule virtual machines or containers as the primary compute resource in a private cloud data center.
Docker Networking - Common Issues and Troubleshooting TechniquesSreenivas Makam
This document discusses Docker networking components and common issues. It covers Docker networking drivers like bridge, host, overlay, topics around Docker daemon access and configuration behind firewalls. It also discusses container networking best practices like using user-defined networks instead of links, connecting containers to multiple networks, and connecting managed services to unmanaged containers. The document is intended to help troubleshoot Docker networking issues.
Microsoft Azure Container Service - DockerCHNguyen Anh Tu
This document provides an overview and agenda for a presentation on Microsoft Azure Container Service. The presentation will cover deploying to ACS, Mesosphere DC/OS and Marathon, Docker Swarm, and a demo. It will also provide more information on DC/OS and Docker integration with Windows.
Forget MAMP and WAMP, Use Virtual Box to Have a Real Ubuntu Serveraaroncouch
This document provides instructions for setting up a virtual Ubuntu server environment using VirtualBox for Drupal development. It discusses advantages of using VirtualBox over other options and recommends installing Drubuntu to easily configure LAMP. Step-by-step instructions are given for downloading VirtualBox and Ubuntu Server, configuring networking and LAMP, installing Drupal, adding databases and virtual hosts. Additional tips are included for managing packages, running headless, and using Vim.
VCCW - Vagrant based WordPress development environmentTakayuki Miyauchi
This document describes VCCW, a Vagrant-based development environment for WordPress theme and plugin developers. It includes details on what technologies are installed (like PHP, MySQL, WordPress, and tools), how to set up and use the environment, customization options, deployment with Wordmove, and tips for automated testing and continuous integration.
1. This document discusses Microsoft and Docker, including how to deploy Docker containers on Azure. It provides an overview of Azure and Microsoft's support for open source software.
2. Methods for deploying Docker containers on Azure include using a Docker VM extension template, Docker Machine with the Azure driver, and Azure Container Service.
3. The document also covers upcoming integrations between Docker and Windows, such as Windows Server containers, Hyper-V containers, and the Docker beta for Windows developers.
Docker Compose allows users to define and run multi-container Docker applications with a single command (docker up). It uses a YAML file to configure the application's services and Docker to automatically build images and link containers. With Compose, complex applications can be started and stopped with a single command, rather than multiple docker run commands. It also integrates with the Docker API, allowing it to work with tools like Docker Swarm for multi-host clusters.
This document provides an overview and agenda for getting started with Docker. It introduces the main Docker tools including Kitematic, Docker Machine, Docker Compose, Docker Registry, Docker Swarm, and Docker Engine. It explains that these tools each have a specific role in the Docker platform and allow users to build, ship, and run containerized applications. The document concludes by mentioning it will provide a demo walking through installing Docker Toolbox, building and running a Node.js app on Azure, and using Docker Compose to build a Python web app.
OpenNebulaConf 2016 - Networking, NFVs and SDNs Hands-on Workshop by Rubén S....OpenNebula Project
In this 90-minute hands-on workshop, some of the key contributors to OpenNebula will walk attendees through the configuration and integration aspects of the networking subsystem in OpenNebula. The session will also include lightning talks by community members describing aspects related to Networking, NFVs and SDNs with OpenNebula:
- Deployment scenarios
- Integration
- Tuning & debugging
- Best practices
Docker allows users to run applications in isolated containers using images from a registry similar to an app store. It simplifies deploying applications by allowing them to run without installing dependencies on the host machine. The docker architecture includes a client, host with docker daemon, images used to create containers which run applications, and a registry to store images. Users can install docker, search for images, run containers from images, check running containers, kill containers, and share data between containers and hosts.
Docker - Demo on PHP Application deployment Arun prasath
Docker is an open-source project to easily create lightweight, portable, self-sufficient containers from any application. The same container that a developer builds and tests on a laptop can run at scale, in production, on VMs, bare metal, OpenStack clusters, public clouds and more.
In this demo, I will show how to build a Apache image from a Dockerfile and deploy a PHP application which is present in an external folder using custom configuration files.
In this session, we learnt about Docker ONBUILD triggers, how these triggers work and how to use them. In addition, we covered basic docker-compose introduction by demonstrating how to a mini microservices application (with 2 nodes). The session run for 30 minutes. the code sample used in the meetup can be found at github.com/Codefresh-Examples/express-angular-mongo
For any question please email us at contact@codefresh.io
Passionate about Docker technology and want to join our team? give us a shout at joinus@codefresh.io
Join our meetup to attend future sessions online @
meetup.com/Containers-101-online-meetup/
This document summarizes a presentation on Docker security and least-privilege microservices from DockerCon US 2015. It discusses the history and principles of least-privilege, how Docker supports fine-grained access controls for containers through features like namespaces, capabilities, and security profiles. It also covers making containers more secure by default and tools like Docker Bench for assessing container security. The conclusion is that Docker allows least-privilege microservices and better tools are still needed to define per-container security profiles.
Wocker provides a Docker-based rapid development environment for WordPress. It allows users to create new WordPress environments in just 3 seconds using Docker containers. Wocker containers run as isolated processes on the host operating system alongside other containers, sharing just the application and dependencies rather than an entire guest OS, making development more efficient compared to traditional virtual machines. Users can get started with Wocker by installing Vagrant, VirtualBox, cloning the Wocker GitHub repository, and running vagrant up to launch the environment.
The document discusses using OpenStack Ironic to provision bare metal servers. Key points include:
- Ironic allows provisioning of physical servers alongside virtual instances managed by Nova.
- Commands are provided to enroll bare metal nodes in Ironic, create ports, validate and power on nodes, and deploy an image using Nova.
- Tips discuss issues with large-scale deployments, PXE boot, and driver/library conflicts.
OSv presentation from Linux Foundation Collaboration SummitDon Marti
OSv is a lightweight operating system designed to improve performance and administration for applications deployed in the cloud. Learn about the speed and manageability wins from a brand-new OS that works on your private or public cloud.
DockerDay2015: Docker orchestration for sysadminDocker-Hanoi
1) The document discusses Docker Swarm and Docker Machine, which are tools for orchestrating and provisioning Docker containers across multiple hosts.
2) Docker Swarm exposes multiple Docker engines as a single virtual engine and includes fault tolerance features like leader election and replication of the swarm manager.
3) Docker Machine can provision VMs on various platforms and install and manage Docker Engine, enabling easy deployment and management of Docker clusters.
Dockerizing your applications - Docker workshop @TwitterdotCloud
This document discusses how to dockerize desktop applications like Firefox by running them in Docker containers with access to the host desktop, audio devices, and data volumes. It provides instructions for downloading Docker and example Dockerfiles, building images, and running Firefox in both ephemeral and stateful containers with various volume mounting techniques to access files on the host or in data containers.
This document discusses Docker solutions implemented at Hotelsoft to address various challenges in running a multi-tenant SaaS application on Docker across multiple data centers. Key solutions discussed include using Phusion Base image to run multiple processes in a container, securing containers, granting internal access to containers, transferring files, multi-host networking using Weave, and load balancing applications with HAProxy.
This document summarizes enhancements being made to the VMware Nova Compute Driver. It outlines key areas for improvement like launching OVF disk images, VNC console support, attaching/detaching iSCSI volumes, guest info, host operations, VLAN support, live and cold migration. It then provides details on specific driver enhancements like supporting sparse/streamOptimized disks, power on/off, getting VNC console, injecting network info, volume attachment/detachment, host resource info, and live migration functions. The document also discusses linked clones, custom image properties in Glance for VMware adapter/disk types and guest OS, and VNC configuration flags. Lastly, it includes a diagram showing the relationship between
- Docker can be integrated with CloudStack in several ways, including running Docker in CloudStack virtual machine guests, packaging CloudStack as Docker containers, and using Docker orchestrators to manage containers.
- CloudStack could potentially be re-architected to run its components in Docker containers and use Docker networking for isolation, with an orchestrator like Mesos or Kubernetes managing the CloudStack application.
- There are open questions around whether CloudStack or other orchestrators should schedule virtual machines or containers as the primary compute resource in a private cloud data center.
Docker Networking - Common Issues and Troubleshooting TechniquesSreenivas Makam
This document discusses Docker networking components and common issues. It covers Docker networking drivers like bridge, host, overlay, topics around Docker daemon access and configuration behind firewalls. It also discusses container networking best practices like using user-defined networks instead of links, connecting containers to multiple networks, and connecting managed services to unmanaged containers. The document is intended to help troubleshoot Docker networking issues.
ContainerDayVietnam2016: Dockerize a small businessDocker-Hanoi
This document discusses how Docker can transform development and deployment processes for modern applications. It outlines some of the challenges of developing and deploying applications across different environments, and how Docker addresses these challenges through containerization. The document then provides examples of how to dockerize a Rails and Python application, set up an Nginx reverse proxy with Let's Encrypt, and configure a Docker cluster for continuous integration testing.
The slides talk about Docker and container terminologies but will also be able to see the big picture of where & how it fits into your current project/domain.
Topics that are covered:
1. What is Docker Technology?
2. Why Docker/Containers are important for your company?
3. What are its various features and use cases?
4. How to get started with Docker containers.
5. Case studies from various domains
Docker Seattle Meetup April 2015 - The Docker Orchestration Ecosystem on AzurePatrick Chanezon
This document discusses the Docker ecosystem and provides an overview of containerization technologies. It covers the history of containerization from mainframes in the 1960s to Docker in 2013. It discusses Docker's success due to cloud adoption, portability, and hybrid environments. It outlines the Docker ecosystem including Docker Engine, Docker Hub, Docker Machine, Docker Compose, Docker Swarm, and Kitematic. It also discusses companies in the Docker ecosystem like Docker Inc., CoreOS, Deis, Kubernetes, Cloud Foundry/IBM Bluemix, and others.
What is this Docker and Microservice thing that everyone is talking about? A primer to Docker and Microservice and how the two concepts complement each other.
Docker New York Meetup May 2015 - The Docker Orchestration Ecosystem on Azure Patrick Chanezon
Docker Inc. provides products and services for managing containers. The Docker ecosystem includes open source tools for building, shipping, and running applications packaged into containers. Key components include Docker Engine for building containers, Docker Hub for sharing container images, and orchestration tools like Docker Swarm and Kubernetes for deploying containers across multiple hosts. Many companies are developing technologies that work with Docker to provide additional container management capabilities.
Introduction to Docker and Monitoring with InfluxDataInfluxData
In this webinar, Gary Forgheti, Technical Alliance Engineer at Docker, and Gunnar Aasen, Partner Engineering, provide an introduction to Docker and InfluxData. From there, they will show you how to use the two together to setup and monitor your containers and microservices to properly manage your infrastructure and track key metrics (CPU, RAM, storage, network utilization), as well as the availability of your application endpoints.
Introduction to Docker storage, volume and imageejlp12
Docker storage drivers allow images and containers to be stored in different ways by implementing a pluggable storage driver interface. Common storage drivers include overlay2, aufs, devicemapper, and vfs. Images are composed of read-only layers stacked on top of each other, with containers adding a writable layer. Storage can be persisted using volumes, bind mounts, or tmpfs mounts. Strategies for managing persistent container data include host-based storage, volume plugins, and container storage platforms.
Docker allows developers to package applications and dependencies into isolated environments called containers. Containers simplify deployment by reducing complexity and improving repeatability. Dockerfiles provide a simple way to describe how to build images that define the containers. This allows building stateless infrastructure and running multiple versions of programs on one server, improving scaling. However, Docker requires more storage and memory than virtual machines and only runs on Linux currently. It is a useful tool but does not solve all problems like replication, bad code, or automatically scale applications.
Docker San Francisco Meetup April 2015 - The Docker Orchestration Ecosystem o...Patrick Chanezon
The document discusses the Docker ecosystem including:
- The history and components of Docker including the Docker Engine, Hub, Machine, Compose, and Swarm.
- How Docker provides isolation using Linux kernel features like namespaces and cgroups.
- Other projects in the Docker ecosystem like Weave, Flocker, and Powerstrip.
- Orchestration tools like Docker Swarm and Kubernetes that manage Docker containers across multiple hosts.
- Platforms that are built on Docker like CoreOS, Deis, Cloud Foundry, and IBM Bluemix.
Experts Live Europe 2017 - Why you should care about Docker - an introductionMarc Müller
The popularity of Docker has grown massively in recent years. So what are the benefits for development and operations? This talk provides you a proper introduction into the topic and answers the questions around the differences between Linux and Windows containers, the development workflow and enterprise grade hosting scenarios.
This session provides a quick introduction of Docker containers on Linux, and how to configure it on Ubuntu running on a POWER8 processor-based system. We discuss requisites, steps, repositories and use cases. We also make a comparison between Docker and AIX Workload Partitions. During the presentation we demonstrate how to deploy and use containers, and how to manager Docker containers on Power.
An overview on docker and container technology behind it. Lastly, we discuss few tools that might come handy when dealing with large number of containers management.
CloudStack Collab Conference 2015 Run CloudStack in DockerCloudOps2005
Slides from Pierre-Luc Dion's presentation on what he has learned running CloudStack in Docker at the CloudStack Collaboration Conference in Dublin, October 2015.
This document discusses dockerizing Apache CloudStack. It notes that dockerizing CloudStack provides deployment simplicity, allows faster proof-of-concept deployments, and makes CloudStack easier to distribute. Some challenges include constraints around systemvm disk mounting and testing packages. The document demonstrates deploying CloudStack components like the simulator, Marvin, and CloudMonkey using Docker containers with links and volumes. It finds that dockerizing CloudStack is faster than traditional deployment but requires bash scripts and image sizes are large. Overall dockerizing CloudStack provides benefits but could be improved by using smaller base images and deploying from a WAR file.
The document provides an overview of getting started with Docker. It discusses what Docker is, how containerization differs from virtualization, and how to install Docker. It covers building Docker images using Dockerfiles, the difference between images and containers, and common Docker commands. The document also compares traditional deployment workflows to those using Docker, demonstrating how Docker can help ensure consistency across environments.
Deploying Windows Containers on Windows Server 2016Ben Hall
This document discusses deploying Docker containers on Windows Server 2016. It provides an introduction to Docker and containers, explains how containers work on Windows, and demonstrates how to deploy common applications like IIS and ASP.NET within Windows containers. It also covers building Windows-based Docker images, running containers in production, and the future of containers on Windows platforms.
The document provides an introduction to containerization using Docker. It discusses problems with traditional infrastructure approaches, such as time-consuming installation/configuration, inconsistencies across environments, and operational support challenges. Docker addresses these issues by allowing applications and their dependencies to run in isolated containers that are portable and share resources efficiently. Key Docker concepts are then explained, including images, containers, registries, networking, and common commands. The document demonstrates how to install Docker and run basic operations like pulling, running, and inspecting containers.
Similar to Build a Docker Swarm cluster on Azure (20)
On utilise Git tous les jours. Cependant, savez-vous comment enregistrer votre travail sans le comiter? Ou encore comment nettoyer votre historique de commits? C’est quoi la différence entre un merge et un rebase? Ou encore comment faites-vous le distinguo entre un tag et une branche de release? La dernière fois qu’un collègue vous a parlé d’un pic à cerise, qu’en avez-vous pensé? Pourquoi votre collègue, sur GitHub, a-t-il fait un tag “Verified” sur ses commits et pas vous?
Cette présentation s’adresse à tous ceux utilisant Git avec une interface graphique ou en ligne de commande. On discutera des usages de base de Git, et via des cas pratiques, on verra comment utiliser Git pour résoudre nos problèmes.
Après une courte introduction sur comment utiliser Git pour aider vos collègues ou la communauté qui travaille sur le même projet, nous aborderons comment Git peut vous aider sur votre ordinateur à régler des problèmes courants.
À la fin de la présentation, vous aurez appris des commandes Git bien pratiques au quotidien et vous laisserez un historique propre dans vos projets.
On Saturday April, 21st 2018 was the 6th edition of the Global Azure Bootcamp, Maxime and I present 2 way to deploy container on Azure:
Build your own Swarm Cluster
Using AKS (Azure Kubernetes Services)
Sécuriser Docker - Utilisation du CIS Docker 1.12 by @guytalbotJulien Maitrehenry
This document discusses securing Docker containers using the CIS Docker 1.12.0 Benchmark. It provides an introduction to Guy Talbot and his background in IT security. It then outlines the objectives, framework, and means of security including hardening, benchmarks, profiles, and recommendation cards. Specifically, it discusses hardening the host system, daemon configuration, image and build files, and runtime controls to help secure Docker containers.
This document introduces Docker containers. It begins by explaining that Docker solves the problem of inconsistent environments by packaging applications with all their dependencies into standardized units called containers. It then defines what a Docker image is, as a read-only template with layered filesystem changes that form the basis for containers. Finally, it describes how containers are running instances of images that isolate processes but share resources with the host machine, making them lightweight and portable compared to virtual machines.
This document discusses fullstack monitoring and outlines the key components needed: collecting metrics from servers and applications, alerting when issues arise, and visualizing metrics. Metrics can be collected using agents, scripts, logs, and from application code. They are sent to storage locations like Zabbix Server, Elasticsearch, and InfluxDB. Alerting involves notifying teams when things go down or abnormal behavior is detected using various channels. Visualization of metrics over time is best done with Grafana, which allows viewing metrics from multiple sources together on responsive dashboards.
Docker cluster with swarm, consul, registrator and consul-templateJulien Maitrehenry
This document discusses using Docker swarm, Consul, Registrator, and Consul-template together to create a clustered Docker environment with service discovery and auto-configuration capabilities. It describes how to create a swarm cluster, register nodes with Consul for service discovery, use Registrator to register Docker services with Consul, and utilize Consul-template to generate configuration files from Consul for services like load balancers.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
“An Outlook of the Ongoing and Future Relationship between Blockchain Technologies and Process-aware Information Systems.” Invited talk at the joint workshop on Blockchain for Information Systems (BC4IS) and Blockchain for Trusted Data Sharing (B4TDS), co-located with with the 36th International Conference on Advanced Information Systems Engineering (CAiSE), 3 June 2024, Limassol, Cyprus.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
5. WHAT IS CLOUDSTOR
➤ Cloudstor is a modern volume plugin built by Docker.
➤ It comes pre-installed and pre-configured in Docker Swarms deployed on Docker for
Azure
➤ Docker swarm mode tasks and regular Docker containers can use a volume created
with Cloudstor to mount a persistent data volume.
➤ Cloudstor relies on shared storage infrastructure provided by Azure
➤ Specifically File Storage shares exposed over SMB
➤ Direct attached storage, which is used to satisfy very low latency / high IOPS
requirements, is not yet supported
6. INSTALLING CLOUDSTOR
➤ If Cloudstor is not installed, you need to find the lastest version here: https://
store.docker.com/community/images/docker4x/cloudstor/tags
➤ For configuring the plugin, you will need a Storage Account on Azure name and
access key. You can find on your Storage Account > Access Keys page
7. INSTALLING CLOUDSTOR
➤ If you use Docker on Linux, the Account Storage should have Secure transfer
required disabled, it's not supported by Linux for now.
10. TRAEFIK
Træfik (pronounced like traffic) is a modern HTTP reverse proxy and load balancer made
to deploy microservices with ease.
➤ Supports several backends (Docker, Kubernetes, Amazon ECS, and more)
➤ No dependency hell, single binary made with go
➤ Tiny official official docker image
➤ Hot-reloading of configuration. No need to restart the process
➤ Websocket, HTTP/2, GRPC ready
➤ Let’s Encrypt support (Automatic HTTPS with renewal)
➤ High Availability with cluster mode (beta)
11.
12.
13.
14.
15. PROBLEMS WE HAD
➤ Azure will reboot your servers without notice
➤ Azure agent will make a lot of update and can restart your VMs
➤ Some time all your agents on your managers will update in the same time
➤ Bye bye cluster
➤ Egress connection have a hard idle timeout of 4 minutes
➤ You need to transmit data
➤ TCP Keepalived doesn’t work
➤ SMB and SQLite database doesn’t work well together
➤ Can’t add mount flag