Docker on mesos
•
6 likes•2,189 views
This document discusses using Docker containers with the Mesos cluster manager. Mesos provides a uniform computing platform and reduces costs by allowing containers to be run across a cluster of machines. Using Docker with Mesos allows containers to be horizontally scaled across the cluster while still being able to run other workloads. Service discovery when using Docker on Mesos is still evolving, with solutions based on DNS and Mesos events.
Report
Share
Report
Share
Download to read offline
Recommended
Building Web Scale Apps with Docker and Mesos by Alex Rukletsov (Mesosphere)
Operating apps at web scale has become the new normal, but has been out of reach for most companies. Join us as we show you how to deploy and manage your Docker containers at scale. See how easy it is to build highly-available, fault-tolerant web scale apps using Docker with the Mesos cluster scheduler. Docker plus Mesos is a new way to scale applications. Together they give you capabilities similar to Google’s Borg, the Googleplex’s secret weapon of scalability and fault tolerance.
Mesos ♥ Docker
Mesos and Docker are very complementary. Aish Fenton and Pablo Delgado, from OpenTable's Data Science team, talk about how they're used at OpenTable.
Docker at Shopify: From This-Looks-Fun to Production by Simon Eskildsen (Shop...
Since July 2014 Shopify's been serving thousands of requests per second of production web traffic from Docker containers. This was an 8 month effort, with multiple pivots of direction from the team—and we're only getting started. This talk covers the lessons learned through the trial and error of an in-flight architecture redesign, spanning hundreds of hosts, as well as the technical vision of the future of our platform.
Docker, Mesos, Spark
The document discusses integrating Docker, Mesos, Spark, Marathon, and Chronos into a unified big data platform. Docker provides containerization capabilities, while Mesos is a distributed resource manager that supports running Docker containers. Spark can run natively on Mesos by running Spark as a Docker container within Mesos. Marathon and Chronos help manage long-running services and cron jobs on Mesos. The author will demonstrate how to put these technologies together into an integrated system and address running Spark on Mesos in Docker containers.
Scale your docker containers with Mesos
Mesos allows clusters of nodes to be treated as one big computer by sharing computational resources like cores, memory, and disks. It is a top-level Apache project that acts as a cluster resource negotiator, scaling to 10,000s of nodes in a fault-tolerant manner. Mesos supports running Docker containers at scale through frameworks like Marathon and Chronos, which provide interfaces for launching long-running and batch/one-off services respectively. Twitter uses Mesos as the "cornerstone" of their elastic compute infrastructure to build new services and scale to millions of daily users.
Achieving CI/CD with Kubernetes
Kubernetes has evolved from Borg at Google to provide an open source platform for automating deployment, scaling, and management of containerized applications. The presentation discusses how to use Jenkins, Fabric8, and other tools to achieve continuous integration and delivery (CI/CD) with Kubernetes. It provides examples of configuring Jenkins and Fabric8 to build, test, and deploy container images to a Kubernetes cluster, illustrating an end-to-end CI/CD workflow on Kubernetes.
Scaling Development Environments with Docker
This document discusses using Docker to create a scalable development environment. It outlines setting up containers for different development components like the build server, production servers, and tools. Templates are used to configure container dependencies and build processes. The goal is allowing developers to run all components locally for testing and to reproduce the production environment.
Federated mesos clusters for global data center designs
The document describes Huawei's approach to federating Mesos clusters across multiple data centers. It proposes a multi-master federation approach where each data center runs its own Mesos master that coordinates with other masters. Gossiper modules in each data center gossip with each other to exchange framework and resource information. When one data center reaches a resource threshold, its gossiper will direct work to other data centers based on a simple policy engine. A demo visualization is shown to illustrate work load balancing during normal and failure scenarios.
Recommended
Building Web Scale Apps with Docker and Mesos by Alex Rukletsov (Mesosphere)
Operating apps at web scale has become the new normal, but has been out of reach for most companies. Join us as we show you how to deploy and manage your Docker containers at scale. See how easy it is to build highly-available, fault-tolerant web scale apps using Docker with the Mesos cluster scheduler. Docker plus Mesos is a new way to scale applications. Together they give you capabilities similar to Google’s Borg, the Googleplex’s secret weapon of scalability and fault tolerance.
Mesos ♥ Docker
Mesos and Docker are very complementary. Aish Fenton and Pablo Delgado, from OpenTable's Data Science team, talk about how they're used at OpenTable.
Docker at Shopify: From This-Looks-Fun to Production by Simon Eskildsen (Shop...
Since July 2014 Shopify's been serving thousands of requests per second of production web traffic from Docker containers. This was an 8 month effort, with multiple pivots of direction from the team—and we're only getting started. This talk covers the lessons learned through the trial and error of an in-flight architecture redesign, spanning hundreds of hosts, as well as the technical vision of the future of our platform.
Docker, Mesos, Spark
The document discusses integrating Docker, Mesos, Spark, Marathon, and Chronos into a unified big data platform. Docker provides containerization capabilities, while Mesos is a distributed resource manager that supports running Docker containers. Spark can run natively on Mesos by running Spark as a Docker container within Mesos. Marathon and Chronos help manage long-running services and cron jobs on Mesos. The author will demonstrate how to put these technologies together into an integrated system and address running Spark on Mesos in Docker containers.
Scale your docker containers with Mesos
Mesos allows clusters of nodes to be treated as one big computer by sharing computational resources like cores, memory, and disks. It is a top-level Apache project that acts as a cluster resource negotiator, scaling to 10,000s of nodes in a fault-tolerant manner. Mesos supports running Docker containers at scale through frameworks like Marathon and Chronos, which provide interfaces for launching long-running and batch/one-off services respectively. Twitter uses Mesos as the "cornerstone" of their elastic compute infrastructure to build new services and scale to millions of daily users.
Achieving CI/CD with Kubernetes
Kubernetes has evolved from Borg at Google to provide an open source platform for automating deployment, scaling, and management of containerized applications. The presentation discusses how to use Jenkins, Fabric8, and other tools to achieve continuous integration and delivery (CI/CD) with Kubernetes. It provides examples of configuring Jenkins and Fabric8 to build, test, and deploy container images to a Kubernetes cluster, illustrating an end-to-end CI/CD workflow on Kubernetes.
Scaling Development Environments with Docker
This document discusses using Docker to create a scalable development environment. It outlines setting up containers for different development components like the build server, production servers, and tools. Templates are used to configure container dependencies and build processes. The goal is allowing developers to run all components locally for testing and to reproduce the production environment.
Federated mesos clusters for global data center designs
The document describes Huawei's approach to federating Mesos clusters across multiple data centers. It proposes a multi-master federation approach where each data center runs its own Mesos master that coordinates with other masters. Gossiper modules in each data center gossip with each other to exchange framework and resource information. When one data center reaches a resource threshold, its gossiper will direct work to other data centers based on a simple policy engine. A demo visualization is shown to illustrate work load balancing during normal and failure scenarios.
(Draft) Kubernetes - A Comprehensive Overview
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery called pods. Its main components include a master node that manages the cluster and worker nodes that run the applications. It uses labels to organize resources and selectors to group related objects. Common concepts include pods, services for discovery/load balancing, replica controllers for scaling, and namespaces for isolation. It provides mechanisms for configuration, storage, security, and networking out of the box to ensure containers can run reliably and be easily managed at scale.
Apache Mesos: a simple explanation of basics
Mesos is a distributed systems kernel that allows sharing of computing resources across multiple distributed applications or frameworks. It provides scalability, fault tolerance, and resource isolation. Mesos runs on every machine in a distributed cluster and acts as a mediator between systems and applications. The Mesos architecture uses a master-slave design where the master manages resource offers from slaves to frameworks. Frameworks use schedulers to launch and manage tasks on slaves based on resource availability.
Kubernetes HA @ AppDirect - Montreal Kubernetes Meetup
HA Kubernetes Deployment by Alexandre Gervais, Senior Software Developper, AppDirect
* How AppDirect deploys HA Kubernetes clusters using a multi-master setup
* Kubernetes upgrades and lifecycle
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
- Mesos is a cluster management platform that dynamically allocates resources to distributed applications running on Docker containers. It provides deployment, execution, resource sharing, and data locality capabilities.
- Marathon is a Mesos framework that provides easy deployment and management of Docker containers running long-running applications on Mesos. It exposes a REST API.
- MesosDNS provides service discovery by mapping Mesos tasks to DNS names, but has limitations around identifying ports, caching, health checking, and failover that alternative solutions like lb-marathon aim to address.
Introduction to Apache Mesos
Apache Mesos is a cluster manager that simplifies the complexity of running applications on a shared pool of servers.
ContainerDayVietnam2016: Docker at scale with Mesos
Mesos is an open source cluster manager that provides efficient resource isolation and sharing across distributed applications or frameworks. The document discusses how to run Docker containers on Mesos at scale, including using Marathon for container orchestration. Some key lessons learned are around choosing a container style, service discovery with Mesos-DNS, networking with Calico, and managing secrets, deployments, and Docker limitations.
The Operator Pattern - Managing Stateful Services in Kubernetes
Cloud Native Night, January 2018, Mainz: Talk by Jakob Karalus (@krallistic, IT Consultant at codecentric)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night
Abstract: While it's easy to deploy stateless application with Kubernetes, it's harder for stateful software. Since applications often require custom functionality that Kubernetes can't provide, developers want to add more specialized patterns like automatic backups, failover or rebalancing to their Kubernetes deployments. In this talk, we will look at the Operator Pattern and other possibilities to extend the functionality of Kubernetes and how to use them to operate stateful applications.
Integrating Docker with Mesos and Marathon
This document discusses integrating Docker containers with Mesos and Marathon. It provides an overview of Mesos as a distributed systems kernel and cluster manager with a master-slave architecture. Marathon is described as an application scheduler and cluster-wide process supervisor. It explains that Mesos supports Docker containers and long-running tasks in Marathon can use Docker containers. Sample JSON scripts are provided to configure Docker containerized tasks to run on Mesos through Marathon's REST API. The architecture is revised to show Mesos masters and slaves with ZooKeeper and multiple Marathon schedulers.
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
Immutable infrastructure is a way to success, but what about the lifecycle of individual resources. This talk is about evolution of resources, code structure, Terraform coding tricks, composition and refactoring.
Kubernetes on Top of Mesos on Top of DCOS
Containers, cluster management, microservices, Kubernetes and many other buzzwords are flying around us all the time. Our team is building solutions that make it easy to cope with all the complexity around cluster infrastructure. In this talk we present the project we are working on, namely running Kubernetes on top of the Mesos cluster scheduler. Furthermore we show DCOS which makes it easy to deploy and run Kubernetes with a single command.
Flocker
Introduction to Flocker which is a lightweight volume and container manager.
Meetup details of my presentation:
http://www.meetup.com/Docker-Bangalore/events/222476025/
(APP313) NEW LAUNCH: Amazon EC2 Container Service in Action | AWS re:Invent 2014
The document discusses Amazon EC2 Container Service (ECS), a highly scalable and high performance container management service. It provides an overview of ECS and its key components like tasks, containers, clusters and container instances. The summary also includes a demo showing how to create an ECS cluster, register a task definition and run a task using the WordPress application. It concludes with upcoming features for ECS and notes that pricing is based on underlying AWS resources used.
Kubernetes on CloudStack with coreOS
Intro to coreOS linux distributions and how it can be used to run docker based workloads in the cloud.
coreOS instances can be started in a cloudstack cloud, it makes use of cloud-init basics to
Kubernetes @ meetic
3 years ago, Meetic chose to rebuild it's backend architecture using microservices and an event driven strategy. As we where moving along our old legacy application, testing features became gradually a pain, especially when those features rely on multiple changes across multiple components. Whatever the number of application you manage, unit testing is easy, as well as functional testing on a microservice. A good gherkin framework and a set of docker container can do the job. The real challenge is set in end-to-end testing even more when a feature can involve up to 60 different components.
To solve that issue, Meetic is building a Kubernetes strategy around testing. To do such a thing we need to :
- Be able to generate a docker container for each pull-request on any component of the stack
- Be able to create a full testing environment in the simplest way
- Be able to launch automated test on this newly created environment
- Have a clean-up process to destroy testing environment after tests To separate the various testing environment, we chose to use Kubernetes Namespaces each containing a variant of the Meetic stack. But when it comes to Kubernetes, managing multiple namespaces can be hard. Yaml configuration files need to be shared in a way that each people / automated job can access to them and modify them without impacting others.
This is typically why Meetic chose to develop it's own tool to manage namespace through a cli tool, or a REST API on which we can plug a friendly UI.
In this talk we will tell you the story of our CI/CD evolution to satisfy the need to create a docker container for each new pull request. And we will show you how to make end-to-end testing easier using Blackbeard, the tool we developed to handle the need to manage namespaces inspired by Helm.
Secrets in Kubernetes
This is a presentation I held at "DevOps and Security" -meetup on 5th of April 2016 at RedHat.
Source is available at: https://github.com/jerryjj/devsec_050416
Handling Redis failover with ZooKeeper
This document discusses using ZooKeeper to automatically handle Redis failover. ZooKeeper is an open-source tool that provides primitives for building distributed applications and handles tasks like leader election and quorum management. The presenter describes how his redis_failover Ruby gem uses ZooKeeper to monitor Redis servers, detect failures, and automatically inform clients so they reconnect to the new master, preventing downtime during a failover. Several companies already use this approach with redis_failover to make their Redis infrastructure more robust and fault-tolerant.
Openshift Container Platform on Azure
1) The document describes an Azure Resource Manager (ARM) template for deploying OpenShift Enterprise on Azure. It provisions masters, infra nodes, and worker nodes with load balancing and storage.
2) The ARM template automates the entire deployment process through nested templates for each resource and Bash scripts for configuration. It handles naming, load balancing, storage, networking, and more.
3) The goal is to create a production-ready reference architecture for OpenShift on Azure and automate the deployment process through the ARM template. Current work focuses on deployment, storage, authentication, and documentation. Future work includes additional features and integrations.
Container Days Boston - Kubernetes in production
Kubernetes in Production, From the Ground Up discusses setting up a Kubernetes cluster from scratch using CoreOS, etcd, Docker, and Terraform. The document outlines setting up etcd for high availability using an autoscaling group, configuring the Kubernetes master nodes to run the API server, scheduler, and controller manager as pods, and deploying worker nodes that run the kubelet to join the cluster. The process involves using cloud-init scripts, Terraform, and container images to automate the installation and configuration of all cluster components in a scalable and resilient way.
Working with kubernetes
Providing introduction to kubernetes, various components and architecture. intended for beginers looking to understand the basics, evaluating kubernetes.
Also talks about the alternatives such as Swarm, Diego, Nomad etc.
Information on resource monitoring using kubernetes using heapster and cAdvisor
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
Overview;
What is libnetwork
New features in 1.12
Deep Dive;
Multihost networking
Secure Control Plane
Secure Data plane
Service Discovery
Native Loadbalacing
Routing Mesh
Dockercon 2015 - Persistent Data in a Microservices World
This document discusses persistent data in microservices architectures and introduces Flocker as a solution for portable persistence of databases and containers. It describes how Flocker allows containers to be deployed, migrated, and moved while maintaining access to data stored on EMC storage platforms. The document also introduces the Docker volume API and how EMC drivers integrate storage platforms like ScaleIO and Xtremio with Flocker. It notes that persistence approaches are evolving and microservices often require both stateless and stateful services.
More Related Content
What's hot
(Draft) Kubernetes - A Comprehensive Overview
Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery called pods. Its main components include a master node that manages the cluster and worker nodes that run the applications. It uses labels to organize resources and selectors to group related objects. Common concepts include pods, services for discovery/load balancing, replica controllers for scaling, and namespaces for isolation. It provides mechanisms for configuration, storage, security, and networking out of the box to ensure containers can run reliably and be easily managed at scale.
Apache Mesos: a simple explanation of basics
Mesos is a distributed systems kernel that allows sharing of computing resources across multiple distributed applications or frameworks. It provides scalability, fault tolerance, and resource isolation. Mesos runs on every machine in a distributed cluster and acts as a mediator between systems and applications. The Mesos architecture uses a master-slave design where the master manages resource offers from slaves to frameworks. Frameworks use schedulers to launch and manage tasks on slaves based on resource availability.
Kubernetes HA @ AppDirect - Montreal Kubernetes Meetup
HA Kubernetes Deployment by Alexandre Gervais, Senior Software Developper, AppDirect
* How AppDirect deploys HA Kubernetes clusters using a multi-master setup
* Kubernetes upgrades and lifecycle
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
- Mesos is a cluster management platform that dynamically allocates resources to distributed applications running on Docker containers. It provides deployment, execution, resource sharing, and data locality capabilities.
- Marathon is a Mesos framework that provides easy deployment and management of Docker containers running long-running applications on Mesos. It exposes a REST API.
- MesosDNS provides service discovery by mapping Mesos tasks to DNS names, but has limitations around identifying ports, caching, health checking, and failover that alternative solutions like lb-marathon aim to address.
Introduction to Apache Mesos
Apache Mesos is a cluster manager that simplifies the complexity of running applications on a shared pool of servers.
ContainerDayVietnam2016: Docker at scale with Mesos
Mesos is an open source cluster manager that provides efficient resource isolation and sharing across distributed applications or frameworks. The document discusses how to run Docker containers on Mesos at scale, including using Marathon for container orchestration. Some key lessons learned are around choosing a container style, service discovery with Mesos-DNS, networking with Calico, and managing secrets, deployments, and Docker limitations.
The Operator Pattern - Managing Stateful Services in Kubernetes
Cloud Native Night, January 2018, Mainz: Talk by Jakob Karalus (@krallistic, IT Consultant at codecentric)
Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night
Abstract: While it's easy to deploy stateless application with Kubernetes, it's harder for stateful software. Since applications often require custom functionality that Kubernetes can't provide, developers want to add more specialized patterns like automatic backups, failover or rebalancing to their Kubernetes deployments. In this talk, we will look at the Operator Pattern and other possibilities to extend the functionality of Kubernetes and how to use them to operate stateful applications.
Integrating Docker with Mesos and Marathon
This document discusses integrating Docker containers with Mesos and Marathon. It provides an overview of Mesos as a distributed systems kernel and cluster manager with a master-slave architecture. Marathon is described as an application scheduler and cluster-wide process supervisor. It explains that Mesos supports Docker containers and long-running tasks in Marathon can use Docker containers. Sample JSON scripts are provided to configure Docker containerized tasks to run on Mesos through Marathon's REST API. The architecture is revised to show Mesos masters and slaves with ZooKeeper and multiple Marathon schedulers.
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
Immutable infrastructure is a way to success, but what about the lifecycle of individual resources. This talk is about evolution of resources, code structure, Terraform coding tricks, composition and refactoring.
Kubernetes on Top of Mesos on Top of DCOS
Containers, cluster management, microservices, Kubernetes and many other buzzwords are flying around us all the time. Our team is building solutions that make it easy to cope with all the complexity around cluster infrastructure. In this talk we present the project we are working on, namely running Kubernetes on top of the Mesos cluster scheduler. Furthermore we show DCOS which makes it easy to deploy and run Kubernetes with a single command.
Flocker
Introduction to Flocker which is a lightweight volume and container manager.
Meetup details of my presentation:
http://www.meetup.com/Docker-Bangalore/events/222476025/
(APP313) NEW LAUNCH: Amazon EC2 Container Service in Action | AWS re:Invent 2014
The document discusses Amazon EC2 Container Service (ECS), a highly scalable and high performance container management service. It provides an overview of ECS and its key components like tasks, containers, clusters and container instances. The summary also includes a demo showing how to create an ECS cluster, register a task definition and run a task using the WordPress application. It concludes with upcoming features for ECS and notes that pricing is based on underlying AWS resources used.
Kubernetes on CloudStack with coreOS
Intro to coreOS linux distributions and how it can be used to run docker based workloads in the cloud.
coreOS instances can be started in a cloudstack cloud, it makes use of cloud-init basics to
Kubernetes @ meetic
3 years ago, Meetic chose to rebuild it's backend architecture using microservices and an event driven strategy. As we where moving along our old legacy application, testing features became gradually a pain, especially when those features rely on multiple changes across multiple components. Whatever the number of application you manage, unit testing is easy, as well as functional testing on a microservice. A good gherkin framework and a set of docker container can do the job. The real challenge is set in end-to-end testing even more when a feature can involve up to 60 different components.
To solve that issue, Meetic is building a Kubernetes strategy around testing. To do such a thing we need to :
- Be able to generate a docker container for each pull-request on any component of the stack
- Be able to create a full testing environment in the simplest way
- Be able to launch automated test on this newly created environment
- Have a clean-up process to destroy testing environment after tests To separate the various testing environment, we chose to use Kubernetes Namespaces each containing a variant of the Meetic stack. But when it comes to Kubernetes, managing multiple namespaces can be hard. Yaml configuration files need to be shared in a way that each people / automated job can access to them and modify them without impacting others.
This is typically why Meetic chose to develop it's own tool to manage namespace through a cli tool, or a REST API on which we can plug a friendly UI.
In this talk we will tell you the story of our CI/CD evolution to satisfy the need to create a docker container for each new pull request. And we will show you how to make end-to-end testing easier using Blackbeard, the tool we developed to handle the need to manage namespaces inspired by Helm.
Secrets in Kubernetes
This is a presentation I held at "DevOps and Security" -meetup on 5th of April 2016 at RedHat.
Source is available at: https://github.com/jerryjj/devsec_050416
Handling Redis failover with ZooKeeper
This document discusses using ZooKeeper to automatically handle Redis failover. ZooKeeper is an open-source tool that provides primitives for building distributed applications and handles tasks like leader election and quorum management. The presenter describes how his redis_failover Ruby gem uses ZooKeeper to monitor Redis servers, detect failures, and automatically inform clients so they reconnect to the new master, preventing downtime during a failover. Several companies already use this approach with redis_failover to make their Redis infrastructure more robust and fault-tolerant.
Openshift Container Platform on Azure
1) The document describes an Azure Resource Manager (ARM) template for deploying OpenShift Enterprise on Azure. It provisions masters, infra nodes, and worker nodes with load balancing and storage.
2) The ARM template automates the entire deployment process through nested templates for each resource and Bash scripts for configuration. It handles naming, load balancing, storage, networking, and more.
3) The goal is to create a production-ready reference architecture for OpenShift on Azure and automate the deployment process through the ARM template. Current work focuses on deployment, storage, authentication, and documentation. Future work includes additional features and integrations.
Container Days Boston - Kubernetes in production
Kubernetes in Production, From the Ground Up discusses setting up a Kubernetes cluster from scratch using CoreOS, etcd, Docker, and Terraform. The document outlines setting up etcd for high availability using an autoscaling group, configuring the Kubernetes master nodes to run the API server, scheduler, and controller manager as pods, and deploying worker nodes that run the kubelet to join the cluster. The process involves using cloud-init scripts, Terraform, and container images to automate the installation and configuration of all cluster components in a scalable and resilient way.
Working with kubernetes
Providing introduction to kubernetes, various components and architecture. intended for beginers looking to understand the basics, evaluating kubernetes.
Also talks about the alternatives such as Swarm, Diego, Nomad etc.
Information on resource monitoring using kubernetes using heapster and cAdvisor
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
Overview;
What is libnetwork
New features in 1.12
Deep Dive;
Multihost networking
Secure Control Plane
Secure Data plane
Service Discovery
Native Loadbalacing
Routing Mesh
What's hot (20)
Kubernetes HA @ AppDirect - Montreal Kubernetes Meetup
Kubernetes HA @ AppDirect - Montreal Kubernetes Meetup
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
DEPLOYING A DOCKERIZED DISTRIBUTED APPLICATION IN MESOS
ContainerDayVietnam2016: Docker at scale with Mesos
ContainerDayVietnam2016: Docker at scale with Mesos
The Operator Pattern - Managing Stateful Services in Kubernetes
The Operator Pattern - Managing Stateful Services in Kubernetes
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
OSDC 2018 | Lifecycle of a resource. Codifying infrastructure with Terraform ...
(APP313) NEW LAUNCH: Amazon EC2 Container Service in Action | AWS re:Invent 2014
(APP313) NEW LAUNCH: Amazon EC2 Container Service in Action | AWS re:Invent 2014
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
Docker for Ops: Docker Networking Deep Dive, Considerations and Troubleshooti...
Viewers also liked
Dockercon 2015 - Persistent Data in a Microservices World
This document discusses persistent data in microservices architectures and introduces Flocker as a solution for portable persistence of databases and containers. It describes how Flocker allows containers to be deployed, migrated, and moved while maintaining access to data stored on EMC storage platforms. The document also introduces the Docker volume API and how EMC drivers integrate storage platforms like ScaleIO and Xtremio with Flocker. It notes that persistence approaches are evolving and microservices often require both stateless and stateful services.
Docker at Spotify
Spotify uses Docker and Helios to deploy over 100 backend services across 5000 servers. Docker provides repeatable deployments by running the same tested image in production. Helios ensures Docker containers are deployed and running as intended across servers. Spotify is moving more services to Docker and has its first Docker-based service in production using Helios to deploy containers across its infrastructure.
Docker at Spotify - Dockercon14
Spotify uses Docker and Helios to deploy over 100 backend services across 5000 servers. Docker provides repeatable deployments by running the same tested image in production. Helios ensures Docker containers are deployed and running correctly across servers. Spotify is moving more services to Docker, starting with their first Docker-based service going live that week.
Building and Deploying Application to Apache Mesos
Building and Deploying Application to Apache Mesos using Marathon, Apache Aurora and Custom Frameworks
Viewers also liked (7)
Dockercon 2015 - Persistent Data in a Microservices World
Dockercon 2015 - Persistent Data in a Microservices World
Building and Deploying Application to Apache Mesos
Building and Deploying Application to Apache Mesos
Similar to Docker on mesos
Intro to Docker November 2013
This document provides an introduction to Docker, including why it was created, how it works, and its growing ecosystem. Docker allows applications to be packaged with all their dependencies and run consistently across any Linux server by using lightweight virtual containers rather than full virtual machines. It solves the problem of differences between development, testing, and production environments. The document outlines the technical details and advantages of Docker, examples of how companies are using it, and the growing support in tools and platforms.
Intro to Docker October 2013
This document provides an introduction and overview of Docker, including its rapid growth and adoption, key benefits for developers and operations teams, technical underpinnings, ecosystem support, use cases, and future plans. Docker provides a way to package applications into lightweight containers that are portable and can run on any infrastructure. It solves issues around dependency management and consistency across environments.
Datacenter Computing with Apache Mesos - シリコンバレー日本人駐在員Meetup
シリコンバレー日本人駐在員Meetup
2014-03-14, NTT San Jose
http://www.meetup.com/svjapan/events/166310842/
Apache Mesos for Datacenter Computing
Docker introduction
Docker is a system for running applications in isolated containers. It addresses issues with traditional virtual machines by providing lightweight containers that share resources and allow applications to run consistently across different environments. Docker eliminates inconsistencies in development, testing and production environments. It allows applications and their dependencies to be packaged into a standardized unit called a container that can run on any Linux server. This makes applications highly portable and improves efficiency across the entire development lifecycle.
Intro Docker october 2013
This document provides an introduction and overview of Docker. It discusses why Docker was created to address issues with managing applications across different environments, and how Docker uses lightweight containers to package and run applications. It also summarizes the growth and adoption of Docker in its first 7 months, and outlines some of its core features and the Docker ecosystem including integration with DevOps tools and public clouds.
Docker for the enterprise
A presentation about container technology for the enterprise held at Ekito's geek breakfast the 4th of November 2016.
Docker and OpenStack Boston Meetup
OpenStack, Containers, and Docker: The Future of Application Deployment
Twenty years ago, developers built static applications on well-defined stacks that ran on proprietary, monolithic hardware. Developers today want freedom to build applications using their choice of services and stacks and, ideally, want to be able to run those applications on any available hardware. Of course, this raises questions about service interaction, the practicality of migrating applications across environments, and the challenges of managing unlimited combinations of services and hardware environment.
By promoting an opensource approach to flexible and inter-operable infrastructure, OpenStack goes a long way towards achieving this vision of the future. This talk discusses the application and platform side of the equation, and the interplay between OpenStack, Container technology (e.g. LXC), and the opensource Docker.io project. Docker.io enables any application and its dependencies to be deployed as lightweight containers that run consistently virtually anywhere. The same containerized application that runs on a developer's laptop can run consistently on a bare metal server, an OpenStack cluster, a Rackspace cloud, a VM,etc. While providing isolation and compatibility, containers have significant size, performance, and deployment advantages over traditional VMs.
Recently, the community created an integration between Docker and OpenStack Nova, opening up exciting possibilities for web scale application deployment, continuous integration and deployment, private PaaS, and hybrid cloud. This session will give an introduction to Docker and containers in the context of OpenStack, and will then demonstrate cross-environment deployment of applications.
OpenStack Boston
This document discusses using Docker containers with OpenStack for application deployment. It begins with an introduction to Docker, describing its growth in usage and integration with various tools. Docker is presented as a solution to issues around deploying applications across different environments and hardware by providing lightweight, portable containers that package code and dependencies. The document demonstrates how Docker can be used with OpenStack through a new hypervisor that allows OpenStack to deploy and manage Linux containers, enabling control of Docker through the OpenStack dashboard.
Docker open stack boston
This document discusses using Docker containers with OpenStack for application deployment. It begins with an introduction to Docker, describing its growth in usage and integration with various tools. Docker is presented as a solution to issues around deploying applications across different environments and hardware by providing lightweight, portable containers that package code and dependencies. The document demonstrates how Docker can be used with OpenStack through a new hypervisor that allows OpenStack to deploy and manage Linux containers, enabling control of Docker through the OpenStack dashboard. It outlines some benefits of Docker combined with OpenStack and the current state of the related OpenStack project.
Choosing PaaS: Cisco and Open Source Options: an overview
This document discusses container platforms and PaaS. It provides context on containers and supporting technologies like Docker. It describes how containers are limited when confined to a single host, and how schedulers can distribute containers across multiple hosts. It outlines common production tools used with containers like configuration management, monitoring, and logging. It compares PaaS and containers, noting how PaaS consumed containers before they were widely known, and how the lines between the two are blurring as container platforms provide more services. It introduces Mantl as Cisco's container stack designed to run container workloads and big data applications across clouds.
Devoxx France 2015 - The Docker Orchestration Ecosystem on Azure
Overview of the Docker ecosystem and orchestration systems, and how to make them run on Microsoft Azure.
Integration in the age of DevOps
In an increasingly competitive marketplace, speed and business agility are paramount. And integration between customer-facing systems and back-end applications is more crucial than ever.
At this event, you'll learn how open source software built by communities, like Apache Camel, Docker, Kubernetes, OpenShift Origin, and Fabric8, can help organizations integrate services and establish effective continuous integration and delivery (CI/CD) pipelines.
Microsoft Azure Container Service - DockerCH
This document provides an overview and agenda for a presentation on Microsoft Azure Container Service. The presentation will cover deploying to ACS, Mesosphere DC/OS and Marathon, Docker Swarm, and a demo. It will also provide more information on DC/OS and Docker integration with Windows.
What can-be-done-around-mesos
This document discusses ways to use Apache Mesos, including:
1) Running frameworks directly on Mesos by developing a scheduler or containerizing components and using Marathon.
2) Building platform as a service (PaaS) using Mesos, Marathon, Docker, Jenkins, Gitlab/GitHub, and metrics for monitoring.
3) Implementing continuous integration/continuous delivery (CI/CD) pipelines based on Mesos.
On Docker and its use for LHC at CERN
This document discusses Docker containers and CoreOS. It summarizes Sebastien Goasguen's background working with high performance computing, cloud computing, and various open source projects. It then discusses how Docker simplifies application deployment and portability using containers and image sharing. CoreOS is introduced as a Linux distribution optimized for Docker with tools like etcd and Fleet for managing distributed applications across containers. Kubernetes is presented as a system for orchestrating Docker containers across multiple hosts and providing services like replication and high availability.
State of the Container Ecosystem
This document discusses containerization and the Docker ecosystem. It begins by describing the challenges of managing different software stacks across multiple environments. It then introduces Docker as a solution that packages applications into standardized units called containers that are portable and can run anywhere. The rest of the document covers key aspects of the Docker ecosystem like orchestration tools like Kubernetes and Docker Swarm, networking solutions like Flannel and Weave, storage solutions, and security considerations. It aims to provide an overview of the container landscape and components.
Cloud Native Camel Riding
Using apache camel for microservices and integration then deploying and managing on Docker and Kubernetes. When we need to make changes to our app, we can use Fabric8 continuous delivery built on top of Kubernetes and OpenShift.
The challenge of application distribution - Introduction to Docker (2014 dec ...
Live recording with the demos: https://www.youtube.com/watch?v=0XRcmJEiZOM
Contents
- The application distribution challenge
- The current solutions
- Introduction to Docker, Containers, and the Matrix from Hell
- Why people care: Separation of Concerns
- Technical Discussion
- Ecosystem, momentum
- How to build Docker images
- How to make containers talk to each other, how to handle data persistence
- Demo 1: isolation
- Demo 2: real case - installing Go Math! Academy, tail –f containers, unit tests
Docker San Francisco Meetup April 2015 - The Docker Orchestration Ecosystem o...
The document discusses the Docker ecosystem including:
- The history and components of Docker including the Docker Engine, Hub, Machine, Compose, and Swarm.
- How Docker provides isolation using Linux kernel features like namespaces and cgroups.
- Other projects in the Docker ecosystem like Weave, Flocker, and Powerstrip.
- Orchestration tools like Docker Swarm and Kubernetes that manage Docker containers across multiple hosts.
- Platforms that are built on Docker like CoreOS, Deis, Cloud Foundry, and IBM Bluemix.
Rami Sayar - Node microservices with Docker
The document discusses converting a monolithic Node.js application into microservices and deploying them using Docker. It begins by defining microservices and their benefits. It then describes converting a sample pizza ordering application into independent microservices for handling messages, serving the frontend, and providing an API. Next, it covers patterns for networking microservices, including using an API gateway. It concludes by demonstrating how to deploy the microservices to Docker containers and use an orchestration tool like Kubernetes to manage them.
Similar to Docker on mesos (20)
Datacenter Computing with Apache Mesos - シリコンバレー日本人駐在員Meetup
Datacenter Computing with Apache Mesos - シリコンバレー日本人駐在員Meetup
Choosing PaaS: Cisco and Open Source Options: an overview
Choosing PaaS: Cisco and Open Source Options: an overview
Devoxx France 2015 - The Docker Orchestration Ecosystem on Azure
Devoxx France 2015 - The Docker Orchestration Ecosystem on Azure
The challenge of application distribution - Introduction to Docker (2014 dec ...
The challenge of application distribution - Introduction to Docker (2014 dec ...
Docker San Francisco Meetup April 2015 - The Docker Orchestration Ecosystem o...
Docker San Francisco Meetup April 2015 - The Docker Orchestration Ecosystem o...
Recently uploaded
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
UI5con 2024 - Bring Your Own Design System
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
Liberarsi dai framework con i Web Component.pptx
In Italian
Presentazione sulle feature e l'utilizzo dei Web Component nell sviluppo di pagine e applicazioni web. Racconto delle ragioni storiche dell'avvento dei Web Component. Evidenziazione dei vantaggi e delle sfide poste, indicazione delle best practices, con particolare accento sulla possibilità di usare web component per facilitare la migrazione delle proprie applicazioni verso nuovi stack tecnologici.
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
原版一模一样【微信：741003700 】【加拿大英属哥伦比亚大学毕业证本科学位证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
WWDC 2024 Keynote Review: For CocoaCoders Austin
Overview of WWDC 2024 Keynote Address.
Covers: Apple Intelligence, iOS18, macOS Sequoia, iPadOS, watchOS, visionOS, and Apple TV+.
Understandable dialogue on Apple TV+
On-device app controlling AI.
Access to ChatGPT with a guest appearance by Chief Data Thief Sam Altman!
App Locking! iPhone Mirroring! And a Calculator!!
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Consistent toolbox talks are critical for maintaining workplace safety, as they provide regular opportunities to address specific hazards and reinforce safe practices.
These brief, focused sessions ensure that safety is a continual conversation rather than a one-time event, which helps keep safety protocols fresh in employees' minds. Studies have shown that shorter, more frequent training sessions are more effective for retention and behavior change compared to longer, infrequent sessions.
Engaging workers regularly, toolbox talks promote a culture of safety, empower employees to voice concerns, and ultimately reduce the likelihood of accidents and injuries on site.
The traditional method of conducting safety talks with paper documents and lengthy meetings is not only time-consuming but also less effective. Manual tracking of attendance and compliance is prone to errors and inconsistencies, leading to gaps in safety communication and potential non-compliance with OSHA regulations. Switching to a digital solution like Safelyio offers significant advantages.
Safelyio automates the delivery and documentation of safety talks, ensuring consistency and accessibility. The microlearning approach breaks down complex safety protocols into manageable, bite-sized pieces, making it easier for employees to absorb and retain information.
This method minimizes disruptions to work schedules, eliminates the hassle of paperwork, and ensures that all safety communications are tracked and recorded accurately. Ultimately, using a digital platform like Safelyio enhances engagement, compliance, and overall safety performance on site. https://safelyio.com/
Energy consumption of Database Management - Florina Jonuzi
Presentation from Florina Jonuzi at the GSD Community Stage Meetup on June 06, 2024
Microservice Teams - How the cloud changes the way we work
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
J-Spring 2024 - Going serverless with Quarkus, GraalVM native images and AWS ...
Presented at NLJUG's J-Spring 2024.
Using Query Store in Azure PostgreSQL to Understand Query Performance
Microsoft has added an excellent new extension in PostgreSQL on their Azure Platform. This session, presented at Posette 2024, covers what Query Store is and the types of information you can get out of it.
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Presentation about a VSCode plugin from Dario Jurisic at the GSD Community Stage meetup
Unveiling the Advantages of Agile Software Development.pdf
Learn about Agile Software Development's advantages. Simplify your workflow to spur quicker innovation. Jump right in! We have also discussed the advantages.
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers. This video you can watch from my youtube channel at https://youtu.be/m-F-mZA3MkU
Malibou Pitch Deck For Its €3M Seed Round
French start-up Malibou raised a €3 million Seed Round to develop its payroll and human resources
management platform for VSEs and SMEs. The financing round was led by investors Breega, Y Combinator, and FCVC.
Artificia Intellicence and XPath Extension Functions
The purpose of this presentation is to provide an overview of how you can use AI from XSLT, XQuery, Schematron, or XML Refactoring operations, the potential benefits of using AI, and some of the challenges we face.
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Recently uploaded (20)
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Safelyio Toolbox Talk Softwate & App (How To Digitize Safety Meetings)
Energy consumption of Database Management - Florina Jonuzi
Energy consumption of Database Management - Florina Jonuzi
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
J-Spring 2024 - Going serverless with Quarkus, GraalVM native images and AWS ...
J-Spring 2024 - Going serverless with Quarkus, GraalVM native images and AWS ...
Using Query Store in Azure PostgreSQL to Understand Query Performance
Using Query Store in Azure PostgreSQL to Understand Query Performance
Unveiling the Advantages of Agile Software Development.pdf
Unveiling the Advantages of Agile Software Development.pdf
Oracle Database 19c New Features for DBAs and Developers.pptx
Oracle Database 19c New Features for DBAs and Developers.pptx
YAML crash COURSE how to write yaml file for adding configuring details
YAML crash COURSE how to write yaml file for adding configuring details
Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
Fundamentals of Programming and Language Processors
Fundamentals of Programming and Language Processors
Docker on mesos
- 1. Docker on Mesos ! ! Bart Spaans @Work_of_Bart
- 3. Scaling
- 4. PaaS, data processing, scheduling, data storage, ….
- 5. Benefits • Provides a uniform computing platform • Reduces operational costs and complexity • Empowers development teams • Lessens vendor lock-in
- 6. Architecture
- 7. WooRank • In-house Platform as a Service • Marathon • Docker • HAProxy
- 8. Docker on Mesos • Built-in support for deploying Docker containers on the cluster • Get the benefits of both Docker and Mesos • Horizontally scaling containers • Still able to run “non-Docker” computations
- 9. Service Discovery • Still in flux • Solutions based on DNS • Solutions based on Mesos events
- 10. Links • Mesosphere https://mesosphere.io/ • Ansible playbooks https://github.com/Woorank/vagrant-mesos-cluster • Mesos service discovery https://github.com/opencredo/mesos_service_discovery • Bamboo https://github.com/QubitProducts/bamboo • OpenCredo http://www.opencredo.com • Twitter https://twitter.com/Work_of_Bart
- 11. Docker on Mesos ! ! Bart Spaans @Work_of_Bart