Building specialized container-based systems with Moby: a few use cases
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios. We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary. Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Docker Cap Gemini CloudXperience 2017 - la revolution des conteneurs logicielsPatrick Chanezon
Si vous avez raté le début : Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels en quelques films ; comment ils accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
En bref, comment expliquer la stratégie des opérateurs du Cloud avec des films de science- fiction ? C’est le défi que va relever Patrick Chanezon, évangéliste chez Docker.
Oscon 2017: Build your own container-based system with the Moby projectPatrick Chanezon
Build your own container-based system
with the Moby project
Docker Community Edition—an open source product that lets you build, ship, and run containers—is an assembly of modular components built from an upstream open source project called Moby. Moby provides a “Lego set” of dozens of components, the framework for assembling them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
Patrick Chanezon and Mindy Preston explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud, or bare-metal scenarios. Patrick and Mindy explore Moby’s framework, components, and tooling, focusing on two components: LinuxKit, a toolkit to build container-based Linux subsystems that are secure, lean, and portable, and InfraKit, a toolkit for creating and managing declarative, self-healing infrastructure. Along the way, they demo how to use Moby, LinuxKit, InfraKit, and other components to quickly assemble full-blown container-based systems for several use cases and deploy them on various infrastructures.
Docker moves very fast, with an edge channel released every month and a stable release every 3 months. Patrick will talk about how Docker introduced Docker EE and a certification program for containers and plugins with Docker CE and EE 17.03 (from March), the announcements from DockerCon (April), and the many new features planned for Docker CE 17.05 in May.
This talk will be about what's new in Docker and what's next on the roadmap
The Docker Way: modernize traditional applications without action (wu-wei) and create new cloud native microservices applications with naturalness (ziran).
This talk also provides a summary of all the DockerCon EU 2017 announcements: Kubernetes now supported in Docker, MTA, IBM partnership.
Docker Cap Gemini CloudXperience 2017 - la revolution des conteneurs logicielsPatrick Chanezon
Si vous avez raté le début : Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels en quelques films ; comment ils accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
En bref, comment expliquer la stratégie des opérateurs du Cloud avec des films de science- fiction ? C’est le défi que va relever Patrick Chanezon, évangéliste chez Docker.
Oscon 2017: Build your own container-based system with the Moby projectPatrick Chanezon
Build your own container-based system
with the Moby project
Docker Community Edition—an open source product that lets you build, ship, and run containers—is an assembly of modular components built from an upstream open source project called Moby. Moby provides a “Lego set” of dozens of components, the framework for assembling them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
Patrick Chanezon and Mindy Preston explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud, or bare-metal scenarios. Patrick and Mindy explore Moby’s framework, components, and tooling, focusing on two components: LinuxKit, a toolkit to build container-based Linux subsystems that are secure, lean, and portable, and InfraKit, a toolkit for creating and managing declarative, self-healing infrastructure. Along the way, they demo how to use Moby, LinuxKit, InfraKit, and other components to quickly assemble full-blown container-based systems for several use cases and deploy them on various infrastructures.
Docker moves very fast, with an edge channel released every month and a stable release every 3 months. Patrick will talk about how Docker introduced Docker EE and a certification program for containers and plugins with Docker CE and EE 17.03 (from March), the announcements from DockerCon (April), and the many new features planned for Docker CE 17.05 in May.
This talk will be about what's new in Docker and what's next on the roadmap
The Docker Way: modernize traditional applications without action (wu-wei) and create new cloud native microservices applications with naturalness (ziran).
This talk also provides a summary of all the DockerCon EU 2017 announcements: Kubernetes now supported in Docker, MTA, IBM partnership.
Recording here: https://www.youtube.com/watch?v=5W4n9K3PIVg
Since Docker was open sourced in 2013, the community and adoption around Docker containers has grown to over 6 billion downloads and over 1000 contributors. Learn about why this is, and why you should start using containers for your own applications.
Using Open Source and Open Standards in the Platform gamePatrick Chanezon
Software platforms are a particular case of two-sided markets, where growing the 2 sides of the market at the same time is quite hard, but once established, the network effects accruing to the platform provider provide a solid moat to grow a robust business.
After the meteoric rise the Windows Platform using a proprietary development model in the 90's, in the past 20 years, Open Source and Open Standards proved to be very useful strategic options in the platform game. In this talk I will share my personal experiences in this area about the use of open source and open standards in platforms I have helped create or grow: Sun Portal Server, Google Adwords, OpenSocial, HTML5, Google App Engine, Cloud Foundry, Microsoft Azure, and Docker. I will also cover platforms I have studied, and try to extract some useful lessons and principles that I hope can be useful to other practitioners.
I presented "My journey to becoming a Docker Captain" session to DellEMC Folks in Bengaluru. It was a great interactive session with tons of questions around Docker, Tips to become a Docker Captain and much more.
Neo4j works very well in cloud environments. However, with such variance in compute, network, and storage options, the job of configuring a production database environment is getting complex. In this demo-oriented session, Patrick and David Makogon will introducing straightforward ways to configure and deploy Neo4j with Docker containers, as well as showing how to use automated cloud resource configuration with the new Azure Resource Manager.
Docker has become extremely popular in China. Since October of 2016, Alibaba Cloud and Docker partnered to drive adoption of containerized applications in China. In this talk, I will share the status for this program and will present the latest survey of container adoption in China. We'll take a deep analysis of the current landscape and what is different about China's market.
In this session, we will also share some use cases for container usage in enterprises - i.e. how Alibaba group build the core business application platform based on scalable container infrastructure and how local enterprises run their business with container technologies in a hybrid cloud environment.
Docker: Redistributing DevOps cards, on the way to PaaSAdrien Blind
This talk first presents Docker through its key characteristics: being Portable, Disposable, Live, Social. It then discusses a new type of cloud, the CaaS (Container as a Service), and it potential benefits for PaaS (Platform as a Service).
Microsoft Techsummit Zurich Docker and MicrosoftPatrick Chanezon
Docker and Microsoft have been collaborating both in open source and through their commercial partnership to bring the benefits of Docker Windows and Linux containers to Azure Enterprise customers. Docker’s container platform, Docker Enterprise Edition, is used to modernize traditioal applications, and move them to Azure, as well as to develop new cloud native applications using microservices architecture, bringing agility to developers and control to IT Pros. This talk will cover the latest developments in Docker’s container platform with planned support for Kubernetes in Docker for Windows, and Docker Enterprise Edition for Azure, Docker for Azure Stack to enable hybrid cloud deployments, Windows containers, Linux containers on Windows.
Today I presented a session on "Top 5 Exciting Dockercon 2018 Announcements"in Docker Bangalore Meetup which happened in Nutanix India Office, Bellandur Road. It was yet another great opportunity to meet and network with Docker Enthusiasts.
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShiftDevOps.com
Administrators and developers are increasingly seeking ways to improve application time to market and improve maintainability. Containers and Red Hat® OpenShift® have quickly become the de facto solution for agile development and application deployment.
Red Hat Training has developed a course that provides the gateway to container adoption by understanding the potential of DevOps using a container-based architecture. Orchestrating a container-based architecture with Kubernetes and Red Hat® OpenShift® improves application reliability and scalability, decreases developer overhead, and facilitates continuous integration and continuous deployment.
In this webinar, our expert will cover:
An overview of container and OpenShift architecture.
How to manage containers and container images.
Deploying containerized applications with Red Hat OpenShift.
An outline of Red Hat OpenShift training offerings.
Docker, cornerstone of an hybrid cloud?Adrien Blind
In this presentation, I propose to explore the orchestration & hybridation potential raised by Docker 1.12 Swarm Mode and the subsequent benefits.
I'll first remind why docker fits well the microservices paradigms, and how does this architecture engender new challenges : service discovery, app-centric security, scalability & resilience, and of course, orchestration.
I'll then discuss the opportunity to create your own docker CaaS platform hybridating simultaneously on various cloud vendors & traditional datacenters, better than just leveraging on vendors integrated offers.
Finally, I'll discuss the rise of new technologies (Windows containers, ARM architectures) in the docker landscape, and the opportunity of integrating them in a global docker composite orchestration, enabling to depict globally complex apps.
Moby is an open source project providing a "LEGO set" of dozens of components, the framework to assemble them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
One of these assemblies is Docker CE, an open source product that lets you build, ship, and run containers.
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios.
We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary.
Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Video at https://www.youtube.com/watch?v=kDp22YkD6WY
Container Runtimes: Comparing and Contrasting Today's EnginesPhil Estes
A webinar presented for the {code} Community on August 30, 2017. In this talk, we looked at the sphere of modern container runtimes that start with Docker's emergence in 2013/2014 to today's additions of rkt, OCI's runc, containerd, cri-o, and Cloud Foundry's garden-runc project, many of them consolidating around the OCI standard for container runtime and image specifications.
Recording here: https://www.youtube.com/watch?v=5W4n9K3PIVg
Since Docker was open sourced in 2013, the community and adoption around Docker containers has grown to over 6 billion downloads and over 1000 contributors. Learn about why this is, and why you should start using containers for your own applications.
Using Open Source and Open Standards in the Platform gamePatrick Chanezon
Software platforms are a particular case of two-sided markets, where growing the 2 sides of the market at the same time is quite hard, but once established, the network effects accruing to the platform provider provide a solid moat to grow a robust business.
After the meteoric rise the Windows Platform using a proprietary development model in the 90's, in the past 20 years, Open Source and Open Standards proved to be very useful strategic options in the platform game. In this talk I will share my personal experiences in this area about the use of open source and open standards in platforms I have helped create or grow: Sun Portal Server, Google Adwords, OpenSocial, HTML5, Google App Engine, Cloud Foundry, Microsoft Azure, and Docker. I will also cover platforms I have studied, and try to extract some useful lessons and principles that I hope can be useful to other practitioners.
I presented "My journey to becoming a Docker Captain" session to DellEMC Folks in Bengaluru. It was a great interactive session with tons of questions around Docker, Tips to become a Docker Captain and much more.
Neo4j works very well in cloud environments. However, with such variance in compute, network, and storage options, the job of configuring a production database environment is getting complex. In this demo-oriented session, Patrick and David Makogon will introducing straightforward ways to configure and deploy Neo4j with Docker containers, as well as showing how to use automated cloud resource configuration with the new Azure Resource Manager.
Docker has become extremely popular in China. Since October of 2016, Alibaba Cloud and Docker partnered to drive adoption of containerized applications in China. In this talk, I will share the status for this program and will present the latest survey of container adoption in China. We'll take a deep analysis of the current landscape and what is different about China's market.
In this session, we will also share some use cases for container usage in enterprises - i.e. how Alibaba group build the core business application platform based on scalable container infrastructure and how local enterprises run their business with container technologies in a hybrid cloud environment.
Docker: Redistributing DevOps cards, on the way to PaaSAdrien Blind
This talk first presents Docker through its key characteristics: being Portable, Disposable, Live, Social. It then discusses a new type of cloud, the CaaS (Container as a Service), and it potential benefits for PaaS (Platform as a Service).
Microsoft Techsummit Zurich Docker and MicrosoftPatrick Chanezon
Docker and Microsoft have been collaborating both in open source and through their commercial partnership to bring the benefits of Docker Windows and Linux containers to Azure Enterprise customers. Docker’s container platform, Docker Enterprise Edition, is used to modernize traditioal applications, and move them to Azure, as well as to develop new cloud native applications using microservices architecture, bringing agility to developers and control to IT Pros. This talk will cover the latest developments in Docker’s container platform with planned support for Kubernetes in Docker for Windows, and Docker Enterprise Edition for Azure, Docker for Azure Stack to enable hybrid cloud deployments, Windows containers, Linux containers on Windows.
Today I presented a session on "Top 5 Exciting Dockercon 2018 Announcements"in Docker Bangalore Meetup which happened in Nutanix India Office, Bellandur Road. It was yet another great opportunity to meet and network with Docker Enthusiasts.
Kubernetes 101 - an Introduction to Containers, Kubernetes, and OpenShiftDevOps.com
Administrators and developers are increasingly seeking ways to improve application time to market and improve maintainability. Containers and Red Hat® OpenShift® have quickly become the de facto solution for agile development and application deployment.
Red Hat Training has developed a course that provides the gateway to container adoption by understanding the potential of DevOps using a container-based architecture. Orchestrating a container-based architecture with Kubernetes and Red Hat® OpenShift® improves application reliability and scalability, decreases developer overhead, and facilitates continuous integration and continuous deployment.
In this webinar, our expert will cover:
An overview of container and OpenShift architecture.
How to manage containers and container images.
Deploying containerized applications with Red Hat OpenShift.
An outline of Red Hat OpenShift training offerings.
Docker, cornerstone of an hybrid cloud?Adrien Blind
In this presentation, I propose to explore the orchestration & hybridation potential raised by Docker 1.12 Swarm Mode and the subsequent benefits.
I'll first remind why docker fits well the microservices paradigms, and how does this architecture engender new challenges : service discovery, app-centric security, scalability & resilience, and of course, orchestration.
I'll then discuss the opportunity to create your own docker CaaS platform hybridating simultaneously on various cloud vendors & traditional datacenters, better than just leveraging on vendors integrated offers.
Finally, I'll discuss the rise of new technologies (Windows containers, ARM architectures) in the docker landscape, and the opportunity of integrating them in a global docker composite orchestration, enabling to depict globally complex apps.
Moby is an open source project providing a "LEGO set" of dozens of components, the framework to assemble them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
One of these assemblies is Docker CE, an open source product that lets you build, ship, and run containers.
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios.
We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary.
Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Video at https://www.youtube.com/watch?v=kDp22YkD6WY
Container Runtimes: Comparing and Contrasting Today's EnginesPhil Estes
A webinar presented for the {code} Community on August 30, 2017. In this talk, we looked at the sphere of modern container runtimes that start with Docker's emergence in 2013/2014 to today's additions of rkt, OCI's runc, containerd, cri-o, and Cloud Foundry's garden-runc project, many of them consolidating around the OCI standard for container runtime and image specifications.
LinuxKit: the first five months by Justin Cormack & Riyaz Faizullabhoy (Docker)Docker, Inc.
LinuxKit was launched five months ago, and has received a huge number of contributions from the Moby community. This talk will cover some of the large number of areas the community has contributed to, including: ARM64 support, bare metal support, containerd-cri integration with system containers and Kubernetes running on the same containerd and Wireguard for encrypted networking.
Building Distributed Systems without Docker, Using Docker Plumbing Projects -...Patrick Chanezon
Docker provides an integrated and opinionated toolset to build, ship and run distributed applications. Over the past year, the Docker codebase has been refactored extensively to extract infrastructure plumbing components that can be used independently, following the UNIX philosophy of small tools doing one thing well: runC, containerd, swarmkit, hyperkit, vpnkit, datakit and the newly introduced InfraKit.
This talk will give an overview of these tools and how you can use them to build your own distributed systems without Docker.
Patrick Chanezon & David Chung, Docker & Phil Estes, IBM
Presentation given at Open Source Summit Japan 2016 about the state of the cloud native technology (Cloud Native Computing Foundation) and the standardization of container technology (Open Container Initiative)
An introduction to the Moby Project and LinuxKit. The demo essentially walked through the LinuxKit examples available on Github at https://github.com/linuxkit/linuxkit paying specific attention to the linuxkit.yml nginx example in the home directory, and the redis-os example in the examples directory.
Diving Through The Layers: Investigating runc, containerd, and the Docker eng...Phil Estes
A presentation given on Thursday, January 19th, 2017 at the Devops Remote Conf 2017. This talk details the history of the Docker engine architecture, focusing on the split in April 2016 into the containerd and runc layers, and talking through the December 2016 announcement of the *new containerd project and what it will bring for the Docker engine and other consumers.
.docker : How to deploy Digital Experience in a container, drinking a cup of ...ICON UK EVENTS Limited
Matteo Bisi / Factor-y srl
Andrea Fontana / SOWRE SA
Docker is one of best technologies available on market to install and run and deploy application fastest , securely like never before. In this session you will see how to deploy a complete digital experience inside containers that will enable you to deploy a Portal drinking a cup of coffee. We will start from a deep overview of docker: what is docker, where you can find that, what is a container and why you should use container instead a complete Virtual Machine. After the overview we will enter inside how install IBM software inside a container using docker files that will run the setup using silent setup script. At last part we will talk about possible use of this configuration in real work scenario like staging or development environment or in WebSphere Portal farm setup.
docker : how to deploy Digital Experience in a container drinking a cup of co...Matteo Bisi
This was my session @ IconUK 2016. We was talking about docker and ibm and giving some tips to use it and build it your own container with ibm social collaboration software
Demystifying Containerization Principles for Data ScientistsDr Ganesh Iyer
Demystifying Containerization Principles for Data Scientists - An introductory tutorial on how Dockers can be used as a development environment for data science projects
Kubernetes has many ways to scale your workloads, most of what we hear about is scaling our cluster up with either with vm sets or autoscaling groups. There is another way, in this talk we will look at virtual kubelet. Virual Kubelet will allow us to talk to a cloud providers container as a service platform like ACI, fargate or ECI. We will deep dive into how you can scale your applications across virtual kubelet. One issue is the kubernetes service type has is scaling to zero due to the way routing to the pod happens if there is no pod for the service to route too. Scaling our applications to zero is just as important and scaling up. We will look at projects that integrate with the horizontal pod autoscaler that fix this issue. Allowing us to not only scale our applications up but as easily down to make our cluster truly elastic.
KubeCon China 2019 - Building Apps with Containers, Functions and Managed Ser...Patrick Chanezon
Cloud native applications are composed of many technologies and components, but three canonical abstraction emerged in the past few years that help developers structure their architecture: container, functions responding to events, and managed services.
This talk will explain how to develop (Docker, local Kubernetes, virtual Kubelet, OpenFaaS), deploy (managed Kubernetes, functions and services) and package (CNAB specification and tooling) applications using these three components and look at not only deployment workflows but also at day 2 concerns that a developer would need to consider in the cloud native landscape.
We will demo every topic and a Github repository will be available for developers to reproduce the demos and learn at their own pace.
Patrick Chanezon and Scott Coulton
Dockercon 2019 Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are composed of containers, serverless functions and managed cloud services.
What is the best set of tools on your desktop to provide a rapid, iterative development experience and package applications using these three components?
This hand-on talk will explain how you can complement Docker Desktop, with it’s local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, Open Service Broker, the Gloo hybrid app gateway, Draft, and others, to build the most productive development inner-loop for these type of applications.
It will also cover how you can use the Cloud Native Application Bundle (CNAB) format and it’s implementation in the Docker app experimental tool to package your application and manage it with container supply chain tooling such as Docker Hub.
GIDS 2019: Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are increasingly composed of containers, serverless functions responding to events and managed cloud services. What is the best workflow and set of tools to provide a rapid, iterative development experience and to package applications using these three components?
This hand-on talk will compare and contrast several sets of tools and their associated workflows:
Using Docker Desktop, with its local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, or the Gloo hybrid app gateway, to build the most productive development inner-loop for these type of applications
OpenFaaS, Fn, or Nuclio open source serverless framework to run functions in containers locally
Telepresence to run a container locally, connected to a remote cluster
Helm and Draft
Knative
The talk will also cover how you can use the Cloud Native Application Bundle (CNAB) format and tools to package your applications and share them using a container registry.
Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels et comment certains concepts du taoïsme, wei-wu-wei, "agir sans agir", et ziran, naturel, ou spontanéïté, permettent d'en mieux cerner les enjeux.
Les conteneurs accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi cloud, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
Develop and deploy Kubernetes applications with Docker - IBM Index 2018Patrick Chanezon
Docker Desktop and Enterprise Edition now both include Kubernetes as an optional orchestration component. This talk will explain how to use Docker Desktop (Mac or Windows) to develop and debug a cloud native application, then how Docker Enterprise Edition helps you deploy it to Kubernetes in production.
Docker is the developer-friendly container technology that enables creation of your application stack: OS, JVM, app server, app, database and all your custom configuration. So you are a Java developer but how comfortable are you and your team taking Docker from development to production? Are you hearing developers say, “But it works on my machine!” when code breaks in production? And if you are, how many hours are then spent standing up an accurate test environment to research and fix the bug that caused the problem?
This workshop/session explains how to package, deploy, and scale Java applications using Docker.
Oscon London 2016 - Docker from Development to ProductionPatrick Chanezon
Docker revolutionized how developers and operations teams build, ship, and run applications, enabling them to leverage the latest advancements in software development: the microservice architecture style, the immutable infrastructure deployment style, and the DevOps cultural model.
Existing software layers are not a great fit to leverage these trends. Infrastructure as a service is too low level; platform as a service is too high level; but containers as a service (CaaS) is just right. Container images are just the right level of abstraction for DevOps, allowing developers to specify all their dependencies at build time, building and testing an artifact that, when ready to ship, is the exact thing that will run in production. CaaS gives ops teams the tools to control how to run these workloads securely and efficiently, providing portability between different cloud providers and on-premises deployments.
Patrick Chanezon offers a detailed overview of the latest evolutions to the Docker ecosystem enabling CaaS: standards (OCI, CNCF), infrastructure (runC, containerd, Notary), platform (Docker, Swarm), and services (Docker Cloud, Docker Datacenter). Patrick ends with a demo showing how to do in-container development of a Spring Boot application on a Mac running a preconfigured IDE in a container, provision a highly available Swarm cluster using Docker Datacenter on a cloud provider, and leverage the latest Docker tools to build, ship, and run a polyglot application architected as a set of microservices—including how to set up load balancing.
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
6. Docker is building a stack to program the Internet
CE
EEA commercial product,
built on
a development platform,
built on
infrastructure,
built on
standards.
8. Image Registry
CI/CD
Security scan
& sign
Traditional
Third Party
Microservices
docker store
DEVELOPERS IT OPERATIONS
Control Plane
Docker EE Container Platform to Modernize Traditional Apps
and beyond
More Info: Docker.com/MTA
10. Docker is a platform made of components
Raft Store
Node
Identity
Secrets
Routing
Mesh
Overlay
Networking
Swarm Orchestration
Engine
Application Services
12. A Brief History
APRIL 2016 Containerd “0.2” announced, Docker 1.11
DECEMBER 2016Announce expansion of containerd OSS project
Management/Supervisor for the OCI runc executor
Containerd 1.0: A core container runtime project for the industry
MARCH 2017 Containerd project contributed to CNCF
13. runc
containerd
Why Containerd 1.0?
▪ Continue projects spun out
from monolithic Docker engine
▪ Expected use beyond Docker
engine (Kubernetes CRI)
▪ Donation to foundation for
broad industry collaboration
▫ Similar to runc/libcontainer
and the OCI
14. Technical Goals/Intentions
▪ Clean gRPC-based API + client library
▪ Full OCI support (runtime and image spec)
▪ Stability and performance with tight, well-
defined core of container function
▪ Decoupled systems (image, filesystem,
runtime) for pluggability, reuse
15. Requirements
- A la carte: use only what is required
- Runtime agility: fits into different platforms
- Pass-through container configuration (direct OCI)
- Decoupled
- Use known-good technology
- OCI container runtime and images
- gRPC for API
- Prometheus for Metrics
16. Use cases
- CURRENT
- Docker (moby)
- Kubernetes (cri-
containerd)
- SwarmKit (experimental)
- LinuxKit
- BuildKit
- FUTURE/POTENTIAL
- IBM Cloud/Bluemix
- OpenFaaS
- {your project here}
17. LinuxKit
A toolkit for building secure, portable and lean
operating systems for containers
18. What is LinuxKit?
A toolkit for building secure, portable and lean operating systems for
containers.
● uses Moby tooling to build system images
● everything is a container
● runs with Containerd 1.0 branch for over four months
● lightweight, fully customizable
19. Some metrics
● 75 contributors!
● first new maintainer appointed from the community
● 50 commits a week since DockerCon
20. Arm64 support
Thanks to Dennis Chen at ARM
● multi arch base images so system containers can be built
● signed multiarch manifests - thanks to IBM for all their work
● thanks to Packet.net for providing ARM64 machines
● ongoing work on EFI boot that works cross platform
● other architectures now easy to add
21. Linux Containers on Windows
● as announced at DockerCon
● LinuxKit provides build images in blueprints/lcow.yml
● ultra minimal system only 13MB
● blog post soon with HOWTO instructions
● ongoing work with Microsoft on shipping this
22. Platform support
The community added support for so many platforms...
● Azure
● OpenStack
● VMware and vCenter
● Packet.net
● Vultr
● IBM Bluemix
... and improved AWS, GCP, Hyperkit, KVM, Hyper-V...
24. Lots of smaller improvements
● TPM support
● containers to run on clean shutdown
● fully immutable images, eg CD-ROM images
● 4.10, 4.11, 4.12 kernels, 4.13 coming soon
● namespace sharing for system containers
● rewrote a lot of shell scripts in Go for better maintainability
● OCI runtime spec 1.0
● static PIE binaries everywhere
● many more tests
25. WireGuard graduated from projects
● fast secure modern VPN tunnel based on Noise framework
● added to the LinuxKit kernels
● now easy to construct network tunnels between system containers
● prototype next stage of container networking
26. Kubernetes about to graduate from projects
● initial port contributed by Weave for DockerCon launch
● maintained since then
● also working on CRI-Containerd support, with shared system containerd
● more work ongoing
● full testing and validation planned
28. LinuxKit Use Cases
● Linux Containers on Windows - announced at DockerCon, in the works
● Docker for Mac: shipping in edge release soon
● Kubernetes with shared system containerd
● Secure appliances
● Network function virtualization
32. It’s time to take our ecosystem to the next level…
By collaborating on components AND COMMON ASSEMBLIES.
33.
34. – Library of 80+ components
– Package your own
components as containers
– Reference assemblies
deployed on millions of nodes
– Create your own assemblies
or start from an existing one
A framework to assemble
specialized container
systems without
reinventing the wheel.
35. Docker uses Moby for its
open-source
– Thousands of contributors,
hundreds of patches/week
– Component development
– Specialized assembly
development
– Integration tests
– Architecture design
– Integration with other projects
– Experimentation and bleeding
edge features
36. Docker uses Moby for its
open-source...
and so can you!
– Community-run
– Open governance inspired by
the Fedora project
– Plays well with existing
projects - no donation
necessary!
38. What it means for you
Moby helps you
innovate without tying
you to Docker
System BuildersDocker Users
Docker will better leverage
the ecosystem to innovate
faster for you
47. Notary & TUF
A Framework for trusted content distribution.
48. What is Notary?
- Framework for trusted content
distribution.
- Golang implementation of The
Update Framework (TUF)
- Created by a group of NYU
researchers.
- Based on the TOR updater Thandy
49. Proposal to contribute to CNCF June 20
- Still waiting for vote
- Proposal and discussion at https://github.com/cncf/toc/pull/38
50. TUF core concepts
- Compromise-resilient software distribution
- Principled, graceful degradation of security
- Focus on key revocation / partial compromise of infrastructure
- Applies security best practices: separation of privilege (roles), threshold signatures,
minimizing risk, selective delegation of trust, etc.
- Flexibility
- Does not prescribe exactly how to perform a task
- Works with existing deployments constraints
51. TUF in the Cloud Native Ecosystem
- Solves trusted data distribution problem.
- Specific opinionated implementations, or uses of existing tools like Notary
can solve vast majority of content trust problems.
- Abstract solution aiming for best security.
- Sets the bar for high expectation of security in ecosystem.
56. Notary in the Cloud Native Ecosystem
- Solves the problem of image provenance
- Can be more generally applied:
- OS/VM images
- Updates/patches
- Shared filesystems
- External resources
- Every piece of deployed code from the OS to the application should be signed
57. Notary Use Cases
- Signing container images for trusted distribution.
- Docker, Quay, Huawei, Motorola, VMWare
- Signing system components/packages for system updates.
- LinuxKit
- Signing filesystem integrity checksums
- moby
- Threshold signing to require quorum for validity
- Docker Data Center, Quay
- Signing service definitions
- Docker Swarm, Kubernetes
58. Notary Community
- Open Sourced at DockerCon SF 2015
- 865 GitHub stars, 156 forks
- 45 Contributors
- 8 maintainers from 3 Companies; Docker, CoreOS, Huawei
- 2600+ commits, 34 releases
60. Alignment with CNCF
- Provides state of the art trust and provenance for content distribution.
- Uses existing CNCF projects
- GRPC
- Prometheus
- Enhances existing CNCF projects
- Can provide trusted content acquisition for containerd, kubernetes, rkt
62. What is it?
62
• Launched at LinuxCon, Berlin in October, 2016.
• Toolkit for building declarative, self-managing distributed
applications
• Active management with active controllers
• scaling groups, rolling updates
• monitoring / health checks
• connecting nodes to L4 / ingress
• Declarative infrastructure
• Proposal to contribute to CNCF 6/20, too soon
63. What is InfraKit
63
• Toolkit for infrastructure automation
• Provisioning and management services for
higher-level systems
• Focus on patterns and automation:
• Convergence to declarative specification
• Scaling groups, rolling updates
• Infrastructure metadata, events
• Immutable infrastructure
Application Definition/ Development
Orchestration & Management
Runtime
Provisioning
Infrastructure (Bare Metal/Cloud)
64. InfraKit in a Cloud Native Ecosystem
64
• Immutable nodes + attached storage
• OS Images - LinuxKit integration
• Devops Deployment Tooling &
Provisioning
• Infrastructure Automation
• Compute - rolling updates, scaling
groups
• Storage
• Network
Provisioning layer + infrastructure automation services
65. InfraKit Use Cases
65
• Day-0 (install), Day-1 (configure) of container orchestrators
• Docker Swarm - Docker for GCP, AWS, Appcelerator/AMP
• Kubernetes
• Day-N automation of infrastructure - provisioning, rolling
updates and capacity scaling.
• A cloud provider for Kubernetes Cluster Autoscaler
• GPU cluster provisioning
• LinuxKit integration for building, deployment of custom OS on
bare-metal or virtualized infrastructure (video).
67. InfraKit Deployment
67
CLI
API
Control Plane
• High availability, single leader
• Can share leader election / spec
storage with higher-level systems:
• Docker swarm mode
• etcd (k8s)
• As Docker or containerd / oci
containers
• Typically “embedded” in control plane
of higher systems as “system”
containers (e.g. LinuxKit image)
68. InfraKit Community: active and growing
• Made public at LinuxCon, Berlin in October, 2016
•1.5K Github stars, 140+ forks
•16 infrastructure providers
•4 maintainers, 4 companies (Docker, IBM, NTT, Axway)
•25 contributors total, 200+ members on slack
•460+ commits, 7 releases, ~50 commits / month
•Meetups: Moby Project Summit, April 20, 2017;
Next: June 19, 2017
68
72. Support more platforms
72
• Compute:
• Bare-metal: HP OneView, MAAS, RackHD
• Public cloud: AWS, GCP
• MacOS X (HyperKit); Docker containers
• Coming soon: Azure, IBM, Digital Ocean,
Packet, libvirt
• Other resource types
• AWS - vpc, subnets, gateways, etc.
73. Improve usability
73
• Templates
• Complex scripts and configuration in any format;
no more escape quotes in JSON
• Fetch templates from remote repositories
• Playbooks
• CLI - flags, prompts — config driven and
dynamic
• Share “playbooks” from remote repositories
74. Improve core system
74
• High Availability — Swarm Mode or etcd
• New Plugin types — Metadata and Events
• Metadata: cluster-wide sysfs and reflection
• Events - publish / subscribe
• Remote client access:
infrakit -H host:port to remote cluster
75. Use Cases
75
• Support container orchestration
• bootstrapping + day N management
• API for cluster autoscaling
• k8s, Docker Swarm Mode
• Bare-metal + GPU provisioning
• IoT — LinuxKit integration / custom kernel
deployment
78. Example: build an autoscaling group
● Pick a plugin to create instances
● Add flavor plugin
● Embed config inside definition of a group.
ID: group/workers
Properties:
Instance:
Plugin: terraform
Properties:
// terraform config here
Flavor:
Plugin: kubernetes/worker
Properties:
// config add-on, etc.
terraform
kubernetes configs
Group RPC API
infrastructure API
Client
79. … across zones / clouds
● Wrap instance plugins with Selector
● Selector selects plugin to provision,
based on weights or spread evenly.
ID: group/workers
Properties:
Instance:
Plugin: selector/weighted
Properties:
aws-us-east/workers:
gcp-us-central/workers:
Options: - aws-us-east:80
- gcp-us-central:20
Flavor:
Plugin: kubernetes/worker
Properties:
// config add-on, etc.
aws-us-east
kubernetes configs
Group RPC API
Client
gcpaws
gcp-us-central
80% 20%
80. … with provisioning priorities
● Tiered selector is just another Instance
● Selects one option after another until
provisioning succeeds.
ID: group/workers
Properties:
Instance:
Plugin: selector/tiered
Properties:
Plugin: vsphere/on-prem-workers:
Properties: // ...
Plugin: aws/ec2-spot-instance:
Properties: // spot price...
Plugin: aws/ec2-instance:
Properties: // on-demand…
Flavor:
Plugin: kubernetes/worker ...
on-prem: vsphere
kubernetes configs
Group RPC API
Client
cloud: AWS spot
cloud: AWS on-demand
82. Learn More at OSS Summit
- Wednesday, September 13 • 4:00pm - 4:40pm
Unikernels: Where Are They Now? - Amir Chaudhry,
Docker
- Thursday, September 14 • 9:00am - 12:10pm
Tutorial: Docker Container Orchestration: Building
Clusters in Production - Bret Fisher, DevOps Sysadmin
and Docker Captain & Laura Frank, Codeship
83. Moby Summit at OSS NA
Thursday, September 14, 2017
“An open framework to assemble specialized
container systems without reinventing the
wheel.”
Tickets:
https://www.eventbrite.com/e/moby-summit-los-angeles-tickets-35930560273
Docker has its roots in dev productivitystill lot of work to dosolve it by listening to devs, solving all their pbs one by onelet’s talk about dev problems.
our job is to give you the best tools to take your app to prod securely
3 rules we follow
usability, portability, scalability
usable security so that devs don't bypass it
scale, automation
Docker suite of tools for security in production
tools deliver security that is
usable
scalable
portable
not getting in the way of operators
help developers make applications be more secure
has to be easy and portable so that developers will use it.
Security never ends, continuous process
We made a lot of progress this year
4 features I want to talk about
reason that Docker is so componentized because of open dev model we adopted
partnered with an ecosystem that grew around it
several phases
----
docker is a container platform
solve pb for our users
develop new components, or improve existing components
open dev model, 12 oss projects produce one comp of a container platform
any one project useless on its own
This is compared to “container systems of the past” that were monolithic and tightly coupled
Example: hard to reuse components; e.g. take a Docker graphdriver and use it to implement a volume driver
introduced assemblies
allowed docker to scale internally
allowed us to ramp up to 12 editions of docker
complexity
duplication of effort, design
allowed docker to scale internally
allowed us to ramp up to 12 editions of docker
introduced an additional level of collaboration, assembly, cpatures what is common and that teams can use for their environments
looks like this, moby origin, assembly we use to create editions of docker
all of our assembly dev will take place in moby project
if want close derivative to docker platform, join dev of moby origin
want diofferent assembly, fork moby-origin
partners
Introducing a new project
where Docker does 100% of its oss work
all components
all assemblies
inviting users, partners the whole ecosystem to join this project and together take container ecosystem to the mainstream
seed this project with 12s of components, an assembly that is very stable and deployed in prod on 1000s nodes
the most important project we have introduced since 2014
not a foundation moby does not own projects
any project can come collab and retain ownership of their code
all components
all assemblies
inviting users, partners the whole ecosystem to join this project and together take container ecosystem to the mainstream
seed this project with 12s of components, an assembly that is very stable and deployed in prod on 1000s nodes
the most important project we have introduced since 2014
not a foundation moby does not own projects
any project can come collab and retain ownership of their code
all components
all assemblies
inviting users, partners the whole ecosystem to join this project and together take container ecosystem to the mainstream
seed this project with 12s of components, an assembly that is very stable and deployed in prod on 1000s nodes
the most important project we have introduced since 2014
not a foundation moby does not own projects
any project can come collab and retain ownership of their code
platform based on containers
Docker uses Moby to innovate in the open.
Each version of Docker will innovate faster
Moore innovation/more choice
all components
all assemblies
inviting users, partners the whole ecosystem to join this project and together take container ecosystem to the mainstream
seed this project with 12s of components, an assembly that is very stable and deployed in prod on 1000s nodes
the most important project we have introduced since 2014
not a foundation moby does not own projects
any project can come collab and retain ownership of their code
platform based on containers
platform based on containers
TUF is used in production by Docker, LEAP, App Container with integrations on-going into multiple other large projects. It is standardized by Python for deployment in their community repository. The automotive industry has begun integrating a TUF-variant called Uptane. You can buy Uptane from two suppliers, with an OEM currently integrating Uptane. It has been security audited by multiple groups.
InfraKit is designed to automate setup and management of infrastructure in support of distributed systems and higher-level container orchestration systems. These are the use cases we currently focus on.
Maintainers from a diverse set of companies: Docker, IBM, NTT, and Axway.
Used in Docker Editions (Docker for AWS, Docker for GCP), Axway Appcelerator
Instance plugin implementation ⇒ to different platform providers.
Diverse set of platforms from bare-metal provisioning (HP OneView, Dell/EMC RackHD) to public clouds (AWS, Alibaba Cloud). Even includes integration with Terraform for even more platform coverage.