A survey of problems involved in building containers and build tools such as:
buildah
nixos-container
ansible-container
Smith
Distroless
Buildkit
Source to Image (s2i)
Habitat
Monoliths, Myths, and Microservices - CfgMgmtCampMichael Ducy
Moving from a monolithic based architecture to a more microservices architecture can be fraught with challenges. We'll talk about some of these challenges and some common myths associated with trying to strangle the Monolith. We'll also talk about config management and automation's critical role in helping you move to a microservices architecture, and how our monolithic approach to automation changes in the new world.
Moving from a monolithic based architecture to a more microservices architecture can be fraught with challenges. This talk covers some of these challenges and some common myths associated with trying to strangle the Monolith. We will also talk a bit about the open source project Habitat (habitat.sh), and how it can help you move towards microservices.
The Hardest Part of Microservices: Your Data - Christian Posta, Red HatAmbassador Labs
Christian Posta, principal architect at Red Hat discusses how to manage your data within a microservices architecture at the 2017 Microservices.com Practitioner Summit.
From Monolithic to Microservices in 45 MinutesMongoDB
Presented by Norberto Leite, Developer Advocate, MongoDB
In this session you will learn how to leverage both Python and MongoDB to build highly scalable, asynchronous applications based on microservices architecture. We will review how to connect several different “exotic” services, using a variety of datasets, that together we can mashup into a consolidated application.
We will start by introducing several technologies that we will be using (e.g. Python, Flask, MongoDB, AngularJS) and take a ten-thousand foot overview of micro services architecture. At the end of the talk you will have a better understanding of how to decouple and implement microservices with MongoDB.
Monoliths, Myths, and Microservices - CfgMgmtCampMichael Ducy
Moving from a monolithic based architecture to a more microservices architecture can be fraught with challenges. We'll talk about some of these challenges and some common myths associated with trying to strangle the Monolith. We'll also talk about config management and automation's critical role in helping you move to a microservices architecture, and how our monolithic approach to automation changes in the new world.
Moving from a monolithic based architecture to a more microservices architecture can be fraught with challenges. This talk covers some of these challenges and some common myths associated with trying to strangle the Monolith. We will also talk a bit about the open source project Habitat (habitat.sh), and how it can help you move towards microservices.
The Hardest Part of Microservices: Your Data - Christian Posta, Red HatAmbassador Labs
Christian Posta, principal architect at Red Hat discusses how to manage your data within a microservices architecture at the 2017 Microservices.com Practitioner Summit.
From Monolithic to Microservices in 45 MinutesMongoDB
Presented by Norberto Leite, Developer Advocate, MongoDB
In this session you will learn how to leverage both Python and MongoDB to build highly scalable, asynchronous applications based on microservices architecture. We will review how to connect several different “exotic” services, using a variety of datasets, that together we can mashup into a consolidated application.
We will start by introducing several technologies that we will be using (e.g. Python, Flask, MongoDB, AngularJS) and take a ten-thousand foot overview of micro services architecture. At the end of the talk you will have a better understanding of how to decouple and implement microservices with MongoDB.
Service-mesh technology promises to deliver a lot of value to a cloud-native application, but it doesn't come without some hype. In this talk, we'll look at what is a "service mesh", how it compares to similar technology (Netflix OSS, API Management, ESBs, etc) and what options for service mesh exist today.
FestiveTechCalendar2021 - Have Yourself An Azure Container RegistryPhilip Welz
The Christmas wish list often contains stuff we want but don't really need. One thing we definitely need on our Christmas journey on Azure is the Azure Container Registry.
Join this session to learn all the details about the Azure Container Registry and the magical things you can do besides the obvious like storing container images.
Making sense of microservices, service mesh, and serverlessChristian Posta
As companies move to become digital, we can get sidetracked and distracted by some of the changes in the technology landscape. Ideally we will be harnessing technology to solve the problems we have and leverage it to deliver software faster and safer. In this talk, I'll we'll take a look at some new technology trends in the open-source communities and when and how to use them.
Slides from my presentation on microservices, spring cloud oss, service registry, zuul, hystrix. We also discuss various flavours of service registry for instance when zookeeper, eureka, consul. Then we took a first look on zuul and its key components, hystrix, hystrix dashboard, all accompanied with a demo hosted on github.
KubeCon NA 2018: Evolution of Integration and Microservices with Service Mesh...Christian Posta
Cloud-native describes a way of building applications on a cloud platform to iteratively discover and deliver business value. We now have access to a lot of similar technology that the large internet companies pioneered and used to their advantage to dominate their respective markets. What challenges arise when we start building applications to take advantage of this new technology?
In this talk we'll explore the role of service meshes when building distributed systems, why they make sense, and where they don't make sense. We will look at a class of problem that crops up that service mesh cannot solve, but that frameworks and even new programming languages like Ballerina are aiming to solve
Servers? Where we're going we don't need servers.drnugent
Real-time data is becoming ubiquitous. Mobile apps, Internet of Things, connected cars, and JavaScript-based desktop apps are relying more and more on real-time data and events. In this short talk, we’ll dive into how to add real-time functionality to your HTML5 apps and ways to build out back-end infrastructure.
Alternatives to REST
Hosted Real-time networks
Chrome developer tools
Node.js, Faye and Socket.io
The theme for the 2015 LabMan Conference (held at UNT in Denton, TX) is sustainability, and this closing keynote presentation talks about sustaining your career.
An eventful tour from enterprise integration to serverless and functionsChristian Posta
In this talk, Marius (@mariusbogoevici) and I (@christianposta) discuss the value of event-driven architectures (both business and technical merits) and how the landscape of integration, streaming, and messaging and now functions/lambdas have evolved to implement EDA while balancing agility, utilization, and simplicity.
The currently generally accepted properties of microservices can be summed up as follows: They are small and plentiful. They collaborate over the network. They are often built using different technologies by autonomous teams. These teams assume end-to-end responsibility for their creations and follow DevOps and Continuous Delivery principles. They also tend to be deployed as software containers using Docker.
Each one of these properties individually can make traditional information security managers shudder. A large attack surface due to the great number of network services, which are built and run by teams with possibly little security expertise. Changes deployed to production multiple times a day, often without any human intervention or sign-off. All that using whatever new tech stack the team in charge sees fit and run in overhyped container technology, which has yet to be proven in production.
This talk explored if the situation is really that dire, or if the properties of microservices can possibly even strengthen information security in your organisation.
На JavaScript Odesa #TechTalks мы поговорили о микрофронтендах как о современном архитектурном стиле проектирования для фронтенд разработки, который облегчает поддержку и деплой обновлений для крупных проектов.
Также мы обсудили:
Что такое микрофронтенды?
Как использовать их с старым проектом?
Монорепа vs мультирепа и почему?
О спикере:
Максим Белкин, Senior Software Engineer с 10-летним опытом коммерческой разработки веб-приложений. У Максима большой опыт в создании одностраничных приложений с использованием современных фреймворков и инструментов, а также большой опыт в области серверной разработки и создания REST API. Он также обладает глубокими знаниями в области объектно-ориентированной разработки, алгоритмов, кодирования и шаблонов тестирования и имеет опыт в гибкой разработке программного обеспечения, включая роли SCRUM Master и Team Lead.
Lowering the risk of monolith to microservicesChristian Posta
Breaking down the monolith is a risky and difficult job. Is it even worth it? Can you improve your position with the monolith? If you do decide to decompose the monolith, how do you actually do it?
In this talk, we look at some of the difficult and nasty parts of decomposing the monolith and look at tools and techniques for lowering the risk for making these changes including tools like service mesh (Istio) and data management (Teiid spring boot, debezium.io, etc).
Follow along on twitter @christianposta or http://blog.christianposta.com for a write up and the videos from this talk.
There are many resources out there that walk you through the process of setting up distributed systems, queuing and asynchronous processes — with and without NServiceBus.
Despite all the online education, teams continue to make the same common mistakes when designing and implementing microservices architecture. While the mistakes can have devastating consequences, they are easy to avoid when approached intentionally.
Jeffrey Palermo and Justin Self share their experiences in overcoming common microservices pitfalls and show how NServiceBus naturally encourages better architecture, such as easy adherence to SOLID principles.
Learn:
* What a microservice really is (and is not)
* What mistakes teams commonly make
* How to avoid the pitfalls and design more robust and scalable architecture
* How to equip your team for a microservices architecture
Service-mesh technology promises to deliver a lot of value to a cloud-native application, but it doesn't come without some hype. In this talk, we'll look at what is a "service mesh", how it compares to similar technology (Netflix OSS, API Management, ESBs, etc) and what options for service mesh exist today.
FestiveTechCalendar2021 - Have Yourself An Azure Container RegistryPhilip Welz
The Christmas wish list often contains stuff we want but don't really need. One thing we definitely need on our Christmas journey on Azure is the Azure Container Registry.
Join this session to learn all the details about the Azure Container Registry and the magical things you can do besides the obvious like storing container images.
Making sense of microservices, service mesh, and serverlessChristian Posta
As companies move to become digital, we can get sidetracked and distracted by some of the changes in the technology landscape. Ideally we will be harnessing technology to solve the problems we have and leverage it to deliver software faster and safer. In this talk, I'll we'll take a look at some new technology trends in the open-source communities and when and how to use them.
Slides from my presentation on microservices, spring cloud oss, service registry, zuul, hystrix. We also discuss various flavours of service registry for instance when zookeeper, eureka, consul. Then we took a first look on zuul and its key components, hystrix, hystrix dashboard, all accompanied with a demo hosted on github.
KubeCon NA 2018: Evolution of Integration and Microservices with Service Mesh...Christian Posta
Cloud-native describes a way of building applications on a cloud platform to iteratively discover and deliver business value. We now have access to a lot of similar technology that the large internet companies pioneered and used to their advantage to dominate their respective markets. What challenges arise when we start building applications to take advantage of this new technology?
In this talk we'll explore the role of service meshes when building distributed systems, why they make sense, and where they don't make sense. We will look at a class of problem that crops up that service mesh cannot solve, but that frameworks and even new programming languages like Ballerina are aiming to solve
Servers? Where we're going we don't need servers.drnugent
Real-time data is becoming ubiquitous. Mobile apps, Internet of Things, connected cars, and JavaScript-based desktop apps are relying more and more on real-time data and events. In this short talk, we’ll dive into how to add real-time functionality to your HTML5 apps and ways to build out back-end infrastructure.
Alternatives to REST
Hosted Real-time networks
Chrome developer tools
Node.js, Faye and Socket.io
The theme for the 2015 LabMan Conference (held at UNT in Denton, TX) is sustainability, and this closing keynote presentation talks about sustaining your career.
An eventful tour from enterprise integration to serverless and functionsChristian Posta
In this talk, Marius (@mariusbogoevici) and I (@christianposta) discuss the value of event-driven architectures (both business and technical merits) and how the landscape of integration, streaming, and messaging and now functions/lambdas have evolved to implement EDA while balancing agility, utilization, and simplicity.
The currently generally accepted properties of microservices can be summed up as follows: They are small and plentiful. They collaborate over the network. They are often built using different technologies by autonomous teams. These teams assume end-to-end responsibility for their creations and follow DevOps and Continuous Delivery principles. They also tend to be deployed as software containers using Docker.
Each one of these properties individually can make traditional information security managers shudder. A large attack surface due to the great number of network services, which are built and run by teams with possibly little security expertise. Changes deployed to production multiple times a day, often without any human intervention or sign-off. All that using whatever new tech stack the team in charge sees fit and run in overhyped container technology, which has yet to be proven in production.
This talk explored if the situation is really that dire, or if the properties of microservices can possibly even strengthen information security in your organisation.
На JavaScript Odesa #TechTalks мы поговорили о микрофронтендах как о современном архитектурном стиле проектирования для фронтенд разработки, который облегчает поддержку и деплой обновлений для крупных проектов.
Также мы обсудили:
Что такое микрофронтенды?
Как использовать их с старым проектом?
Монорепа vs мультирепа и почему?
О спикере:
Максим Белкин, Senior Software Engineer с 10-летним опытом коммерческой разработки веб-приложений. У Максима большой опыт в создании одностраничных приложений с использованием современных фреймворков и инструментов, а также большой опыт в области серверной разработки и создания REST API. Он также обладает глубокими знаниями в области объектно-ориентированной разработки, алгоритмов, кодирования и шаблонов тестирования и имеет опыт в гибкой разработке программного обеспечения, включая роли SCRUM Master и Team Lead.
Lowering the risk of monolith to microservicesChristian Posta
Breaking down the monolith is a risky and difficult job. Is it even worth it? Can you improve your position with the monolith? If you do decide to decompose the monolith, how do you actually do it?
In this talk, we look at some of the difficult and nasty parts of decomposing the monolith and look at tools and techniques for lowering the risk for making these changes including tools like service mesh (Istio) and data management (Teiid spring boot, debezium.io, etc).
Follow along on twitter @christianposta or http://blog.christianposta.com for a write up and the videos from this talk.
There are many resources out there that walk you through the process of setting up distributed systems, queuing and asynchronous processes — with and without NServiceBus.
Despite all the online education, teams continue to make the same common mistakes when designing and implementing microservices architecture. While the mistakes can have devastating consequences, they are easy to avoid when approached intentionally.
Jeffrey Palermo and Justin Self share their experiences in overcoming common microservices pitfalls and show how NServiceBus naturally encourages better architecture, such as easy adherence to SOLID principles.
Learn:
* What a microservice really is (and is not)
* What mistakes teams commonly make
* How to avoid the pitfalls and design more robust and scalable architecture
* How to equip your team for a microservices architecture
Docker is an open platform for developers and system administrators to build, ship and run distributed applications. Using Docker, companies in Jordan have been able to build powerful system architectures that allow speeding up delivery, easing deployment processes and at the same time cutting major hosting costs.
George Khoury shares his experience at Salalem in building flexible and cost effective architectures using Docker and other tools for infrastructure orchestration. The result allows them to easily and quickly move between different cloud providers.
Containers: from development to production at DevNation 2015Jérôme Petazzoni
In Docker, applications are shipped using a lightweight format, managed with a high-level API, and run within software containers which abstract the host environment. Operating details like distributions, versions, and network setup no longer matter to the application developer.
Thanks to this abstraction level, we can use the same container across all steps of the life cycle of an application, from development to production. This eliminates problems stemming from discrepancies between those environments.
Even so, these environments will always have different requirements. If our quality assurance (QA) and production systems use different logging systems, how can we still ship the same container to both? How can we satisfy the backup and security requirements of our production stack without bloating our development stack?
In this sess, you will learn about the unique features in containers that allow you to cleanly decouple system administrator tasks from the core of your application. We’ll show you how this decoupling results in smaller, simpler containers, and gives you more flexibility when building, managing, and evolving your application stacks.
Most people think "adopting containers" means deploying Docker images to production. In practice, adopting containers in the continuous integration process provides visible benefits even if the production environment are VMs.
In this webinar, we will explore this pattern by packaging all build tools inside Docker containers.
Container-based pipelines allow us to create and reuse building blocks to make pipeline creation and management MUCH easier. It's like building with Legos instead of clay.
This not only makes pipeline creation and maintenance much easier, it also solves a myriad of classic CI/CD problems such as:
Putting an end to version conflicts in build machines
Eliminating build machine management in general
Step portability and maintenance
In a very real sense, Docker-based pipelines reflect lessons learned from microservices in CI/CD pipelines. We will share tips and tricks for running these kinds of pipelines while using Codefresh as a CI/CD solution as it fully supports pipelines where each build step is running on its own Docker image.
Instant developer onboarding with self contained repositoriesYshay Yaacobi
Slide from my talk on "Instant developer onboarding with self-contained repositories".
https://sched.co/l9yG
Code examples on:
https://github.com/Yshayy/self-contained-repositories
Conference Recordings will be added once it will be public
Real-World Docker: 10 Things We've Learned RightScale
Docker has taken the world of software by storm, offering the promise of a portable way to build and ship software - including software running in the cloud. The RightScale development team has been diving into Docker for several projects, and we'll share our lessons learned on using Docker for our cloud-based applications.
Containers in depth – Understanding how containers work to better work with c...All Things Open
Presented by: Brent Laster, SAS
Presented at All Things Open 2020
Abstract: Containers are all the rage these days – from Docker to Kubernetes and everywhere in-between. But to get the most out of them it can be helpful to understand how containers are constructed, how they depend and interact with the operating system, and what the differences and interactions are between layers, images, and containers. Join R&D Director, Brent Laster as he does a quick, visual overview of how containers work and how applications such as Docker work with them. Topics to be discussed include:
What containers are and the benefits they provide
How containers are constructed
The differences between layers, images, and containers
What does immutability really mean
The core Linux functionalities that containers are based on
How containers reuse code
The differences between containers and VMs
What Docker really does
The Docker storage drivers
How overlays work
The Open Container Initiative
A good analogy for understanding all of this
Starting with introduction to containers, how it all began, making analogy with VMs wherever relevant, and going on to discuss about Kubernetes and how containers have changed the software development and deployment across the board.
Presentation given during Virginia Alliance for Secure Computing and Networking (VASCAN). Covers what containers actually are, as well as how they change the way we secure, patch, and run apps and infrastructure.
Open collaboration in the Moby ProjectAkihiro Suda
The Moby Project is a collaborative open-source project launched by Docker, Inc. to promote software containerization.
The Moby Project provides a "lego set" of components that can be assembled into custom downstream container systems such as Docker.
Akihiro Suda, a maintainer of Moby, Moby BuildKit, and containerd, shows how the community has been collaborating in the Moby Project.
He also shows how the Moby Project relates to Docker, OCI, and CNCF projects such as Kubernetes.
http://events.linuxfoundation.org/events/open-source-forum
>>WATCH THE WEBINAR HERE: https://codefresh.io/docker-based-pipelines-with-codefresh/
Most people think that Docker adoption means deploying Docker images. In this webinar, we will see the alternative way of adopting Docker in a Continuous Integration Pipeline, by packaging all build tools inside Docker containers. This makes it very easy to use different tool versions on the same build and puts an end to version conflicts in build machines. We will use Codefresh as a CI/CD solution as it fully supports pipelines where each build step is running on its own container image.
Sign up for FREE Codefresh account (120 builds/month) at Codefresh.io/codefresh-signup
Michigan IT Symposium 2017 - Container BOFJeffrey Sica
Development with Containers
Moderator: Jeffery Sica
Orchestration and Management with Containers
Moderator: Bob Killen
The Container has revolutionized how many industries and enterprises develop and deploy software and services. While the promise of containers to improve reliability, reproducibility and sharing application is helping to drive this adoption, there are still questions and concerns that are holding back broader adoption. In this BOF we will provide an opportunity for the Michigan IT community to engage with the local leaders in this area that are developing solutions and promoting the container model in their units
This BoF has been broken into two high-level topics: Development with Containers that is geared toward developers working with and implementing containerized applications, and Orchestration and Management with Containers that is geared toward sysadmins that are hosting and maintaining production-level containers. There will be an overview followed by an interactive period where the audience can ask questions of our experts and share their experiences with others. A key goal of these sessions is to understand and develop an agenda for solving questions and concerns that are holding back broader adoption.
Automating Security Response with ServerlessMichael Ducy
Serverless (or Functions as a Service) tends to get thrown in the "paradigms nice for developers" bucket, but Serverless can provide meaningful benefits to Operations, DevOps, and SRE teams. In a world where everything is presented or controlled via an API, Serverless' event driven, api first philosophy can help these teams create new levels of automation that were typically the realm of runbook tooling.
In this talk we'll cover the various open source Serverless frameworks and platforms available. We'll show how to automate basic day to day operational task with Serverless functions. Finally, we will show how to build an open source, automated, Serverless based, event driven pipeline to automatically secure and protect a Kubernetes cluster.
Rethinking Open Source in the Age of CloudMichael Ducy
The last several years has brought explosive growth to the realm of open source. Many new projects have started, and many have went on to become foundational components of running applications at scale. Cloud providers have focused on a strategy of embracing open source not only to help build value added services, but to also make it easy to use open source on their compute platforms. Open source companies have reacted by changing their software licenses in an attempt to cut out the Cloud providers.
So what does this mean for the future of open source? In this talk we’ll revisit some of the foundational tenets of open source, and compare these ideas to where open source has evolved. We’ll also talk about the pros and cons, and maybe unintended consequences, of Cloud based computing.
Open source security tools for Kubernetes.Michael Ducy
Cloud Native platforms such as Kubernetes help developers to easily get started deploying and running their applications at scale. But as this access to compute starts to become ubiquitous, how you secure and maintain compliance standards in these environments becomes extremely important.
In this talk, we'll cover the basics of securing Cloud Native platforms such as Kubernetes. We will also cover open source tools - such as Clair, Anchore, and Sysdig Falco - that can be used to maintain a secure computing environment. Attendees will walk away with a good understanding of the challenges of securing a Cloud Native platform and practical advice on using open source tools as part of their security strategy.
Effective security requires a layered approach. If one layer is comprised, the additional layers will (hopefully) stop an attacker from going further. Much of container security has focused on the image build process and providing providence for the artifacts in a container image, and restricting kernel level tunables in the container runtime (seccomp, SELinux, capabilities, etc). What if we can detect abnormal behavior in the application and the container runtime environment as well? In this talk, we’ll present Falco - an open source project for runtime security - and discuss how it provides application and container runtime security. We will show how Falco taps Linux system calls to provide low level insight into application behavior, and how to write Falco rules to detect abnormal behavior. Finally we will show how Falco can trigger notifications to stop abnormal behavior, notify humans, and isolate the compromised application for forensics. Attendees will leave with a better understanding of the container security landscape, what problems runtime security solves, & how Falco can provide runtime security and incident response.
You just got “done” with the transformation of your organization (or parts of it) to leverage more DevOps practices, and now the next hot thing is taking over the industry: containers, Cloud Native, SRE, GitOps, Kubernetes, etc. What’s a DevOps Manager to do? Throw away the last few years and rebrand the team as Cloud Native SREs?
Technological advancement not only provides advancement in “what” a modern technology architecture looks like, it can also provide advancement in the processes and the day to day of an organization’s technology teams. We’ve seen this before in the move from mainframe to client-server, and client-server to Cloud.
In this presentation I’ll talk about the relationship of DevOps to Cloud Native technologies, and help make sense of all the jargon - containers, microservices, orchestration (and Kubernetes), SRE, GitOps, etc. I’ll also talk about how some processes & practices in the world of DevOps change when leveraging these technologies. Attendees will leave with a base understanding of what a DevOps operating model looks like when leveraging modern Cloud Native technologies.
Securing your Container Environment with Open SourceMichael Ducy
Cloud Native platforms such as Kubernetes and Cloud Foundry help developers to easily get started deploying and running their applications at scale. But as this access to compute starts to become ubiquitous, how you secure and maintain compliance standards in these environments becomes extremely important. In this talk we'll cover the basics of securing Cloud Native platforms such as Kubernetes. We will also cover open source tools - such as Clair, Anchore, and Sysdig Falco - that can be used to maintain secure computing environment. Attendees will walk away with a good understanding of the challenges of securing a Cloud Native platform and practical advice on using open source tools as part of their security strategy.
Monitoring & Securing Microservices in KubernetesMichael Ducy
Application running in containers provide a myriad of choices to the end developer. But how do you provide the necessary services to monitor and secure these applications running in platforms such as Kubernetes. This presentation covers some common sense principles to monitor and secure your Kubernetes based applications.
We talked about the Sysdig open source projects (Sysdig and Falco), as well as the Sysdig Container Intelligence Platform, Sysdig Monitor and Sysdig Secure.
Principles of Monitoring MicroservicesMichael Ducy
Containers and Microservices have radically changed how you get visibility into your applications. As developers have started to leverage orchestration systems on top of containers, the game is changing yet again. What was a simple application on a host before is now a sophisticated, dynamically orchestrated, multi-container architecture. It’s amazing for development - but introduces a whole new set of challenges for monitoring and visibility.
In this talk we’ll lay out five key principles for monitoring microservices and the containers they are based on. These principles take into account the operational difference of containers and microservices when compared to traditional architectures.
This talk is for the operator that needs to help development teams understand how visibility of apps has changed, and help teams implement these ideas. You’ll walk away with a good understanding of the challenges of monitoring microservices and how you can set your team up for success.
Deployment pipelines seem to go hand in hand with any mention of DevOps. Why do pipelines matter and how do the principles of DevOps intertwine with the idea of treating everything as an artifact in a pipeline?
Changing the Way Development and Operations WorksMichael Ducy
DevOps, DevOps, Every where but not a drop to drink. Everyone talks about DevOps, but what does it really mean at the heart of it. To summarize, Increasing the flow of work through IT.
CloudStack Day 14 - Automation: The Key to Hybrid CloudMichael Ducy
Often Hybrid Cloud is talked about in terms of migrating entire VMs. This is fraught with problems, and can be better acheived by using automation to move a VMs configuration instead of the entire VM.
Ignite talk from Cloudstack Collab Conference EU 2013 held in Amsterdam.
C. Northcote Parkinson is quickly becoming widely quoted for ideas like "Bike Shedding". Let's talk quickly about Parkinson's Law and Parkinson's Law of Triviality and why Bureaucracies are so slow.
Much is often said about Silos in IT, and the fact that DevOps needs to "tear down the silos". But often the "rage against the silos" is often misdirected and we need to focus on the real problems, not organizational structure. Goats are your key to helping your organization change the way it operates.
Little Tech, Big Impact - Monktoberfest 2013Michael Ducy
How to use a little technology to impact your community. This presentation details my experience contributing to a School Boundary Realignment process and how just a little tech made things easier for the community in Westerville, Ohio.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
3. @mfdii
About me
Spent the last 4.5 years at Chef
Cloud, Automation, Performance & Capacity, Ops
Ask me about goats (goatcan.do)
Triton, Maroon, Buckeye
4. @mfdii
Review of “What’s a Container”
Cgroups
Control what a process can use.
● Memory
● CPU
● Blkio
● Cpuacct
● Cpuset
● Devices
● Net_prio
● Freezer
Namespaces
Control what a process can see.
● PID
● Mount
● Network
● UTS
● IPC
● User
● Cgroup
Thanks to Jess Frazelle (@jessfraz) for this slide https://goo.gl/7fVKFa
5. @mfdii
Containers vs. Zones vs. Jails vs. VMs
Thanks to Jess Frazelle (@jessfraz) for this slide https://goo.gl/7fVKFa
Containers
Cgroups
Namespaces
LSMs
Zones
First class
concept
Jails
First class
concept
VMs
First class
concept
Read more about this here: https://blog.jessfraz.com/post/containers-zones-jails-vms/
7. @mfdii
Problem with the Dockerfile paradigm
Builds aren’t deterministic or reproducable.
Programmability through Bash
Easy to turn a container image into a “VM”
Lack of visibility into what’s really in the final image
Bottom up approach vs application down
8. @mfdii
Real World Numbers Show the Problem
7 to 1 container to host ratio (DataDog survey, April 2017)
10 to 1 container to host ratio(Sysdig survey April 2017)
9. @mfdii
Base OS Image Size
https://anchore.com/blog/breakdown-of-operating-systems-of-dockerhub/
17. @mfdii
buildah
Project from Project Atomic - https://github.com/projectatomic/buildah
OCI and Docker Image Formats
Doesn’t require a container runtime to build containers.
Allows for some _interesting_ uses which are 0_0 LOLWUT
Not deterministic.
18. @mfdii
nixos-container
Builds containers based on NixOS
Imperative and Declarative approaches
Containers can be auto-rebuilt when host OS updates
Ability to get very granular with software installed in a container due to Nix’s
packaging approach
21. @mfdii
ansible-container
Declarative approach (mostly)
Allows you to build multiple containers from one container.yml (like
docker-compose)
Allows you to take advantage of Ansible expertise/playbooks you already have
https://github.com/ansible/ansible-container
23. @mfdii
Smith
Focuses on building “microcontainers”
Principles of microcontainers
1. A microcontainer only contains the process to be run and its direct dependencies.
2. The microcontainer has files with no user ownership or special permissions beyond the executable
bit.
3. The root filesystem of the container should be able to run read-only. All writes from the container
should be into a directory called /write. Any unique config that an individual container instance will
need should be placed into a directory called /read. Ephemeral files such as pid files can be written
to /run.
24. @mfdii
Smith
Declarative (mostly)
Builds containers that are significantly smaller (httpd built with Smith is 3% of
Dockerhub image)
Can use yum packages or Docker base images for source of binaries
https://hackernoon.com/how-to-build-a-tiny-httpd-container-ae622c37db39
26. @mfdii
Distroless
Declarative builds leveraging Google’s Bazel
‘"Distroless" images contain only your application and its runtime dependencies.
They do not contain package managers, shells any other programs you would
expect to find in a standard Linux distribution.’
Provides stripped down base images
Support for language runtimes: Java, Python, Go, C, Node, dotnet
27. @mfdii
Source-to-Image
“Source-to-Image (S2I) is a toolkit and workflow for building reproducible Docker
images from source code.”
One image can be used for builds, one can be used to run the artifact.
Allows build environments to be tightly versioned and controlled for reproducibility
Allows for control/security of the build environment through the use of build
containers
29. @mfdii
Buildkit
“BuildKit is a toolkit for converting source code to build artifacts in an efficient, expressive
and repeatable manner.”
Frontend’s specify a definition for how your software is built.
Buildkit takes this human readable definition (frontend) and transforms it into low level build
(LLB) definition.
Exporters allow build artifacts to be exported in a variety of formats not just container
formats.
Focuses on “How can we create generic primitives for a build system?”
https://blog.mobyproject.org/introducing-buildkit-17e056cc5317
33. @mfdii
Habitat
BUILD DEPLOY SUPERVISE
▪ Consistent process for
packaging all apps across all
architectures.
▪ Scaffolding for key languages:
Node.js, Ruby, Go, Java.
▪ Built in supervisor for Service
Discovery, Templated Configs,
Clustering Topologies, Health
Check APIs, and more
BUILD DEPLOY MANAGE
▪ Export to variety of different
formats:
Docker
ACI
CloudFoundry
Kubernetes
Mesos
tar
34. @mfdii
Habitat Build ServiceHabitat provides a cloud native build and packaging system
HABITAT BUILDER
Developer adds a plan.sh to define the build phases of
their software.
Scaffolding for common languages can be used provides
sane defaults.
Developer explicitly declares dependencies, required
backing services, and what services/ports are exposed.
Runtime lifecycle hooks can be defined for the application
(start, reconfigure, etc).
Templated configuration files can be included.
Habitat Builder watches a GitHub repository for changes,
when code is merged a build is performed based on the
repo’s plan.sh.
Build artifact includes runtime lifecycle hooks,
configuration, and application binaries or code.
Build artifact metadata includes dependent services,
exposed services/ports, and required dependencies.
Artifacts are stored in a Habitat Builder depot.
USER PLAN
PUBLIC
DEPOT
PRIVATE
DEPOT
35. @mfdii
Lots of choices
● buildah
○ Still coupling yourself to the operating system paradigms
● nixos-container
○ Niche OS, with it’s own insecure container model. Have to eat NixOS
● ansible-container
○ Great if you’ve committed to Ansible.
○ Ansible Service Bus for stateful services
● Smith
○ Microcontainers are what you want (++)
○ Janky to pull apart container images and still leverages OS package managers (to an
extent)
● Distroless
○ Removes the OS (++), very language specific
○ Bazel is not the most approachable tool and real world examples are minimal
36. @mfdii
Lots of choices
● Buildkit
○ Very interesting approach to solve the problem of building software in general.
○ Versioned build environments possible
○ Still too early, examples sparse, frontends for languages non-existent
● s2i
○ Versioned, secured build environments
○ Library of build/run images but built on OS paradigm
● Habitat
○ Easily describes software builds in BASH
○ Export formats for multiple platforms (++)
○ Does the right thing to determine what a build artifact needs to run
○ Have to eat the Supervisor which doesn’t fit with Kubernetes paradigms
○ Software libraries provided OOTB are not well maintained
37. @mfdii
Summary
Container Build Tools still have a long way to go.
Each tool has ++ and --
Some tools sacrifice “best practice” for approachability
Some tools make things overly complex
What do we need?
● Buildpack type model for Source Code building
● Declarative container build manifest generated from the build
● Exporter to create container image of choice with only the app and deps