Visualising Kubernetes with Weave Scope
•
0 likes•616 views
Presenter: Ilya Dmitrichenko, Community Engineer, Weaveworks Title: Visualizing Kubernetes Clusters with Weave Scope Abstract: Weave Scope automatically generates a map of your containers, enabling you to intuitively understand, monitor, and control your applications. It has full support for Kubernetes, which will be show during this talk.
Report
Share
Report
Share
Download to read offline
Recommended
Introduction to Kubernetes
Kubernetes is a container orchestration tool that automates the deployment, scaling, and management of containers across clusters of hosts. It monitors containers, performs automated scaling based on load, and restarts containers if they fail, reducing the need for manual intervention. Kubernetes can manage containers distributed across multiple nodes, making it useful for microservices applications. It provides features like rolling updates, load balancing, health checks, and integrates with tools for logging and monitoring. Kubernetes can be installed in different ways including Minikube for local testing, kubeadm for production clusters, and managed offerings from Google, AWS, and Azure.
Kubernetes SDN performance and architecture
The document discusses Kubernetes SDN performance and architecture. It provides an overview of Calico and OpenContrail, two common SDN solutions for Kubernetes. Calico uses standard protocols and has no overhead but lacks L2 capabilities. OpenContrail provides advanced networking features through an overlay but has more overhead and complexity. Both solutions were tested on a 100 node cluster and their performance and production considerations are examined. The presentation concludes with a comparison of Calico and OpenContrail and examples of multi-cloud architectures using them.
KubeCon EU 2016: Distributed containers in the physical world
The building industry in the world today is at large, far behind the rest of the world, technically. Alongside this, it is at threat of being dominated by a small selection of software vendors. These vendors push specific software solutions to the technically unskilled consumers in the AEC industry. The software they provide however is monolithic, native and heavy. Containers, distributed computing, and open source microservices and applications offer a solution to turn the construction industries future on its head. When computing is ubiquitous in our buildings with the internet of things, the whole way we think about building design has to change. We need to think in advance about how our applications which will run our buildings are developed. Each building is bespoke and the offers currently on the software market simply wont fit the bill in the near future. We are trying to develop a kubernetes based platform to lay the foundations for the future of lightweight bespoke apps developed for our built environment.
Sched Link:
KubeCon EU 2016:
We will explore the make up of the Kubernetes community and the adoption trends that we are tracking at RedMonk.
Sched Link: http://sched.co/67d4
KubeCon EU 2016: ChatOps and Automatic Deployment on Kubernetes
ChatOps is a term often credited to GitHub, and it is all about putting the tools in the middle of the conversations. At Unacast, most of our conversations go through Slack. When we integrated ChatOps into our workflow, we got the tools closer to the conversation.
We are using a version of GitHub Flow for our development process. That means all new features goes in a branch, someone opens a pull request and we merge continuously from master into the feature branch. When we have something that is ready to deploy to a server we trigger a deploy of the branch to a test environment. When the new feature gets verified it gets deployed to production, gets verified again, and then merged back into master. This workflow enables us to maintain a clean master branch so we can roll back in case something fails.
Sched Link: http://sched.co/67c1
KubeCon EU 2016: A Practical Guide to Container Scheduling
Containers are at the forefront of a new wave of technology innovation but the methods for scheduling and managing them are still new to most developers. In this talk we'll look at the kind of problems that container scheduling solves and at how maximising efficiency and maiximising QoS don't have to be exclusive goals. We'll take a behind the scenes look at the Kubernetes scheduler: How does it prioritize? What about node selection and external dependencies? How do you schedule based on your own specific needs? How does it scale and what’s in it both for developers already using containers and for those that aren't? We’ll use a combination of slides, code, demos to answer all these questions and hopefully all of yours.
Sched Link: http://sched.co/6BZa
KubeCon EU 2016: Trading in the Kube
We will present the latest iteration of our sample trading application, Reactive Trader (previous iteration - http://adaptiveconsulting.github.io/ReactiveTraderJS). This is built on Google Cloud Platform, Kubernetes and Docker and has a Microservices architecture.
Sched Link: http://sched.co/6BUp
KubeCon EU 2016: Integrated trusted computing in Kubernetes
Being able to trust your containers requires that you be able to trust the systems your containers are running on. Trusted computing makes it possible for computers to prove what they’ve booted, making it practical for clusters to verify that systems haven’t been compromised, but up until now it’s been a heroic task to deploy a trusted computing environment.
This presentation will describe the integration of trusted computing technologies into Kubernetes, making it possible to define policies that provide fine-grained access control to cluster resources and distribute secrets in a secure manner. It will then introduce functionality added to the rkt runtime, making it possible to extend trusted computing from initial system state to validation of individual containers.
Sched Link: http://sched.co/67eX
Recommended
Introduction to Kubernetes
Kubernetes is a container orchestration tool that automates the deployment, scaling, and management of containers across clusters of hosts. It monitors containers, performs automated scaling based on load, and restarts containers if they fail, reducing the need for manual intervention. Kubernetes can manage containers distributed across multiple nodes, making it useful for microservices applications. It provides features like rolling updates, load balancing, health checks, and integrates with tools for logging and monitoring. Kubernetes can be installed in different ways including Minikube for local testing, kubeadm for production clusters, and managed offerings from Google, AWS, and Azure.
Kubernetes SDN performance and architecture
The document discusses Kubernetes SDN performance and architecture. It provides an overview of Calico and OpenContrail, two common SDN solutions for Kubernetes. Calico uses standard protocols and has no overhead but lacks L2 capabilities. OpenContrail provides advanced networking features through an overlay but has more overhead and complexity. Both solutions were tested on a 100 node cluster and their performance and production considerations are examined. The presentation concludes with a comparison of Calico and OpenContrail and examples of multi-cloud architectures using them.
KubeCon EU 2016: Distributed containers in the physical world
The building industry in the world today is at large, far behind the rest of the world, technically. Alongside this, it is at threat of being dominated by a small selection of software vendors. These vendors push specific software solutions to the technically unskilled consumers in the AEC industry. The software they provide however is monolithic, native and heavy. Containers, distributed computing, and open source microservices and applications offer a solution to turn the construction industries future on its head. When computing is ubiquitous in our buildings with the internet of things, the whole way we think about building design has to change. We need to think in advance about how our applications which will run our buildings are developed. Each building is bespoke and the offers currently on the software market simply wont fit the bill in the near future. We are trying to develop a kubernetes based platform to lay the foundations for the future of lightweight bespoke apps developed for our built environment.
Sched Link:
KubeCon EU 2016:
We will explore the make up of the Kubernetes community and the adoption trends that we are tracking at RedMonk.
Sched Link: http://sched.co/67d4
KubeCon EU 2016: ChatOps and Automatic Deployment on Kubernetes
ChatOps is a term often credited to GitHub, and it is all about putting the tools in the middle of the conversations. At Unacast, most of our conversations go through Slack. When we integrated ChatOps into our workflow, we got the tools closer to the conversation.
We are using a version of GitHub Flow for our development process. That means all new features goes in a branch, someone opens a pull request and we merge continuously from master into the feature branch. When we have something that is ready to deploy to a server we trigger a deploy of the branch to a test environment. When the new feature gets verified it gets deployed to production, gets verified again, and then merged back into master. This workflow enables us to maintain a clean master branch so we can roll back in case something fails.
Sched Link: http://sched.co/67c1
KubeCon EU 2016: A Practical Guide to Container Scheduling
Containers are at the forefront of a new wave of technology innovation but the methods for scheduling and managing them are still new to most developers. In this talk we'll look at the kind of problems that container scheduling solves and at how maximising efficiency and maiximising QoS don't have to be exclusive goals. We'll take a behind the scenes look at the Kubernetes scheduler: How does it prioritize? What about node selection and external dependencies? How do you schedule based on your own specific needs? How does it scale and what’s in it both for developers already using containers and for those that aren't? We’ll use a combination of slides, code, demos to answer all these questions and hopefully all of yours.
Sched Link: http://sched.co/6BZa
KubeCon EU 2016: Trading in the Kube
We will present the latest iteration of our sample trading application, Reactive Trader (previous iteration - http://adaptiveconsulting.github.io/ReactiveTraderJS). This is built on Google Cloud Platform, Kubernetes and Docker and has a Microservices architecture.
Sched Link: http://sched.co/6BUp
KubeCon EU 2016: Integrated trusted computing in Kubernetes
Being able to trust your containers requires that you be able to trust the systems your containers are running on. Trusted computing makes it possible for computers to prove what they’ve booted, making it practical for clusters to verify that systems haven’t been compromised, but up until now it’s been a heroic task to deploy a trusted computing environment.
This presentation will describe the integration of trusted computing technologies into Kubernetes, making it possible to define policies that provide fine-grained access control to cluster resources and distribute secrets in a secure manner. It will then introduce functionality added to the rkt runtime, making it possible to extend trusted computing from initial system state to validation of individual containers.
Sched Link: http://sched.co/67eX
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
One of the most underrated features of Kubernetes is namespaces. In the market, instead of using this feature, people are still stuck with having different clusters for their environments. This talk will try to break this approach, and will introduce how we end up using ephemeral namespaces within our CI/CD pipeline. It will cover the architecture of our system for running the user acceptance tests on isolated ephemeral namespaces with every bits and pieces running within pods. While doing this, we will set up our CI/CD pipeline on top of TravisCI, GoCD, and Selenium that is controlled by Nightwatch.js.
Sched Link: http://sched.co/6Bcb
KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico
Why does the network matter and why does it need to be simple (the 3am test)? Why should we build networks that scale to the extremes and how can we do that with proven technologies? Finally, how can we secure microservices, why should we bother, and what does this mean for developers and operators?
Sched Link: http://sched.co/6BUR
KubeCon EU 2016: Heroku to Kubernetes
Arkena's video-on-demand platform is used as backend by major european channels (TF1 / beIN SPORTS / Elisa) to propose a non-linear experience to their customers.
Previously hosted on Heroku, the number of our users is increasing constantly. In order to optimize resources we decided to move on a bare metal infrastructure powered by Kubernetes.
We'll share thoughts, feedbacks and technical details about this successful transition.
Sched Link:
KubeCon EU 2016: Transforming the Government
This talk is documents the UK Home Office's cloud-native journey, changing how we did devops forever!
At the UK Home Office, we run Kubernetes in production. This talk is about how we got there, where we came from, where we are right now and where do we want to go from here. We will also cover what things worked out and which things didn't.
From on-boarding projects into Kubernetes to continous delivery, this talk will give you a good understanding of what lies ahead if you decided to take the road to schedule containers in production.
Sched Link: http://sched.co/68xS
KubeCon EU 2016: Getting the Jobs Done With Kubernetes
When you hear words such as Kubernetes or OpenShift you immediately start thinking
about long running processes you can easily scale at will. However, Kubernetes includes a lesser known feature which allows you to run pretty much anything from simple tasks up to highly-complicated ones.
During this presentation, the author of the Job resource in Kubernetes will guide you through several techniques for performing anything ranging from simple Pi calculations to rendering a movie. No matter if you're a data scientist running large scale calculations across several data centers or a hobby programmer running simple day-to-day tasks, this presentation is to teach you how to efficiently use Kubernetes Jobs on their own or as the building blocks of something
bigger.
This presentation will feature a number of live demos to help illustrate the various ways that you can put Jobs to work. Don’t miss out on learning about one of the coolest features of Kubernetes!
Sched Link: http://sched.co/6BUw
KubeCon EU 2016: Kubernetes Storage 101
You have deployed your application on Kube and now you want to actually do something permanent with it?? You will need STORAGE.
This talk will be a good introduction to using storage in Kubernetes. It will cover the use of EmptyDir, HostPath and Persistent Storage options. How to configure and use each type. This talk will also discuss the security features for storage in the open source OpenShift project.
Sched Link: http://sched.co/6BcS
KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes
Testing applications is important, as shown by the rise of continuous integration and automated testing. In this talk, I will focus on one area of testing that is difficult to automate: poor network connectivity. Developers usually work within reliable networking conditions so they might not notice issues that arise in other networking conditions. I will give examples of software that would benefit from test scenarios with varying connectivity. I will explain how traffic control on Linux can help to simulate various network connectivity. Finally, I will run a demo showing how an application running in Kubernetes behaves when changing network parameters.
Sched Link: http://sched.co/6Bb3
KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom
The New York Times’ is a US media company serves digital journalism to millions of visitors every day. The format of our stories is constantly experimented with; for example we publish graphics based on election data ingested from APIs, question and answer led discussions, breaking news live coverage, and quizzes. This leads to a lot of applications.
Our previous experience with infrastructure may be a familiar one: an unruly number of virtual machines, which led us to containers. Containers give our web developers who are not infrastructure engineers the opportunity to configure and launch their applications with little oversight.
Kubernetes offers us an infrastructure for our numerous applications at scale. Leveraging the Kubernetes API, we’ve built a self-service admin interface for developers (not sysadmins) to configure and launch their applications at scale, similar to the Kubernetes Dashboard project, tailored to our development workflow.
Sched Link: http://sched.co/67f2
KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise
With growing demand for containers in the enterprise, build pipelines are a bottleneck to success. Traditional workflows can't release application candidates quickly enough to fulfill demand. With over 400 development teams across many different business units, Pearson had to move away from massive installs of traditional build pipeline tools and rethink the entire concept. In this talk we'll demonstrate how we have built in security compliance, performance testing, quality assurance, abstracted away complexity, reduced overhead, aim to recover 10% of developers time and turned build tools into cattle.
This represents the story to date of an in-flight engineering project to modernise the digital estate of a global enterprise organisation and how scale of the operation is leading us to challenge many established beliefs. Attendees will walk away with everything from workflows to code which they can use to get started in their own endeavors.
Sched Link:
KubeCon EU 2016: SmartCity IoT on Kubernetes
Modern cities are rapidly adopting smart technologies to deliver realtime data about a number of city services. These technologies heavily rely on a high quality network interconnecting all sensors and reactors as lamps with controlling services. Many low level PLC systems solve the automation, but their purpose is limited to narrow areas of usage as these device have limited computational power. On the other hand, the rise of single-board computers as Raspberry Pi with multi-core processors and plenty of memory can serve as a platform for virtualized services based on Kubernetes. The distributed cluster across whole city on public streetlights gives operators the possibility to adapt to rapidly changing conditions. We propose distribution of HA clusters of single-board devices in key topological points of smart city mesh networks connected together by reliable SDN network. These virtualized services fulfill various tasks as data collection, data processing or and all of these services can rely on cloud backends, that provide much more computational and storage capacity. Services can be operated at both locations to serve local as well as foreign users.
We will share whole concept and architecture of SmartCity project, which covers deployment of more than 3000 endpoints[, both sensoric and reactive devices,] and about 30 smart gateways running in HA mode on Kubernetes Nodes.
Sched Link: http://sched.co/6BUM
KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...
Kubernetes gives developers a platform on which to run images and many configuration objects to control those images, but constructing a cohesive application made up of images and configuration objects is currently a challenge. Reconstructing or sharing that configuration can also be a challenge. This talk will cover the Template feature implemented in OpenShift to simplify the process of defining and repeatably deploying coordinated objects, discuss what is coming to Kubernetes with respect to this capability, and touch on several other existing projects that enable templatizing application definitions.
Sched Link: http://sched.co/6BVH
KubeCon EU 2016 Keynote: Pushing Kubernetes Forward
The Kubernetes community has aspirations of becoming the Linux kernel of distributed systems. Together we want to build a scalable, stable, and secure platform for distributed system that is the ubiquitous choice for people building server infrastructure. This talk will discuss the major community efforts made in recent months to deliver this goal and the work we need to do to continue our momentum.
Sched Link: http://sched.co/68lU
KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...
Load balancing is an important part of any resilient web application. Kubernetes supports a few options for external load balancing, but they are limited in features. After a brief discussion of those options and the features they lack, we’ll show how to build an advanced load balancing solution for Kubernetes on top of NGINX, utilizing Kubernetes features including Ingress, Annotations, and ConfigMap. We’ll conclude with a demo of how to use NGINX and NGINX Plus to expose services to the Internet.
Sched Link: http://sched.co/6Bc9
KubeCon EU 2016: Killing containers to make weather beautiful
The Met Office Informatics Lab includes scientists, developers and designers. We build prototypes exploring new technologies to make environmental data useful. Here we describe a recent project to process multi-dimensional weather data to create a fully interactive 4D browser application. We used long-running containers to serve data and web pages and short-running processes to ingest and compress the data. Forecast data is issued every three hours so our data ingestion goes through regular and predictable bursts (i.e. perfect for autoscaling).
We built a Kubernetes cluster in an AWS group which auto-scales based on load. We used replication controllers to process the data. Every three hours ingestion jobs are added to a queue and the number of ingestion containers are set in proportion to the queue length. Each worker completes exactly one ingestion job from the queue and then exits, at which point Kubernetes creates a new one to process the next message. This has allowed us to remove the lifespan logic from the containers and keep them light, fast and massively scalable. We are now in the process of using this in our production systems.
Sched Link: http://sched.co/6BWQ
KubeCon EU 2016: Multi-Tenant Kubernetes
Today Kubernetes is mostly employed in single tenant deployment, either private cloud, or as a COE on top of IaaS. By leveraging virtualized container like Hyper, Kubernetes will be the core of multi-tenant Container-as-a-Service. This talk will present Hypernetes, a secure Kubernetes distro focusing on the public container hosting service.
Sched Link: http://sched.co/6BYD
KubeCon EU 2016: Bringing an open source Containerized Container Platform to ...
Kurma is a open source container runtime that is based on the container instrumentation built into the Apcera Platform. Kurma, and its accompanied "KurmaOS" is our vision of a lightweight, fully containerized operating system.
This presentation will cover Apcera's journey in its container
instrumentation. Beginning with the pre-Docker landscape, how it grew over the course of 3+ years, and the "next-gen" adaption of it, where the base container instrumentation has been adapted to stand as its own open source project, and growing it to be used beyond just Apcera's own usage.
Kurma incorporates a lot of lessons learned with both development and operations of a container platform, including building modular vs monolith, extensibility being built in vs built on, and managing a cluster of hosts and containers.
We'll also cover our experiences with introducing it to Kubernetes as another first class runtime provider. Taking how Kurma works and have it work with Kubernetes, and how we'd like to see Kubernetes grow in some of the areas we see Kurma growing.
Sched Link: http://sched.co/6BlW
KubeCon EU 2016: "rktnetes": what's new with container runtimes and Kubernetes
rkt is a modern container runtime, built for security, efficiency, and composability. Kubernetes is a modern cluster orchestration system allowing users. Kubernetes doesn't directly execute application containers but instead delegate to a container runtime, which is integrated at the kubelet (node) level. When Kubernetes first launched, the only supported container runtime was Docker - but in recent months, we've been hard at work integrating rkt as an alternative container runtime, aka "rktnetes". The goal of "rktnetes" is to have first-class integration between rkt and the kubelet, and allow Kubernetes users to take advantage of some of rkt's unique features.
This talk will describe how rkt works, some of the features that make it unique as a container runtime, and some of the process of integrating an alternative container runtime with Kubernetes, as well as the latest state of "rktnetes."Introduction to rkt, including special/unique features.
Sched Link: http://sched.co/6BY7
KubeCon EU 2016: Full Automatic Database: PostgreSQL HA with Kubernetes
Why pay for always-on relational database service when you can deploy it yourself so easily? This demo-heavy talk will show off a deceptively simple high availability stack for PostgreSQL, using Docker, Etcd, Kubernetes, Patroni and Atomic. Not only is this open source solution ready to go to give you HA Postgres right now, it represents an approach which can be adapted to other relational databases with replication.
Sched Link: http://sched.co/6BV4
KubeCon EU 2016: A lightweight deployment system for appops
In this talk I'd like to introduce kploy (http://kubernetes.sh/kploy/), the opinionated Kubernetes deployment system for appops. I'll cover the motivation, practical usage examples and future directions for kploy and discuss the ecosystem and related projects (helm, servpeek, etc.)
Sched Link: http://sched.co/6BTj
KubeCon EU 2016: Scaling Open edX with Kubernetes
Abstract:
Over the past few years, massive open online courses (MOOCs) powered by Open edX have become wildly popular, bringing free or low-cost education to millions of students around the world. Such success, however, presents a slew of challenging problems in terms of providing a scalable, robust, and secure platform.
At Appsembler, we offer customers a fully managed and supported Open edX stack, all the way from the frontend web application to the backend services like ElasticSearch, MySQL, and MongoDB. With so many moving parts, we have come to realize the value of a multi-container, microservices-oriented architecture using Kubernetes.
In contrast to a single-container deployment of the Open edX stack, a Kubernetes-based approach allows us to scale different services independently; improves robustness since we can simply spin up new copies of containers if they go down; and results in improved security through greater segmentation and isolation. In addition to discussing these benefits, we'll also cover Kubernetes’ integration with Google Cloud services like Cloud SQL and Cloud Logging.
Sched Link: http://sched.co/6BbQ
Session 1 - Intro to Robotic Process Automation.pdf
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program:
https://bit.ly/Automation_Student_Kickstart
In this session, we shall introduce you to the world of automation, the UiPath Platform, and guide you on how to install and setup UiPath Studio on your Windows PC.
📕 Detailed agenda:
What is RPA? Benefits of RPA?
RPA Applications
The UiPath End-to-End Automation Platform
UiPath Studio CE Installation and Setup
💻 Extra training through UiPath Academy:
Introduction to Automation
UiPath Business Automation Platform
Explore automation development with UiPath Studio
👉 Register here for our upcoming Session 2 on June 20: Introduction to UiPath Studio Fundamentals: https://community.uipath.com/events/details/uipath-lagos-presents-session-2-introduction-to-uipath-studio-fundamentals/
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
More Related Content
More from KubeAcademy
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
One of the most underrated features of Kubernetes is namespaces. In the market, instead of using this feature, people are still stuck with having different clusters for their environments. This talk will try to break this approach, and will introduce how we end up using ephemeral namespaces within our CI/CD pipeline. It will cover the architecture of our system for running the user acceptance tests on isolated ephemeral namespaces with every bits and pieces running within pods. While doing this, we will set up our CI/CD pipeline on top of TravisCI, GoCD, and Selenium that is controlled by Nightwatch.js.
Sched Link: http://sched.co/6Bcb
KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico
Why does the network matter and why does it need to be simple (the 3am test)? Why should we build networks that scale to the extremes and how can we do that with proven technologies? Finally, how can we secure microservices, why should we bother, and what does this mean for developers and operators?
Sched Link: http://sched.co/6BUR
KubeCon EU 2016: Heroku to Kubernetes
Arkena's video-on-demand platform is used as backend by major european channels (TF1 / beIN SPORTS / Elisa) to propose a non-linear experience to their customers.
Previously hosted on Heroku, the number of our users is increasing constantly. In order to optimize resources we decided to move on a bare metal infrastructure powered by Kubernetes.
We'll share thoughts, feedbacks and technical details about this successful transition.
Sched Link:
KubeCon EU 2016: Transforming the Government
This talk is documents the UK Home Office's cloud-native journey, changing how we did devops forever!
At the UK Home Office, we run Kubernetes in production. This talk is about how we got there, where we came from, where we are right now and where do we want to go from here. We will also cover what things worked out and which things didn't.
From on-boarding projects into Kubernetes to continous delivery, this talk will give you a good understanding of what lies ahead if you decided to take the road to schedule containers in production.
Sched Link: http://sched.co/68xS
KubeCon EU 2016: Getting the Jobs Done With Kubernetes
When you hear words such as Kubernetes or OpenShift you immediately start thinking
about long running processes you can easily scale at will. However, Kubernetes includes a lesser known feature which allows you to run pretty much anything from simple tasks up to highly-complicated ones.
During this presentation, the author of the Job resource in Kubernetes will guide you through several techniques for performing anything ranging from simple Pi calculations to rendering a movie. No matter if you're a data scientist running large scale calculations across several data centers or a hobby programmer running simple day-to-day tasks, this presentation is to teach you how to efficiently use Kubernetes Jobs on their own or as the building blocks of something
bigger.
This presentation will feature a number of live demos to help illustrate the various ways that you can put Jobs to work. Don’t miss out on learning about one of the coolest features of Kubernetes!
Sched Link: http://sched.co/6BUw
KubeCon EU 2016: Kubernetes Storage 101
You have deployed your application on Kube and now you want to actually do something permanent with it?? You will need STORAGE.
This talk will be a good introduction to using storage in Kubernetes. It will cover the use of EmptyDir, HostPath and Persistent Storage options. How to configure and use each type. This talk will also discuss the security features for storage in the open source OpenShift project.
Sched Link: http://sched.co/6BcS
KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes
Testing applications is important, as shown by the rise of continuous integration and automated testing. In this talk, I will focus on one area of testing that is difficult to automate: poor network connectivity. Developers usually work within reliable networking conditions so they might not notice issues that arise in other networking conditions. I will give examples of software that would benefit from test scenarios with varying connectivity. I will explain how traffic control on Linux can help to simulate various network connectivity. Finally, I will run a demo showing how an application running in Kubernetes behaves when changing network parameters.
Sched Link: http://sched.co/6Bb3
KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom
The New York Times’ is a US media company serves digital journalism to millions of visitors every day. The format of our stories is constantly experimented with; for example we publish graphics based on election data ingested from APIs, question and answer led discussions, breaking news live coverage, and quizzes. This leads to a lot of applications.
Our previous experience with infrastructure may be a familiar one: an unruly number of virtual machines, which led us to containers. Containers give our web developers who are not infrastructure engineers the opportunity to configure and launch their applications with little oversight.
Kubernetes offers us an infrastructure for our numerous applications at scale. Leveraging the Kubernetes API, we’ve built a self-service admin interface for developers (not sysadmins) to configure and launch their applications at scale, similar to the Kubernetes Dashboard project, tailored to our development workflow.
Sched Link: http://sched.co/67f2
KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise
With growing demand for containers in the enterprise, build pipelines are a bottleneck to success. Traditional workflows can't release application candidates quickly enough to fulfill demand. With over 400 development teams across many different business units, Pearson had to move away from massive installs of traditional build pipeline tools and rethink the entire concept. In this talk we'll demonstrate how we have built in security compliance, performance testing, quality assurance, abstracted away complexity, reduced overhead, aim to recover 10% of developers time and turned build tools into cattle.
This represents the story to date of an in-flight engineering project to modernise the digital estate of a global enterprise organisation and how scale of the operation is leading us to challenge many established beliefs. Attendees will walk away with everything from workflows to code which they can use to get started in their own endeavors.
Sched Link:
KubeCon EU 2016: SmartCity IoT on Kubernetes
Modern cities are rapidly adopting smart technologies to deliver realtime data about a number of city services. These technologies heavily rely on a high quality network interconnecting all sensors and reactors as lamps with controlling services. Many low level PLC systems solve the automation, but their purpose is limited to narrow areas of usage as these device have limited computational power. On the other hand, the rise of single-board computers as Raspberry Pi with multi-core processors and plenty of memory can serve as a platform for virtualized services based on Kubernetes. The distributed cluster across whole city on public streetlights gives operators the possibility to adapt to rapidly changing conditions. We propose distribution of HA clusters of single-board devices in key topological points of smart city mesh networks connected together by reliable SDN network. These virtualized services fulfill various tasks as data collection, data processing or and all of these services can rely on cloud backends, that provide much more computational and storage capacity. Services can be operated at both locations to serve local as well as foreign users.
We will share whole concept and architecture of SmartCity project, which covers deployment of more than 3000 endpoints[, both sensoric and reactive devices,] and about 30 smart gateways running in HA mode on Kubernetes Nodes.
Sched Link: http://sched.co/6BUM
KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...
Kubernetes gives developers a platform on which to run images and many configuration objects to control those images, but constructing a cohesive application made up of images and configuration objects is currently a challenge. Reconstructing or sharing that configuration can also be a challenge. This talk will cover the Template feature implemented in OpenShift to simplify the process of defining and repeatably deploying coordinated objects, discuss what is coming to Kubernetes with respect to this capability, and touch on several other existing projects that enable templatizing application definitions.
Sched Link: http://sched.co/6BVH
KubeCon EU 2016 Keynote: Pushing Kubernetes Forward
The Kubernetes community has aspirations of becoming the Linux kernel of distributed systems. Together we want to build a scalable, stable, and secure platform for distributed system that is the ubiquitous choice for people building server infrastructure. This talk will discuss the major community efforts made in recent months to deliver this goal and the work we need to do to continue our momentum.
Sched Link: http://sched.co/68lU
KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...
Load balancing is an important part of any resilient web application. Kubernetes supports a few options for external load balancing, but they are limited in features. After a brief discussion of those options and the features they lack, we’ll show how to build an advanced load balancing solution for Kubernetes on top of NGINX, utilizing Kubernetes features including Ingress, Annotations, and ConfigMap. We’ll conclude with a demo of how to use NGINX and NGINX Plus to expose services to the Internet.
Sched Link: http://sched.co/6Bc9
KubeCon EU 2016: Killing containers to make weather beautiful
The Met Office Informatics Lab includes scientists, developers and designers. We build prototypes exploring new technologies to make environmental data useful. Here we describe a recent project to process multi-dimensional weather data to create a fully interactive 4D browser application. We used long-running containers to serve data and web pages and short-running processes to ingest and compress the data. Forecast data is issued every three hours so our data ingestion goes through regular and predictable bursts (i.e. perfect for autoscaling).
We built a Kubernetes cluster in an AWS group which auto-scales based on load. We used replication controllers to process the data. Every three hours ingestion jobs are added to a queue and the number of ingestion containers are set in proportion to the queue length. Each worker completes exactly one ingestion job from the queue and then exits, at which point Kubernetes creates a new one to process the next message. This has allowed us to remove the lifespan logic from the containers and keep them light, fast and massively scalable. We are now in the process of using this in our production systems.
Sched Link: http://sched.co/6BWQ
KubeCon EU 2016: Multi-Tenant Kubernetes
Today Kubernetes is mostly employed in single tenant deployment, either private cloud, or as a COE on top of IaaS. By leveraging virtualized container like Hyper, Kubernetes will be the core of multi-tenant Container-as-a-Service. This talk will present Hypernetes, a secure Kubernetes distro focusing on the public container hosting service.
Sched Link: http://sched.co/6BYD
KubeCon EU 2016: Bringing an open source Containerized Container Platform to ...
Kurma is a open source container runtime that is based on the container instrumentation built into the Apcera Platform. Kurma, and its accompanied "KurmaOS" is our vision of a lightweight, fully containerized operating system.
This presentation will cover Apcera's journey in its container
instrumentation. Beginning with the pre-Docker landscape, how it grew over the course of 3+ years, and the "next-gen" adaption of it, where the base container instrumentation has been adapted to stand as its own open source project, and growing it to be used beyond just Apcera's own usage.
Kurma incorporates a lot of lessons learned with both development and operations of a container platform, including building modular vs monolith, extensibility being built in vs built on, and managing a cluster of hosts and containers.
We'll also cover our experiences with introducing it to Kubernetes as another first class runtime provider. Taking how Kurma works and have it work with Kubernetes, and how we'd like to see Kubernetes grow in some of the areas we see Kurma growing.
Sched Link: http://sched.co/6BlW
KubeCon EU 2016: "rktnetes": what's new with container runtimes and Kubernetes
rkt is a modern container runtime, built for security, efficiency, and composability. Kubernetes is a modern cluster orchestration system allowing users. Kubernetes doesn't directly execute application containers but instead delegate to a container runtime, which is integrated at the kubelet (node) level. When Kubernetes first launched, the only supported container runtime was Docker - but in recent months, we've been hard at work integrating rkt as an alternative container runtime, aka "rktnetes". The goal of "rktnetes" is to have first-class integration between rkt and the kubelet, and allow Kubernetes users to take advantage of some of rkt's unique features.
This talk will describe how rkt works, some of the features that make it unique as a container runtime, and some of the process of integrating an alternative container runtime with Kubernetes, as well as the latest state of "rktnetes."Introduction to rkt, including special/unique features.
Sched Link: http://sched.co/6BY7
KubeCon EU 2016: Full Automatic Database: PostgreSQL HA with Kubernetes
Why pay for always-on relational database service when you can deploy it yourself so easily? This demo-heavy talk will show off a deceptively simple high availability stack for PostgreSQL, using Docker, Etcd, Kubernetes, Patroni and Atomic. Not only is this open source solution ready to go to give you HA Postgres right now, it represents an approach which can be adapted to other relational databases with replication.
Sched Link: http://sched.co/6BV4
KubeCon EU 2016: A lightweight deployment system for appops
In this talk I'd like to introduce kploy (http://kubernetes.sh/kploy/), the opinionated Kubernetes deployment system for appops. I'll cover the motivation, practical usage examples and future directions for kploy and discuss the ecosystem and related projects (helm, servpeek, etc.)
Sched Link: http://sched.co/6BTj
KubeCon EU 2016: Scaling Open edX with Kubernetes
Abstract:
Over the past few years, massive open online courses (MOOCs) powered by Open edX have become wildly popular, bringing free or low-cost education to millions of students around the world. Such success, however, presents a slew of challenging problems in terms of providing a scalable, robust, and secure platform.
At Appsembler, we offer customers a fully managed and supported Open edX stack, all the way from the frontend web application to the backend services like ElasticSearch, MySQL, and MongoDB. With so many moving parts, we have come to realize the value of a multi-container, microservices-oriented architecture using Kubernetes.
In contrast to a single-container deployment of the Open edX stack, a Kubernetes-based approach allows us to scale different services independently; improves robustness since we can simply spin up new copies of containers if they go down; and results in improved security through greater segmentation and isolation. In addition to discussing these benefits, we'll also cover Kubernetes’ integration with Google Cloud services like Cloud SQL and Cloud Logging.
Sched Link: http://sched.co/6BbQ
More from KubeAcademy (20)
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline
KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico
KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico
KubeCon EU 2016: Getting the Jobs Done With Kubernetes
KubeCon EU 2016: Getting the Jobs Done With Kubernetes
KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes
KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes
KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom
KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom
KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise
KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise
KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...
KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...
KubeCon EU 2016 Keynote: Pushing Kubernetes Forward
KubeCon EU 2016 Keynote: Pushing Kubernetes Forward
KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...
KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...
KubeCon EU 2016: Killing containers to make weather beautiful
KubeCon EU 2016: Killing containers to make weather beautiful
KubeCon EU 2016: Bringing an open source Containerized Container Platform to ...
KubeCon EU 2016: Bringing an open source Containerized Container Platform to ...
KubeCon EU 2016: "rktnetes": what's new with container runtimes and Kubernetes
KubeCon EU 2016: "rktnetes": what's new with container runtimes and Kubernetes
KubeCon EU 2016: Full Automatic Database: PostgreSQL HA with Kubernetes
KubeCon EU 2016: Full Automatic Database: PostgreSQL HA with Kubernetes
KubeCon EU 2016: A lightweight deployment system for appops
KubeCon EU 2016: A lightweight deployment system for appops
Recently uploaded
Session 1 - Intro to Robotic Process Automation.pdf
👉 Check out our full 'Africa Series - Automation Student Developers (EN)' page to register for the full program:
https://bit.ly/Automation_Student_Kickstart
In this session, we shall introduce you to the world of automation, the UiPath Platform, and guide you on how to install and setup UiPath Studio on your Windows PC.
📕 Detailed agenda:
What is RPA? Benefits of RPA?
RPA Applications
The UiPath End-to-End Automation Platform
UiPath Studio CE Installation and Setup
💻 Extra training through UiPath Academy:
Introduction to Automation
UiPath Business Automation Platform
Explore automation development with UiPath Studio
👉 Register here for our upcoming Session 2 on June 20: Introduction to UiPath Studio Fundamentals: https://community.uipath.com/events/details/uipath-lagos-presents-session-2-introduction-to-uipath-studio-fundamentals/
Astute Business Solutions | Oracle Cloud Partner |
Your goto partner for Oracle Cloud, PeopleSoft, E-Business Suite, and Ellucian Banner. We are a firm specialized in managed services and consulting.
AppSec PNW: Android and iOS Application Security with MobSF
Mobile Security Framework - MobSF is a free and open source automated mobile application security testing environment designed to help security engineers, researchers, developers, and penetration testers to identify security vulnerabilities, malicious behaviours and privacy concerns in mobile applications using static and dynamic analysis. It supports all the popular mobile application binaries and source code formats built for Android and iOS devices. In addition to automated security assessment, it also offers an interactive testing environment to build and execute scenario based test/fuzz cases against the application.
This talk covers:
Using MobSF for static analysis of mobile applications.
Interactive dynamic security assessment of Android and iOS applications.
Solving Mobile app CTF challenges.
Reverse engineering and runtime analysis of Mobile malware.
How to shift left and integrate MobSF/mobsfscan SAST and DAST in your build pipeline.
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Folding is a recent technique for building efficient recursive SNARKs. Several elegant folding protocols have been proposed, such as Nova, Supernova, Hypernova, Protostar, and others. However, all of them rely on an additively homomorphic commitment scheme based on discrete log, and are therefore not post-quantum secure. In this work we present LatticeFold, the first lattice-based folding protocol based on the Module SIS problem. This folding protocol naturally leads to an efficient recursive lattice-based SNARK and an efficient PCD scheme. LatticeFold supports folding low-degree relations, such as R1CS, as well as high-degree relations, such as CCS. The key challenge is to construct a secure folding protocol that works with the Ajtai commitment scheme. The difficulty, is ensuring that extracted witnesses are low norm through many rounds of folding. We present a novel technique using the sumcheck protocol to ensure that extracted witnesses are always low norm no matter how many rounds of folding are used. Our evaluation of the final proof system suggests that it is as performant as Hypernova, while providing post-quantum security.
Paper Link: https://eprint.iacr.org/2024/257
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
ScyllaDB Tablets: Rethinking Replication
ScyllaDB is making a major architecture shift. We’re moving from vNode replication to tablets – fragments of tables that are distributed independently, enabling dynamic data distribution and extreme elasticity. In this keynote, ScyllaDB co-founder and CTO Avi Kivity explains the reason for this shift, provides a look at the implementation and roadmap, and shares how this shift benefits ScyllaDB users.
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
At this talk we will discuss DDoS protection tools and best practices, discuss network architectures and what AWS has to offer. Also, we will look into one of the largest DDoS attacks on Ukrainian infrastructure that happened in February 2022. We'll see, what techniques helped to keep the web resources available for Ukrainians and how AWS improved DDoS protection for all customers based on Ukraine experience
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
This is a session that details how PostgreSQL's features and Azure AI Services can be effectively used to significantly enhance the search functionality in any application.
In this session, we'll share insights on how we used PostgreSQL to facilitate precise searches across multiple fields in our mobile application. The techniques include using LIKE and ILIKE operators and integrating a trigram-based search to handle potential misspellings, thereby increasing the search accuracy.
We'll also discuss how the azure_ai extension on PostgreSQL databases in Azure and Azure AI Services were utilized to create vectors from user input, a feature beneficial when users wish to find specific items based on text prompts. While our application's case study involves a drug search, the techniques and principles shared in this session can be adapted to improve search functionality in a wide range of applications. Join us to learn how PostgreSQL and Azure AI can be harnessed to enhance your application's search capability.
"What does it really mean for your system to be available, or how to define w...
We will talk about system monitoring from a few different angles. We will start by covering the basics, then discuss SLOs, how to define them, and why understanding the business well is crucial for success in this exercise.
"Choosing proper type of scaling", Olena Syrota
Imagine an IoT processing system that is already quite mature and production-ready and for which client coverage is growing and scaling and performance aspects are life and death questions. The system has Redis, MongoDB, and stream processing based on ksqldb. In this talk, firstly, we will analyze scaling approaches and then select the proper ones for our system.
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Tomaz Bratanic
Graph ML and GenAI Expert - Neo4j
JavaLand 2024: Application Development Green Masterplan
My presentation slides I used at JavaLand 2024
Apps Break Data
How information systems are built or acquired puts information, which is what they should be about, in a secondary place. Our language adapted accordingly, and we no longer talk about information systems but applications. Applications evolved in a way to break data into diverse fragments, tightly coupled with applications and expensive to integrate. The result is technical debt, which is re-paid by taking even bigger "loans", resulting in an ever-increasing technical debt. Software engineering and procurement practices work in sync with market forces to maintain this trend. This talk demonstrates how natural this situation is. The question is: can something be done to reverse the trend?
A Deep Dive into ScyllaDB's Architecture
This talk will cover ScyllaDB Architecture from the cluster-level view and zoom in on data distribution and internal node architecture. In the process, we will learn the secret sauce used to get ScyllaDB's high availability and superior performance. We will also touch on the upcoming changes to ScyllaDB architecture, moving to strongly consistent metadata and tablets.
Mutation Testing for Task-Oriented Chatbots
Conversational agents, or chatbots, are increasingly used to access all sorts of services using natural language. While open-domain chatbots - like ChatGPT - can converse on any topic, task-oriented chatbots - the focus of this paper - are designed for specific tasks, like booking a flight, obtaining customer support, or setting an appointment. Like any other software, task-oriented chatbots need to be properly tested, usually by defining and executing test scenarios (i.e., sequences of user-chatbot interactions). However, there is currently a lack of methods to quantify the completeness and strength of such test scenarios, which can lead to low-quality tests, and hence to buggy chatbots.
To fill this gap, we propose adapting mutation testing (MuT) for task-oriented chatbots. To this end, we introduce a set of mutation operators that emulate faults in chatbot designs, an architecture that enables MuT on chatbots built using heterogeneous technologies, and a practical realisation as an Eclipse plugin. Moreover, we evaluate the applicability, effectiveness and efficiency of our approach on open-source chatbots, with promising results.
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
The typical problem in product engineering is not bad strategy, so much as “no strategy”. This leads to confusion, lack of motivation, and incoherent action. The next time you look for a strategy and find an empty space, instead of waiting for it to be filled, I will show you how to fill it in yourself. If you’re wrong, it forces a correction. If you’re right, it helps create focus. I’ll share how I’ve approached this in the past, both what works and lessons for what didn’t work so well.
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Join us to learn how UiPath Apps can directly and easily interact with prebuilt connectors via Integration Service--including Salesforce, ServiceNow, Open GenAI, and more.
The best part is you can achieve this without building a custom workflow! Say goodbye to the hassle of using separate automations to call APIs. By seamlessly integrating within App Studio, you can now easily streamline your workflow, while gaining direct access to our Connector Catalog of popular applications.
We’ll discuss and demo the benefits of UiPath Apps and connectors including:
Creating a compelling user experience for any software, without the limitations of APIs.
Accelerating the app creation process, saving time and effort
Enjoying high-performance CRUD (create, read, update, delete) operations, for
seamless data management.
Speakers:
Russell Alfeche, Technology Leader, RPA at qBotic and UiPath MVP
Charlie Greenberg, host
What is an RPA CoE? Session 2 – CoE Roles
In this session, we will review the players involved in the CoE and how each role impacts opportunities.
Topics covered:
• What roles are essential?
• What place in the automation journey does each role play?
Speaker:
Chris Bolin, Senior Intelligent Automation Architect Anika Systems
Recently uploaded (20)
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
"NATO Hackathon Winner: AI-Powered Drug Search", Taras Kloba
"What does it really mean for your system to be available, or how to define w...
"What does it really mean for your system to be available, or how to define w...
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Visualising Kubernetes with Weave Scope
- 1. Visualising Kubernetes with Weave Scope Ilya Dmitrichenko @errordeveloper
- 2. Weave Scope automatically generates a map of your containers, enabling you to intuitively understand, monitor, and control your applications.
- 5. Drill down
- 7. Demo
- 8. Thank you! Check-out our podcast on The New Stack next week :) @errrodeveloper @weaveworks