The document discusses the agenda for KubeCon 2019, including that it was the 4th KubeCon EU event with over 8000 attendees, 400+ talks over 3 days, and was held at Fira Gran Via which is half the size of the Vatican. It also discusses the Cloud Native Computing Foundation (CNCF) and provides information on various Kubernetes tools including Helm, Harbor, Rook, CRI-O and their features and websites. It lists additional Kubernetes topics like the 5th birthday, growth on GitHub, new releases, and tools for benchmarking, security, and resources. Finally it discusses a talk on real world Kubernetes deployment patterns.
Azure Service Operator - Provision Your Resources in a Cloud-Native WayNico Meisenzahl
In this talk, Nico will introduce you to the Azure Service Operator project. The Azure Service Operator allows you to manage your Azure resources with a cloud-native approach using a Kubernetes Controllers and Custom Resource Definitions (CRDs). We will show you how Azure Service Operator works and share how customers and partners use it to take their Azure infrastructure management to the next level.
Get insights into how Azure Service Operator can help you to package your application with its infrastructure dependencies, how you can use a GitOps approach to manage your Azure infrastructure, or how Azure Service Operator allows you to create your own composable abstraction to build your own implementations and self-service solutions.
Walk away and know everything you need to know to successfully provision your Azure resources with Azure Service Operator.
All Things Cloud Native Meetup: Azure Kubernetes Service BasicsNico Meisenzahl
Containerized applications have become tremendously important in our everyday life. Learn everything about Kubernetes and how you can run it in the Azure Cloud. In this talk, Nico will explain how Kubernetes works and how it can help to run Containers in production. You will learn everything about Azure Kubernetes Service, Azure Container Registry and Azure Container Instances.
Cloud Native Night February 2019, Munich: Talk by Olaf Meyer (Consol)
Join our Meetup: www.meetup.com/cloud-native-muc
Abstract: Knative is at the time being one of the most hyped frameworks for Kubernetes and OpenShift. In this talk I don't want to focus on the features from a technical point of view but rather have a look at what Knative brings to the table if you are running a cluster in an enterprise environment with different users and projects. At the end of the talk you should have a sound understanding what Knative is doing, what its benefits are, where it extends respectively conflicts with OpenShift and what its drawbacks are.
What's New in KNIME Analytics Platform 4.0 and KNIME Server 4.9KNIMESlides
All the information about the latest features in KNIME Analytics Platform 4.0 and KNIME Server 4.9.
What we cover:
- New features of the KNIME Hub (hub.knime.com)
- What components are and how you can use these to bundle functionality for sharing and reusing
- Performance improvements
- New database integration
- New machine learning functionality
- New Plotly Integration (which brings all kinds of exciting interactive visualizations)
- New Spark nodes
- KNIME Server Remote Workflow Editor
- Scheduling improvements
- KNIME Server Distributed Executors
Webinar link: https://youtu.be/slOIiQzT_7E
What's New Document here: https://www.knime.com/whats-new-in-knime-40
Azure Service Operator - Provision Your Resources in a Cloud-Native WayNico Meisenzahl
In this talk, Nico will introduce you to the Azure Service Operator project. The Azure Service Operator allows you to manage your Azure resources with a cloud-native approach using a Kubernetes Controllers and Custom Resource Definitions (CRDs). We will show you how Azure Service Operator works and share how customers and partners use it to take their Azure infrastructure management to the next level.
Get insights into how Azure Service Operator can help you to package your application with its infrastructure dependencies, how you can use a GitOps approach to manage your Azure infrastructure, or how Azure Service Operator allows you to create your own composable abstraction to build your own implementations and self-service solutions.
Walk away and know everything you need to know to successfully provision your Azure resources with Azure Service Operator.
All Things Cloud Native Meetup: Azure Kubernetes Service BasicsNico Meisenzahl
Containerized applications have become tremendously important in our everyday life. Learn everything about Kubernetes and how you can run it in the Azure Cloud. In this talk, Nico will explain how Kubernetes works and how it can help to run Containers in production. You will learn everything about Azure Kubernetes Service, Azure Container Registry and Azure Container Instances.
Cloud Native Night February 2019, Munich: Talk by Olaf Meyer (Consol)
Join our Meetup: www.meetup.com/cloud-native-muc
Abstract: Knative is at the time being one of the most hyped frameworks for Kubernetes and OpenShift. In this talk I don't want to focus on the features from a technical point of view but rather have a look at what Knative brings to the table if you are running a cluster in an enterprise environment with different users and projects. At the end of the talk you should have a sound understanding what Knative is doing, what its benefits are, where it extends respectively conflicts with OpenShift and what its drawbacks are.
What's New in KNIME Analytics Platform 4.0 and KNIME Server 4.9KNIMESlides
All the information about the latest features in KNIME Analytics Platform 4.0 and KNIME Server 4.9.
What we cover:
- New features of the KNIME Hub (hub.knime.com)
- What components are and how you can use these to bundle functionality for sharing and reusing
- Performance improvements
- New database integration
- New machine learning functionality
- New Plotly Integration (which brings all kinds of exciting interactive visualizations)
- New Spark nodes
- KNIME Server Remote Workflow Editor
- Scheduling improvements
- KNIME Server Distributed Executors
Webinar link: https://youtu.be/slOIiQzT_7E
What's New Document here: https://www.knime.com/whats-new-in-knime-40
I'll introduce you to using Terraform to spin up a Kubernetes cluster on Amazon's Web Services. We will be creating an EKS cluster and an auto-scaling group of workers for the cluster.
Accompanying Blog: https://blog.anant.us/deploying-kubernetes-on-aws-using-terraform/
Webinar Recording: https://www.youtube.com/watch?v=62DlyF3B4_k
Follow Us and Reach Us At:
Anant:
https://www.anant.us/home
Cassandra.Link:
https://cassandra.link/
Email:
solutions@anant.us
LinkedIn:
https://www.linkedin.com/organization...
Twitter:
https://twitter.com/anantcorp
Eventbrite:
https://www.eventbrite.com/o/anant-10...
Facebook:
https://www.facebook.com/AnantCorp/
See Consul running on Kubernetes and learn how to use Consul as a universal service mesh to securely connect your applications running on different platforms.
Cloud Native Day: Cloud-native Anwendungsentwicklung im Jahr 2021Nico Meisenzahl
In diesem Vortrag sprechen wir darüber, wie sich die Entwicklung und Bereitstellung von Cloud-nativen Anwendungen in der Zukunft verändern wird. Cloud-native Anwendungen, die oft auf Microservices und Kubernetes basieren, werden immer häufiger genutzt und sind inzwischen sehr verbreitet. Jedoch ist die Hürde noch immer recht hoch. Wir glauben, dass eine weitere Abstraktion notwendig ist, damit sich Entwickler und Administratoren auf ihre Arbeit konzentrieren können, anstatt sich mit zu vielen Implementierungsdetails zu beschäftigen.
Aus diesem Grund möchten wir Ihnen die folgenden Open-Source-Projekte vorstellen:
* Distributed Application Runtime (dapr) - Eine quellenoffene Laufzeitumgebung, die es Entwicklern leicht macht, robuste microservice-basierte Applikationen zu entwickeln.
* Service Mesh Interface - Eine Standardschnittstelle für Service Meshes auf Kubernetes. Das Ziel ist es, einen gemeinsamen, portablen Satz von Service-Mesh-APIs bereitzustellen, den Entwickler und Administratoren providerunabhängig nutzen können.
Verpassen Sie den Vortrag von Martin und Nico nicht und erhalten Sie nützliche Einblicke in die Zukunft der Entwicklung und des Betriebs Cloud-nativer Anwendungen.
Kubernetes, Istio e Knative: The new cloud stackLuram Archanjo
Over the years architectural styles have evolved with microservice, service mesh and serverless. Would not it be nice to have all of them working together to add value to our business?
Well, I introduce the new cloud stack: Kubernetes, Istio and Knative that are totally open source.
So, in this talk I will introduce the newest member of the team, the Knative! Which brings the serverless feature in our architecture, using Istio to route traffic between versioned functions, among other characteristics that I will demonstrate during the course of the lecture.
Engage, Amaze and Deliver with EPiServer in the AWS Cloud - Customer: Reed Bu...Amazon Web Services
Learn how one of our key customers Reed Business Information has used EPiServer and AWS to enable CMS deployments quickly and cost-effectively.
Tom von Gessel, Reed Business Information
En esta sesión empezaremos analizando el papel que juegan las tecnologías de integración en un mundo cada vez más competitivo y conectado, y terminaremos revisando el proceso de modernización iniciado por BizTalk Server a través de las principales novedades incluidas en su versión 2016 con el objetivo de adaptarse al ritmo que marca el momento de cambio que estamos viviendo.
This presentations covers our journey to cloud native architectures and the bit lessons that we learned while transitioning to distributed infrastructures.
Service-mesh technology promises to deliver a lot of value to a cloud-native application, but it doesn't come without some hype. In this talk, we'll look at what is a "service mesh", how it compares to similar technology (Netflix OSS, API Management, ESBs, etc) and what options for service mesh exist today.
For more information about the project visit:
https://github.com/spring-cloud-incubator/spring-cloud-kubernetes
and http://salaboy.com
Here is an example project for the discovery module:
https://github.com/Salaboy/minions/tree/spring-cloud-k8s
What's New in KNIME Analytics Platform 4.1KNIMESlides
Slides from our recent webinar highlighting the newest features in KNIME Analytics Platform 4.1 and KNIME Server 4.10
It covers all the new features like Guided Labeling and all the new nodes such as the Binary Classification Inspector node, and WebRetriever node. It covers public and private spaces on the KNIME Hub and how the Hub can help you build your workflows more quickly and easily by giving you access to components. It also covers the additional cloud connectivity as well as the new Create Databricks Environment node for connecting to your Databricks cluster running on Microsoft Azure or Amazon AWS.
On the KNIME Server side, we highlight how the server now supports the open standard for authorization - OAuth identification as well as how you can more easily configure workflows that are already running on KNIME Server.
View the webinar here: https://www.youtube.com/watch?v=VzNqE4WklEk
Read here for more details on this release: https://www.knime.com/whats-new-in-knime-41
I'll introduce you to using Terraform to spin up a Kubernetes cluster on Amazon's Web Services. We will be creating an EKS cluster and an auto-scaling group of workers for the cluster.
Accompanying Blog: https://blog.anant.us/deploying-kubernetes-on-aws-using-terraform/
Webinar Recording: https://www.youtube.com/watch?v=62DlyF3B4_k
Follow Us and Reach Us At:
Anant:
https://www.anant.us/home
Cassandra.Link:
https://cassandra.link/
Email:
solutions@anant.us
LinkedIn:
https://www.linkedin.com/organization...
Twitter:
https://twitter.com/anantcorp
Eventbrite:
https://www.eventbrite.com/o/anant-10...
Facebook:
https://www.facebook.com/AnantCorp/
See Consul running on Kubernetes and learn how to use Consul as a universal service mesh to securely connect your applications running on different platforms.
Cloud Native Day: Cloud-native Anwendungsentwicklung im Jahr 2021Nico Meisenzahl
In diesem Vortrag sprechen wir darüber, wie sich die Entwicklung und Bereitstellung von Cloud-nativen Anwendungen in der Zukunft verändern wird. Cloud-native Anwendungen, die oft auf Microservices und Kubernetes basieren, werden immer häufiger genutzt und sind inzwischen sehr verbreitet. Jedoch ist die Hürde noch immer recht hoch. Wir glauben, dass eine weitere Abstraktion notwendig ist, damit sich Entwickler und Administratoren auf ihre Arbeit konzentrieren können, anstatt sich mit zu vielen Implementierungsdetails zu beschäftigen.
Aus diesem Grund möchten wir Ihnen die folgenden Open-Source-Projekte vorstellen:
* Distributed Application Runtime (dapr) - Eine quellenoffene Laufzeitumgebung, die es Entwicklern leicht macht, robuste microservice-basierte Applikationen zu entwickeln.
* Service Mesh Interface - Eine Standardschnittstelle für Service Meshes auf Kubernetes. Das Ziel ist es, einen gemeinsamen, portablen Satz von Service-Mesh-APIs bereitzustellen, den Entwickler und Administratoren providerunabhängig nutzen können.
Verpassen Sie den Vortrag von Martin und Nico nicht und erhalten Sie nützliche Einblicke in die Zukunft der Entwicklung und des Betriebs Cloud-nativer Anwendungen.
Kubernetes, Istio e Knative: The new cloud stackLuram Archanjo
Over the years architectural styles have evolved with microservice, service mesh and serverless. Would not it be nice to have all of them working together to add value to our business?
Well, I introduce the new cloud stack: Kubernetes, Istio and Knative that are totally open source.
So, in this talk I will introduce the newest member of the team, the Knative! Which brings the serverless feature in our architecture, using Istio to route traffic between versioned functions, among other characteristics that I will demonstrate during the course of the lecture.
Engage, Amaze and Deliver with EPiServer in the AWS Cloud - Customer: Reed Bu...Amazon Web Services
Learn how one of our key customers Reed Business Information has used EPiServer and AWS to enable CMS deployments quickly and cost-effectively.
Tom von Gessel, Reed Business Information
En esta sesión empezaremos analizando el papel que juegan las tecnologías de integración en un mundo cada vez más competitivo y conectado, y terminaremos revisando el proceso de modernización iniciado por BizTalk Server a través de las principales novedades incluidas en su versión 2016 con el objetivo de adaptarse al ritmo que marca el momento de cambio que estamos viviendo.
This presentations covers our journey to cloud native architectures and the bit lessons that we learned while transitioning to distributed infrastructures.
Service-mesh technology promises to deliver a lot of value to a cloud-native application, but it doesn't come without some hype. In this talk, we'll look at what is a "service mesh", how it compares to similar technology (Netflix OSS, API Management, ESBs, etc) and what options for service mesh exist today.
For more information about the project visit:
https://github.com/spring-cloud-incubator/spring-cloud-kubernetes
and http://salaboy.com
Here is an example project for the discovery module:
https://github.com/Salaboy/minions/tree/spring-cloud-k8s
What's New in KNIME Analytics Platform 4.1KNIMESlides
Slides from our recent webinar highlighting the newest features in KNIME Analytics Platform 4.1 and KNIME Server 4.10
It covers all the new features like Guided Labeling and all the new nodes such as the Binary Classification Inspector node, and WebRetriever node. It covers public and private spaces on the KNIME Hub and how the Hub can help you build your workflows more quickly and easily by giving you access to components. It also covers the additional cloud connectivity as well as the new Create Databricks Environment node for connecting to your Databricks cluster running on Microsoft Azure or Amazon AWS.
On the KNIME Server side, we highlight how the server now supports the open standard for authorization - OAuth identification as well as how you can more easily configure workflows that are already running on KNIME Server.
View the webinar here: https://www.youtube.com/watch?v=VzNqE4WklEk
Read here for more details on this release: https://www.knime.com/whats-new-in-knime-41
Containerized Workloads sind mittlerweile nicht mehr aus unserem Alltag wegzudenken. Warum also nicht auch Container und deren Vorteile als Grundlage unserer Build- und Deployment-Pipelines nutzen?
Nico wird in seinem Talk über die Grundlagen und Vorteile von Containerized Pipelines sprechen sowie nützliche Best Practices vorstellen, die sich direkt umsetzen lassen.
Darüber hinaus wird Nico die folgenden Themen anhand von Demos präsentieren und vertiefen:
* Pipeline Workload auf Kubernetes mit Hilfe von Gitlab Runner
* Docker Image Builds mit Kaniko
* Ausblick auf Kubernetes-native Pipelines mit Tekton
Forced Evolution: Shopify's Journey to KubernetesC4Media
Niko Kurtti talks about the challenges Shopify saw in moving from a traditional host-based infrastructure to a cloud native one, moving not only their core app to Kubernetes but also hundreds of other apps at the same time. He focuses on the cluster tooling solutions they've built, such as controllers, cluster creators, and deploy tools. Filmed at qconnewyork.com.
Niko Kurtti is a production engineer at Shopify. He started out as a software developer doing web apps with Java, but since then fell in love with container technologies. He was part of the effort to roll out Docker in production at Shopify in 2014 and is still working around the same domain, but today the focus is on Shopify’s internal PaaS based on k8s.
DevOpsCon London: How containerized Pipelines can boost your CI/CDNico Meisenzahl
Learn how to eliminate any dependencies on your CI/CD build nodes and don’t bother yourself with multiple versions of your toolchain and any corresponding constraints. Walk away with knowledge and best practices that will help you to optimize your builds and deployments with containerized pipelines Use containerized Gitlab CI/CD pipelines and Kaniko to move your build and deployment workloads into your Kubernetes cluster. Build your apps and infrastructure without any external dependencies and constraints. You are building a Go project, deploying an app to Kubernetes or building your infrastructure. It doesn’t matter. Anything is possible! Nico will also introduce you to Tekton – an open source project which helps you building a cloud native toolchain by moving your whole CI/CD into Kubernetes. Join Nico on a deep dive into the secrets of building hassle-free containerized build and deployment pipelines with Gitlab CI/CD, Kaniko and Tekton.
DevOps Gathering - How Containerized Pipelines Can Boost Your CI/CDNico Meisenzahl
Learn how to eliminate any dependencies on your CI/CD build nodes and don’t bother yourself with multiple versions of your toolchain and any corresponding constraints. Walk away with knowledge and best practices that will help you to optimize your builds and deployments with containerized pipelines! Use containerized Gitlab CI/CD pipelines and Kaniko to move your build and deployment workloads into your Kubernetes cluster. Build your apps and infrastructure without any external dependencies and constraints. You are building a Go project, deploying an app to Kubernetes or building your infrastructure. It doesn’t matter. Anything is possible! Nico will also introduce you to Tekton - an open source project which helps you building a cloud native toolchain by moving your whole CI/CD into Kubernetes. Join Nico on a deep dive into the secrets of building hassle-free containerized build and deployment pipelines with Gitlab CI/CD, Kaniko and Tekton.
Container on Windows, not windows containers Docker meetup MelbourneJorge Arteiro
Windows now can support Windows and Linux containers in a single platform. I am bringing details about Windows evolution to provide a hybrid environment for containers.
Containers, OCI, CNCF, Magnum, Kuryr, and You!Daniel Krook
Presentation at the OpenStack Summit in Austin, Texas on April 28, 2016.
http://bit.ly/os-oci-cncf-ses
The technology industry has been abuzz about cloud workload containerization since the open source Docker project became a phenomenon in early 2014.
Meanwhile, an OpenStack Containers Team was formed and the Magnum project launched to provide users with a convenient Containers-as-a-Service solution for OpenStack environments.
As the potential of both technologies emerged, many wanted to see shared governance over the baseline container specification and runtime technology to ensure an open cloud ecosystem.
This past December, two new groups were launched with a goal of creating open, industry standards. The first called the Open Container Initiative (http://www.opencontainers.org), and the second called the Cloud Native Computing Foundation (http://cncf.io)
Jeffrey Borek - Program Director, Open Tech, IBM - @JeffBorek
Daniel Krook - Senior Software Engineer, IBM - @DanielKrook
Val Bercovici - Global Cloud CTO, NetApp/SolidFire - @valb00
In this presentation we discuss the latest trends in the Spring ecosystem as learned on Spring I/O Barcelona (the largest Spring Conference in Europe). Spring's growing reactive support (R2DBC & RSocket) in Spring Framework 5.2+. We stille see a lot of love between Sping & Kotlin with support for coroutines & Kofu and to conclude we discuss what's next in Spring Cloud development now that some of the Netflix projects are in maintenance mode.
Social Connections 14 - Running Microservices in Production with IBMpanagenda
Recording: http://pan.news/5zPi30mvmuk
Abstract: Join Nico to get an overview on how to run your Microservices on-premises as well as in the Cloud in a production ready environment. This session will cover how to run, manage and orchestrate your Containers using IBM Cloud Kubernetes Service (IKS) as well as IBM Cloud Private (ICP). You will get useful insights, tips and live demos of both solutions. Nico will also talk about tools which will help you to manage and secure your environment. Join his sessions and you will be ready to run your own Microservices using IKS and ICP!
Join Nico to get an overview on how to run your Microservices on-premises as well as in the Cloud in a production ready environment. This session will cover how to run, manage and orchestrate your Containers using IBM Cloud Kubernetes Service (IKS) as well as IBM Cloud Private (ICP). You will get useful insights, tips and live demos of both solutions. Nico will also talk about tools which will help you to manage and secure your environment. Join his sessions and you will be ready to run your own Microservices using IKS and ICP!
Kubernetes is much more than a runtime platform for Docker containers. Through its API not only can you create custom clients, but you can also extend Kubernetes. Those custom Controllers are called Operators and work with application-specific custom resource definitions.
Not only can you write those Kubernetes operators in Go, but you can also do this in Java. Within this talk, you will be guided through setting up and your first explorations of the Kubernetes API within a plain Java program. We explore the concepts of resource listeners, programmatic creation of deployments and services and how this can be used for your custom requirements.
GitLab London Meetup: How Containerized Pipelines and Kubernetes Can Boost Yo...Nico Meisenzahl
Learn how to eliminate any dependencies on your CI/CD build nodes and don’t bother yourself with multiple versions of your toolchain and any corresponding constraints. Walk away with knowledge and best practices that will help you to optimize your builds and deployments with containerized pipelines!
Use containerized GitLab CI/CD pipelines and Kaniko to move your build and deployment workloads into your Kubernetes cluster. Build your apps and infrastructure without any external dependencies and constraints. If you are building a Go project, deploying an app to Kubernetes or just building your infrastructure. It doesn’t matter, anything is possible!
Join Nico on a deep dive into the secrets of building hassle-free containerized build and deployment pipelines with GitLab CI/CD, Kubernetes and Kaniko.
Effiziente CI/CD-Pipelines – mit den richtigen Tools klappt dasNico Meisenzahl
Lernen Sie, wie Sie mit containerisierten Pipelines Abhängigkeiten in Ihren CI/CD-Umgebung eliminieren, um sich nicht mit verschiedenen Versionen Ihrer Toolchain und Abhängigkeiten herumschlagen zu müssen.
Nutzen Sie die containerisierten Gitlab CI/CD-Pipelines und Kaniko, um Build- und Deployment-Workloads in Ihrem Kubernetes-Cluster zu verlagern. Stellen Sie Ihre Microservices und/oder Infrastruktur ohne externe Abhängigkeiten und Einschränkungen bereit.
Nico wird Sie auch in Tekton einführen - ein Open-Source-Projekt, das Ihnen hilft, eine Cloud-native Toolchain aufzubauen, indem Sie Ihr gesamtes CI/CD (Workload sowie Konfiguration) in Kubernetes verlagern.
Begleiten Sie Nico auf einem Deep Dive in die Geheimnisse von containerisierten Build und Deployment Pipelines mit Gitlab CI/CD, Kaniko und Tekton.
Moby is an open source project providing a "LEGO set" of dozens of components, the framework to assemble them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
One of these assemblies is Docker CE, an open source product that lets you build, ship, and run containers.
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios.
We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary.
Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Video at https://www.youtube.com/watch?v=kDp22YkD6WY
Into the Box Keynote Day 2: Unveiling amazing updates and announcements for modern CFML developers! Get ready for exciting releases and updates on Ortus tools and products. Stay tuned for cutting-edge innovations designed to boost your productivity.
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Mind IT Systems
Healthcare providers often struggle with the complexities of chronic conditions and remote patient monitoring, as each patient requires personalized care and ongoing monitoring. Off-the-shelf solutions may not meet these diverse needs, leading to inefficiencies and gaps in care. It’s here, custom healthcare software offers a tailored solution, ensuring improved care and effectiveness.
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Understanding Globus Data Transfers with NetSageGlobus
NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?
Developing Distributed High-performance Computing Capabilities of an Open Sci...Globus
COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among public health practitioners, mathematical modelers, and scientific computing specialists, while revealing critical gaps in exploiting advanced computing systems to support urgent decision making. Informed by our team’s work in applying high-performance computing in support of public health decision makers during the COVID-19 pandemic, we present how Globus technologies are enabling the development of an open science platform for robust epidemic analysis, with the goal of collaborative, secure, distributed, on-demand, and fast time-to-solution analyses to support public health.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
Globus Connect Server Deep Dive - GlobusWorld 2024Globus
We explore the Globus Connect Server (GCS) architecture and experiment with advanced configuration options and use cases. This content is targeted at system administrators who are familiar with GCS and currently operate—or are planning to operate—broader deployments at their institution.
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxrickgrimesss22
Discover the essential features to incorporate in your Winzo clone app to boost business growth, enhance user engagement, and drive revenue. Learn how to create a compelling gaming experience that stands out in the competitive market.
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
2016 London
2017 Berlin
2018 Copenhagen
North America, Europe, China
This is our lovely hotel – there definitely weren’t any cheaper hotels in the area Jim
The venue for this year’s talk was the Fira Gran Via in Barcelona’s new business development area. This site was enormous covering a floor space of almost 250,000 square metres, meaning walking between meetings took some time – we covered on average 20,000 steps a day. The production value of the event was outstanding, with massive KubeCon branding, enormous screens, good food & drink and excellent organisation.
Every morning and evening the keynotes would be held in this huge room with giant screens.
Talk about the kid who was still in German High School who had done two years military service, ported Kubernetes to a stack of Rasberry Pies, created a company and was sub contracting to IBM for Kubernetes work.
Talks were very interesting, some a lot better than others. You were able to preview the slides before choosing which talks you were going to attend.
Tutorials required an early sign up and we would have missed out on a lot of talks.
The showcase hall was enourmous which had a ton of vendors in.
All the big players; Redhat, AWS, GCP, Azure, VMWare, Suse
Not as much free swag as we thought and we're still receiving emails!
A ton of companies out there – a lot providing similar managed services, logging and devops solutions
CNCF founded in 2015 to promote containers
Containers reduced app downtime and associated costs by 57%!
Every dollar invested in digital business innovation will require enterprises to spend three times that on continuously modernizing their legacy applications
CNCF Cloud Native Landscape
Greyed Icons not open sourced
Mobilise at the bottom next to Samsung and Mirantis
CNCF offers services to projects they take on such as: Program Management, Event Management, Marketing Services and Communications, Certification & Training and a neutral home for your project.
Three different types of project:
Sanbox – The entry point for projects into CNCF, nurturing phase (Examples; OpenEBS - containerized storage and related storage services, Network Service Mesh (NSM) is a novel approach solving complicated L2/L3 use cases in Kubernetes that are tricky to address with the existing Kubernetes Network Model. Inspired by Istio. Doesn’t use traditional concepts of routers, ip addresses etc.
Incubating – Next stage in the projects life, wide adoption and support (Examples: HELM, LinkerD, OpenTracing)
HELM
Harbor
Rook
CRI - O
Graduated – Kubernetes was the first project to gradate from the CNCF in early 2018, other projects include Prometheus and FluentD
Last year, the CNCF’s cloud native survey made it clear that the “preferred method for packaging is Helm (68%) followed by managed Kubernetes offerings (19%).
Users find that Helm is a great way to:
Manage complexity: describe complex Kubernetes applications in a “chart.”
Share charts: search for shared charts on public and private chart repositories.
Easily update Kubernetes applications: in-place upgrades and rollbacks
Tiller, the server-side component of Helm 2, requires additional security steps and Helm 2 was created for developers to install applications when Kubernetes did not yet have role-based access control (RBAC). This complexity isn’t needed in recent releases of Kubernetes, so for Helm 3 tiller has been removed entirely – so no more security concerns around Tillers sudo like permissions.
New templating language called Lua which aims to bring together all of the third party languages such as Go, Jinja and raw python.
Releases are now confined to a namespace
An open source trusted cloud native registry project that stores, signs, and scans content.
Harbor solves common challenges by delivering trust, compliance, performance, and interoperability. It fills a gap for organizations and applications that cannot use a public or cloud-based registry, or want a consistent experience across clouds.
Security and vulnerability analysis
Content signing and validation
Multi-tenant
Extensible API and web UI
Image replication across multiple harbour instances – take advantage of Harbors remote replication features to create replicas of image repository in data centres across different regions
Identity integration and role-based access control
Open Source, Cloud Native Storage for Kubernetes providing production ready File, Block and Object Storage
It’s essentially a storage orchestrator for Kubernetes…
turning distributed storage systems into self-managing, self-scaling, self-healing storage services.
It uses the power of the Kubernetes platform to deliver its services: cloud-native container management, scheduling, and orchestration. Rook orchestrates multiple storage solutions, providing a common framework across all of them. Choose the best storage provider for your scenarios, and Rook ensures that they all run well on Kubernetes with the same, consistent experience.
It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management
the same, consistent experience.
CNCFs replacement for Docker on Kubernetes, CRI-O is an implementation of the Kubernetes CRI (Container Runtime Interface) to enable using OCI (Open Container Initiative) compatible runtimes.
It is a lightweight alternative to using Docker as the runtime for kubernetes. It allows Kubernetes to use any OCI-compliant runtime as the container runtime for running pods.
Today it supports runc and Kata Containers as the container runtimes but any OCI-conformant runtime can be plugged in principle.
Principles
Designed – Optimised for Kubernetes
Stable – Committed to passing Kubernetes tests
Any Image, Any Registry – Pull from any compliant registry, run any OCI-compliant container
Adantages…
Save on CPU core per node, increased security and better integration with Kubernetes (ie no extra fudging steps to get docker installed)
The Kubernetes project is number 2 in pull requests on GitHub, second only to linux with 31,000 contributions, 164,000 commits and 1.2 million comments.
During the event There was a big focus on the Kubernetes community and how it is one of the healthiest on GitHub – enabling people to easily get involved with the project. There is a large amount of community support available including a dedicated Slack workspace – with people always willing to offer support and advice.
Keen to demonstrate how important Kubernetes has become
Established, global organizations like Uber, Bloomberg, Blackrock, The New York Times, Lyft, eBay & Goldman Sachs and many others use Kubernetes in production at massive scale. Three of the largest cloud providers offer their own managed Kubernetes services. Furthermore, according to Redmonk (analyst firm), 71 percent of the Fortune 100 use containers and more than 50 percent of Fortune 100 companies use Kubernetes as their container orchestration platform.
Kubernetes 1.15, is focused far more on introducing new features than stable ones, and spending time building those features up before declaring them stable.
Scalability improvements. FOR EXAMPLE; Node status updates - are very expensive, updated every 10 seconds - stored in etcd (even though the node hasn’t changed), for a 5000 node cluster that means 5-6MB per minute. In etcdNewAPI NodeLease has been introduced which is much more lightweight
numerous additions to custom resource definitions (CRDs).
Continued preparation on cloud provider extraction and code organization.
Nodes now support third-party monitoring plugins.
A new Scheduling Framework for schedule plugins is now Alpha
kubeadm has promoted high availability (HA) capability to beta, allowing users to use the familiar kubeadm init and kubeadm join commands to configure and deploy a HA control plane.
An honest and insightful look into the world of KOPS and how people try their best to maintain it while working full time jobs. KOPS are changing the way they do development, so we should see quicker releases and more frequently – with a release of KOPS 30-60 days after a Kubernetes release (although they promise to deliver an alpha release sooner). Etcd3 will be included shortly and etcd-manager will be merging with etcdadm to provide automated backups of clusters and cluster resizing etc.
The Service Mesh Interface (SMI) was also introduced during a keynote speech which promises to provide a common set of APIs for vendors developing a service mesh. This means that users of Kubernetes can now change between service meshes without getting tied into specific vendors. There was a lot of focus on the Service Mesh during keynotes – with the main focus on intelligent networks; pushing network logic from the application and onto Kubernetes means developers can focus on writing feature rich code rather than coding for network issues. The service mesh also introduces a lot of telemetry information which provides great observability of running applications including logging, metrics and tracing.
OpenTelemetry is combining two products, Googles OpenCensus and CNCF’s OpenTracing into one application. can collect traces and metrics from processes instrumented by OpenTelemetry or other monitoring/tracing libraries (Jaeger, Prometheus, etc.), handles aggregation and smart sampling, and export traces and metrics to one or more monitoring/tracing backends.
The mantra maybe two years ago was definitely don’t store any data in the cluster, that has now swung a little to ‘maybe store data in the cluster if you need to’. Projects like Rook extend Kubernetes with custom types and controllers to orchestrate storage. Automates scaling, upgrading, migration Disaster Recovery, monitoring and resource management.
EKS is making great improvements including AWS own CNI which lets you use the ALB instead of ingress allowing you to use multiple ssl certs in ACM without writing more yaml.
The number of pods is defined by the size of the instance and the allocation of CIDR blocks given to the cluster – which can be increased, Recommendation is a minimum of four CIDR blocks so that all Azs can be hit.
Kube2IAM replacement coming from AWS in months.
Databases are still a no-no in the cluster as they make upgrades and failovers a lot more difficult.
Make sure you use a blue/green deployment strategy to upgrade your cluster as ETCD3 cannot be rolled back if there are any issues.
A Pod Security Policy is a cluster-level resource that controls security sensitive aspects of the pod specification. The PodSecurityPolicyobjects define a set of conditions that a pod must run with in order to be accepted into the system, as well as defaults for the related fields. Control user and group ids run in containers, linux capabilities, privileged usage.
Pusher monitors config and secrets for changes and automatically redeploys an application if this changes so the app can reload the new config – for apps that can't dynamically reload config.
Kube Resource Report shows amount of slack in the system and costs associated
Kubesec.io - Risk score for running YAML into cluster – So you can go to the website online and submit your YAML to see how risky it is. Or install a copy locally. CIS scores added shortly
Goss can be used in Kubernetes at runtime to validate the image and its runtime dependencies; process is installed and running, necessary ports open, user accounts are set, filesystem properties, URLs responding with expected content. Mount goss as a sidecar container which runs tests against the pod before its allowed to come up
kube-bench is a Go application that checks whether Kubernetes is deployed securely by running the checks against the cluster - documented in the CIS Kubernetes Benchmark.
EKSCTL from weaveworks
Production proofing EKS – list of 20 topics to build on top of EKS
Kubernetes creating Kubernetes clusters
A library of Kubernetes operators
Spotify managed to keep 100% of their service online after deleting a cluster by having tried and tested failover
Envoy – which is the CNCF service proxy can be used to deploy to on prem legacy apps. You can then communicate to your on prem apps using a service mesh – consistent, reliable communication.
Panatir Technologies (Defence Company) – Run a million pods a day, 10,000 nodes per day are destroyed and rebuilt to ensure the latest patches are deployed and improve security posture.
Hoggs Boson particle was rediscovered using Kubernetes jobs to submit 1500 concurrent workloads on stage in 5 minutes!
Where are we going to put a Kubernetes service?
Managed; EKS, AKS etc. - May not be able to employ specific security concerns that you need access to (e.g. etcd, audit logs)
Roll your own
MISSTEPS
Go all in with managed Kubernetes; no access with control plane (couldn’t turn on security policies)
One size fits all tool (does everything from start to finish) - don’t understand the pipeline that builds your cluster (build tool)
Principles
Yesterday, today, and tomorrow - declarative nature means you can easily change your deployment in the future
Use the tools you have today that makes sense for your business, dont go grabbing new shiny tools
Enables your stakeholders - give them the access they need to look at logs, RBAC for logs etc. More buying from stakeholders = :-)
MISSTEPS
Solving problems that you don’t yet have; do you need service mesh? Yes its cool to have one, but it will add unnecessary complication that you don’t need
Perfect is the enemy of done - wasting sprints guessing about requirements, too much time spent not getting an MVP out
Bedrock
There are somethings you won’t change - get these right first
Container Networking
Persistent Storage
Connectivity
MISSTES
Trading battle tested for cutting-edge
Open source is not free…it requires diligence
Community health
Release cycles
GitHub starts (most important)
Security
Consistent Authorisation and Authentication. Use OADC and connect existing federation services to Kubernetes
Policies - Resource Quota etc.
Backup & Restore - ARC (Velero)
MISSTEPS
Getting security on early
Not easy to bolt security on later (e.g. adding network policies to existing cluster - hard work)
Use different cluster types for example a PCI compliant application can go on a PCI compliant cluster rather than changing existing cluster
Scale Out
500 nodes is the maximum number you should be running on before having to tune Kubernetes
Should be in a multi cluster mindset - migrate workloads to the new cluster with new features
Resources - don’t use generic tools for federations, use Jenkins workflows or pipelines instead
MISSTEPS
Mega clusters - big blast radius, go with smaller clusters for security and cleaner upgrades/ application changes
Embrace and Extend but dont go off the rails - build on the same patterns that Kubernetes is founded on (CRDs)
After a day of talks there were some great social events including a party in a 16th century church hosted by Mirantis (K8SorDie party) that included cocktail bars, mountain bikers jumping off stage and street skateboarders outside the event.
And the official party which was held in Poble Espanyol – a purpose built Spanish village displaying architecture from all over spain throughout its history. Set up on the hill of Montjuic overlooking Barcelona offering street food and drinks throughout.
And the official party which was held in Poble Espanyol – a purpose built Spanish village displaying architecture from all over spain throughout its history. Set up on the hill of Montjuic overlooking Barcelona offering street food and drinks throughout.