Microservices Architectures (aka Distributed Architectures) are the new paradigm to develop and deploy applications in Cloud environments. These architectures resolve several problems and improve the new life cycle in DevOps teams, however new challenges should be resolved or managed.
OpenShift Service Mesh (based in Istio, Kiali, Jaeger) allows us to manage this new paradigm easily without to change our current applications.
These slides will introduce you in OpenShift Service Mesh as a new component on OpenShift to manage your microservices architectures. Carlos Vicens worked on it with me.
Slides used during a coordinated meetup between three different groups in Madrid:
- OpenShift Madrid Group: https://www.meetup.com/es/openshift_spain/events/258188248/
- Microservices Madrid Group: https://www.meetup.com/es-ES/Microservicios/events/258188068/
- Madrid Spring User Group: https://www.meetup.com/es/madrid-spring-user-group/events/258322835/
OpenSouthCode 2018 - Integrating your applications easily with Apache CamelJosé Román Martín Gil
Apache Camel slides to introduce you in this awesome Integration Framework. High level, architecture and some use cases.
Slides showed in OpenSouthCode 2018.
Event Link: https://www.opensouthcode.org/conferences/opensouthcode2018/program/proposals/153
Presented by: Justin Reock
Presented at the All Things Open 2021
Raleigh, NC, USA
Raleigh Convention Center
Abstract: In our FluentD vs. Logstash comparison blog we talked about the importance of easily capturing, parsing, and visualizing log data at enterprise scale. We looked at the approaches FluentD and Logstash take to accomplish these tasks and defined particular areas of complexity and challenge that users face. Participants in this demo-driven webinar will watch as a system is configured for log analysis using both approaches, highlighting the strengths and weaknesses of each technology in the process.
Companion Blog: https://www.openlogic.com/blog/fluentd-vs-logstash
[DevDay 2017] OpenShift Enterprise - Speaker: Linh Do - DevOps Engineer at Ax...DevDay.org
This session discusses OpenShift Enterprise (or OpenShift Container Platform). OpenShift Container Platform is Red Hat's on-premise private platform as a service product, built around a core of application containers powered by Docker, with orchestration and management provided by Kubernetes, on a foundation of Red Hat Enterprise Linux.
OpenSouthCode 2018 - Integrating your applications easily with Apache CamelJosé Román Martín Gil
Apache Camel slides to introduce you in this awesome Integration Framework. High level, architecture and some use cases.
Slides showed in OpenSouthCode 2018.
Event Link: https://www.opensouthcode.org/conferences/opensouthcode2018/program/proposals/153
Presented by: Justin Reock
Presented at the All Things Open 2021
Raleigh, NC, USA
Raleigh Convention Center
Abstract: In our FluentD vs. Logstash comparison blog we talked about the importance of easily capturing, parsing, and visualizing log data at enterprise scale. We looked at the approaches FluentD and Logstash take to accomplish these tasks and defined particular areas of complexity and challenge that users face. Participants in this demo-driven webinar will watch as a system is configured for log analysis using both approaches, highlighting the strengths and weaknesses of each technology in the process.
Companion Blog: https://www.openlogic.com/blog/fluentd-vs-logstash
[DevDay 2017] OpenShift Enterprise - Speaker: Linh Do - DevOps Engineer at Ax...DevDay.org
This session discusses OpenShift Enterprise (or OpenShift Container Platform). OpenShift Container Platform is Red Hat's on-premise private platform as a service product, built around a core of application containers powered by Docker, with orchestration and management provided by Kubernetes, on a foundation of Red Hat Enterprise Linux.
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT
Cisco IT added OpenShift by Red Hat to its technology mix to rapidly expose development staff to a rich set of web-scale application frameworks and runtimes. Deploying Platform-as-a-Service (PaaS) architectures, like OpenShift, bring with it:
- A Focus on the Developer Experience
- Container Technology
- Network Security and User Isolation
- Acceleration of DevOps Models without Negatively Impacting Business
In this session, Cisco and Red Hat will take you through:
- The problems Cisco set out to solve with PaaS. - How OpenShift aligned with their needs.
- Key lessons learned during the process.
Business & IT Strategy Alignment: This track targets the juncture of business and IT considerations necessary to create competitive advantage. Example topics include: new architecture deployments, competitive differentiators, long-term and hidden costs, and security.
Attendees will learn how to align architecture and technology decisions with their specific business needs and how and when IT departments can provide competitive advantage.
Academic research institutions are at a precipice. They have historically been constrained to supporting classic “job” style workloads. With the growth of new workflow practices such as streaming data, science gateways, and more “dynamic” research using lambda-like functions, they must now support a variety of workloads.
In this talk, Lindsey and Bob will discuss some difficulties faced by academic institutions and how Kubernetes offers an extensible solution to support the future of research. They will present a selection of projects currently benefiting from Kubernetes enabled tools, like Argo, Kubeflow, and kube-batch. These workflows will be demonstrated using specific examples from two large research institutions: Compute Canada, Canada’s national computation research consortium and the University of Michigan, one of the largest public Universities in the United States.
KubeCon EU 2019
An introduction to the open source project that empowers modern workflows to build, deploy and manage the lifecycle of containers. You will learn what OpenShift is, what are its use cases, and more about all the fuss around Cloud computing, microservices, DevOps and whatnot.
L’evoluzione delle pratiche di sviluppo, delle architetture e delle infrastrutture è un processo che anche Drupal ha abbracciato, trasformandosi da un CMS per community a un framework PHP moderno.
Drupal oggi permette di creare un'esperienza developer-friendly e può essere la base su cui costruire la vostra applicazione cloud-native.
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...Martin Etmajer
Until recently, applications ran on a handful of carefully curated technologies for years to come, deployments were static and teams siloed. In the microservices age, teams are cross-functional, pick the technologies they consider to work best for them, and are held accountable for what they produce. Application deployments are fine-grained, frequent, scalable and fully automated. What a shift and what a challenge for monitoring such environments! In this presentation, you'll learn how to obtain insights from your OpenShift environment by exploring various open-source monitoring, logging, and tracing technologies, including Elasticsearch, Fluentd, Hawkular, Heapster, Jolokia, Kibana, OpenTracing, Prometheus and ZipKin.
OpenShift pour le developpement cloud native - 20171214Laurent Broudoux
Talk donné au Cloud Workshop Azure - Red Hat & Microsoft, le 14/12/2017. Découvrez comment la plateforme OpenShift de Red Hat permet de faciliter le développement, le déploiement et le monitoring d'applications Cloud Native !
SpringBoot and Spring Cloud Service for MSAOracle Korea
Cloud 환경에서 MSA를 하기 위해서 Service Discovery, Circuit Breaker 등을 사용하여 Application을 개발하는 방법과 SpringBoot 와 Spring Cloud Service 를 사용하는데, Cloud에서 Kubernetes를 위시한 Container 생태계가 어떻게 MSA에 영향을 미치는지 알아봅니다.
Load Balancing for Containers and Cloud Native ArchitectureChiradeep Vittal
Introduces micro services and the importance of load balancing for micro services architecture. Explores NetScaler CPX - a containerized NetScaler and integration with Kubernetes, Docker and Apache Mesos
From on premises monolith to cloud microservicesAlbert Lombarte
Presentation from Devops Barcelona conference on June 2019.
Step by step process to migrate from a monolith to several microservices in the cloud.
See with transitions at https://docs.google.com/presentation/d/10PvqjwDwBv96Ga2k0ZLrfi83NrQQnGQyLPKn0XsYC40/edit#slide=id.g585eb34422_0_592
Building a scalable microservice architecture with envoy, kubernetes and istioSAMIR BEHARA
Talk from O'Reilly Software Architecture Conference San Jose 2019
Microservices and containers have taken the software industry by storm. Transitioning from a monolith to microservices enables you to deploy your application more frequently, independently, and reliably. However, microservice architecture has its own challenges, and it has to deal with the same problems encountered while designing distributed systems.
Enter service mesh technology to the rescue. A service mesh reduces the complexity associated with microservices and provides functionality like load balancing, service discovery, traffic management, circuit breaking, telemetry, fault injection, and more. Istio is one of the best implementations of a service mesh at this point, while Kubernetes provides a platform for running microservices and automating deployment of containerized applications.
Join Samir Behara to go beyond the buzz and understand microservices and service mesh technologies.
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT
Cisco IT added OpenShift by Red Hat to its technology mix to rapidly expose development staff to a rich set of web-scale application frameworks and runtimes. Deploying Platform-as-a-Service (PaaS) architectures, like OpenShift, bring with it:
- A Focus on the Developer Experience
- Container Technology
- Network Security and User Isolation
- Acceleration of DevOps Models without Negatively Impacting Business
In this session, Cisco and Red Hat will take you through:
- The problems Cisco set out to solve with PaaS. - How OpenShift aligned with their needs.
- Key lessons learned during the process.
Business & IT Strategy Alignment: This track targets the juncture of business and IT considerations necessary to create competitive advantage. Example topics include: new architecture deployments, competitive differentiators, long-term and hidden costs, and security.
Attendees will learn how to align architecture and technology decisions with their specific business needs and how and when IT departments can provide competitive advantage.
Academic research institutions are at a precipice. They have historically been constrained to supporting classic “job” style workloads. With the growth of new workflow practices such as streaming data, science gateways, and more “dynamic” research using lambda-like functions, they must now support a variety of workloads.
In this talk, Lindsey and Bob will discuss some difficulties faced by academic institutions and how Kubernetes offers an extensible solution to support the future of research. They will present a selection of projects currently benefiting from Kubernetes enabled tools, like Argo, Kubeflow, and kube-batch. These workflows will be demonstrated using specific examples from two large research institutions: Compute Canada, Canada’s national computation research consortium and the University of Michigan, one of the largest public Universities in the United States.
KubeCon EU 2019
An introduction to the open source project that empowers modern workflows to build, deploy and manage the lifecycle of containers. You will learn what OpenShift is, what are its use cases, and more about all the fuss around Cloud computing, microservices, DevOps and whatnot.
L’evoluzione delle pratiche di sviluppo, delle architetture e delle infrastrutture è un processo che anche Drupal ha abbracciato, trasformandosi da un CMS per community a un framework PHP moderno.
Drupal oggi permette di creare un'esperienza developer-friendly e può essere la base su cui costruire la vostra applicazione cloud-native.
Challenges in a Microservices Age: Monitoring, Logging and Tracing on Red Hat...Martin Etmajer
Until recently, applications ran on a handful of carefully curated technologies for years to come, deployments were static and teams siloed. In the microservices age, teams are cross-functional, pick the technologies they consider to work best for them, and are held accountable for what they produce. Application deployments are fine-grained, frequent, scalable and fully automated. What a shift and what a challenge for monitoring such environments! In this presentation, you'll learn how to obtain insights from your OpenShift environment by exploring various open-source monitoring, logging, and tracing technologies, including Elasticsearch, Fluentd, Hawkular, Heapster, Jolokia, Kibana, OpenTracing, Prometheus and ZipKin.
OpenShift pour le developpement cloud native - 20171214Laurent Broudoux
Talk donné au Cloud Workshop Azure - Red Hat & Microsoft, le 14/12/2017. Découvrez comment la plateforme OpenShift de Red Hat permet de faciliter le développement, le déploiement et le monitoring d'applications Cloud Native !
SpringBoot and Spring Cloud Service for MSAOracle Korea
Cloud 환경에서 MSA를 하기 위해서 Service Discovery, Circuit Breaker 등을 사용하여 Application을 개발하는 방법과 SpringBoot 와 Spring Cloud Service 를 사용하는데, Cloud에서 Kubernetes를 위시한 Container 생태계가 어떻게 MSA에 영향을 미치는지 알아봅니다.
Load Balancing for Containers and Cloud Native ArchitectureChiradeep Vittal
Introduces micro services and the importance of load balancing for micro services architecture. Explores NetScaler CPX - a containerized NetScaler and integration with Kubernetes, Docker and Apache Mesos
From on premises monolith to cloud microservicesAlbert Lombarte
Presentation from Devops Barcelona conference on June 2019.
Step by step process to migrate from a monolith to several microservices in the cloud.
See with transitions at https://docs.google.com/presentation/d/10PvqjwDwBv96Ga2k0ZLrfi83NrQQnGQyLPKn0XsYC40/edit#slide=id.g585eb34422_0_592
Building a scalable microservice architecture with envoy, kubernetes and istioSAMIR BEHARA
Talk from O'Reilly Software Architecture Conference San Jose 2019
Microservices and containers have taken the software industry by storm. Transitioning from a monolith to microservices enables you to deploy your application more frequently, independently, and reliably. However, microservice architecture has its own challenges, and it has to deal with the same problems encountered while designing distributed systems.
Enter service mesh technology to the rescue. A service mesh reduces the complexity associated with microservices and provides functionality like load balancing, service discovery, traffic management, circuit breaking, telemetry, fault injection, and more. Istio is one of the best implementations of a service mesh at this point, while Kubernetes provides a platform for running microservices and automating deployment of containerized applications.
Join Samir Behara to go beyond the buzz and understand microservices and service mesh technologies.
2019 devoxx - apis, microservices, et le service meshJoel Gauci
Les développeurs adoptent de plus en plus une architecture de microservices pour permettre une agilité plus élevée et une évolutivité de leurs applications - mais la mise en œuvre réussie d'une architecture de microservices est notoirement compliquée. À mesure que le nombre des services augmente, la complexité et les risques peuvent également augmenter rapidement. Cette session montre comment créer une architecture de microservices sécurisée et évolutive avec Apigee, Kubernetes et Istio
I'm a developer; should I care about a service mesh?Aspen Mesh
A disruptive technology pattern like a service mesh is exciting, but it can also be confusing as it straddles various concerns and responsibilities ranging from SecOps to application developers.
Neeraj Poddar dissects service mesh capabilities using Istio as an example, focusing on the pieces you should care about, and explores how you can offload some of the logic traditionally baked into the applications—distributed tracing and telemetry, request retries and timeouts, mutual transport layer security (TLS) and end user validation, and service decomposition—into a common infrastructure layer. Neeraj then walks you through some of the questions you should be asking your platform team, such as if you need to update your applications to use service mesh and whether or not the sidecars will downgrade your application performance, as you adopt a service mesh environment.
OSCON 2019 - I'm a Developer, should I care about a service mesh?Neeraj Poddar
A disruptive technology pattern like a service mesh is exciting, but it can also be confusing as it straddles various concerns and responsibilities ranging from SecOps to application developers.
Neeraj Poddar dissects service mesh capabilities using Istio as an example, focusing on the pieces you should care about, and explores how you can offload some of the logic traditionally baked into the applications—distributed tracing and telemetry, request retries and timeouts, mutual transport layer security (TLS) and end user validation, and service decomposition—into a common infrastructure layer. Neeraj then walks you through some of the questions you should be asking your platform team, such as if you need to update your applications to use service mesh and whether or not the sidecars will downgrade your application performance, as you adopt a service mesh environment.
Cilium:: Application-Aware Microservices via BPFCynthia Thomas
Intro to Cilium Microservices Security with Kubernetes Integration
Open Source Cilium website: cilium.io
GH: github.com/cilium/cilium
Join our Slack! cilium.herokuapp.com
Follow us on Twitter!
@ciliumproject
@_techcet_
Blowing up the Monolith: Practical Advice on MicroservicesNordic APIs
Many companies are transitioning to microservices but what factors influence whether or not to “blow up” your monolith? The advantages of moving to a microservices architecture include increased performance, deployability and scalability, but these advantages come at the cost of increased complexity. This presentation will cover the architectural considerations involved in transitioning from a monolithic to a microservices or service-oriented architecture. Take a technical look into the factors to consider during a transition including how to define boundaries between microservices, interservice communication patterns and testing. Learn strategies for transitioning such as the “ice cream scoop,” “lego” and “nuclear” options, routing and versioning strategies, and how to handle libraries and security to maximize service independence.
Consul Connect - EPAM SEC - 22nd september 2018Peter Souter
A service mesh is necessary for organizations adopting microservices and dynamic cloud-native infrastructure. Traditional host-based network security must be replaced with modern service-based security to accommodate the highly dynamic nature of modern runtime environments. In this talk, we will look at Connect a significant new feature in Consul that provides secure service-to-service communication with automatic TLS encryption and identity-based authorization. We will look at the features of Connect, how to enable Connect in an existing Consul cluster and how easy it is to secure service-to-service communication using Connect.
Microservice architectures have changed how companies develop and deploy applications, and have therefore in turn affected the testing process as well. New techniques have now emerged and others have been enhanced, while old testing techniques (used in monolith) drive us to a dead-end when we try to apply them to a microservices architecture.
In this master class, Alex Soto will introduce some testing techniques, such as service virtualization, contract testing and testing in production to increase deployment velocity from 1 week to N times per day and deploy each service independently without worrying about breaking the compatibility between services. He will show you several examples in Java but will also point out resources for other languages as well.
After this theoretical and live code master class, you'll understand how to test microservice architectures and reduce the friction between trying to apply old testing techniques to a new paradigm.
Serhiy Kalinets "Building Service Mesh with .NET Core"Fwdays
There is a lot of hype around service mesh happening right now. It’s a new concept that solves common problems related to microservices: observability, traffic management, security and so on.
In this session Serhiy will introduce the idea of service mesh and show how to use it with the latest release of .NET Core to build lightweight microservices with minimal efforts. And of course, we will see how it works in action.
The Cytoscape Cyberinfrastructure extends Cytoscape and its community into web-connected services.The CI is a Service Oriented Architecture that supports network biology oriented computations that can be orchestrated into repeatable workflows.
Managing microservices with Istio Service MeshRafik HARABI
Developing and managing hundreds (or maybe thousands) of microservices at scale is a challenge for both development and operations teams.
We have seen over the last years the appearance of new frameworks dedicated to deliver ‘Cloud Native’ applications by providing a set of (out of box) building blocks. Most of these frameworks integrate microservices concerns at the code level.
Recently, we have seen the emerging of a new pattern known as sidecar or proxy promoting to push all these common concerns outside of the business code and provides them on the edge by integrate a new layer to the underlying platform called Service Mesh.
Istio is one of the leading Service Mesh implementing sidecar pattern.
We will go during the presentation throw the core concepts behind Istio, the capabilities that provides to manage, secure and observe microservices and how it gives a new breath for both developers and operations.
The presentation will be guided by a sequence of demo exposing Istio capabilities.
This presentation was made by Mangesh Patankar (Developer Advocate - IBM Cloud) as part of Container Conference 2018: www.containerconf.in.
"How do we make microservices resilient and fault-tolerant? How do we enforce policy decisions, such as fine-grained access control and rate limits? How do we enable timeouts/retries, health checks, etc.?
A service-mesh architecture attempts to resolve these issues by extracting the common resiliency features needed by a microservices framework away from the applications and frameworks and into the platform itself. Istio provides an easy way to create this service mesh."
What is a Service Mesh and what can it do for your MicroservicesMatt Turner
e’ll explore what a service mesh is and what it can do for your microservices. Are the claims of observability, resiliency, and WAF features real? Are they useful during development, production, or both? Using pictures and demos, we’ll find out!
This session will also briefly cover how a service mesh works, giving us a mental model with which to explore and evaluate after the talk. Matt will show a simple installation and demo, giving us all the knowledge to go home and try for ourself.
Building Event Driven (Micro)services with Apache KafkaGuido Schmutz
What is a Microservices architecture and how does it differ from a Service-Oriented Architecture? Should you use traditional REST APIs to bind services together? Or is it better to use a richer, more loosely-coupled protocol? This talk will start with quick recap of how we created systems over the past 20 years and how different architectures evolved from it. The talk will show how we piece services together in event driven systems, how we use a distributed log (event hub) to create a central, persistent history of events and what benefits we achieve from doing so.
Apache Kafka is a perfect match for building such an asynchronous, loosely-coupled event-driven backbone. Events trigger processing logic, which can be implemented in a more traditional as well as in a stream processing fashion. The talk will show the difference between a request-driven and event-driven communication and show when to use which. It highlights how the modern stream processing systems can be used to hold state both internally as well as in a database and how this state can be used to further increase independence of other services, the primary goal of a Microservices architecture.
Similar to Managing microservices with istio on OpenShift - Meetup (20)
Unleash Unlimited Potential with One-Time Purchase
BoxLang is more than just a language; it's a community. By choosing a Visionary License, you're not just investing in your success, you're actively contributing to the ongoing development and support of BoxLang.
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
JASMIN is the UK’s high-performance data analysis platform for environmental science, operated by STFC on behalf of the UK Natural Environment Research Council (NERC). In addition to its role in hosting the CEDA Archive (NERC’s long-term repository for climate, atmospheric science & Earth observation data in the UK), JASMIN provides a collaborative platform to a community of around 2,000 scientists in the UK and beyond, providing nearly 400 environmental science projects with working space, compute resources and tools to facilitate their work. High-performance data transfer into and out of JASMIN has always been a key feature, with many scientists bringing model outputs from supercomputers elsewhere in the UK, to analyse against observational or other model data in the CEDA Archive. A growing number of JASMIN users are now realising the benefits of using the Globus service to provide reliable and efficient data movement and other tasks in this and other contexts. Further use cases involve long-distance (intercontinental) transfers to and from JASMIN, and collecting results from a mobile atmospheric radar system, pushing data to JASMIN via a lightweight Globus deployment. We provide details of how Globus fits into our current infrastructure, our experience of the recent migration to GCSv5.4, and of our interest in developing use of the wider ecosystem of Globus services for the benefit of our user community.
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Globus
The Earth System Grid Federation (ESGF) is a global network of data servers that archives and distributes the planet’s largest collection of Earth system model output for thousands of climate and environmental scientists worldwide. Many of these petabyte-scale data archives are located in proximity to large high-performance computing (HPC) or cloud computing resources, but the primary workflow for data users consists of transferring data, and applying computations on a different system. As a part of the ESGF 2.0 US project (funded by the United States Department of Energy Office of Science), we developed pre-defined data workflows, which can be run on-demand, capable of applying many data reduction and data analysis to the large ESGF data archives, transferring only the resultant analysis (ex. visualizations, smaller data files). In this talk, we will showcase a few of these workflows, highlighting how Globus Flows can be used for petabyte-scale climate analysis.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Anthony Dahanne
Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ?
Venez le découvrir lors de cette session ignite
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Globus
Large Language Models (LLMs) are currently the center of attention in the tech world, particularly for their potential to advance research. In this presentation, we'll explore a straightforward and effective method for quickly initiating inference runs on supercomputers using the vLLM tool with Globus Compute, specifically on the Polaris system at ALCF. We'll begin by briefly discussing the popularity and applications of LLMs in various fields. Following this, we will introduce the vLLM tool, and explain how it integrates with Globus Compute to efficiently manage LLM operations on Polaris. Attendees will learn the practical aspects of setting up and remotely triggering LLMs from local machines, focusing on ease of use and efficiency. This talk is ideal for researchers and practitioners looking to leverage the power of LLMs in their work, offering a clear guide to harnessing supercomputing resources for quick and effective LLM inference.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
Navigating the Metaverse: A Journey into Virtual Evolution"Donna Lenk
Join us for an exploration of the Metaverse's evolution, where innovation meets imagination. Discover new dimensions of virtual events, engage with thought-provoking discussions, and witness the transformative power of digital realms."
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
Large Language Models and the End of ProgrammingMatt Welsh
Talk by Matt Welsh at Craft Conference 2024 on the impact that Large Language Models will have on the future of software development. In this talk, I discuss the ways in which LLMs will impact the software industry, from replacing human software developers with AI, to replacing conventional software with models that perform reasoning, computation, and problem-solving.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
2. oc whoami
$ oc whoami
rmarting, jromanmartin
$ oc describe user rmarting jromanmartin
Name: Jose Roman Martin Gil
Created: 43 years ago
Labels: father, husband, friend, runner, curious, red hatter,
developer (in any order)
Annotations: Principal Middleware Architect @ Red Hat
Identities:
mailto: rmarting@redhat.com
GitHub: https://github.com/rmarting
Twitter: https://twitter.com/jromanmartin
LinkedIn: https://www.linkedin.com/in/jromanmartin/
3. oc whoami
$ oc whoami
cvicens, _cvicens, carlosvicens
$ oc describe user cvicens
Name: Carlos Vicens Alonso
Created: 43 years ago
Labels: father, husband, red hatter, developer, tinkerer (in
any order)
Annotations: Senior Specialist Solution Architect @ Red Hat
Identities:
mailto: cvicensa@redhat.com
GitHub: https://github.com/cvicens
Twitter: https://twitter.com/_cvicens
LinkedIn: https://www.linkedin.com/in/carlosvicens/
Medium: https://medium.com/@carlos.vicens.alonso
4. Have you ever woken up at night feeling uneasy
and sweaty wondering if your app is a monolith?
… I have
True story
…any given night
_shy_developer
5.
6. Now I’m a believer… I love microservices…
I hate monoliths…
What next? How do I move on?
True story
… same night, but later
Same _shy_developer, now converted
7. We’ll break something in a mesh...
We’ll walk you through a plausible route to find
the root cause of the problem
...the butler did it!
Sorry I couldn’t help it
Little spoiler!
(although we hate spoilers!)
12. Eight Fallacies of Distributed Computing
1. The network is reliable
2. Latency is zero
3. Bandwidth is infinite
4. The network is secure
5. Topology doesn’t change
6. There is one administrator
7. Transport cost is zero
8. The network is homogeneous
Source: https://en.wikipedia.org/wiki/Fallacies_of_distributed_computing
Photo: Icon made by Freepik from www.flaticon.com
17. Dynamic Routing
Spring Cloud
Config Server
Service
Netflix Eureka
Netflix Ribbon Config
Service
Config
Service
Config
Svc Discovery Svc Discovery Svc Discovery
Routing Routing Routing
Netflix Zuul
Server
INFRASTRUCTURE
18. Fault Tolerance
Spring Cloud
Config Server
Service
Netflix Eureka
Netflix Ribbon Config
Service
Config
Service
Config
Svc Discovery Svc Discovery Svc Discovery
Routing Routing Routing
Netflix Zuul
Server
Circuit Breaker Circuit Breaker Circuit Breaker
INFRASTRUCTURE
19. Tracing and Visibility
Spring Cloud
Config Server
Service
Netflix Eureka
Netflix Ribbon Config
Service
Config
Service
Config
Svc Discovery Svc Discovery Svc Discovery
Routing Routing Routing
Netflix Zuul
Server
Circuit Breaker Circuit Breaker Circuit Breaker
Tracing Tracing Tracing
ZipKin Server
INFRASTRUCTURE
24. Microservices without Service Mesh
Container
JVM
service A
discovery
load-balancer
resiliency
metrics
tracing
app logic
ff
Container
JVM
service B
discovery
load-balancer
resiliency
metrics
tracing
app logic
Container
JVM
service C
discovery
load-balancer
resiliency
metrics
tracing
app logic
30. Circuit Breaker without Service Mesh
SERVICE
A
SERVICE
B
SERVICE
C
CB CB
coupled to the service code
31. Circuit Breaker with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
transparent to the services
32. Circuit Breaker with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
improved response time with global circuit status
33. Timeouts and Retries with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
configure timeouts and retries, transparent to the services
timeout: 10 sec
retry: 5
timeout: 15 sec
retry: 5
34. Rate Limits with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
limit invocation rates, transparent to the services
max 500
concurrent reqs
max 100
connections
40. Secure Communication without Service Mesh
SERVICE
A
SERVICE
B
SERVICE
C
TLS TLS TLS TLS
coupled to the service code
41. Secure Communication with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
mutual TLS authentication, transparent to the services
TLS TLS
42. Control Service Access with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
control the service access flow, transparent to the services
44. Chaos Engineering without Service Mesh
SERVICE
A
SERVICE
B
SERVICE
C
Netflix
Chaos Monkeys
Netflix
Spinnaker
random
termination
45. Chaos Engineering with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
inject delays, transparent to the services
10 sec delay
in 10% of requests
46. Chaos Engineering with Service Mesh
inject protocol-specific errors, transparent to the services
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
HTTP 400
in 5% of requests
48. Distributed Tracing without Service Mesh
SERVICE
A
SERVICE
B
SERVICE
C
Spring Sleuth
ZipKin
Spring Sleuth
ZipKin
Spring Sleuth
ZipKin
code to enable dynamic tracing
49. Distributed Tracing with Service Mesh
POD
SERVICE
A
ENVOY
POD
SERVICE
B
ENVOY
POD
SERVICE
C
ENVOY
discovers service relationships and process times,
transparent to the services
SERVICE A SERVICE B SERVICE C
210 ms 720 ms
930 ms
56. The network is reliable. Circuit Breaking and Load Balancing
Latency is zero. Timeouts and Retries
Bandwidth is infinite Rating and Limiting
The network is secure Mutual TLS
Topology doesn't change Service Discovery
There is one administrator Role Based Access Control
Transport cost is zero gRPC and Protobuf
The network is homogeneous. Dynamic Routing - A/B, Canary
Then?
57. NO ANIMALS were harmed during the making of this demo
NO CODE was changed either… almost :-)
DEMO TIME!
58. 1. Coolstore works properly
2. Break Catalog (2 pods, 1 down)
3. Notice (Kiali, Grafana, Jaeger)
4. Find the root cause
5. Fix → retry policy (2 pods, 1 down, avoid the one down!)
Demo explained...
2. New version Inventory
3. Distribute load
4. Break inventory (2 versions, 1 version down)
5. Notice (Kiali, Grafana, Jaeger)
6. Find …
7. Fix → circuit breaker (avoid damaged version)
60. Distributed Services Platform
ANY
INFRASTRUCTURE
OpenShift Container Platform
(Enterprise Kubernetes)
Amazon Web Services Microsoft Azure Google CloudOpenStackDatacenterLaptop
OpenShift Service Mesh
(Istio + Kiali + Jaeger)
ANY
APPLICATION
Service
CONTAINER
Service
CONTAINER
Service
CONTAINER
Service
CONTAINER
Service
CONTAINER
try it at http://learn.openshift.com