Openshift/Kubernetes integration with Apache YARN

•Download as PPTX, PDF•

1 like•892 views

Openshift/Kubernetes integration with Apache YARN Shows how YARN allows Big Data/Hadoop and other workloads to run side by side on same cluster

Page1 © Hortonworks Inc. 2014
OpenShift scheduling docker
containers in YARN via Kubernetes

Page2 © Hortonworks Inc. 2014
Static website Web frontendUser DB Queue Analytics DB
Development VM
QA server Public Cloud Contributor’
s laptop
Docker: a shipping container system for codeMultiplicityofStacks
Multiplicityof
hardware
environments
Production
Cluster
Customer
Data Center
Doservicesandapps
interact
appropriately?
CanImigrate
smoothlyandquickly
…that can be manipulated using
standard operations and run
consistently on virtually any
hardware platform
An engine that enables
any payload to be
encapsulated as a
lightweight, portable,
self-sufficient
container…

Page3 © Hortonworks Inc. 2014
Why are Docker containers lightweight?
HDP 2.1
Hortonworks Data Platform
I/O performance comparable to Bare Metal

Page4 © Hortonworks Inc. 2014
Kubernetes – container orchestrator
• Service for container cluster management
• Allows deploying and managing applications running
on multiple hosts using docker
• Open sourced by Google
• Supports GCE, CoreOS, Azure, vSphere
• Used to manage Docker containers as a default
implementation
• Master – maintain state of Kubernetes Server runtime
• Scheduler, API server, registries, storage
• Minions – represent the host were containers created
• Kubelet – manage pod and container lifecycle

Page5 © Hortonworks Inc. 2014
OpenShift
• Red Hat’s platform as a service for
applications in the cloud that supports
both public and private cloud
• Provides high level abstraction for applications on top
of containers allowing easy scaling, service discovery,
and deployment
• Enable Docker image authors to easily deliver
reusable application components, including highly
available databases, monitoring and log aggregation
tools, service discovery platforms, and prepackaged
web applications
• Allow developers to deeply customize their runtime
environments while preserving operational support at
scale for those applications

Page6 © Hortonworks Inc. 2014
6
Kubernetes/YARN Integration
YARN Node Manager
YARN Node Manager
Kubernetes
AppMaster

Page7 © Hortonworks Inc. 2014
Demo: OpenShift scheduling docker container in YARN
Running in docker

Page8 © Hortonworks Inc. 2014
Demo: 1. Launch Docker container on YARN via OpenShift
#openshift kube create pods –c demo.json
#cat demo.json

Page9 © Hortonworks Inc. 2014
Demo: 2. Enter into container and confirm web server started
#openshift kube create pods –c demo.json

Page10 © Hortonworks Inc. 2014
Demo: 3. Webapp on Openshift interacting with Hadoop

Page11 © Hortonworks Inc. 2014
Demo: 4. Launch other workloads on YARN
YARN allows Big Data and other workloads to run side by side on same cluster

Page12 © Hortonworks Inc. 2014
Questions?

From 2013-04-14 OpenShift Origin Community Day in Portland, Oregon Presenter: (William) Bill DeCoste (Principal Software Engineer for OpenShift) will introduce Red Hat's PaaS. He'll describe the several flavors of OpenShift ranging from the upstream community project Origin, the EC2-based online offering at http://openshift.redhat.com, to the corresponding commercial offering, OpenShift Enterprise. OpenShift Origin and Online will be demonstrated.

Building Domain-specific PaaS with OpenShift Origin: The TRESOR Healthcare P...

OpenShift Origin

Building Domain-specific PaaS with OpenShift Origin Presenter: Alexander Grzesik, Softwarearchitekt, Medisite.de Alexander will discuss customizing OpenShift Origin for the Healthcare industry to meet with specific to German government compliance regulations for cloud security as part of the German Federal Ministry of Economics and Technology's Trusted Cloud initiative also know as TRESOR - Trusted Ecosystem for Standardized and Open cloud-based Resources.

Welcome to the @OpenShift Origin Community by Diane Mueller @pythondj @redhat

OpenShift Origin

OpenShift Meetup 8th july 2019 at ConSol - OpenShift v4

Robert Bohne

Pydata 2020 containers meetup

Walid Shaari

This event is in collaboration and hosted in and by the Khobar PyData meetup. Registration will not be here but on the PyData meetup page https://www.meetup.com/PyDataKhobar/events/268654243/ Modern Applications: Do you want to start your cloud-native journey? modern applications that are portable, failure resilient and behave consistently in repeatable way? did you hear of containers? Docker? Kubernetes? come, get introduced to container and how to manage and run them at scale to deploy modern day applications, come practice, share knowledge and have fun with Docker, and Kubernetes. Better have your notebook fully charged! Containers are becoming a fundamental technology skill to master for any job: DevOps Engineer, Software Engineer, Data Engineer or Data Scientist. This meetup will try to answer the questions of why and how the container revolution came about by providing a short history of container technologies. Using hands-on introduction to Docker and docker-compose. We will show why the portability of containers is so important in running the same application in multiple environments. The last section of the meetup will consist of a hands-on demonstration of the most popular container orchestration technology today, Kubernetes.

OpenShift In a Nutshell - Episode 02 - Architecture

Behnam Loghmani

Future of Microservices - Jakub Hadvig

WEBtlak

Cisco IT added OpenShift by Red Hat to its technology mix to rapidly expose development staff to a rich set of web-scale application frameworks and runtimes. Deploying Platform-as-a-Service (PaaS) architectures, like OpenShift, bring with it: - A Focus on the Developer Experience - Container Technology - Network Security and User Isolation - Acceleration of DevOps Models without Negatively Impacting Business In this session, Cisco and Red Hat will take you through: - The problems Cisco set out to solve with PaaS. - How OpenShift aligned with their needs. - Key lessons learned during the process. Business & IT Strategy Alignment: This track targets the juncture of business and IT considerations necessary to create competitive advantage. Example topics include: new architecture deployments, competitive differentiators, long-term and hidden costs, and security. Attendees will learn how to align architecture and technology decisions with their specific business needs and how and when IT departments can provide competitive advantage.

Reproducible development to live applications with Red Hat CDK and Red Hat Op...

Lalatendu Mohanty

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2

Amrita Prasad

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech Talk

Red Hat Developers

The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable, and scalable by leveraging best-of-breed open source projects. These include Jupyter Notebooks, TensorFlow, and Pytorch for Training; Seldon and KFServing for Serving; and Kubeflow Pipelines. These are all wrapped up neatly in an easy-to-use portal so developers and data scientists can easily collaborate and deliver production-ready AI/ML workloads.

RPM Factory for RDO

Frédéric Lepied

Docker in Production, die Mobiliar

Philipp Grossenbacher

Multi-container Applications on OpenShift with the Ansible Service Broker Mul...

Amazon Web Services

The Kubernetes/OpenShift Service Catalog and Open Service Broker API are creating a new way for users to provision and manage services on Kubernetes/OpenShift through a collection of Service Brokers. One of these brokers, the Ansible Service Broker, is focused on providing a mechanism for allowing applications defined with Ansible to be exposed to the Service Catalog. We call this application definition an Ansible Playbook Bundle (APB); a lightweight definition that is essentially a few Ansible playbooks named for each of the Open Service Broker API methods. The bundle is packaged as a container image with an Ansible runtime for distribution to be consumed by the Ansible Service Broker. In this talk we will introduce the concept of the Ansible Playbook Bundle and Ansible Service Broker. Additionally, we will walk through a few example and live demo demonstrating how to define and deploy multi-container applications.

Managing OpenShift From Installation and Beyond

Andrew Block

Slides from the hands on lab at Red Hat Summit 2017. Configuring distributed systems can be difficult. Fortunately, automation tools such as Ansible are available to help manage even the most complex environments. This lab allowed attendees to take the reigns of their own cluster and experience firsthand how Ansible can be used to install, configure, and maintain OpenShift to support mission-critical systems. Once the installation of Red Hat OpenShift is complete, attendees learned how to diagnose, troubleshoot, and resolve common platform issues. Managing the platform doesn't stop once the installation is complete. Ansible can be used to simplify ongoing maintenance and to make worry-free platform upgrades, all facilitated in an automated fashion. Finally, the use of centralized management systems will be introduced into the environment in order to demonstrate its importance and to provide a streamlined experience for both platform maintainers and users.

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshift

NAVER D2

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...

Puppet

11th Docker Switzerland User Group Meetup

Philipp Grossenbacher

Pycon9 - Paas per tutti i gusti con Dokku and Kubernetes

Claudio Mignanti

DevFestMN 2017 - Learning Docker and Kubernetes with Openshift

Keith Resar

Openstack benelux 2015

Microsoft

Open shift 2.x and MongoDB

plarsen67

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOps

Renato de Oliveira

Red Hat OpenShift App Dev meetup - Operator SDK

Dmitry Kartsev

OpenShift As A DevOps Platform

Lalatendu Mohanty

Workshop-Build e deploy avançado com Openshift e Kubernetes

juniorjbn

Openshift presentation

Armağan Ersöz

What's hot

OpenStack Summit Tokyo 2015: Scale or Fail: Containers on OpenStack with Open...

Diane Mueller

OPENSHIFT CONTAINER PLATFORM CI/CD Build & Deploy

Natale Vinto

PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand

Cisco IT

Reproducible development to live applications with Red Hat CDK and Red Hat Op...

Lalatendu Mohanty

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2

Amrita Prasad

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech Talk

Red Hat Developers

RPM Factory for RDO

Frédéric Lepied

Docker in Production, die Mobiliar

Philipp Grossenbacher

Multi-container Applications on OpenShift with the Ansible Service Broker Mul...

Amazon Web Services

Managing OpenShift From Installation and Beyond

Andrew Block

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshift

NAVER D2

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...

Puppet

11th Docker Switzerland User Group Meetup

Philipp Grossenbacher

Pycon9 - Paas per tutti i gusti con Dokku and Kubernetes

Claudio Mignanti

DevFestMN 2017 - Learning Docker and Kubernetes with Openshift

Keith Resar

Openstack benelux 2015

Microsoft

Open shift 2.x and MongoDB

plarsen67

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOps

Renato de Oliveira

Red Hat OpenShift App Dev meetup - Operator SDK

Dmitry Kartsev

OpenShift As A DevOps Platform

Lalatendu Mohanty

What's hot (20)

OpenStack Summit Tokyo 2015: Scale or Fail: Containers on OpenStack with Open...

OPENSHIFT CONTAINER PLATFORM CI/CD Build & Deploy

PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand

Reproducible development to live applications with Red Hat CDK and Red Hat Op...

Puzzle ITC Talk @Docker CH meetup CI CD_with_Openshift_0.2

Exploring Kubeflow on Kubernetes for AI/ML | DevNation Tech Talk

RPM Factory for RDO

Docker in Production, die Mobiliar

Multi-container Applications on OpenShift with the Ansible Service Broker Mul...

Managing OpenShift From Installation and Beyond

[D2 COMMUNITY] Open Container Seoul Meetup - Kubernetes를 이용한 서비스 구축과 openshift

PuppetConf 2016: Using Puppet with Kubernetes and OpenShift – Diane Mueller, ...

11th Docker Switzerland User Group Meetup

Pycon9 - Paas per tutti i gusti con Dokku and Kubernetes

DevFestMN 2017 - Learning Docker and Kubernetes with Openshift

Openstack benelux 2015

Open shift 2.x and MongoDB

Meetup - Automate your project lifecycle using MuleSoft and Azure DevOps

Red Hat OpenShift App Dev meetup - Operator SDK

OpenShift As A DevOps Platform

Viewers also liked

Workshop-Build e deploy avançado com Openshift e Kubernetes

juniorjbn

Openshift presentation

Armağan Ersöz

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShift

Andy Pemberton

[Devconf.cz][2017] Understanding OpenShift Security Context Constraints

Alessandro Arrichiello

In addition to authorization policies that control what a user can do, OpenShift Container Platform gives its administrators the ability to manage a set of security context constraints (SCCs) for limiting pods and securing their cluster. Default security context may be too restrictive for containers pulled down from DockerHub, thorugh this talk we'll explore the various steps to execute for enabling required permissions on selected OpenShift's pods.

OpenShift In a Nutshell - Episode 04 - Infrastructure part II

Behnam Loghmani

OpenShift In a Nutshell - Episode 06 - Core Concepts Part II

Behnam Loghmani

Episode 06 of "OpenShift in a nutshell" presentations in Iran OpenStack community group This episode is about core concepts in OpenShift. Part 2 includes concepts of Users, Projects, Builds and Image streams At the end of presentation you can find a link that helps you to setup OpenShift in your local system ( this setup is not a enterprise setup and it's only for creating a small test environment ). I hope you will find it useful.

OpenShift In a Nutshell - Episode 05 - Core Concepts Part I

Behnam Loghmani

OpenShift In a Nutshell - Episode 03 - Infrastructure part I

Behnam Loghmani

Openshift Container Platform on Azure

Glenn West

Understanding DevOps in simpler way with Continuous Delivery

Swapnil Jain

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016

ManageIQ

Developing microservices with wildfly swarm and deploying on openshift

andreas kuncoro

Minishift (Run OpenShift locally)

Praveen Kumar

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for...

Jeremy Eder

earn tips and tricks on how to best configure and tune your container infrastructure for maximum performance and scale. The Performance Engineering Group at Red Hat is responsible for performance of the complete container portfolio, including Docker, RHEL Atomic, Kubernetes and OpenShift. We will share: - Latest Performance Features in OpenShift, Docker and RHEL Atomic, tips and tricks on how to best configure and tune your system for maximum performance and scale - Latest performance and scale test results, using RHEL Atomic, OpenvSwitch, Cockpit multi-server container management - DevOps, Agile approach to Performance Analysis of OpenShift, Kubernetes, Docker and RHEL Atomic - Test harness code and example scripts Audience The audience is anyone interested in deploying containers to run performance sensitive workloads, as well as architecting highly scalable distributed systems for hosting those workloads. This includes workloads that require NUMA awareness, direct hardware access and kernel-bypass I/O.

Microservices with JBoss EAP & OpenShift

bobmcwhirter

OpenShift In a Nutshell - Episode 01 - Introduction

Behnam Loghmani

OpenShift on OpenStack with Kuryr

Antoni Segura Puimedon

Simplifying and Securing your OpenShift Network with Project Calico

Andrew Randall

OpenShift Commons Webinar presented on March 2 2017 OpenShift networking works great out of the box, right? So why would you consider anything else? This briefing examines an alternative approach that has benefits for many scenarios – from tightly securing a few high value AWS instances to scaling a large private cloud deployment. Come learn about how how Calico differs from traditional solutions like OpenShift SDN, and see how Calico has now been integrated with Kubernetes and OpenShift to provide a smooth deployment experience, and lessons learned across hundreds of enterprise users.

Openshift: Build, deploy & manage open, standard containers

Jonh Wendell

Automated Image Builds in OpenShift and Kubernetes

Graham Dumpleton

Viewers also liked (20)

Workshop-Build e deploy avançado com Openshift e Kubernetes

Openshift presentation

Ultimate DevOps - Jenkins Enterprise & Red Hat OpenShift

[Devconf.cz][2017] Understanding OpenShift Security Context Constraints

OpenShift In a Nutshell - Episode 04 - Infrastructure part II

OpenShift In a Nutshell - Episode 06 - Core Concepts Part II

OpenShift In a Nutshell - Episode 05 - Core Concepts Part I

OpenShift In a Nutshell - Episode 03 - Infrastructure part I

Openshift Container Platform on Azure

Understanding DevOps in simpler way with Continuous Delivery

DevOps with OpenShift - Fabien Dupont - ManageIQ Design Summit 2016

Developing microservices with wildfly swarm and deploying on openshift

Minishift (Run OpenShift locally)

KubeCon NA, Seattle, 2016: Performance and Scalability Tuning Kubernetes for...

Microservices with JBoss EAP & OpenShift

OpenShift In a Nutshell - Episode 01 - Introduction

OpenShift on OpenStack with Kuryr

Simplifying and Securing your OpenShift Network with Project Calico

Openshift: Build, deploy & manage open, standard containers

Automated Image Builds in OpenShift and Kubernetes

Similar to Openshift/Kubernetes integration with Apache YARN

Docker and OpenStack Boston Meetup

Kamesh Pemmaraju

OpenStack, Containers, and Docker: The Future of Application Deployment Twenty years ago, developers built static applications on well-defined stacks that ran on proprietary, monolithic hardware. Developers today want freedom to build applications using their choice of services and stacks and, ideally, want to be able to run those applications on any available hardware. Of course, this raises questions about service interaction, the practicality of migrating applications across environments, and the challenges of managing unlimited combinations of services and hardware environment. By promoting an opensource approach to flexible and inter-operable infrastructure, OpenStack goes a long way towards achieving this vision of the future. This talk discusses the application and platform side of the equation, and the interplay between OpenStack, Container technology (e.g. LXC), and the opensource Docker.io project. Docker.io enables any application and its dependencies to be deployed as lightweight containers that run consistently virtually anywhere. The same containerized application that runs on a developer's laptop can run consistently on a bare metal server, an OpenStack cluster, a Rackspace cloud, a VM,etc. While providing isolation and compatibility, containers have significant size, performance, and deployment advantages over traditional VMs. Recently, the community created an integration between Docker and OpenStack Nova, opening up exciting possibilities for web scale application deployment, continuous integration and deployment, private PaaS, and hybrid cloud. This session will give an introduction to Docker and containers in the context of OpenStack, and will then demonstrate cross-environment deployment of applications.

OpenStack BostonDocker, Inc.

Docker open stack boston

dotCloud

SS Introduction to Docker

Stephane Woillez

Docker and Microsoft - Windows Server 2016 Technical Deep Dive

Docker, Inc.

Docker OpenStack Cloud Foundry

Animesh Singh

Docker introNoelMc Grath

Docker Presentation at the OpenStack Austin Meetup | 2013-09-12

dotCloud

Application Deployment on OpenstackDocker, Inc.

A curtain-raiser to the container world Docker & Kubernetes

zekeLabs Technologies

Agenda 1. The changing landscape of IT Infrastructure 2. Containers - An introduction 3. Container management systems 4. Kubernetes 5. Containers and DevOps 6. Future of Infrastructure Mgmt About the talk In this talk, you will get a review of the components & the benefits of Container technologies - Docker & Kubernetes. The talk focuses on making the solution platform-independent. It gives an insight into Docker and Kubernetes for consistent and reliable Deployment. We talk about how the containers fit and improve your DevOps ecosystem and how to get started with containerization. Learn new deployment approach to effectively use your infrastructure resources to minimize the overall cost.

Intro to Docker at the 2016 Evans Developer relations conference

Mano Marks

Building large scale apps traditionally has traditionally meant building large monolithic apps to handle everything. In the new age of the cloud and on premise data centers, increasingly the world is looking to containers and microservices. This allows flexibility and agility. Individual teams can choose the tools they need and be assured they'll work in the environment they want. And it also has implications for how we do developer relations, making it easier to deploy samples without worrying about environment. This session will look at microservices and how they are changing both the enterprise, and our work in developer relations.

Dockerizing OpenStack for High Availability

Daniel Krook

Presentation at the OpenStack Summit in Paris, France on November 4, 2014. High availability in OpenStack can be achieved in many ways. In this session we will describe how Docker can be used to provide an active-active highly available OpenStack environment. We will focus the real world work that we have done to "Dockerize" OpenStack services, detail the advantages to this type of deployment (rapid deployment, rapid scale out, versioning, etc.), and walk through our design - from requirements, limitations, obstacles, and especially our decisions. We will use our experiences as examples to provide real world best practices, as well as showing a demonstration of the environment in action. Manuel Silveyra - Senior Cloud Solutions Architect Daniel Krook - Senior Certified IT Specialist Shaun Murakami - Senior Cloud Solution Architect Kalonji Bankole - Cloud Architect

DockerCon EU 2015 Barcelona

Roman Dembitsky

Docker Birthday #3 Slides - OverviewChris Ciborowski

Docker Birthday #3 - Intro to Docker Slides

Docker, Inc.

Docker for dev

Erik Talboom

Kubernetes is all you need

Vishwas N

Docker Online Training | Hyderabad

navyatejavisualpath

Kubernetes Online Training - Visualpath is the Leading and Best Software Online Docker Training institute in Ameerpet. Avail complete job-oriented Docker and Kubernetes Training Course by simply enrolling in our institute in Hyderabad. Call on - +91-9989971070. For more info: https://dockerandkubernetesonlinetraining.blogspot.com/ WhatsApp: https://www.whatsapp.com/catalog/919989971070/ Visit: https://www.visualpath.in/DevOps-docker-kubernetes-training.html

Docker Overview - Rise of the Containers

Ryan Hodgin

Container on azure

Vishwas N

Similar to Openshift/Kubernetes integration with Apache YARN (20)

Docker and OpenStack Boston Meetup

OpenStack Boston

Docker open stack boston

SS Introduction to Docker

Docker and Microsoft - Windows Server 2016 Technical Deep Dive

Docker OpenStack Cloud Foundry

Docker intro

Docker Presentation at the OpenStack Austin Meetup | 2013-09-12

Application Deployment on Openstack

A curtain-raiser to the container world Docker & Kubernetes

Intro to Docker at the 2016 Evans Developer relations conference

Dockerizing OpenStack for High Availability

DockerCon EU 2015 Barcelona

Docker Birthday #3 Slides - Overview

Docker Birthday #3 - Intro to Docker Slides

Docker for dev

Kubernetes is all you need

Docker Online Training | Hyderabad

Docker Overview - Rise of the Containers

Container on azure

Recently uploaded

RESUME BUILDER APPLICATION Project for students

KAMESHS29

Essentials of Automations: The Art of Triggers and Actions in FME

Safe Software

In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation. We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios. Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

UiPath Community Day Dubai: AI at Work..

UiPathCommunity

Welcome to the first live UiPath Community Day Dubai! Join us for this unique occasion to meet our local and global UiPath Community and leaders. You will get a full view of the MEA region's automation landscape and the AI Powered automation technology capabilities of UiPath. Also, hosted by our local partners Marc Ellis, you will enjoy a half-day packed with industry insights and automation peers networking. 📕 Curious on our agenda? Wait no more! 10:00 Welcome note - UiPath Community in Dubai Lovely Sinha, UiPath Community Chapter Leader, UiPath MVPx3, Hyper-automation Consultant, First Abu Dhabi Bank 10:20 A UiPath cross-region MEA overview Ashraf El Zarka, VP and Managing Director MEA, UiPath 10:35: Customer Success Journey Deepthi Deepak, Head of Intelligent Automation CoE, First Abu Dhabi Bank 11:15 The UiPath approach to GenAI with our three principles: improve accuracy, supercharge productivity, and automate more Boris Krumrey, Global VP, Automation Innovation, UiPath 12:15 To discover how Marc Ellis leverages tech-driven solutions in recruitment and managed services. Brendan Lingam, Director of Sales and Business Development, Marc Ellis

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Alex Pruden

This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second). Paper: https://eprint.iacr.org/2023/1886

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Enhancing Performance with Globus and the Science DMZ

Globus

PHP Frameworks: I want to break free (IPC Berlin 2024)

Ralf Eggert

In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development. This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

Accelerate your Kubernetes clusters with Varnish Caching

Thijs Feryn

Recently uploaded (20)

RESUME BUILDER APPLICATION Project for students

Essentials of Automations: The Art of Triggers and Actions in FME

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Introduction to CHERI technology - Cybersecurity

Epistemic Interaction - tuning interfaces to provide information for AI support

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

Monitoring Java Application Security with JDK Tools and JFR Events

UiPath Community Day Dubai: AI at Work..

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPath Test Automation using UiPath Test Suite series, part 4

Enhancing Performance with Globus and the Science DMZ

PHP Frameworks: I want to break free (IPC Berlin 2024)

FIDO Alliance Osaka Seminar: Overview.pdf

Pushing the limits of ePRTC: 100ns holdover for 100 days

Accelerate your Kubernetes clusters with Varnish Caching

Openshift/Kubernetes integration with Apache YARN

2. Page2 © Hortonworks Inc. 2014 Static website Web frontendUser DB Queue Analytics DB Development VM QA server Public Cloud Contributor’ s laptop Docker: a shipping container system for codeMultiplicityofStacks Multiplicityof hardware environments Production Cluster Customer Data Center Doservicesandapps interact appropriately? CanImigrate smoothlyandquickly …that can be manipulated using standard operations and run consistently on virtually any hardware platform An engine that enables any payload to be encapsulated as a lightweight, portable, self-sufficient container…

3. Page3 © Hortonworks Inc. 2014 Why are Docker containers lightweight? HDP 2.1 Hortonworks Data Platform I/O performance comparable to Bare Metal

4. Page4 © Hortonworks Inc. 2014 Kubernetes – container orchestrator • Service for container cluster management • Allows deploying and managing applications running on multiple hosts using docker • Open sourced by Google • Supports GCE, CoreOS, Azure, vSphere • Used to manage Docker containers as a default implementation • Master – maintain state of Kubernetes Server runtime • Scheduler, API server, registries, storage • Minions – represent the host were containers created • Kubelet – manage pod and container lifecycle

5. Page5 © Hortonworks Inc. 2014 OpenShift • Red Hat’s platform as a service for applications in the cloud that supports both public and private cloud • Provides high level abstraction for applications on top of containers allowing easy scaling, service discovery, and deployment • Enable Docker image authors to easily deliver reusable application components, including highly available databases, monitoring and log aggregation tools, service discovery platforms, and prepackaged web applications • Allow developers to deeply customize their runtime environments while preserving operational support at scale for those applications

8. Page8 © Hortonworks Inc. 2014 Demo: 1. Launch Docker container on YARN via OpenShift #openshift kube create pods –c demo.json #cat demo.json

9. Page9 © Hortonworks Inc. 2014 Demo: 2. Enter into container and confirm web server started #openshift kube create pods –c demo.json

11. Page11 © Hortonworks Inc. 2014 Demo: 4. Launch other workloads on YARN YARN allows Big Data and other workloads to run side by side on same cluster

Editor's Notes

This lesson provides a high-level overview of Apache Hive.
Doing a tech preview of Kafka ensures that we have the packaging mechanism in place and allows us to explore other things like Slider, Stack Definitions via Ambari, etc.
This lesson provides a high-level overview of Apache Hive.

Openshift/Kubernetes integration with Apache YARN

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Openshift/Kubernetes integration with Apache YARN

Similar to Openshift/Kubernetes integration with Apache YARN (20)

Recently uploaded

Recently uploaded (20)

Openshift/Kubernetes integration with Apache YARN

Editor's Notes