Alluxio on Kubernetes - Powering training through Container Storage Interface plugin

•

0 likes•163 views

This document summarizes Alluxio's Container Storage Interface (CSI) plugin for Kubernetes. The CSI plugin allows Alluxio to integrate with Kubernetes volumes, improving performance through data locality while making deployment easier. Earlier versions had challenges around Fuse process lifecycles being tied to worker nodes. Version 1.1 decouples Fuse pods from nodes, addressing upgrade and failure issues by running Fuse independently for each application pod. Future work includes optimizing Fuse pod resource usage and supporting separate Fuse instances for different applications.

Software

Alluxio on Kubernetes
Powering training through
Container Storage Interface (CSI) plugin

Alluxio on Kubernetes
Alluxio Master pod
Master
Container
Job
Master
Container
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container

DaemonSet: Worker & Fuse
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Host Machine 1 Host Machine 2 Host Machine 3

Application
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Host Machine
Volume
mount

Application
Alluxio Worker pod
Worker
Container
Job
Worker
Container
Alluxio Fuse pod
Fuse
Container
Host Machine
Application pod
Application
Container
Volume
mount
mount
req data

Advantages
1. Better performance because of
data-locality
2. Easy to deploy. `helm install` to start
the whole Alluxio cluster
Alluxio Worker pod
Worker
Contain
er
Job
Worker
Contain
er
Alluxio Fuse pod
Fuse
Container
Host Machine
Application pod
Application
Container
Volume
mount
mount
req data

Challenges
Alluxio Worker pod
Worker
Contain
er
Job
Worker
Contain
er
Alluxio Fuse pod
Fuse
Container
Host Machine
Application pod
Application
Container
Volume
mount
mount
req data
1. Fuse pod is not always needed but
always taking resources.
Ex. data preprocessing
2. In some workloads Fuse pod is not
needed on some machines in the
cluster. Lots of manual work.

Before CSI on Kubernetes
Pod
Volume
AWS EBS
AzureDisk
AzureFile
CephFS
…

CSI on Kubernetes
Pod
Volume CSI
AWS EBS
AzureDisk
AzureFile
CephFS
…
More than 100
existing CSI drivers

Alluxio CSI Driver v1.0.0
Host Machine
Alluxio CSI Driver
Components

Alluxio CSI Driver v1.0.0
Host Machine
Alluxio CSI Driver
Components
Persistent
volume +
claim

Alluxio CSI Driver v1.0.0
Host Machine
Alluxio CSI Driver
Components
Application pod
Application
Container
Persistent
volume +
claim
mount
mount
+
Alluxio Fuse

Advantages of Alluxio CSI Driver v1.0.0
1. Fuse process lifecycle is the same as
the application pod. Perfectly
solving our previous challenges
2. Easy to deploy. With CSI deployed
with `helm install`, Fuse process is
automated.
Host
Machine
CSI
Components
Application pod
Application
Container
Persistent
volume +
claim
mount
mount
+
Alluxio
Fuse

Challenges of Alluxio CSI Driver v1.0.0
1. Fuse processes reside in one of the
CSI components - nodeserver
What if nodeserver is down?
What if nodeserver needs to be upgraded?
Host
Machine
CSI
Components
Application pod
Application
Container
Persistent
volume +
claim
mount
mount
+
Alluxio
Fuse

Alluxio CSI Driver v1.1.0
Host Machine
Persistent
volume +
claim
CSI
Components

Alluxio CSI Driver v1.1.0
Alluxio Fuse pod
Fuse
Container
Host Machine
Application pod
Application
Container
Persistent
volume +
claim
mount
mount
CSI
Components
create

1. Fuse pod resource allocation
2. In some cases, different applications always use different Fuse
processes
Next Steps

Acknowledgement
Community users
● Kevin Cai@AntFin
● Hui Fei, Haoning Sun@Shopee
● Binyang Li@Microsoft

VMware AppCatalyst is a lightweight desktop hypervisor for Mac that provides a drop-in replacement for VirtualBox in Docker Machine and Vagrant. It comes with Photon OS, a container-optimized Linux distribution built by VMware for cloud-native applications. AppCatalyst exposes a REST API and CLI for seamless integration with container workflows. It also includes Vagrant integration out of the box to support using Vagrant and Photon OS VMs. Photon OS is optimized for running containers and provides a secure container runtime with updates from VMware.

Building Kubernetes images at scale with Tanzu Build Service

VMware Tanzu

Alluxio Product School Webinar - Get Started with Alluxio on Kubernetes

Alluxio, Inc.

Alluxio Product School Webinar Apr. 25, 2023 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: Shaun Sun (Software Engineer, Alluxio) Shawn Sun, Alluxio's software engineer, shares how to get started with Alluxio on Kubernetes in April's Product School Webinar. To simplify the DevOps of the stack of Alluxio with a query engine, Alluxio has provided two ways to deploy on Kubernetes, helm and operator. They significantly simplify the deployment, configuration, and life cycle management of resources on Kubernetes. Through this webinar, you will learn step-by-step how to deploy and run Alluxio on Kubernetes to accelerate analytics workloads.

VMware Tanzu Introduction- June 11, 2020

VMware Tanzu

This document outlines an agenda for a presentation on vSphere 7 With Kubernetes and Tanzu. It includes introductions of the presenters Bernard Park and Prasanna Upperi. The presentation will cover an overview of Tanzu, vSphere with Kubernetes, and Tanzu Mission Control. It will also include demonstrations. The document provides background on the presenters and describes the Tanzu portfolio and key products like Tanzu Kubernetes Grid, vSphere with Kubernetes, and Tanzu Mission Control. It outlines how vSphere with Kubernetes allows using Kubernetes to manage VMs, containers, and other workloads across environments in a standardized way through custom resources.

Integrating security testing into your container build pipeline - SDD308 - AW...

Amazon Web Services

"In this workshop, you learn to leverage AWS development tools and open-source projects to integrate automated security testing into a CI/CD pipeline. Learn about a variety of patterns for integrating security testing and security-centric release control into AWS CodePipeline. Additionally, learn how to add feedback loops and fix common security vulnerabilities in your container-based application. All attendees need a laptop, an active AWS Account, an AWS IAM Administrator, and a familiarity with core AWS services."

Akmal Khaleeq Waheed - Challenge 3

tovmug

ZCM update VAI Brainforce

Roel van Bueren

From 0 to 60 with kubernetes and istio

Joonathan Mägi

In this high technology times, it is really hard to catch up with everything. Especially for the mobile world when there are thousands of mobile devices with different modification of the Android OS. Most of us who work in the mobile testing industry familiar with Appium framework for a UI automation and also aware of complicate setup and hard maintenance of it. Using Docker in Android UI automation is making our life much easier. Docker-Android is a docker image built to be used for everything related to Android mobile website or application testing. All the tools needed (devices, framework, Android SDK etc.) are packaged in the image. It is free and open source and supports other features such as video recording. In this session, we will talk about the advantages and disadvantages of Appium and docker-android will go throw getting started with Docker-Android and run sample tests against it.

70 533 study material

Jayasimha reddy Madhira

This document provides a summary of a 70-533 exam preparation material. It contains 10 multiple choice questions related to implementing Microsoft Azure Infrastructure Solutions. The questions cover topics like deploying VM extensions, configuring availability sets, creating VMs with specific disk configurations, modifying service definition files, enabling cross-premises connectivity, choosing appropriate web hosting plans, accessing log files, deploying web jobs, integrating with Azure Active Directory, and filtering sync accounts. Each question is followed by an explanation of the correct answer.

Breaking the Monolith Using AWS Container Services

Amazon Web Services

How do you break a monolithic application into microservices? Learn how AWS delivers the integrated building blocks to support the move to containerized microservices for any application architecture, regardless of scale, load, or complexity. Learn more about the newly released AWS App Mesh and how it makes it easy to monitor and control containerized microservices. We will explore different options for running containers on AWS, such as AWS Fargate (serverless containers), EKS, and ECS.

VMware Tanzu Introduction

VMware Tanzu

VMware introduced their Tanzu portfolio for building, running, and managing modern applications on Kubernetes. The presentation included an overview of Tanzu and its components, including how vSphere 7 integrates Kubernetes and Tanzu Kubernetes Grid for deploying and managing Kubernetes clusters. It also described Tanzu Mission Control for centralized management of multiple Kubernetes clusters across different platforms and clouds through consistent policies, visibility, and control.

vSphere with Tanzu Tech Overview 7.0 U1 (1).pptx

hokismen

This document provides an overview of vSphere with Tanzu. It discusses how vSphere with Tanzu allows developers to use familiar Kubernetes tools while empowering administrators to maintain governance. The architecture leverages vSphere and open source technologies to provide networking and storage services for modern applications. Developers can use Kubernetes APIs to deploy applications, while administrators define policies using namespaces to isolate resources and ensure security, availability, and quality of service.

Agility Requires Safety

Yevgeniy Brikman

Virtualize Your Disaster! Introduction & Update

Emirates Computers

The document discusses virtualization and VMware virtualization solutions. It provides an agenda for a presentation on virtualizing disaster recovery. It discusses how VMware provides a single platform to help with server consolidation, business continuity, green IT, and simplified management. It also provides examples of how VMware improves productivity through features like live migration, disaster recovery, automated patching and provisioning.

GitOps on Kubernetes with Carvel

Alexandre Roman

Carvel is an open source tool suite you can use to build, configure and deploy apps to Kubernetes. In this presentation, check out how to leverage Carvel to apply a GitOps strategy on Kubernetes. This deck was used as part of a meetup organized by Programmez, a french magazine, on May 10th, 2022. Here are some live demos to better understand the value of Carvel with GitOps: get the source code at https://github.com/alexandreroman/k8s-gitops-carvel.

TLS303 How to Deploy Python Applications on AWS Elastic Beanstalk - AWS re:In...

Amazon Web Services

The document describes the architecture of a sample Django application deployed on AWS Elastic Beanstalk. It includes details on using Elastic Beanstalk environments, RDS for the database, and configuration files for deployment. Key components are the Python application code, Django settings, requirements file, Elastic Beanstalk configuration and extensions for deployment automation. The application is configured to use RDS for the database with connection details injected via environment variables.

Ibm smart cloud entry+ for system x administrator guide

IBM India Smarter Computing

This document provides instructions for installing and configuring IBM SmartCloud Entry+ for System X. It describes deploying the IBM SmartCloud Entry virtual appliance to an existing VMware vSphere environment. It also covers optional components like Tivoli Provisioning Manager for Images to manage virtual images, and IBM Systems Director for system management. The document is intended to supplement official IBM product documentation for a quick installation and proof of concept of the IBM SmartCloud Entry cloud management platform.

Code Factory avec GitLab CI et Rancher

SUSE

This document discusses SUSE and Rancher integration and continuous integration. It provides an overview of SUSE's portfolio, defines continuous integration, and describes the components involved. It then demonstrates a code assembly pipeline where code is committed, built into a container image, pushed to a registry, deployed to a Kubernetes cluster, and tested. The pipeline is triggered by code commits and managed by GitLab.

Django Deployment

Tareque Hossain

The document discusses deployment strategies in the cloud using tools like Amazon EC2, Fabric, virtualenv, and git. Key points: - Software packages are included in Amazon Machine Images to maximize automation and deployment is fully automated. - Project packages are retrieved and installed during deployment for the latest versions but this can impact performance and security. - Tools used for deployment include Fabric, virtualenv, pip, and git. - The deployment procedure instantiates servers, checks out the project from git, and runs a bootstrap script to install virtualenv and Fabric to manage deployment.

Using Security To Build With Confidence in AWS – Justin Foster, Director of P...

Amazon Web Services

In this talk, you’ll see how various AWS features and cloud-aware security controls can work together to protect your deployments. Using real-world examples, you’ll come away with an understanding of steps you can take to ensure that you maximise the security of your deployment while minimising the work it takes to keep it secure. You will learn a logical approach to modern security that you can immediately apply to your own AWS deployments. You will learn how to use security tools and techniques to help you build with confidence.

AWS CodeDeploy - basic intro

Anton Babenko

AWS CodeDeploy is a fully managed deployment service that allows deploying code and applications to EC2 instances and on-premise servers. It is technology agnostic and supports deploying from Amazon S3 buckets or GitHub repositories. The document provides an overview of CodeDeploy, including how to get started, the execution flow using appspec.yml files, deployment configurations and groups, and considerations for using CodeDeploy.

VBR v8 Overview-handout

Bastian Nurcahya

This document summarizes the key features of Veeam Availability Suite. It provides agentless backup and replication for VMware and Hyper-V virtual machines that is scalable, powerful, easy to use and affordable. It allows for high-speed recovery including instant virtual machine and file-level recovery. New features include explorers for Exchange, SharePoint, SQL and Active Directory that allow for instant item-level recovery. It also provides data loss avoidance, backup from storage snapshots, integration with DataDomain and ExaGrid, replication enhancements, and end-to-end encryption.

Introduction into Cloud Foundry and Bosh | anynines

anynines GmbH

Oracle autovue

Osama Mustafa

AKS backup with Velero and Workload Identities

Kumton Suttiraksiri

The document discusses Cloud NC's copyright policy which prohibits copying, modifying, or distributing their content publicly. It then introduces the speaker as an experienced software engineer passionate about cloud native technologies and site reliability engineering who has experience building mobile and microservices applications for leading financial services in Thailand and helping them migrate over 100 apps to Kubernetes.

Dev ops & laas fundamental

Kanin Kearpimy

AI/ML Infra Meetup | ML explainability in Michelangelo

Alluxio, Inc.

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Eric Wang (Software Engineer, @Uber) Uber has numerous deep learning models, most of which are highly complex with many layers and a vast number of features. Understanding how these models work is challenging and demands significant resources to experiment with various training algorithms and feature sets. With ML explainability, the ML team aims to bring transparency to these models, helping to clarify their predictions and behavior. This transparency also assists the operations and legal teams in explaining the reasons behind specific prediction outcomes. In this talk, Eric Wang will discuss the methods Uber used for explaining deep learning models and how we integrated these methods into the Uber AI Michelangelo ecosystem to support offline explaining.

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

Alluxio, Inc.

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Junchen Jiang (Assistant Professor of Computer Science, @University of Chicago) Prefill in LLM inference is known to be resource-intensive, especially for long LLM inputs. While better scheduling can mitigate prefill’s impact, it would be fundamentally better to avoid (most of) prefill. This talk introduces our preliminary effort towards drastically minimizing prefill delay for LLM inputs that naturally reuse text chunks, such as in retrieval-augmented generation. While keeping the KV cache of all text chunks in memory is difficult, we show that it is possible to store them on cheaper yet slower storage. By improving the loading process of the reused KV caches, we can still significantly speed up prefill delay while maintaining the same generation quality.

Similar to Alluxio on Kubernetes - Powering training through Container Storage Interface plugin

Masterless Puppet Using AWS S3 Buckets and IAM Roles

Malcolm Duncanson, CISSP

Run your Appium tests using Docker Android - AppiumConf 2019

Sargis Sargsyan

70 533 study material

Jayasimha reddy Madhira

Breaking the Monolith Using AWS Container Services

Amazon Web Services

VMware Tanzu Introduction

VMware Tanzu

vSphere with Tanzu Tech Overview 7.0 U1 (1).pptx

hokismen

Agility Requires Safety

Yevgeniy Brikman

Virtualize Your Disaster! Introduction & Update

Emirates Computers

GitOps on Kubernetes with Carvel

Alexandre Roman

TLS303 How to Deploy Python Applications on AWS Elastic Beanstalk - AWS re:In...

Amazon Web Services

Ibm smart cloud entry+ for system x administrator guide

IBM India Smarter Computing

Code Factory avec GitLab CI et Rancher

SUSE

Django Deployment

Tareque Hossain

Using Security To Build With Confidence in AWS – Justin Foster, Director of P...

Amazon Web Services

AWS CodeDeploy - basic intro

Anton Babenko

VBR v8 Overview-handout

Bastian Nurcahya

Introduction into Cloud Foundry and Bosh | anynines

anynines GmbH

Oracle autovue

Osama Mustafa

AKS backup with Velero and Workload Identities

Kumton Suttiraksiri

Dev ops & laas fundamental

Kanin Kearpimy

Similar to Alluxio on Kubernetes - Powering training through Container Storage Interface plugin (20)

Masterless Puppet Using AWS S3 Buckets and IAM Roles

Run your Appium tests using Docker Android - AppiumConf 2019

70 533 study material

Breaking the Monolith Using AWS Container Services

VMware Tanzu Introduction

vSphere with Tanzu Tech Overview 7.0 U1 (1).pptx

Agility Requires Safety

Virtualize Your Disaster! Introduction & Update

GitOps on Kubernetes with Carvel

TLS303 How to Deploy Python Applications on AWS Elastic Beanstalk - AWS re:In...

Ibm smart cloud entry+ for system x administrator guide

Code Factory avec GitLab CI et Rancher

Django Deployment

Using Security To Build With Confidence in AWS – Justin Foster, Director of P...

AWS CodeDeploy - basic intro

VBR v8 Overview-handout

Introduction into Cloud Foundry and Bosh | anynines

Oracle autovue

AKS backup with Velero and Workload Identities

Dev ops & laas fundamental

More from Alluxio, Inc.

AI/ML Infra Meetup | ML explainability in Michelangelo

Alluxio, Inc.

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

Alluxio, Inc.

AI/ML Infra Meetup | Perspective on Deep Learning Framework

Alluxio, Inc.

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...

Alluxio, Inc.

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Lu Qiu (Data & AI Platform Tech Lead, @Alluxio) - Siyuan Sheng (Senior Software Engineer, @Alluxio) Speed and efficiency are two requirements for the underlying infrastructure for machine learning model development. Data access can bottleneck end-to-end machine learning pipelines as training data volume grows and when large model files are more commonly used for serving. For instance, data loading can constitute nearly 80% of the total model training time, resulting in less than 30% GPU utilization. Also, loading large model files for deployment to production can be slow because of slow network or storage read operations. These challenges are prevalent when using popular frameworks like PyTorch, Ray, or HuggingFace, paired with cloud object storage solutions like S3 or GCS, or downloading models from the HuggingFace model hub. In this presentation, Lu and Siyuan will offer comprehensive insights into improving speed and GPU utilization for model training and serving. You will learn: - The data loading challenges hindering GPU utilization - The reference architecture for running PyTorch and Ray jobs while reading data from S3, with benchmark results of training ResNet50 and BERT - Real-world examples of boosting model performance and GPU utilization through optimized data access

Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud

Alluxio, Inc.

Alluxio Monthly Webinar May. 14, 2024 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - ChanChan Mao (Developer Advocate, Alluxio) - Bin Fan (VP of Technology, Alluxio) Running AI/ML workloads in different clouds present unique challenges. The key to a manageable multi-cloud architecture is the ability to seamlessly access data across environments with high performance and low cost. This webinar is designed for data platform engineers, data infra engineers, data engineers, and ML engineers who work with multiple data sources in hybrid or multi-cloud environments. Chanchan and Bin will guide the audience through using Alluxio to greatly simplify data access and make model training and serving more efficient in these environments. You will learn: - How to access data in multi-region, hybrid, and multi-cloud like accessing a local file system - How to run PyTorch to read datasets and write checkpoints to remote storage with Alluxio as the distributed data access layer - Real-world examples and insights from tech giants like Uber, AliPay and more

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Alluxio, Inc.

Alluxio Monthly Webinar Apr. 23, 2024 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - ChanChan Mao (Developer Advocate, Alluxio) - Shawn Sun (Tech Lead of Cloud Native, Alluxio) Cloud-native model training jobs require fast data access to achieve shorter training cycles. Accessing data can be challenging when your datasets are distributed across different regions and clouds. Additionally, as GPUs remain scarce and expensive resources, it becomes more common to set up remote training clusters from where data resides. This multi-region/cloud scenario introduces the challenges of losing data locality, resulting in operational overhead, latency and expensive cloud costs. In the third webinar of the multi-cloud webinar series, Chanchan and Shawn dive deep into: - The data locality challenges in the multi-region/cloud ML pipeline - Using a cloud-native distributed caching system to overcome these challenges - The architecture and integration of PyTorch/Ray+Alluxio+S3 using POSIX or RESTful APIs - Live demo with ResNet and BERT benchmark results showing performance gains and cost savings analysis

Optimizing Data Access for Analytics And AI with Alluxio

Alluxio, Inc.

Speed Up Presto at Uber with Alluxio Caching

Alluxio, Inc.

Correctly Loading Incremental Data at Scale

Alluxio, Inc.

Alluxio x Tobiko - ETL Happy Hour April 16, 2024 For more Alluxio events: https://alluxio.io/events/ Speaker: Toby Mao (CTO @ Tobiko Data) Writing efficient and correct incremental pipelines is challenging. Data practitioners who take on this challenge are viewed as performing an "advanced" function, which discourages broader teams from adopting incremental loads. In this lightning talk, CTO of Tobiko Data, Toby Mao, will demystify incremental loading data at scale.

Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML

Alluxio, Inc.

Big Data Bellevue Meetup March 21, 2024 For more Alluxio events: https://alluxio.io/events/ Speakers: Bin Fan (VP of Open Source, Alluxio) In this presentation, Bin Fan (VP of Open Source @ Alluxio) will address a critical challenge of optimizing data loading for distributed Python applications within AI/ML workloads in the cloud, focusing on popular frameworks like Ray and Hugging Face. Integration of Alluxio’s distributed caching for Python applications is accomplished using the fsspec interface, thus greatly improving data access speeds. This is particularly useful in machine learning workflows, where repeated data reloading across slow, unstable or congested networks can severely affect GPU efficiency and escalate operational costs. Attendees can look forward to practical, hands-on demonstrations showcasing the tangible benefits of Alluxio’s caching mechanism across various real-world scenarios. These demos will highlight the enhancements in data efficiency and overall performance of data-intensive Python applications. This presentation is tailored for developers and data scientists eager to optimize their AI/ML workloads. Discover strategies to accelerate your data processing tasks, making them not only faster but also more cost-efficient.

Alluxio Monthly Webinar | Why a Multi-Cloud Strategy Matters for Your AI Plat...

Alluxio, Inc.

Alluxio Monthly Webinar Feb. 27, 2024 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Tarik Bennett (Senior Solutions Engineer, Alluxio) As GenAI and AI continue to transform businesses, scaling these workloads requires optimized underlying infrastructure. A multi-cloud architecture allows organizations to leverage different cloud services to meet diverse workload demands while maximizing efficiency, reducing costs, and avoiding vendor lock-in. However, achieving a multi-cloud vision can be challenging. In this webinar, Tarik will share how an agonistic data layer, like Alluxio, allows you to embrace the separation of storage from compute and simplify the adoption of multi-cloud for AI. - Learn why leveraging multiple cloud providers is critical for balancing performance, scalability, and cost of your AI platform - Discover how an agnostic data layer like Alluxio provides seamless data access in multi-cloud that bridges storage and compute without data replication - Gain insights into real-world examples and best practices for deploying AI across on-prem, hybrid, and multi-cloud environments

Alluxio Monthly Webinar | Five Disruptive Trends that Every Data & AI Leader...

Alluxio, Inc.

Alluxio Monthly Webinar Jan. 30, 2024 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Kevin Petrie (VP of Research, Eckerson Group) - Omid Razavi (SVP of Customer Success, Alluxio) 2024 is gearing up to be an impactful year for AI and analytics. Join us on January 30, as Kevin Petrie (VP of Research at Eckerson Group) and Omid Razavi (SVP of Customer Success at Alluxio) share key trends that data and AI leaders should know. This event will efficiently guide you with market data and expert insights to drive successful business outcomes. - Assess current and future trends in data and AI with industry experts - Discover valuable insights and practical recommendations - Learn best practices to make your enterprise data more accessible for both analytics and AI applications

Data Infra Meetup | FIFO Queues are All You Need for Cache Eviction

Alluxio, Inc.

Data Infra Meetup Jan. 25, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Juncheng Yang(Ph.D Candidate, @CMU) As a cache eviction algorithm, FIFO has a lot of attractive properties, such as simplicity, speed, scalability, and flash-friendliness. The most prominent criticism of FIFO is its low efficiency (high miss ratio). In this talk, I will describe a simple, scalable FIFO-based algorithm with three static queues (S3-FIFO). Evaluated on 6594 cache traces from 14 datasets, we show that S3- FIFO has lower miss ratios than state-of-the-art algorithms across traces. Moreover, S3-FIFO’s efficiency is robust — it has the lowest mean miss ratio on 10 of the 14 datasets. FIFO queues enable S3-FIFO to achieve good scalability with 6× higher throughput compared to optimized LRU at 16 threads. Our insight is that most objects in skewed workloads will only be accessed once in a short window, so it is critical to evict them early (also called quick demotion). The key of S3-FIFO is a small FIFO queue that filters out most objects from entering the main cache, which provides a guaranteed demotion speed and high demotion precision.

Data Infra Meetup | Accelerate Your Trino/Presto Queries - Gain the Alluxio Edge

Alluxio, Inc.

Data Infra Meetup Jan. 25, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Jingwen Ouyang (Product Manager, @Alluxio) In this session, Jingwen presents an overview of using Alluxio Edge caching to accelerate Trino or Presto queries. She offers practical best practices for using distributed caching with compute engines. In addition, this session also features insights from real-world examples.

Data Infra Meetup | Accelerate Distributed PyTorch/Ray Workloads in the Cloud

Alluxio, Inc.

Data Infra Meetup Jan. 25, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Siyuan Sheng (Senior Software Engineer, @Alluxio) - Chunxu Tang (Research Scientist, @Alluxio) In this session, cloud optimization specialists Chunxu and Siyuan break down the challenges and present a fresh architecture designed to optimize I/O across the data pipeline, ensuring GPUs function at peak performance. The integrated solution of PyTorch/Ray + Alluxio + S3 offers a promising way forward, and the speakers delve deep into its practical applications. Attendees will not only gain theoretical insights but will also be treated to hands-on instructions and demonstrations of deploying this cutting-edge architecture in Kubernetes, specifically tailored for Tensorflow/PyTorch/Ray workloads in the public cloud.

Data Infra Meetup | ByteDance's Native Parquet Reader

Alluxio, Inc.

Data Infra Meetup | Uber's Data Storage Evolution

Alluxio, Inc.

Data Infra Meetup Jan. 25, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Jing Zhao (Principal Engineer, @Uber) Uber builds one of the biggest data lakes in the industry, which stores exabytes of data. In this talk, we will introduce the evolution of our data storage architecture, and delve into multiple key initiatives during the past several years. Specifically, we will introduce: - Our on-prem HDFS cluster scalability challenges and how we solved them - Our efficiency optimizations that significantly reduced the storage overhead and unit cost without compromising reliability and performance - The challenges we are facing during the ongoing Cloud migration and our solutions

Alluxio Monthly Webinar | Why NFS/NAS on Object Storage May Not Solve Your AI...

Alluxio, Inc.

Alluxio Monthly Webinar Nov. 15, 2023 For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Tarik Bennett (Senior Solutions Engineer) - Beinan Wang (Senior Staff Engineer & Architect) Many companies are working with development architectures for AI platforms but have concerns about efficiency at scale as data volumes increase. They use centralized cloud data lakes, like S3, to store training data for AI platforms. However, GPU shortages add more complications. Storage and compute can be separate, or even remote, making data loading slow and expensive: 1) Optimizing a developmental setup can include manual copies, which are slow and error-prone 2) Directly transferring data across regions or from cloud to on-premises can incur expensive egress fees This webinar covers solutions to improve data loading for model training. You will learn: - The data loading challenges with distributed infrastructure - Typical solutions, including NFS/NAS on object storage, and why they are not the best options - Common architectures that can improve data loading and cost efficiency - Using Alluxio to accelerate model training and reduce costs

AI Infra Day | Accelerate Your Model Training and Serving with Distributed Ca...

Alluxio, Inc.

AI Infra Day Oct. 25, 2023 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Adit Madan (Director of Product Management, @Alluxio) In this session, Adit Madan, Director of Product Management at Alluxio, presents an overview of using distributed caching to accelerate model training and serving. He explores the requirements of data access patterns in the ML pipeline and offers practical best practices for using distributed caching in the cloud. This session features insights from real-world examples, such as AliPay, Zhihu, and more.

AI Infra Day | The AI Infra in the Generative AI Era

Alluxio, Inc.

AI Infra Day Oct. 25, 2023 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Bin Fan (Cheif Architect, VP of Open Source, @Alluxio) As the AI landscape rapidly evolves, the advancements in generative AI technologies, such as ChatGPT, are driving a need for a robust AI infra stack. This opening keynote will explore the key trends of the AI infra stack in the generative AI era.

More from Alluxio, Inc. (20)

AI/ML Infra Meetup | ML explainability in Michelangelo

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

AI/ML Infra Meetup | Perspective on Deep Learning Framework

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...

Alluxio Monthly Webinar | Simplify Data Access for AI in Multi-Cloud

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Optimizing Data Access for Analytics And AI with Alluxio

Speed Up Presto at Uber with Alluxio Caching

Correctly Loading Incremental Data at Scale

Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML

Alluxio Monthly Webinar | Why a Multi-Cloud Strategy Matters for Your AI Plat...

Alluxio Monthly Webinar | Five Disruptive Trends that Every Data & AI Leader...

Data Infra Meetup | FIFO Queues are All You Need for Cache Eviction

Data Infra Meetup | Accelerate Your Trino/Presto Queries - Gain the Alluxio Edge

Data Infra Meetup | Accelerate Distributed PyTorch/Ray Workloads in the Cloud

Data Infra Meetup | ByteDance's Native Parquet Reader

Data Infra Meetup | Uber's Data Storage Evolution

Alluxio Monthly Webinar | Why NFS/NAS on Object Storage May Not Solve Your AI...

AI Infra Day | Accelerate Your Model Training and Serving with Distributed Ca...

AI Infra Day | The AI Infra in the Generative AI Era

Recently uploaded

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

Łukasz Chruściel

GreenCode-A-VSCode-Plugin--Dario-Jurisic

Green Software Development

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

Neo4j

SWEBOK and Education at FUSE Okinawa 2024

Hironori Washizaki

Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf

timtebeek1

Oracle Database 19c New Features for DBAs and Developers.pptx

Remote DBA Services

原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样

mz5nrf0n

原版一模一样【微信：741003700 】【美国纽约州立大学奥尔巴尼分校毕业证学位证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma 1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700 留信网认证的作用: 1:该专业认证可证明留学生真实身份 2:同时对留学生所学专业登记给予评定 3:国家专业人才认证中心颁发入库证书 4:这个认证书并且可以归档倒地方 5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息 6:个人职称评审加20分 7:个人信誉贷款加10分 8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

Crescat

Crescat is industry-trusted event management software, built by event professionals for event professionals. Founded in 2017, we have three key products tailored for the live event industry. Crescat Event for concert promoters and event agencies. Crescat Venue for music venues, conference centers, wedding venues, concert halls and more. And Crescat Festival for festivals, conferences and complex events. With a wide range of popular features such as event scheduling, shift management, volunteer and crew coordination, artist booking and much more, Crescat is designed for customisation and ease-of-use. Over 125,000 events have been planned in Crescat and with hundreds of customers of all shapes and sizes, from boutique event agencies through to international concert promoters, Crescat is rigged for success. What's more, we highly value feedback from our users and we are constantly improving our software with updates, new features and improvements. If you plan events, run a venue or produce festivals and you're looking for ways to make your life easier, then we have a solution for you. Try our software for free or schedule a no-obligation demo with one of our product specialists today at crescat.io

Webinar On-Demand: Using Flutter for Embedded

ICS

Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.

GraphSummit Paris - The art of the possible with Graph Technology

Neo4j

E-commerce Application Development Company.pdf

Hornet Dynamics

What is Augmented Reality Image Tracking

pavan998932

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

Neo4j

Vitthal Shirke Java Microservices Resume.pdf

Vitthal Shirke

Atelier - Innover avec l’IA Générative et les graphes de connaissances

Neo4j

Atelier - Innover avec l’IA Générative et les graphes de connaissances Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement. Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management

Utilocate

Utilocate offers a comprehensive solution for locate ticket management by automating and streamlining the entire process. By integrating with Geospatial Information Systems (GIS), it provides accurate mapping and visualization of utility locations, enhancing decision-making and reducing the risk of errors. The system's advanced data analytics tools help identify trends, predict potential issues, and optimize resource allocation, making the locate ticket management process smarter and more efficient. Additionally, automated ticket management ensures consistency and reduces human error, while real-time notifications keep all relevant personnel informed and ready to respond promptly. The system's ability to streamline workflows and automate ticket routing significantly reduces the time taken to process each ticket, making the process faster and more efficient. Mobile access allows field technicians to update ticket information on the go, ensuring that the latest information is always available and accelerating the locate process. Overall, Utilocate not only enhances the efficiency and accuracy of locate ticket management but also improves safety by minimizing the risk of utility damage through precise and timely locates.

APIs for Browser Automation (MoT Meetup 2024)

Boni García

OpenMetadata Community Meeting - 5th June 2024

OpenMetadata

The OpenMetadata Community Meeting was held on June 5th, 2024. In this meeting, we discussed about the data quality capabilities that are integrated with the Incident Manager, providing a complete solution to handle your data observability needs. Watch the end-to-end demo of the data quality features. * How to run your own data quality framework * What is the performance impact of running data quality frameworks * How to run the test cases in your own ETL pipelines * How the Incident Manager is integrated * Get notified with alerts when test cases fail Watch the meeting recording here - https://www.youtube.com/watch?v=UbNOje0kf6E

Hand Rolled Applicative User ValidationCode Kata

Philip Schwarz

Could you use a simple piece of Scala validation code (granted, a very simplistic one too!) that you can rewrite, now and again, to refresh your basic understanding of Applicative operators <*>, <*, *>? The goal is not to write perfect code showcasing validation, but rather, to provide a small, rough-and ready exercise to reinforce your muscle-memory. Despite its grandiose-sounding title, this deck consists of just three slides showing the Scala 3 code to be rewritten whenever the details of the operators begin to fade away. The code is my rough and ready translation of a Haskell user-validation program found in a book called Finding Success (and Failure) in Haskell - Fall in love with applicative functors.

Using Xen Hypervisor for Functional Safety

Ayan Halder

Recently uploaded (20)

2024 eCommerceDays Toulouse - Sylius 2.0.pdf

GreenCode-A-VSCode-Plugin--Dario-Jurisic

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

SWEBOK and Education at FUSE Okinawa 2024

Automated software refactoring with OpenRewrite and Generative AI.pptx.pdf

Oracle Database 19c New Features for DBAs and Developers.pptx

原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样

Introducing Crescat - Event Management Software for Venues, Festivals and Eve...

Webinar On-Demand: Using Flutter for Embedded

GraphSummit Paris - The art of the possible with Graph Technology

E-commerce Application Development Company.pdf

What is Augmented Reality Image Tracking

Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris

Vitthal Shirke Java Microservices Resume.pdf

Atelier - Innover avec l’IA Générative et les graphes de connaissances

Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management

APIs for Browser Automation (MoT Meetup 2024)

OpenMetadata Community Meeting - 5th June 2024

Hand Rolled Applicative User ValidationCode Kata

Using Xen Hypervisor for Functional Safety

Alluxio on Kubernetes - Powering training through Container Storage Interface plugin

1. Alluxio on Kubernetes Powering training through Container Storage Interface (CSI) plugin

2. Alluxio Fuse

3. Alluxio on Kubernetes Alluxio Master pod Master Container Job Master Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container

4. DaemonSet: Worker & Fuse Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine 1 Host Machine 2 Host Machine 3

5. Application Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine Volume mount

6. Application Alluxio Worker pod Worker Container Job Worker Container Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data

7. Advantages 1. Better performance because of data-locality 2. Easy to deploy. `helm install` to start the whole Alluxio cluster Alluxio Worker pod Worker Contain er Job Worker Contain er Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data

8. Challenges Alluxio Worker pod Worker Contain er Job Worker Contain er Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Volume mount mount req data 1. Fuse pod is not always needed but always taking resources. Ex. data preprocessing 2. In some workloads Fuse pod is not needed on some machines in the cluster. Lots of manual work.

9. Before CSI on Kubernetes Pod Volume AWS EBS AzureDisk AzureFile CephFS …

10. CSI on Kubernetes Pod Volume CSI AWS EBS AzureDisk AzureFile CephFS … More than 100 existing CSI drivers

11. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components

12. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components Persistent volume + claim

13. Alluxio CSI Driver v1.0.0 Host Machine Alluxio CSI Driver Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse

14. Advantages of Alluxio CSI Driver v1.0.0 1. Fuse process lifecycle is the same as the application pod. Perfectly solving our previous challenges 2. Easy to deploy. With CSI deployed with `helm install`, Fuse process is automated. Host Machine CSI Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse

15. Challenges of Alluxio CSI Driver v1.0.0 1. Fuse processes reside in one of the CSI components - nodeserver What if nodeserver is down? What if nodeserver needs to be upgraded? Host Machine CSI Components Application pod Application Container Persistent volume + claim mount mount + Alluxio Fuse

16. Challenges of Alluxio CSI Driver v1.0.0 1. Fuse processes reside in one of the CSI components - nodeserver What if nodeserver is down? What if nodeserver needs to be upgraded? Host Machine Application pod Application Container Persistent volume + claim mount

17. Alluxio CSI Driver v1.1.0 Host Machine Persistent volume + claim CSI Components

18. Alluxio CSI Driver v1.1.0 Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Persistent volume + claim mount mount CSI Components create

19. Alluxio CSI Driver v1.1.0 Alluxio Fuse pod Fuse Container Host Machine Application pod Application Container Persistent volume + claim mount mount What if nodeserver is down? What if nodeserver needs to be upgraded? Problem solved!

20. 1. Fuse pod resource allocation 2. In some cases, different applications always use different Fuse processes Next Steps

21. Acknowledgement Community users ● Kevin Cai@AntFin ● Hui Fei, Haoning Sun@Shopee ● Binyang Li@Microsoft

22. Thanks for watching Questions?

Alluxio on Kubernetes - Powering training through Container Storage Interface plugin

Recommended

Recommended

More Related Content

Similar to Alluxio on Kubernetes - Powering training through Container Storage Interface plugin

Similar to Alluxio on Kubernetes - Powering training through Container Storage Interface plugin (20)

More from Alluxio, Inc.

More from Alluxio, Inc. (20)

Recently uploaded

Recently uploaded (20)

Alluxio on Kubernetes - Powering training through Container Storage Interface plugin