Alluxio x Tobiko - ETL Happy Hour April 16, 2024 For more Alluxio events: https://alluxio.io/events/ Speaker: Lucy Ge (Staff Software Engineer @ Alluxio) In this presentation, Lucy Ge will discuss the data access challenges in the data pipeline and how to optimize the speed and costs of analytics and AI workloads.

1. Optimizing Data Access
for Analytics And AI
Shufan(Lucy) Ge
lucy.ge@alluxio.com
Lucy Ge
Staff Software Engineer @ Alluxio

2. Staff Software Engineer
@ Alluxio
Lucy Ge
Major in:
- Distributed systems
- Distributed NoSQL
database
- Software-defined
storage (SDS)
- Data
infrastructure/middlew
are.

3. 3
Common Challenges
with Analytics/ETL
Data access across
regions
Managing different
tech stacks / vendors
Costly, complex data
engineering

4. 4
Common Challenges
with AI/ML
Time to market Scarcity of GPUs Low GPU
utilization
High performance data
access for model training
and distribution
Faster training & faster
iteration
Multi cloud/data centers
data serving capability &
shorten the time to
production

5. Data is …
5
● EVERYWHERE (data sits in HDFS, in s3 / in AWS in GCP / in
on-prem datacenter1, in on-prem datacenter2…)
● GROWING (more data sources for analyze, for training)
● FAR AWAY (compute entities keep waiting for data fetching)
● EXPENSIVE (accessing data from storage takes costs)
[3] AI and compute, https://openai.com/research/ai-and-compute [4] Amazon EC2 P4 Instances, https://aws.amazon.com/ec2/instance-types/p4

6. 6
Data Platform with Complex Data Engineering &
Management

7. 7
Data Platform with Alluxio
High Performance Data Access, Transparent View

9. v v
DATACENTER 2
DATACENTER 1
Hive
MULTI-CLOUD ANALYTICS & AI PLATFORM
Example Solution Architecture with Alluxio
Transparent
Namespace
No-copy Data Access across silos
For multiple instances of compute,
whether ephemeral or elastic
Data is EVERYWHERE,
— But Accessible, Transparent!
s3://bucket1/training/dataset1
gs://bucket2/parquet_files
hdfs://models/model_folder

10. Data is GROWING,
— And so can Alluxio!
AWS S3 GCP
trino
PyTorch
… bucket1 bucket2 … bucket10001
cluster cluster
node node node node
node node node node node node
…

11. Alluxio closely collocated with Compute
11
Data is FAR AWAY,
— Alluxio brings it closer

12. Presto
Presto
S3
us-east-1
Without Cache With Cache
S3
us-west-1 S3
us-east-1
Alluxio
Frequently Retrieving Data =
High GET/LIST Operations Costs & Data Transfer Costs
Fast Access with
Hot Data Cached
S3
us-west-1
Only Retrieve Data When Necessary = Lower S3 Costs
… …
… …
Data is EXPENSIVE,
— Alluxio reduce access cost

13. Powered by Alluxio
INTERNET
PUBLIC CLOUD PROVIDERS
GENERAL
E-COMMERCE
OTHERS
TECHNOLOGY FINANCIAL SERVICES
TELCO & MEDIA
LEARN MORE
13

14. Data is …
14
● EVERYWHERE, but accessible, and transparent!
● GROWING, so can Alluxio!
● FAR AWAY, Alluxio brings them closer!
● EXPENSIVE, Alluxio reduce the cost!
[3] AI and compute, https://openai.com/research/ai-and-compute [4] Amazon EC2 P4 Instances, https://aws.amazon.com/ec2/instance-types/p4

15. Thank you!
twitter.com/alluxio slackin.alluxio.io
linkedin.com/alluxio
www.alluxio.io
Scan the QR code for
a Linktree including
great learning
resources, exciting
meetups & a community