Alluxio Webinar | 10x Faster Trino Queries on Your Data Platform

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

10x Faster Trino Queries
on Your Data Platform
Jianjian Xie
Staff Software Engineer @ Alluxio

Staﬀ Engineer @ Alluxio
Trino Contributor
PrestoDB Contributor
Jianjian Xie

RubiX is OUT, Alluxio is IN
3
Trino 332 introduced
Hive connector
storage caching
by RubiX/Qubole
2020
Trino 439
introduce...

Glossary - Let’s Talk Cache
4
Trino File System
Cache
latest built-in fs cache in Trino 439 release based on Alluxio cachi...

Which Cache Fits Your Need?
5
Trino File System Cache Alluxio or Alluxio Distributed Cache
Maintainers
Actively maintained...

Trino File System Cache
6

7
Four
Values of
Trino File
System
Cache
Boost
Performance
Save Costs
Prevent
Network
Congestion
Oﬀload
Under
Storage

Key Features of Trino File System Cache
8
Caching Data
Local SSD
Memory
Connector Support
Iceberg
Hudi
Delta Lake
Hive

9
How to Enable Trino File System Cache?
From the view of a Trino user, nothing really changes
fs.cache.enabled=true
fs.ca...

10
A Deeper Dive - How Trino File Cache Works

11
File System Caching at Uber Scale
3 Clusters, 1500 Nodes
Source: https://www.uber.com/blog/speed-up-presto-with-alluxio...

Alluxio
Distributed Cache
12

13
Alluxio Distributed Cache Architecture
Compute Node

14
Unify Data Lake Across Multiple
Geographic Regions at Expedia
PROBLEMS ENCOUNTERED ALLUXIOʼS SOLUTION RESULTS ACHIEVED
...

Multi-Level
Cache
15

16
Multi-level Cache: Best of Both Worlds
Trino Worker
Trino
Trino
File System
Cache
Alluxio
Distributed
Cache

Ongoing
Work
17

18
Upcoming Trino Native Alluxio Distributed Cache
Avoid old & complex HDFS interface with native Trino interface implemen...

Takeaways
19

Takeaways: Which Cache Fits Your Need?
20
Trino File System Cache Alluxio or Alluxio Distributed Cache
Maintainers
Activel...

Thank You
Any Questions?
Scan the QR code for a
Linktree including great
learning resources,
exciting meetups & a
communit...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1062387 views
Storytelling For The Web: Integrate... by Chiara Aliotta 980817 views
Artificial Intelligence, Data and C... by OECD Directorate ... 921734 views
How to Leverage AI to Boost Employe... by SocialHRCamp 391483 views
2024 State of Marketing Report – by... by Marius Sescu 221384 views
Everything You Need To Know About C... by Expeed Software 237443 views

View on Slideshare

1 of 21 Ad

View on Slideshare

1 of 21 Ad