Speed Up Uber's Presto with Alluxio

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Speed Up Uber’s Presto
with Alluxio
Chen Liang: Senior Software Engineer@Uber Data Analytics
Beinan Wang: Software Enginee...

Data informs every decision at Uber
Marketplace
Pricing
Community
Operations
Growth Marketing Data Science
Compliance
Eats

Presto @ Uber: Numbers
7K
Weekly Active Users
500K
Queries/day
2
Regions
5K
Nodes
15
Clusters
50PB
HDFS bytes read/day

Workloads
Interactive
Ad hoc queries
Batch
Scheduled

Presto Deployment

Alluxio Local Cache: Overview
Production Deployment
● Deployed to 3 clusters, with >200
nodes each
● Plugged in as a local...

Challenges Alluxio@Uber
● Challenge #1: Realtime Partition Updates
● Challenge #2: Cluster Membership Change
● Challenge #...

Challenge #1: Realtime Partition Updates
● At Uber, a lot of tables/partitions are constantly changing
○ Upsert queries co...

Challenge #1: Realtime Partition Updates
● Solution: Add Hive latest modiﬁcation time to caching key
○ Previous caching ke...

Challenge #2: Cluster Membership Change
● Cached bytes only present on certain nodes
○ SOFT_AFFINITY
● Presto worker nodes...

Challenge #2: Cluster Membership Change
Presto Coordinator
Presto Worker#0 Presto Worker#1 Presto Worker#2
key=4
Currently...

Challenge #2: Cluster Membership Change
Presto Coordinator
Presto Worker#0 Presto Worker#1 Presto Worker#2
key=4
Now node#...

Challenge #2: Cluster Membership Change
Solution: Node id based consistent
hashing
● All nodes are placed on a virtual
rin...

Challenge #3: Cache Size Restriction
● At Uber, PBs accessed by Presto queries >> PBs Disks space available on
Worker node...

Challenge #3: Cache Size Restriction
● Solution: Cache Filter
○ A mechanism that decide whether to cache a table and how m...

Challenge #3: Cache Size Restriction
● Greatly increased cache hit rate
○ From ~65% to >90%
● Notes wrt Cache Filter
○ Man...

Monitoring/Dashboarding
● Integrated with Uber’s internal metrics platform
● Jmx metrics emitted to Grafana based dashboard

Current Status and Next Steps
● Deployed to production cluster
○ 3 clusters of 200+ nodes each, all nodes on NVMe disks, 5...

Table Level Metrics - Motivation

Table Level Metrics - Architecture

Table Level Metrics - Dashboard

Persistent File Level Metadata for Local Cache
● Prevent stale caching
○ The underlying data ﬁles might be changed by the ...

Future Work
● Performance Tuning
○ Improve cache efﬁciency
○ Optimized for SATA or mechanical hard drives
● Adopt Shadow C...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1059379 views
Storytelling For The Web: Integrate... by Chiara Aliotta 976667 views
Artificial Intelligence, Data and C... by OECD Directorate ... 914599 views
How to Leverage AI to Boost Employe... by SocialHRCamp 387831 views
2024 State of Marketing Report – by... by Marius Sescu 219508 views
Everything You Need To Know About C... by Expeed Software 236350 views

View on Slideshare

1 of 23 Ad

View on Slideshare

1 of 23 Ad