Optimizing Performance in Rust for Low-Latency Database Drivers

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Optimizing Performance
in Rust for Low-Latency
Database Drivers
Piotr Grabowski, Software Team Leader, ScyllaDB

Poll
Where are you in your NoSQL adoption?

Presenter
Piotr Grabowski, Software Team Leader, ScyllaDB
+ Software Team Leader at ScyllaDB
+ Responsible for all ScyllaD...

+ For data-intensive applications that require high
throughput and predictable low latencies
+ Close-to-the-metal design t...

+ ScyllaDB runs only on Linux
+ We take advantage of many Linux-only APIs:
+ io_uring
+ (previously) epoll/aio
+ Avi Kivit...

6
+400 Gamechangers Leverage ScyllaDB
Seamless experiences
across content + devices
Digital experiences at
massive scale
C...

Agenda
+ Introduction
+ ScyllaDB Rust Driver
+ Bindings to ScyllaDB Rust Driver

Introduction

Drivers 101
+ Drivers (in this presentation) - libraries that allow sending queries to
ScyllaDB
+ Primary protocol: CQL (C...

Drivers 101 - Role of Drivers
+ The role of drivers:
+ Serialization/deserialization of CQL frames
+ Serialization/deseria...

Drivers 101 - Performance
+ How can the driver improve performance?
+ Shard awareness: sending the query to a correct shar...

ScyllaDB Rust Driver

ScyllaDB Rust Driver
+ The idea was born during a hackathon in 2020
+ Over the last 3 years we continued the development

ScyllaDB Rust Driver
+ The idea was born during a hackathon in 2020
+ Over the last 3 years we continued the development
+...

ScyllaDB Rust Driver - Runtime
+ Async Rust is based on a quite unique future/promise model:
+ Running a function which re...

ScyllaDB Rust Driver - API Design
+ A central component of our driver is a session, established once and then
used to comm...

ScyllaDB Rust Driver - O(N²) in Tokio?
+ Issue raised by the author of latte - a benchmark tool for ScyllaDB and Cassandra...

ScyllaDB Rust Driver - Connection Management
Ability to customize the number of connections is critical for performance. O...

ScyllaDB Rust Driver - Shard Awareness
Scylla takes it even further - drivers can try to connect directly to a core which
...

ScyllaDB Rust Driver - Load Balancing

ScyllaDB Rust Driver - Load Balancing
SELECT * FROM table
WHERE partition_key = “R1250GS”
hash(“R1250GS”) = replica nodes

+ Main goal: reduce number of allocations and atomic operations while
building the query plan, especially on the happy pat...

ScyllaDB Rust Driver - Load Balancing
Refactor
Inserts:
----------
allocs/req: 15.00
reallocs/req: 8.00
frees/req: 15.00
b...

ScyllaDB Rust Driver - Load Balancing
Refactor
Inserts:
----------
allocs/req: 15.00
reallocs/req: 8.00
frees/req: 15.00
b...

ScyllaDB Rust Driver - Load Balancing
Refactor
Inserts:
----------
allocs/req: 15.00
reallocs/req: 8.00
frees/req: 15.00
b...

ScyllaDB Rust Driver - Load Balancing
Refactor
Selects:
----------
allocs/req: 48.00
reallocs/req: 8.00
frees/req: 48.00
b...

ScyllaDB Rust Driver - Load Balancing
Refactor
Selects:
----------
allocs/req: 48.00
reallocs/req: 8.00
frees/req: 48.00
b...

ScyllaDB Rust Driver - Other Efforts
+ Rack-aware load balancing
+ Reduce the cost of querying ScyllaDB nodes in other rac...

ScyllaDB Rust Driver - Iterator-based
Deserialization
+ Reworked Deserialization API
+ Solves performance issues and impro...

ScyllaDB Rust Driver - Removing All
Allocations?
+ A community-started project, led by Joseph Perez (@wyfo) written from
s...

ScyllaDB Rust Driver - Profiling tools
Rust ecosystem makes it easy to look for performance issues in your
project. One of...

ScyllaDB Rust Driver - Profiling tools

ScyllaDB Rust Driver - Profiling tools
For projects based on Tokio, tokio-console can be used to inspect
running asynchron...

Bindings to ScyllaDB
Rust Driver

Bindings to ScyllaDB Rust Driver
+ When benchmarking ScyllaDB Rust Driver against other drivers, we
measured it was the mo...

Bindings to ScyllaDB Rust Driver - C/C++
+ We started development for the C/C++ language
+ C++ bindings to the Rust driver...

Bindings to ScyllaDB Rust Driver - C/C++
#[no_mangle]
pub unsafe extern "C" fn cass_future_ready(future_raw: *const
CassFu...

Q&A
ScyllaDB University
Free online learning
scylladb.com/university
scylladb.com/events
Build Low-Latency
Rust Applicatio...

Thank you
for joining us today.
@scylladb scylladb/
slack.scylladb.com
@scylladb company/scylladb/
scylladb/

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1026982 views
Storytelling For The Web: Integrate... by Chiara Aliotta 937145 views
Artificial Intelligence, Data and C... by OECD Directorate ... 853259 views
How to Leverage AI to Boost Employe... by SocialHRCamp 357183 views
2024 State of Marketing Report – by... by Marius Sescu 203199 views
Everything You Need To Know About C... by Expeed Software 224364 views

View on Slideshare

1 of 48 Ad

View on Slideshare

1 of 48 Ad