1.
Brought to you by
Is It Faster to Go with
Redpanda Transactions than
Without Them?!
Denis Rystsov
Staff Engineer at

2.
Denis Rystsov
Staff Engineer at Vectorized
■ Invented CASPaxos
■ Designed Redpanda transactions
■ Tested consistency of Cosmos DB
■ Can’t decide what I like more P0 or P99
■ Surfing is pure joy

3.
A All functions
from list to list
B
All sorting
functions from
list to list

4.
More work worse performance

5.
Silver lining
Algorithm Complexity
Merge sort O(n ln n)
Radix sort O(n)
Counting sort O(n)

6.
A
All sorting functions
from list[byte] to
list[byte]
B
All sorting functions
from list[int] to
list[int]
Contravariance

7.
Specialization better performance

8.
Bulk insert

9.
Canonical bulk insert
var futures = new ArrayList();
for (var i=0;i<N;i++) {
futures.add(send("topic1",...));
}
for (var future : futures) {
future.get()
}

10.
■ O(N):
■ Replication protocol
■ Disk IO
■ Client-Cluster RTT
■ Intra-cluster RTT
Latency

11.
Traditional transactional bulk insert
beginTransaction();
for (var i=0;i<N;i++) {
send("topic1",...);
}
commit();

12.
Traditional transactional bulk insert
addTopicToTxn("topic1")
for (var i=0;i<N;i++) {
send("topic1",...);
}
commit();

13.
■ O(N):
■ Replication protocol
■ Disk IO
■ Client-Cluster RTT
■ Intra-cluster RTT
■ Add Topic to Txn
■ Commit
Latency

14.
Add Topic to Txn

15.
Commit

16.
Redpanda optimization

17.
■ Let’s send() be
eventual consistent
Redpanda optimization

18.
■ Let’s send() be
eventual consistent
■ Validate that it’s fully
replicated during
commit
Redpanda optimization

19.
■ Let’s send() be
eventual consistent
■ Validate that it’s fully
replicated during
commit
■ Parallel commits
Redpanda optimization

20.
Add Topic to Txn

21.
Commit

22.
■ O(N):
■ Replication protocol
■ Disk IO
■ Client-Cluster RTT
■ Intra-cluster RTT
■ Add Topic to Txn
■ Commit
Latency

23.
Takeaway
■ Avoid disk IO
■ Embrace limitations
■ Find specialization
■ Be optimistic
■ Look around

24.
Brought to you by
Denis Rystsov
@rystsov