OSA Con 2022: The Open Source Analytic Universe, Version 2022 Robert Hodges - Altinity Every generation builds new cathedrals. For many of us, this means implementing analytic applications built on a foundation of open source. We'll survey developments in analytics since the last OSA Con and highlight new technologies that developers should be watching as we head into the mid-2020s.

1. The Open Source
Analytic Universe
Version 2022
Robert Hodges, Altinity CEO
1

2. Presenter and Company
www.altinity.com
Enterprise provider for ClickHouse.
We run Altinity.Cloud, the first
managed platform for ClickHouse on
AWS and GCP
Robert Hodges - Altinity CEO
30+ years on DBMS plus
virtualization and security. Working
with analytic databases since 2013

3. State of the open source
analytic universe 2021
3

4. Real-time analytics introduce new use cases for SaaS analytics
Weblogs
Online
ad bids
Service
logs
Network
telemetry
System
monitoring
Market
trading
data
Sub-second response
Millions of events per second
Trillions of stored events

5. Real-time data in practice - continuous operation on large
data sets
5
Millions of rows/sec with constant query load
10s of TBs per server node

6. Kubernetes is also flourishing
6
Open source infrastructure
Cloud-native databases

7. What’s new in 2022?
7

8. Connecting transactions to analytics enables basic
operations
8
Fraud
Detection
App
Fraud
Credit card
transaction
OK
✘
✔

9. Real-time OLTP / OLAP integration is critical
9
Fraud
Detection
App
Fraud
Credit card
transaction
OK
✘
✔
Transaction
Processing Analytics

10. Improving that integration is key to efficiency
10
Fraud
Detection
App
Fraud
Credit card
transaction
OK
✘
✔
Transaction
Processing Analytics
Simple, near
real-time transfer

11. And HTAP is having a moment…
11
Fraud
Detection
App
Fraud
Credit card
transaction
OK
✘
✔
Hybrid Transactional/Analytic Processing

12. Object storage is surging as a solution for large datasets
12
Server
SSD
Cache
Server
SSD
Cache
Server
SSD
Cache
Object
Storage
2014

13. Virtually all analytic databases support it
13
Server
SSD
Cache
Server
SSD
Cache
Server
SSD
Cache
Object
Storage
2022

14. Open table formats allow reuse of large data sets
14
Server
SSD
Cache
Server
SSD
Cache
Server
SSD
Cache
Object
Storage
Metadata Transactions
Security

15. How might this play out for open source analytics?
15
Server
SSD
Cache
Server
SSD
Cache
Server
SSD
Cache
ClickHouse
“ObjectTree”
Data Ingest AI/ML
2022 202?...
2018

16. PostgreSQL is fading as an influence on analytics
16
Aster Data
Truviso
Yahoo Everest
Netezza
Greenplum
Vertica
ParAccel
Redshift
TimescaleDB
Materialize

17. ClickHouse Word Cloud!
17
ByteHouse
Hydrolix
Firebolt
CloudFlare
PingCAP
CaspianDB
TinyBird
Huawei
ClickHouse Cloud
DoubleCloud
Gigapipe
Yandex.Cloud
eBay
Alibaba Cloud
Altinity.Cloud
Aiven
Tencent Cloud
ChistaDATA
Cloud
Cloud Service
Fork
Released in 2022

18. Geographical distribution of forks and cloud services
18
Fork
Cloud
Service

19. Fearless predictions for 2023
19
Real-time integration from OLTP to OLAP
Innovation in and around object storage
New ClickHouse cloud services and forks!

20. One final topic
20
In real Open Source, you have the
right to control your own destiny.
- Linus Torvalds
Ownership of data

21. And a final prediction for 2023
21
To own your data you
must also own the code
Committers
Communitees
Users
Vendors

22. And a final prediction for 2023
22
User needs for ownership will help drive
open source analytic development
To own your data you
must also own the code
Committers
Communitees
Users
Vendors

23. Thank you and
enjoy the
conference!
rhodges at altinity.com
https://altinity.com