Presentation on how we at Instana use ClickHouse. The problems we came across and how we solved them.

1. ClickHouse
Or how Instana is using a column-oriented DBMS for sub-second analysis

2. -
-
-

3. 1)
2)
3)
4)
5)
6)

4. Agent
Sensor A
Sensor B
Sensor B
Sensor C
Sensor C

5. -
-
-
-
-

6. -
-
-
-

7. -
-
-
-
-
-
-
-
-
-

8. -
-
-
-
10:001,12:002,11:003,22:004;
Smith:001;Jones:002,004;Johnson:003;
Joe:001,Mary:002,Cathy:003,Bob:004;
40000:001,50000:002,44000:003,55000:004;
001:10,Smith,Joe,40000;
002:12,Jones,Mary,50000;
003:11,Johnson,Cathy,44000;
004:22,Jones,Bob,55000;

9. -
-
-
-
-
-
-
-

10. -
-
AgentAgentAgentAgent
Kafka
WriterWriterWriterWriter
ClickHouse
Cassandra
ClickHouseClickHouse
CassandraCassandra

11. WriterWriterWriterUI-Backend
ClickHouse
Cassandra
ClickHouseClickHouse
CassandraCassandra
ReaderReader

12. -
-
-
-
-

13. 1)
2)
3)
Writer
ClickHouse
Writer

14. 4)
Kafka P0 Writer
ClickHouse
Kafka P1 Writer
Processor A
Processor B

15. 5)
Kafka P0 Writer ClickHouse
Kafka P2 Writer
ClickHouse
ClickHouse
ClickHouseKafka P1 WriterProcessor

16. -
-

17. -
-

18. -
-

19. -
-

20. -
-
-
-
…
-

21. -
-
-
-