Presentation for Java2Days 2020

1. Triangle of
Cassandra &
Solr & Kafka
IRINA KAMALOVA
SENIOR SOFTWARE ENGINEER
ALVEO TECHNOLOGY, UK
22/12/2020

2. “The problem of Tweets”
v Storing
v Verification
v Indexing

3. Motivation
To give a brief introduction to Apache Cassandra and
some things that you will miss from relational database
To give a brief introduction to Apache Solr
To give an example how we can integrate these
products together with Apache Kafka

4. Apache
Cassandra

5. Features
 Peer-to-Peer architecture
 Elastic Scalability
 Data replication
 Tuneable Consistency for reads/writes
 Column oriented and schema-free
 High availability

6. You will miss about:
Cassandra = No Joins
No subqueries for selecting data
No queries “like” expression for selecting data
No commit/rollback features
Adding new columns is not possible in some cases

7. Cassandra architecture

8. You will miss about:
Insert with “if exist” condition is extremely expensive
Update with “if” condition is extremely expensive

9. Paxos protocol

10. Paxos protocol

11. Paxos protocol
4 round trips across the cluster!

12. Well, this is what I
need. But… What if I
need more complex
query on some data?

13. Apache Solr

14. Features:
Full-text indexing and search
REST-like HTTP/XML and JSON APIs
Java Client
Beautiful UI

17. Solr Cloud
Peer-to-Peer architecture
Central configuration for the entire cluster
Automatic load balancing
Fail-overs for queries
ZooKeeper integration for cluster
coordination and configuration

19. Well, this is what we need.
But… How to integrate it
together?

20. Apache Kafka

21. Features:
 High throughput
 Elastic Scalability
 Data durability
 Fault-tolerant
High availability
Parallel
consumption

22. Final architecture for an integration:
IndexerKafka
Cassandra
SolrEvents

23. Features of the whole system:
 Peer-to-Peer architecture for components
 Elastic Scalability
 Data durability
 Fast writes
 Eventual consistence
 Faut-tolerance
 Powerful search

24. Questions?
Follow me:
Github
https://github.com/irenkamalova
Gitpages:
https://irenkamalova.github.io/
Twitter: https://twitter.com/IrenKamalova
Medium:
https://iren-kamalova.medium.com/
LinkedIn
https://www.linkedin.com/in/irina-kamalova/

25. Thank You !