The document discusses real-time business platform architectures that incorporate technologies such as Spark, Akka, Cassandra, Kafka, and various cloud software solutions. It outlines the shift from synchronous ETL and batch processing to an asynchronous model using streams and event-driven systems for real-time analytics and data processing. The integration of these technologies aims to enhance data analysis efficiency and support modern digital business needs.

1. Real-time platforms using Spark, Akka, Cassandra, Kafka, Alpakka, Kafka
Connect, & Kafka Streams.
Realtime Business Platform
Architecture Review

2. Business Platform Success
We design, build, and manage business
platforms by leveraging DataStax,
Sitecore, Salesforce, Quickbooks and
other cloud software.

3. Modern Digital Business Technology Platform

4. Business Use Case for Real-time

5. The current thinking is that the state of the systems in an
enterprise are synchronous and that analysis must be done
sequentially, iteratively from beginning to end in batch.
Old: Synchronous ETL / Batch Pipeline

6. Modern Business Platform : IoT + API + CX + IS + DA

7. New: Coordinated Disparate Systems

8. Reactive Manifesto

9. Modern: Async via Streams/Queues/Actors

10. Modern: Async via Streams/Queues/Actors

11. Real-time Analytics

13. Real-time Analytics
• Deterministic
• Available
• Machine Learning
• Data Enrichment
• Business Intelligence Tools
• SQL
● Data
○ S3
○ Cassandra
○ Redshift
○ RDS
● Analysis
○ Spark
■ Python
■ Scala
■ Java
■ R
○ SQL

14. Real-time + Batch = Lambda Architecture

15. Real-time Analytics
● Message Processing / Materialization
○ Kafka SQL
○ Kafka Connect
○ Samza
○ Akka
○ Alpakka
● Message Enhancement / Computation
○ Kafka Streams
○ Spark
○ Flink
○ Kafka Streams
○ Serverless (Lambda/Functions)
● Realtime Distributed Data
○ Cassandra*/Scylla/DSE
○ Cockroach/TiDB/Galera/YB
○ S3
○ DynamoDB
● Colocated Data / Analytics
○ Cassandra + Spark SQL
○ Cassandra + Spark
○ Cassandra + Spark + Solr
○ Snowflake
○ Redshift

16. Real-time Analytics: SMACK Stack

17. Apache Kafka

18. Kafka as Event Store

19. Kafka, Spark, Cassandra, SQS, Redshift on AWS

20. Kafka Streams

21. Kafka Connect + DataStax Connector

22. Kafka w/ Machine Learning

23. Apache Spark

24. Spark + Streaming + Static Data Sources

25. Spark + Tableau for Business Intelligence

26. Apache Kafka
+ Apache Spark

27. Spark + Kafka Data Processing

28. Simplified Lambda with Kafka + Spark + Cassandra

29. Apache Kafka
+ Apache Spark
+ Akka | Alpakka

30. Canonical Kafka Spark Cassandra Stack

32. Akka + Spark + Kafka + Cassandra

33. Alpakka (Akka Streams)

34. Apache Pulsar

35. Pulsar Architecture

36. Pulsar Subscription Modes

37. Pulsar Geo Replication

38. Pulsar Tiered Storage

39. Major Players

40. Realtime Components

41. www.anant.us | solutions@anant.us | (855) 262-6826
3 Washington Circle, NW | Suite 301 | Washington, DC 20037
Data & Analytics
Cassandra, DataStax, Kafka, Spark
Customer Experience
Sitecore
Information Systems
Salesforce, Quickbooks, and more