Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Kafka website activity architecture
Omid Vahdaty, Cloud Architect
Kakfa Architecture use cases
● https://kafka.apache.org/uses
○ Website Activity Tracking
○ Messaging
○ Log Aggregation
○ M...
Publish / Subscribe
Decouple compute and storage/ Inflight analytics
Kafka multi DC cluster (multi cloud)
● Active Active
● Active Passive
● Active Active with aggregation cluster
● Active Ac...
Kafka multi DC cluster
● http://www.slideshare.net/HadoopSummit/building-largescale-stream-
infrastructures-across-multipl...
Stay in touch...
● Omid Vahdaty
● +972-54-2384178
Kafka website activity architecture
Upcoming SlideShare
Loading in …5
×

Kafka website activity architecture

906 views

Published on

Using Kafka in a website activity use-case. for disaster recovery, multi DC clusters, and multi cloud clusters.

Published in: Engineering
  • Be the first to comment

  • Be the first to like this

Kafka website activity architecture

  1. 1. Kafka website activity architecture Omid Vahdaty, Cloud Architect
  2. 2. Kakfa Architecture use cases ● https://kafka.apache.org/uses ○ Website Activity Tracking ○ Messaging ○ Log Aggregation ○ Metrics ○ Stream Processing ○ Event Sourcing ○ Commit Log
  3. 3. Publish / Subscribe
  4. 4. Decouple compute and storage/ Inflight analytics
  5. 5. Kafka multi DC cluster (multi cloud) ● Active Active ● Active Passive ● Active Active with aggregation cluster ● Active Active with DC tagging on topics
  6. 6. Kafka multi DC cluster ● http://www.slideshare.net/HadoopSummit/building-largescale-stream- infrastructures-across-multiple-data-centers-with-apache-kafka ● http://www.slideshare.net/ToddPalino/more-datacenters-more-problems ● http://www.slideshare.net/ToddPalino/kafka-at-scale-multitier-architectures ● Typically done on AWS on single region (several AV zones) ○ Rely on intra - cluster replication ○ Stretched cluster across regions are NOT RECOMMENDED ■ Security considerations. ■ Network latency considerations.
  7. 7. Stay in touch... ● Omid Vahdaty ● +972-54-2384178

×