What is Big Data messaging? What's the difference between Apache Kafka and RabbitMQ

1. Messaging

2. ○ Messaging models
○ Protocols & Standards
○ Message brokers
○ Data pipeline architecture
○ Microservices architecture
Agenda

3. Overview

4. Messaging models
Publisher-SubscriberPoint-to-Point

5. ○ AMQP - Advanced Message Queuing Protocol
○ MQTT - Message Queuing Telemetry Transport
(machine-to-machine (M2M)/"Internet of Things"
connectivity protocol)
○ STOMP - Simple (or Streaming) Text Orientated
Messaging Protocol
○ JMS - Java Message Service
Messaging protocols & standards

6. RabbitMQ
○ You have messages that need to
be routed in complex ways to
consumers
○ You want per-message delivery
guarantees
○ You don't care about ordered
delivery
Message broker examples
Apache Kafka
○ You have a fire hose of
events
○ You need delivered in
partitioned order 'at least
once'
○ You want to be able to re-
read messages
https://www.quora.com/What-are-the-differences-between-Apache-Kafka-and-
RabbitMQ
http://queues.io

7. Pipeline is a set of data processing elements
connected into series, where the output of one
element is the input of the next one.
Data pipeline architecture

8. Microservices architecture

9. Apache Kafka Hits 1.1 Trillion Messages Per Day – Joins the 4 Comma Club
Apache Kafka at LinkedIn

10. Apache Kafka technical overview

11. Apache Kafka technical overview

12. Questions?