Messaging
RabbitMQ

Marcus Crafter
Red Artisan & CLEAR Interactive (@crafterm)

Daniel Neighman
CLEAR Interactive (@hassox)

Background

http://www.flickr.com/photos/james_c_mattison/2267135704/
During Development

1st Release

Complexity

Request/Response Time

Background Activity

Monolithic Extraction

Memory & Garbage
Collection

External Communication

Messaging

Background processing
BJ, DJ, BackgroundRB, Airbrush, Workling/Starling, DB
Messaging
Stomp, XMPP, ActiveMQ, Amazon SQS, MQ Series, M$

Goldman Sachs

AMQP
Advanced Messaging Queueing Protocol

AMQP Working Group
Barclays Bank IONA Technologies
Cisco Systems JPMorgan Chase Bank
Credit Suisse Microsoft Corporation
Deutsche Börse Novell
Envoy Technologies Red Hat Inc
Goldman Sachs Solace Inc
iMatix Corporation Tervela Inc
... and more

Reliable, Transaction,
Acknowledgement, Routed,
Pub Sub, Independent

Protocol Specification

AMQP Implementations
Apache Qpid
Red Hat Enterprise MRG
ØMQ
Zyre
OpenAMQ
and many more, plus bindings to existing products

Rabbit MQ
http://www.rabbitmq.com

Open Source

Erlang OTP

Distributed

Shiny

Architecture
AMQP & Rabbit MQ

RabbitMQ
Producer
Exchange
Consumer Queue Queue Queue

Queues
Acts as a message buffer between producer &
consumer

Exchange
Determines how messages are routed to queues

Producer
Publishes messages to the exchange

Consumer
Receives message from the queue

Message
Naturally :)

AMQP & Ruby
Libraries, Gems, etc

tmm1-amqp
Event Machine Based & Asynchronous

carrot & bunny
Synchronous

Direct Exchange
Routing Based on “key” that matches exactly

Direct Exchange
Routing Based on “key” that matches exactly
Direct

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Homer
Bindings:
“Beer”“Food”
,

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Homer Marge
Bindings: Bindings:
“Beer”“Food”
, “Food”

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Key = “Beer”
Homer Marge
Bindings: Bindings:
“Beer”“Food”
, “Food”

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Homer Marge
Bindings: Bindings:
“Beer”“Food”
, “Food”

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Key = “Food”
Homer Marge
Bindings: Bindings:
“Beer”“Food”
, “Food”

Direct Exchange
Routing Based on “key” that matches exactly
Direct
Homer Marge
Bindings: Bindings:
Key =,“Food” Key = “Food”
“Beer”“Food” “Food”

Direct Exchange
Demo - Rails

Fanout Exchange
Copies to all bound queues

Fanout Exchange
Copies to all bound queues
Fanout
Silo Silo Silo

Fanout Exchange
Copies to all bound queues
Launch All Fanout
Nukes
Silo Silo Silo

Fanout Exchange
Copies to all bound queues
Fanout
Launch All Launch All Launch All
Silo Silo Silo
Nukes Nukes Nukes

Fanout Exchange
Demo - Desktop

Topic Exchange
Route By Key, with Key Globbing

Topic Exchange
Route By Key, with Key Globbing
Topic
Homer Marge Consumers
Bindings: Bindings: Bindings:
“*.Beer” “Consume.Food” “Consume.#”

Topic Exchange
Route By Key, with Key Globbing
Toast Topic
“Consume.Food”
Homer Marge Consumers
Bindings: Bindings: Bindings:
“*.Beer” “Consume.Food” “Consume.#”

Topic Exchange
Route By Key, with Key Globbing
Topic
Homer Marge Consumers
Bindings: Bindings: Bindings:
“*.Beer” “Consume.Food” “Consume.#”

Topic Exchange
Route By Key, with Key Globbing
Some Brand
“Consume.Beer” Topic
Homer Marge Consumers
Bindings: Bindings: Bindings:
“*.Beer” “Consume.Food” “Consume.#”

Topic Exchange
Route By Key, with Key Globbing
Topic
Homer Marge Consumers
Bindings: Bindings: Bindings:
“*.Beer” “Consume.Food” “Consume.#”

Header Exchange
Route on Meta Data

Header Exchange
Route on Meta Data
Header
Homer Marge Watch Dog
Bindings: Bindings: Bindings:
“type” = “Beer” “type” = “Food”, “rating” = “fatty”
“rating” = “fatty” “rating” = “health”

Header Exchange
Route on Meta Data
Header
Homer Marge Watch Dog
Bindings: Bindings: Bindings:
“type” = “Beer” “type” = “Food”, “rating” = “fatty”
“rating” = “fatty” “rating” = “health”

Header Exchange
Route on Meta Data
Header
Homer Marge Watch Dog
Bindings: Bindings: Bindings:
“type” = “Beer” “type” = “Food”, “rating” = “fatty”
“rating” = “fatty” “rating” = “health”

Header Exchange
Route on Meta Data
Header
Homer Marge Watch Dog
Bindings: Bindings: Bindings:
“type” = “Beer” “type” = “Food”, “rating” = “fatty”
“rating” = “fatty” “rating” = “health”

More Information?
http://amqp.org
http://www.rabbitmq.com
Google Video RabbitMQ
http://github.com/tmm1/amqp
http://github.com/celldee/bunny

Any Questions?