An introduction to message queues with PHP. We'll focus on RabbitMQ and how to leverage queuing scenarios in your applications. The talk will cover the main concepts of RabbitMQ server and AMQP protocol and show how to use it in PHP. The RabbitMqBundle for Symfony2 will be presented and we'll see how easy you can start to use message queuing in minutes. Presented at Symfony User Group Belgium: http://www.meetup.com/Symfony-User-Group-Belgium/events/169953362/

1. Message Queues with PHP

2. About Me
Eric Rodriguez
Founder @ Data.be
Founder @ Pictawall.com
CTO @ Auctelia.com
!
• Web entrepreneur
• Multi-Language: PHP, Java/Groovy/Grails, .Net, …
!
be.linkedin.com/in/erodriguez
!
github.com/wavyx
!
@wavyx

3. Which Rabbit ?!

4. RabbitMQ
• Message Broker
• Open Source
• AMPQ implementation
• Written in Erlang
• Lots of AMQP client libraries
• Wide community and commercial support

5. Message Queues 101
• Producer = Sender
• Consumer = Receiver
• Queue = Mailbox

6. Use Cases
• Send notifications to users
• Process heavy work/tasks with multiple workers
Upload picture, make thumbnails, clear CDN caches…
• Distribute logs/messages to multiple endpoints
• Interoperability between different platforms
• Remote Procedure Call

7. AMQP
Advanced Message Queuing Protocol
• Open Standard Protocol coming from finance
• Interoperable Messaging Middleware
• Queuing
• Routing (point-to-point and publish-and-subscribe)
• Reliability
• Security

8. AMQP Model
• Exchange • Queue • Routes

9. Exchanges
• 4 Types - Direct, Fanout, Topic, Headers
• Durability - Exchanges survive a restart
• Auto-delete - Exchange deleted when queues empty

10. Direct Exchange
A Direct Exchange sends a message to a queue if the message's
routing key is identical to the binding key for the queue

11. Fanout Exchange
A Fanout Exchange sends messages
to every queue bound to the exchange

12. Topic Exchange
A Topic Exchange sends a message to a queue if the message's
routing key matches the binding key for the queue, using wildcard matching

13. Alternatives
Check http://queues.io/
• ZeroMQ - http://zeromq.org/ (ZMTP)
• Beanstalkd - http://kr.github.io/beanstalkd/ (Job Server)
• Gearman - http://gearman.org/ (Job Server)
• HornetQ - http://www.jboss.org/hornetq/ (JMS/STOMP)
• Apache Kafka -http://kafka.apache.org/ (PubSub)
• Apache Qpid - http://qpid.apache.org/ (AMQP)
• Apache ActiveMQ - http://activemq.apache.org/ (AMQP)
• Apache Apollo - https://activemq.apache.org/apollo/ (AMQP)

14. Cloud Alternatives
• IronMQ
http://www.iron.io/mq
• Amazon SQS
http://aws.amazon.com/sqs/
• StormMQ
http://stormmq.com/
• Rackspace Queues
http://www.rackspace.com/cloud/queues/
• Windows Azure Service Bus
http://www.windowsazure.com/en-us/services/messaging/

15. PHP Implementation
• php-amqplib - pure php client
https://github.com/videlalvaro/php-amqplib
• PECL AMQP library - built on RabbitMQ C client
http://pecl.php.net/package/amqp
• amqphp - pure php client
https://github.com/BraveSirRobin/amqphp
• Thumper - library of messaging patterns
https://github.com/videlalvaro/Thumper

16. Hello MQ World - send

17. Hello MQ World - receive

18. Hello MQ World
queue_declare

19. Hello MQ World
basic_publish & basic_consume

20. Work Queues / Task Queues
• Avoid doing a resource-intensive task immediately
• Schedule the task to be done later
• Encapsulate a task as a message and send it to a
queue
• A worker process running in the background will
execute the job
• Multiple workers will share tasks

21. Work Queues - new_task

22. Work Queues - worker

23. Publish/Subscribe
• Task queues: task is delivered to exactly one worker
• Pub/Sub: deliver a message to multiple consumers
• Published messages are going to be broadcast to all
the receivers
• Fanout exchanges

24. Pub/Sub - emit_log

25. Pub/Sub - receive_logs

26. Routing
• Fanout => Direct exchange
• Subscribe only to a subset of the messages
• Filter messages based on their routing key

27. Routing - emit_log_direct

28. Routing - receive_logs_direct

29. Topics
• Direct exchanges cannot do routing based on multiple criteria
• Example: how to combine “severity” and “resource”
• Topic exchange: messages are sent with a routing key
composed by a list of words, delimited by dots
• * (star) can substitute for exactly one word
• # (hash) can substitute for zero or more words

30. Topics - emit_log_topic

31. Topics - receive_logs_topic

32. RPC
• Work Queues = distribute time-consuming tasks
among multiple workers
• Remote Procedure Call or RPC = run a function on a
remote computer and wait for the result

33. RPC - rpc_client 1/2

34. RPC - rpc_client 2/2

35. RPC - rpc_server

36. • Work Queues
• Publish/Subscribe
• Routing
• Topics
• Remote Procedure Call (RPC)

37. RabbitMqBundle
• Fast and Easy to use RabbitMQ with Symfony2
• Use php-amqplib library
• Provide messaging pattern (similar to Thumper)

38. RabbitMqBundle - Setup

39. RabbitMqBundle - Config

40. RabbitMqBundle
• Producer / Consumer
• Callback
• RPC
• Parallel RPC
• Anonymous Consumer
• STDIN Producer

41. Resources
• http://www.rabbitmq.com/getstarted.html
• http://www.rabbitmq.com/how.html
• RabbitMQ - AMQP concepts
• RedHat - Messaging tutorial
• http://www.slideshare.net/old_sound/theres-a-rabbit-on-my-symfony
• http://www.slideshare.net/jasonlotito/php-rabbitmq-and-you
• https://github.com/videlalvaro/rabbitmqbundle
• http://reddikh.com/rabbitmq-bundle-in-symfony2/
• http://techportal.inviqa.com/2013/11/18/let-rabbitmq-do-the-work-in-your-
symfony2-application/

42. Books
• RabbitMQ in Action
http://manning.com/videla/
• RabbitMQ Cookbook
http://www.packtpub.com/
rabbitmq-cookbook/book

43. Thank you!
eric@data.be - @wavyx
be.linkedin.com/in/erodriguez - github.com/wavyx
http://www.meetup.com/Symfony-User-Group-Belgium/