This document discusses using Gearman, PHP, and Supervisor together for job management. Gearman is a job queue and processing system that allows distributing work across multiple machines. It was used to build a deployment solution that processes tasks instantly across daemons. While PHP is not suited for long-running processes, Gearman and Supervisor address this by running PHP workers as daemons and restarting any terminated processes. This combination of tools provided an instant and scalable solution for deployment tasks like fetching code repositories and uploading files to servers.

1. Supervisor, Gearman and PHP - Job
management with sanity!
ABU ASHRAF MASNUN

2. What is it all about?
 PHP
 Gearman
Supervisor
 Job Management

3. Let’s get REAL!
Deploy Ninja – A case study
PROPOSED FEATURES
 Deployment Solution (SVN to s/FTP)
 Trigger URL – Web Hooks
 Deploy Now – Deploy the latest right now
 Full Deploy – Upload the entire repo again

4. How to train our Ninja?
What did we have to do?
REQUIREMENTS
 Tasks Involved:
 Fetch the repo
 Upload to the server
 Instant processing
 Process separation for the three deployment
types

5. And cometh the tragedy!
The day my life sucked !^@# 
ARCHITECTURAL CHALLENGES
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

6. Gearman, the super hero!
He came and saved my a$$ 
GEARMAN FEATURES
 Distributed workload management
 Client – Worker Architecture
 Multiple workers
 Multi-lingual workers

7. Gearman: How it works?
Understanding Gearman

8. Gearman: Installation
Are you ready? QR Code
Install Gearman:
sudo apt-get install gearman
Install Libgearman:
sudo apt-get install libgearman-dev
Install the PHP Extension:
sudo pecl install
channel://pecl.php.net/gearman-0.8.0

9. Gearman: Daemonizing!
Starting Gearman QR Code
Running Gearman
Daemon: sudo gearman –d –u root
Debugging Gearman (Verbose mode) :
sudo gearman –d -vvv –u root

10. QR Code
Gearman: Workers
PHP Worker

11. QR Code
Gearman: Workers
Breaking it down!

12. QR Code
Gearman: Workers
Breaking it down!

13. QR Code
Gearman: Clients
Requesting a job!

14. Gearman: Alternatives!
Who else is there?
 RabbitMQ
 ZeroMQ
 Apache MQ
 Dropr
 Microsoft MQ

15. Whew! Almost done!
Life is getting better
CHALLENGES STATUS
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

16. Meet Supervisor!
Here comes the tough guy!
SUPERVISOR FEATURES
 Simple & Centralized
 Efficient & Extensible
 Compatible & Proven
It monitors your processes and restarts as
instructed!

17. Supervisor: Installation!
Let’s go! QR Code
sudo apt-get install python-setuptools
sudo easy_install supervisor

18. Supervisor: Getting Started!
Config, debug and run! QR Code
sudo echo_supervisord_conf >
/etc/supervisord.conf
sudo supervisord -n
sudo supervisord

19. Hurray! We’re done!
Life is so good :D
CHALLENGES STATUS
 Instant processing requires “Daemons”
 PHP was not built for long running processes!
 Premature termination & Zombie processes.
 Monitoring the processes.
 Restarting the processes when terminated.

20. What’s your Story?
You can do it too!
USE CASES
 Image Processing?
 Cache Regeneration?
 Mass emails?

21. That was Simple! Eh?
Got anything to ask?

22. The Leevian!
Who am I?
ABU ASHRAF MASNUN
Software Engineer @ Leevio
http://masnun.com
masnun@leevio.com