Gearman, Supervisor and PHP - Job Management with Sanity!

Supervisor, Gearman and PHP - Jobmanagement with sanity! ABU ASHRAF MASNUN

What is it all about? PHP GearmanSupervisor Job Management

Let’s get REAL! Deploy Ninja – A case study PROPOSED FEATURES Deployment Solution (SVN to s/FTP) Trigger URL – Web Hooks Deploy Now – Deploy the latest right now Full Deploy – Upload the entire repo again

How to train our Ninja? What did we have to do? REQUIREMENTS Tasks Involved:  Fetch the repo  Upload to the server Instant processing Process separation for the three deploymenttypes

And cometh the tragedy! The day my life sucked !^@#  ARCHITECTURAL CHALLENGES Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.

Gearman, the super hero! He came and saved my a$$  GEARMAN FEATURES Distributed workload management Client – Worker Architecture Multiple workers Multi-lingual workers

Gearman: How it works? Understanding Gearman

Gearman: Installation Are you ready? QR CodeInstall Gearman: sudo apt-get install gearmanInstall Libgearman: sudo apt-get install libgearman-devInstall the PHP Extension: sudo pecl install channel://pecl.php.net/gearman-0.8.0

Gearman: Daemonizing! Starting Gearman QR CodeRunning GearmanDaemon: sudo gearman –d –u rootDebugging Gearman (Verbose mode) : sudo gearman –d -vvv –u root

QR CodeGearman: Workers PHP Worker

QR CodeGearman: Workers Breaking it down!

QR CodeGearman: Clients Requesting a job!

Gearman: Alternatives! Who else is there? RabbitMQ ZeroMQ Apache MQ Dropr Microsoft MQ

Whew! Almost done! Life is getting better CHALLENGES STATUS Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.

Meet Supervisor! Here comes the tough guy! SUPERVISOR FEATURES Simple & Centralized Efficient & Extensible Compatible & ProvenIt monitors your processes and restarts asinstructed!

Supervisor: Installation! Let’s go! QR Codesudo apt-get install python-setuptools sudo easy_install supervisor

Supervisor: Getting Started! Config, debug and run! QR Codesudo echo_supervisord_conf > /etc/supervisord.conf sudo supervisord -n sudo supervisord

Hurray! We’re done! Life is so good :D CHALLENGES STATUS Instant processing requires “Daemons” PHP was not built for long running processes! Premature termination & Zombie processes. Monitoring the processes. Restarting the processes when terminated.

What’s your Story? You can do it too! USE CASES Image Processing? Cache Regeneration? Mass emails?

That was Simple! Eh? Got anything to ask?

The Leevian! Who am I? ABU ASHRAF MASNUN Software Engineer @ Leeviohttp://masnun.commasnun@leevio.com

Gearman, Supervisor and PHP - Job Management with Sanity!

by Abu Masnun on Dec 19, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 108

Statistics

Gearman, Supervisor and PHP - Job Management with Sanity! — Presentation Transcript