Asynchronous processing with PHP and Symfony2. Do it simple
•
14 likes•15,907 views
The presentation for Symfony Camp UA 2013 about asynchronous processing. We will talk about a near real-time processing of a business logic which does not require synchronous actions. How to do it fast. How to do it simple. And how to do not ask PHP to struggle through alone. We will analyze our experience, bad decisions and will try to get Zen of simplicity.
Recommended
Recommended
More Related Content
What's hot
What's hot (17)
Viewers also liked
Viewers also liked (20)
Similar to Asynchronous processing with PHP and Symfony2. Do it simple
Similar to Asynchronous processing with PHP and Symfony2. Do it simple (20)
More from Kirill Chebunin
More from Kirill Chebunin (6)
Recently uploaded
Recently uploaded (20)
Asynchronous processing with PHP and Symfony2. Do it simple
- 1. Asynchronous processing with PHP and Symfony2 Do it simple Kirill chEbba Chebunin
- 2. Overview. The Problem REQUEST RESPONSE Expected Response Complete Logic Kirill chEbba Chebunin
- 3. Overview. Examples • Data transfer and manipulation ! • File upload! • Video conversion! • Massive business logic ! • Billing! • Social! • 3rd-party communication! • API calls ! • Notifications Kirill chEbba Chebunin
- 4. Overview. The Solution REQUEST RESPONSE Required Logic Remaining Logic Kirill chEbba Chebunin
- 5. Experience. The Real Project http://hopeliesat24framespersecond.files.wordpress.com/2011/12/love_actually_movie_image_bill_nighy_01.jpg Kirill chEbba Chebunin
- 6. Experience. Billing Partners Billing Aggregator Service Providers Kirill chEbba Chebunin
- 7. Experience. Billing. 2012 Worker Worker Worker Worker Master Worker Worker Kirill chEbba Chebunin
- 8. Experience. Billing. Revolution Made b y Vasily coyl Ku lakov http://darkroom.baltimoresun.com/wp-content/uploads/2012/05/REU-CUBA-MAYDAY-1.jpg Kirill chEbba Chebunin
- 9. Theory http://marketmybook.in/wp-content/uploads/2013/05/Library-Books.jpg Kirill chEbba Chebunin
- 11. Theory. Master-Worker. Conclusions • Process control! • Resources in workers! • Long living workers! • Memory control! • Signal support Kirill chEbba Chebunin
- 12. Theory. RabbitMQ http://www.rabbitmq.com/img/tutorials/intro/hello-world-example-routing.png Kirill chEbba Chebunin
- 13. RabbitMQ • 1 exchange => multiple queries = topic! • Query = Worker type! • Durable exchanges/queries! • Persistent messages! • autoAck=false Kirill chEbba Chebunin
- 14. Experience. Billing. Review http://bi.gazeta.pl/im/84/96/d8/z14194308Q,Najglupsze-pomysly-mistrzow-prowizorki.jpg Kirill chEbba Chebunin
- 15. New world. Master • Master process => supervisor! • Start workers! • Worker count! • Signaled shutdown! • Auto-restart on failure! • Memory control! • …………. Kirill chEbba Chebunin
- 16. New world. Supervisor Example config ! [program:billing_statistics] process_name=%(program_name)s_%(process_num)d numprocs=4 stdout_logfile=/var/log/supervisor/%(program_name)s.out.log stderr_logfile=/var/log/supervisor/%(program_name)s.error.log command=billing rabbitmq:consumer statistics autorestart=true autostart=true Kirill chEbba Chebunin
- 17. New world. Publish/Subscribe • oldsound/rabbitmq-bundle! • Exchange/Queue setup! • Producers! • Consumers! • Command = worker! • Events! • Special event name! • Producer Listener Kirill chEbba Chebunin
- 18. Experience. Billing. 2013 Worker Worker Worker Worker Worker Worker Supervisor Kirill chEbba Chebunin
- 20. Future. Publish/Subscribe. Improve! • Send any event to async processing! • Use listeners as workers! • Different message bus Kirill chEbba Chebunin
- 25. EventBand. Architecture • Dispatcher! • Band support! • Abstract Subscribers! • Adapters (Symfony, ZF, …)! • Transport! • Setup! • Publisher! • Storage! • Routing! • Consumer! • Adapters (RabbitMQ, ActiveMQ, Gearman, …) Kirill chEbba Chebunin
- 26. EventBand. Utilities • Event Serialization! • Native! • JMS! • Event Routing! • By name! • By properties (PropertyAccess) Kirill chEbba Chebunin
- 27. EventBand. Example. Code Dispatch: ! $dispatcher->dispatch('foo.bar', new FooEvent($foo, $bar)); ! ………………………………………………………… ! Subscribe: ! public function logFooBar(FooEvent $event) { $this->service->saveLog($event->getFoo(), $event->getBar()); } ! ! <service id="log_subscriber" class="FooBarLogSubscriber"> <tag name="kernel.event_subscriber" band=“foo.bar.log" /> </service> Kirill chEbba Chebunin
- 28. EventBand. Example. Config transports: amqp: driver: amqplib connections: default: ~ exchanges: foo: ~ queues: foo.bar.log: bind: foo: "foo.bar" ! publishers: foo: events: "foo.#" ! consumers: foo.bar.log: ~ Kirill chEbba Chebunin
- 29. EventBand. Wanna Play? https://packagist.org/packages/event-band/ Kirill chEbba Chebunin
- 30. Experience. Patterns • Identified Event! • id, time, sequence, process! • logging (sqlite)! • Delayed Event! • original event, delay! • delay time => queue! • ordered queue! • sleep until delay Kirill chEbba Chebunin
- 31. Experience. Troubleshooting • Doctrine! • SqlLogger! • Unit of Work! • flush, detach! • Array properties Kirill chEbba Chebunin
- 32. Questions? Cool Image with Cats and Boobs Kirill chEbba Chebunin iam@chebba.org https://github.com/chEbba https://twitter.com/iamchEbba Kirill chEbba Chebunin
Editor's Notes
- {}