Downloaded 14 times
Uploaded byRuben Tan
Leveraging zeromq for node.js
The document discusses ZeroMQ, a lightweight networking library with message queue semantics, highlighting its functionalities, socket types, and use cases primarily for connecting services. It features code examples showcasing different ZeroMQ socket patterns and discusses building a simple HTTP server on top of Express using worker processes. The conclusion emphasizes the importance of understanding ZeroMQ for building messaging topologies and its compatibility with various programming languages and tech stacks.
More Related Content
Similar to Leveraging zeromq for node.js
Leveraging zeromq for node.js
- 1.
- 2. Leveraging ZeroMQ for Node.js Another tool in your toolbox
- 3. About Me •Ruben Tan • @roguejs (twitter) • Works in GrabTaxi (Malaysia) github.com/soggie/naws
- 5. ZeroMQ • “zero”as in none, nada, nil, 無 • MQ as in Message Queue
- 6. Why call ZeroMQas so when it is not a message queue?
- 7. I know. Wrongmeme. Shhh.
- 8. • Originally conceivedas a stock trading messaging solution • Moved on to generalizing its purpose • Adopted BSD Socket API and semantics • Smart end-point, dump network
- 9. • ZeroMQ isa networking library with message queue semantics • Used primarily for connectivity between services • Can be used to facilitate brokerless message passing topologies
- 10. Crash Course! •Socket basics • Buffering (high watermark) • Load balancing (outgoing/incoming strategy) • PUSH socket • PULL socket • PUB socket • SUB socket • We won’t cover: REQ-REP, XPUB-XSUB, ROUTER-DEALER, STREAM, PAIR, as well as DEVICES
- 11. 0MQ Sockets •Supports: • inproc, IPC, TCP, pgm, epgm • Maintains it’s own internal queue • High watermark controls buffer size • Has a MUTE strategy • Has different INCOMING and OUTGOING strategies
- 12. MUTE • Connectionstates: • connect() ==> READY • bind() ==> MUTE • accept() ==> READY • 2 kinds of MUTE state: block or drop
- 13.
- 14.
- 15. Exhibit A -REQ-REP https://github.com/soggie/naws/tree/master/test/talk/exhibit-a.js
- 16. // Bind theREP socket reply.bind('inproc://exhibit-a'); // Make the REQ socket connect to the REP socket request.connect('inproc://exhibit-a'); request.on('message', function (msg) { console.log('---- recv: ' + msg.toString()); }); reply.on('message', function (msg) { console.log('-- recv: ' + msg.toString()); work(); // Some heavy duty work reply.send(msg); console.log('--- send: ' + msg.toString()); }); setInterval(function () { var msg = color(ran(1000, 1000) + ''); console.log('- send: ' + msg); request.send(msg); }, 1000);
- 17. PUSH • INCOMING: none • OUTGOING: round-robin • MUTE: blocks PPUUSSHH 1 2 3 4 5 6 AA BB CC
- 18.
- 19. PULL AA BBCC 1 2 3 • INCOMING fair-queue • OUTGOING none • MUTE block (??) PPUULLLL 4 5 6
- 20.
- 21. PUB • INCOMING none • OUTGOING fan-out • MUTE drop PPUUBB 1 1 1 2 2 2 AA BB CC
- 22.
- 23. SUB PP PPPP 1 2 3 • INCOMING fair-queue • OUTGOING none • MUTE none SSUUBB 4 5 6
- 24.
- 25.
- 26. • A simpleHTTP web server on top of express • Uses worker processes to handle requests • Can add or kill workers any time • Rudimentary monitoring and reliability
- 27. Architecture SSUUBB PPUUBB RR EExxpprreessss PPUUSSHH 5 HHaannddlleerr PPUULLLL 1 2 3 4 6 8 7 Server Process Worker Process
- 28. Conclusion • zeromqis a lightweight networking library • build messaging topologies you want • nice async features enabling you to do fun stuff (add/kill workers) • use to connect apps written in different languages/tech stacks • a very useful tool to have and understand
- 29. Similar & References • Nanomsg (http://nanomsg.org) - Martin Sustrik, fork/rewrite of 0mq • Axon (https://github.com/visionmedia/axon) - Pure node.js 0mq sockets • Theory of ZeroMQ http://250bpm.com/concepts • ZeroMQ Internal Architecture http://www.aosabook.org/en/zeromq.html • Dissecting Message Queues http://www.bravenewgeek.com/dissecting-message-queues/
- 30. THE END Questions? Questions?