The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
•Download as PPTX, PDF•
4 likes•7,255 views
Michael Laing New York Times - Systems Architect Tuesday, Oct 20th 10:30 am - Back-End Dev
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
Similar to The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka (20)
More from All Things Open
More from All Things Open (20)
Recently uploaded
Recently uploaded (20)
The Current Messaging Landscape: RabbitMQ, ZeroMQ, nsq, Kafka
- 2. Michael Laing Architect, Edge Engineering New York Times michael.laing@nytimes.com
- 5. • nyt⨍aбrik (my project)
- 13. A Global Mesh with a Memory Millions of users Dozens of internal clients
- 19. • nyt⨍aбrik (my project)
- 23. by wmasterj and Fabrice TIERCELIN - Wikipedia
- 27. Messages
- 28. Async Scope
- 32. • nyt⨍aбrik (my project)
- 43. GW GW GW GW GW GW Region A Region B
- 49. Written in C
- 52. Push Pull snd rcv NSQ
- 53. NSQ
- 54. Push Pull snd rcv NSQ What if…
- 55. GW GW GW GW GW GW Region A Region B Then:
- 56. Region A Region B GW GW GW GW GW GW Becomes:
- 61. • nyt⨍aбrik (my project)
- 64. NSQ
- 69. Distributed Graphs at Scale with Cassandra and Titan ● Structured Knowledge Representation ● Index-free adjacency: Like memory pointers, but in disk ● Navigation between nodes in constant time. ● Graph != No schema
- 70. Michael Laing Architect, Edge Engineering (soon to include OLAP w Spark Streaming) New York Times michael.laing@nytimes.com
Editor's Notes
- Back to 1964
- Not me Nice shoes though GE 225 – 8KB
- Rethink Flatten Global Reliable Manageable
- Mesh Resilient Balancing
- Nodes w Roles Self organizing
- Messaging everywhere
- GLobal
- Messaging everywhere
- Header = Metadata: routing, timestamp, source
- Messaging everywhere
- Designed to fail fast
- Designed to fail fast
- Designed to fail fast
- Designed to fail fast
- Rethink Flatten Global Reliable Manageable
- Rethink Flatten Global Reliable Manageable
- Rethink Flatten Global Reliable Manageable
- Rethink Flatten Global Reliable Manageable
- Rethink Flatten Global Reliable Manageable
- This powers The New York Times Semantic Platform: mechanism for accessing all of our knowledge about our indexing concepts: people, places organizations and descriptors. This is an example of a more complex traversal. Let’s say we have a concept called Ebola Virus, and we want to retrieve all the ancestors of this concepts. That means all concepts that have a broader meaning than Ebola Virus. So in theory, we need to iterate through adjacent edges and vertices until we can’t find any other broader term.