Download to read offline
Uploaded byLeonardo Borges
Realtime collaboration with Clojure - EuroClojure - Barcelona, 2015
The document presents a talk by Leonardo Borges on real-time collaboration using Clojure, discussing topics such as operational transformation, distributed systems, and various technologies like Vert.x, Akka, and Aleph. It covers challenges related to web server states, request handling, delivery guarantees, and fairness in messaging. The presentation concludes with future steps toward open-source real-time data synchronization services.
More Related Content
Similar to Realtime collaboration with Clojure - EuroClojure - Barcelona, 2015
Realtime collaboration with Clojure - EuroClojure - Barcelona, 2015
- 1. Realtime collaboration with Clojure EuroClojure- Barcelona, 2015 Leonardo Borges @leonardo_borges www.atlassian.com www.leonardoborges.com
- 2. About ‣ Clojure engineerat Atlassian ‣ Functional Programming Advocate ‣ Founder of the Sydney Clojure User Group
- 3. About ‣ Clojure engineerat Atlassian ‣ Functional Programming Advocate ‣ Founder of the Sydney Clojure User Group ‣ Author of “Clojure Reactive Programming”
- 5.
- 6.
- 7.
- 8. user user user user user DB user user user user web server loadbalancer state web server state web server state
- 9.
- 10.
- 11.
- 12. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona!
- 13. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) Hello BBarcelona!
- 14. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) (del 6) Hello BBarcelona! ello Barcelona!
- 15. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) (del 6) Hello BBarcelona! ello Barcelona!
- 16. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) (del 6) Hello BBarcelona! ello Barcelona! HelloBBarcelona! Hello Barcelona!
- 17. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) (del 6) Hello BBarcelona! ello Barcelona! (del 7)
- 18. Operational Transformation 101 elloBBarcelona! user server ello BBarcelona! (ins 0 “H”) (del 6) Hello BBarcelona! ello Barcelona! (del 7)Hello Barcelona! Hello Barcelona!
- 19. user user user user user DB user user user user web server loadbalancer state web server state web server state
- 20. Where do wesend requests to?
- 21. Where do wesend requests to? How do web nodes talk to each other?
- 22. Where do wesend requests to? How do web nodes talk to each other? What happens when web nodes come up and down?
- 23. Where do wesend requests to? How do web nodes talk to each other? What delivery guarantees are needed? What happens when web nodes come up and down?
- 24. Where do wesend requests to? How do web nodes talk to each other? What delivery guarantees are needed? What happens when web nodes come up and down? What ordering guarantees are needed?
- 25. Where do wesend requests to? How do web nodes talk to each other? What delivery guarantees are needed? What happens when web nodes come up and down? What ordering guarantees are needed?
- 26.
- 27.
- 28.
- 29.
- 30.
- 31. Actors -State -Location Transparency -“At leastonce” delivery semantics -Ordering guarantees
- 32. Actors -State -Location Transparency -“At leastonce” delivery semantics -Ordering guarantees
- 33. Actors -State -Location Transparency -“At leastonce” delivery and ordering guarantees
- 34. Akka and Pulsar -Akais awkward to use from Clojure -Clustering (in Pulsar) -JVM only -Fairness
- 35. Akka and Pulsar -Akais awkward to use from Clojure -Clustering (in Pulsar) -JVM only -Fairness
- 36. Akka and Pulsar -Akais awkward to use from Clojure -Clustering (in Pulsar) -JVM only -Fairness
- 37. Akka and Pulsar -Akais awkward to use from Clojure -Clustering (in Pulsar) -JVM only -Fairness
- 38. user web server stateentity Fairness user
- 39. useruser web server stateentityentity Fairness user user user user
- 40.
- 41. Options Summary Delivery OrderingFairness End-to-End Vert.x Akka / Pulsar Distributed core.async (custom code)
- 42. Right, so whatdid we end up doing?
- 43.
- 44.
- 45.
- 46.
- 47. Multiplexer Multiplexer endpoint endpoint web server state webserver state duplex channel duplex channel duplex channel duplex channel
- 48. web server state Multiplexer Multiplexer endpoint endpoint webserver state web server state duplex channel duplex channel duplex channel duplex channel
- 49. Multiplexer user load balancer web server state Multiplex web server state Multiplex webserver state Multiplex
- 50. Multiplexer user load balancer web server state Multiplex web server state Multiplex webserver state Multiplex
- 51. Multiplexer user load balancer web server state Multiplex web server state Multiplex webserver state Multiplex
- 52. Multiplexer user load balancer web server state Multiplex web server state Multiplex webserver state Multiplex
- 53. Multiplexer user load balancer web server state Multiplex web server state Multiplex webserver state Multiplex
- 54.
- 55. Aleph cluster -Client andServer network programming -Built on Netty and therefore asynchronous -Hazelcast for group membership
- 56. Aleph cluster -Client andServer network programming -Built on Netty (async #FTW) -Hazelcast for group membership
- 57. Aleph cluster -Client andServer network programming -Built on Netty (async #FTW) -Hazelcast for group membership
- 58. Aleph cluster +multiplexer -Distributed, end-to-end core.async channels -Message delivery and ordering guarantees -Fault tolerance -Fairness -Backpressure
- 59. Aleph cluster +multiplexer -Distributed, end-to-end core.async channels -Message delivery and ordering guarantees -Fault tolerance -Fairness -Backpressure
- 60. What’s next? CRDTs Production release Open-source Realtimedata synchronisation as a service
- 61. What’s next? CRDTs Production release Open-source Realtimedata synchronisation as a service
- 62. What’s next? CRDTs Production release Open-source Realtimedata synchronisation as a service
- 63. What’s next? CRDTs Production release Open-source Realtimedata synchronisation as a service
- 64. References Akka Pulsar Vert.x Aleph Jupiter OT algorithm ConsistentHashing Ring CRDTs in Riak akka.io bit.ly/actors-pulsar vertx.io/ aleph.io/ bit.ly/jupiterOT bit.ly/HashingRing bit.ly/CRDTRiak
- 65.