(+ Loom (years 2))
•
0 likes•890 views
Loom is an open-source Clojure library that provides many graph algorithms and visualizations. Loom's graph API focuses on generality and simplicity of integration, which enables other graph representations to be ported to Loom. In this talk, we'll look at how Loom's API and graph implementations evolved in the past 2 years since being presented at Clojure/West 2014. We'll also discuss complexities of maintaining an open-source library.
More Related Content
More from Aysylu Greenberg
More from Aysylu Greenberg (20)
Recently uploaded
Recently uploaded (20)
(+ Loom (years 2))
- 7. Graphs
- 13. • Undirected Graph • Digraph • Weighted Graph • Mul2graph • FlyGraph • nodes + successors edges • successors + start nodes + edges Loom: Supported Graphs
- 16. • DFS/BFS (+ bidirec2onal) • Topological Sort • Shortest Path (Dijkstra, Bellman-Ford, A*, Johnson’s) Loom: Graph Algorithms
- 17. • DFS/BFS (+ bidirec2onal) • Topological Sort • Shortest Path (Dijkstra, Bellman-Ford, A*, Johnson’s) • Cliques & SCC (Bron-Kerbosch, Kosaraju) Loom: Graph Algorithms
- 18. • DFS/BFS (+ bidirec2onal) • Topological Sort • Shortest Path (Dijkstra, Bellman-Ford, A*, Johnson’s) • Cliques & SCC (Bron-Kerbosch, Kosaraju) • Density (edges/nodes) • Loner Nodes Loom: Graph Algorithms
- 19. • DFS/BFS (+ bidirec2onal) • Topological Sort • Shortest Path (Dijkstra, Bellman-Ford, A*, Johnson’s) • Cliques & SCC (Bron-Kerbosch, Kosaraju) • Density (edges/nodes) • Loner Nodes • Greedy & Two Coloring Loom: Graph Algorithms
- 20. • DFS/BFS (+ bidirec2onal) • Topological Sort • Shortest Path (Dijkstra, Bellman-Ford, A*, Johnson’s) • Cliques & SCC (Bron-Kerbosch, Kosaraju) • Density (edges/nodes) • Loner Nodes • Greedy & Two Coloring • Max-Flow & Min Span Tree Loom: Graph Algorithms
- 23. Loom & Friends • Ubergraph (github.com/Engelberg/ubergraph) Beyond Loom's protocols: • mixed graphs • mul2graphs • mul2ple weights per edge • changeable weights
- 28. Loom & Friends • Ubergraph (github.com/Engelberg/ubergraph) • Visualizing Loom graphs – Proto REPL Charts (github.com/jasongilman/proto-repl-charts) – Gorilla REPL (github.com/JonyEpsilon/loom-gorilla) • lein-voom • Clojure for Data Science
- 29. Loom & Friends • Ubergraph (github.com/Engelberg/ubergraph) • Visualizing Loom graphs – Proto REPL Charts (github.com/jasongilman/proto-repl-charts) – Gorilla REPL (github.com/JonyEpsilon/loom-gorilla) • lein-voom • Clojure for Data Science
- 30. Loom & Friends • Ubergraph (github.com/Engelberg/ubergraph) • Visualizing Loom graphs – Proto REPL Charts (github.com/jasongilman/proto-repl-charts) – Gorilla REPL (github.com/JonyEpsilon/loom-gorilla) • lein-voom • Clojure for Data Science • Research projects & produc2on workflows
- 34. Evolu2on of Loom: 2meline • 2010 – incep2on of Loom by Jus2n Kramer • 2013 – maintained by Aysylu Greenberg • 2013 – 2016 – talks on Loom 2013 2014 2015
- 35. Evolu2on of Loom: 2meline • 2010 – incep2on of Loom by Jus2n Kramer • 2013 – maintained by Aysylu Greenberg • 2013 – 2016 – talks on Loom • 2014 – ... (repeatedly #(swap! contributors inc))
- 36. Evolu2on of Loom: 2meline • 2010 – incep2on of Loom by Jus2n Kramer • 2013 – maintained by Aysylu Greenberg • 2013 – 2016 – talks on Loom • 2014 – ... (repeatedly #(swap! contributors inc)) • 2016 – maintenance led by Paul Snyder pataprogramming
- 37. Evolu2on of Loom: more algorithms • A* • pre-edge-traverse and post-edge-traverse • Bron-Kerbosch (maximal cliques) • Greedy coloring • DAG ancestry (+ genera2ve tes2ng!) • Bidirec2onal BFS • Prim’s minimum spanning tree • Dataflow analysis framework
- 38. Evolu2on of Loom: Performance • Algorithmic improvements • Memory usage improvements • Use of transients
- 39. Evolu2on of Loom: API • Separate protocol for EditableGraph • Support for mul2graphs • Protocol cleanup: par2al func2ons removal
- 40. Evolu2on of Loom: Tes2ng & more • Genera2ve tes2ng • loom.compliance-tester • Clojurescript support enabled and Clojure 1.7 • (inc dependencies): – org.clojure/data.priority-map for Prim’s MST • No longer require Clojure contrib
- 44. Maintaining Open Source Project: Pull Requests • Development 2me vs review of PRs • Quality vs quan2ty of contribu2ons • Consistency of codebase over 2me lein eastwood lein bikeshed
- 47. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI
- 48. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – Mailing list: groups.google.com/forum/#!forum/loom-clj
- 49. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – Mailing list: groups.google.com/forum/#!forum/loom-clj – Twiker: @loom_clj
- 50. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – Mailing list: groups.google.com/forum/#!forum/loom-clj – Twiker: @loom_clj
- 51. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – @loom_clj & loom-clj mailing list • Talks on design, structure and content
- 52. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – @loom_clj & loom-clj mailing list • Talks on design, structure and content
- 53. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – @loom_clj & loom-clj mailing list • Talks on design, structure and content • Backwards-compa2bility of releases
- 54. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – @loom_clj & loom-clj mailing list • Talks on design, structure and content • Backwards-compa2bility of releases • Language switch overhead
- 55. Maintaining Open Source Project: Beyond PRs • Releases via Clojars: clojars.org/aysylu/loom • API documenta2on via Codox: aysy.lu/loom/ • Con2nuous integra2on tests via Travis CI • News and announcements: – @loom_clj & loom-clj mailing list • Talks on design, structure and content • Backwards-compa2bility of releases • Language switch overhead • Balancing with other responsibili2es
- 56. References • N. Marz, “History of Apache Storm and lessons learned” !" • A. Bard, “Building a graph-powered sugges2on engine for redditlater with Loom” !" • Gorilla REPL for Loom worksheet !" • H. Garner, “Clojure for Data Science” ! • Images from Wikipedia
- 58. Thanks to Loom contributors • John Szakmeister • Robert Lachlan • Stephen Kocken2edt • Alex Engelberg • Kevin Downey • Aaron Brooks • Mark Engelberg • Daniel Shapero • Daniel Gregoire • Tom Hancock • Horst Duchêne • Ashton Kemerling • Jus2n Kramer • Jony Hudson • Guru Devanla • Joshua Davey • Sung Pae • François Rey • Georgi Shopov • Mak Revelle • Zack Maril • Daniel Compton • Reid D McKenzie • ZTO • Aysylu Greenberg • Paul Snyder