Parse.ly: Inside a modern RIA built with Solr

1,464 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,464
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Parse.ly: Inside a modern RIA built with Solr

  1. 1. Inside a modern RIA powered by Solr Andrew Montalenti Co-Founder & Technology Lead andrew@cogtree.com 1
  2. 2. 2
  3. 3. Mainstream 30,000 Blogs 1 900,000 1From Technorati’s 2008 State of the Blogosphere 3
  4. 4. But, What about your interests? 4
  5. 5. your interests, your web 5
  6. 6. 6
  7. 7. What is ? • Your unique interests • … create a filtered, prioritized, and personalized news feed • … built just for you! • 120K+ news and blog sources tracked • The most personally relevant items at the top • Bottom line: You spend less time skimming headlines, and more time reading relevant content. 7
  8. 8. Demo! (if possible)
  9. 9. Let’s pop open the hood! 9
  10. 10. The RIA ExtJS + jQuery JS REST Binding REST API django-piston Solr Postgres 10
  11. 11. 11
  12. 12. Per-Doc Processing Batch size IO-bound work 12
  13. 13. 13
  14. 14. Solr in the Real World • Storage of "canonical data“ • Relational vs. Search Index • Complexity of custom relevancy scoring • "Near-Real-Time" updates • Solr in a pipeline • Pushing bits and marshalling cost • Index size, corruption, and stability • Administrability 14
  15. 15. Scaling Up Parse.ly • Custom scoring • Multicore • Distributed search • Celery / Disco • User-Article Binding Problem 16
  16. 16. 17
  17. 17. Basic Almost There Comprehensive solr.py collective.solr haystack pysolr solrpy solango python-solr json/py output 18
  18. 18. 19
  19. 19. Batching Context Lib Caching Memoization Multicore Proxies Comprehensive. Pythonic. Solr. Web Pagination Iterators Framework Django 20
  20. 20. powered by 21
  21. 21. Didier Sachin Andrew 22
  22. 22. Quick Plug Does your company or enterprise need our services? 23
  23. 23. 24 24
  24. 24. Andrew Montalenti andrew@cogtree.com Twitter Website Sign up now! @amontalenti http://parse.ly It’s Free! Product Twitter Team Blog Promo Code @parse_ly http://blog.cogtree.com SLIDES 25 25

×