Search as a Service with Xapian - Search Solutions 2009

617 views
564 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
617
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Search as a Service with Xapian - Search Solutions 2009

  1. 1. This page intentionally left somewhat blank
  2. 2. Search as a service with Xapian Richard Boulton
  3. 3. ?
  4. 4. “Every six months, a dozen web developers go to an easily defensible location, without the internet, and build a website” – James Aylett /dev/fort
  5. 5. wildlifenearyou.com
  6. 6. Async, out-of-process, scalable HTTP/JSON http://server/dbname/add http://server/dbname/delete http://server/dbname/search Djape
  7. 7. Throw one away!
  8. 8. Back to work... ● “Flax” ● Rewrite from ground up ● Design a clean REST based protocol
  9. 9. Interfaces matter
  10. 10. Guardian offices, March 2009
  11. 11. PUT to /v1/dbs/dbname POST to /v1/dbs/dbname/schema/fields/text { 'type': 'text', 'freetext': {'language': 'en'} } } POST to /v1/dbs/dbname/docs { 'text': ['foo'] } (or PUT to /v1/dbs/dbname/docs/docid) Present the API so far
  12. 12. Present the API so far ● Don't throw this one away!
  13. 13. Yahoo Hackday 24 hours to make a site
  14. 14. Newspan – learning which news is interesting
  15. 15. Another gathering – more ideas and refinement
  16. 16. ● Separate search from indexer ● More modularity ● Easier ways to specify searches
  17. 17. What's next? ● Performance – rewrite in C++ ● Lower memory overhead ● Expose horizontal scaling features of Xapian ● Easier install – fewer dependencies ● Produce an AMI for Amazon cloud ● Run a fully open source hosted search.
  18. 18. What's next? ● Keep talking to developers and users, to be led by them!
  19. 19. Credits Richard Boulton richard@tartarus.org Andree Stephan: - http://upload.wikimedia.org/wikipedia/commons/thumb/d/d6/ Alderney_-_Fort_Clonque_02.jpg/800px-Alderney_-_Fort_Clonque_02.jpg Ted Drake: - http://www.flickr.com/photos/draket/3517960655/ Gruntzooki: - http://farm4.static.flickr.com/3044/2710669746_c973e8b766.jpg

×