Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Search as a Service with Xapian - Search Solutions 2009

750 views

Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Search as a Service with Xapian - Search Solutions 2009

  1. 1. This page intentionally left somewhat blank
  2. 2. Search as a service with Xapian Richard Boulton
  3. 3. ?
  4. 4. “Every six months, a dozen web developers go to an easily defensible location, without the internet, and build a website” – James Aylett /dev/fort
  5. 5. wildlifenearyou.com
  6. 6. Async, out-of-process, scalable HTTP/JSON http://server/dbname/add http://server/dbname/delete http://server/dbname/search Djape
  7. 7. Throw one away!
  8. 8. Back to work... ● “Flax” ● Rewrite from ground up ● Design a clean REST based protocol
  9. 9. Interfaces matter
  10. 10. Guardian offices, March 2009
  11. 11. PUT to /v1/dbs/dbname POST to /v1/dbs/dbname/schema/fields/text { 'type': 'text', 'freetext': {'language': 'en'} } } POST to /v1/dbs/dbname/docs { 'text': ['foo'] } (or PUT to /v1/dbs/dbname/docs/docid) Present the API so far
  12. 12. Present the API so far ● Don't throw this one away!
  13. 13. Yahoo Hackday 24 hours to make a site
  14. 14. Newspan – learning which news is interesting
  15. 15. Another gathering – more ideas and refinement
  16. 16. ● Separate search from indexer ● More modularity ● Easier ways to specify searches
  17. 17. What's next? ● Performance – rewrite in C++ ● Lower memory overhead ● Expose horizontal scaling features of Xapian ● Easier install – fewer dependencies ● Produce an AMI for Amazon cloud ● Run a fully open source hosted search.
  18. 18. What's next? ● Keep talking to developers and users, to be led by them!
  19. 19. Credits Richard Boulton richard@tartarus.org Andree Stephan: - http://upload.wikimedia.org/wikipedia/commons/thumb/d/d6/ Alderney_-_Fort_Clonque_02.jpg/800px-Alderney_-_Fort_Clonque_02.jpg Ted Drake: - http://www.flickr.com/photos/draket/3517960655/ Gruntzooki: - http://farm4.static.flickr.com/3044/2710669746_c973e8b766.jpg

×