Build your Own Search Service




      Fred Meng
Yahoo! Search Engineer
Outlines
•  Search engines using BOSS
•  Big milestones for BOSS
•  What else can be built with BOSS
•  BOSS API
   –  Wha...
Search engines using
middlespot - http://middlespot.com
hakia - http://hakia.com
hakia - http://hakia.com
hakia - http://hakia.com
Tartin3 - http://www.tartin3.com

             Vertical/niche search products
askBoss - http://ask-boss.appspot.com
askBoss - http://ask-boss.appspot.com
askBoss - http://ask-boss.appspot.com
askBoss - http://ask-boss.appspot.com
OneRiot - http://www.oneriot.com

                New ranking models
tweetnews - http://tweetnews.appspot.com

                New ranking models
spysee - http://spysee.com/
TechCrunch - http://search.techcrunch.com
TechCrunch - http://search.techcrunch.com
Big Milestone for
Big Milestone for BOSS


  • 10 million queries per day in Dec 2009 = 300 million
  monthly queries
     source: http://ww...
Big Milestone for BOSS
What else can be built with
Get the pic - http://www.getthepicsure.com
Get the pic - http://www.getthepicsure.com
Get the pic - http://www.getthepicsure.com
What can be built with the BOSS API?

    Client / Browser integrations
What can be built with the BOSS API?

            Client / Browser integrations
What can be built with the BOSS API?

            Client / Browser integrations
About   APIs
Reality of Search: Huge Barriers of Entry



 •  Three players (G-Y-M) dominate the market, giving
    users limited choic...
Reality of Search: Huge Barriers of Entry
What?


•  Open up Yahoo!'s search infrastructure and enable
   third parties to build revolutionary search products.

•  ...
Opening Yahoo! Search Tech




             All crawled, ranked
             and presented in a
                  single A...
Why?


•  Removes entry barriers
  –  massive capital investment

•  Asset to innovate
  –  New relevancy models
  –  New ...
BOSS API Features
•    Ability to re-rank results
•    Blend results/content sources
•    Ability to use any monetization ...
How to use
Getting Started with BOSS

  1)  Info & Docs: http://developer.yahoo.com/boss
  2)  Register for an BOSS App ID (free)
  3...
API Structure

  The Basics:
  http://boss.yahooapis.com/ysearch/{vert}/v1/{query}?
     appid={BOSSappid}&format=xml

  •...
API Structure

  Optional Parameters:
  http://boss.yahooapis.com/ysearch/{vert}/v1/{query}?
      appid={BOSSappid}&forma...
BOSS API: Web XML Response

  http://boss.yahooapis.com/ysearch/web/v1/iphone?appid=…
      &format=xml&lang=tzh&region=tw
BOSS API: Find related keywords

  http://boss.yahooapis.com/ysearch/web/v1/ ?appid=…
      &format=xml&lang=tzh&region=tw...
API Structure: Images

  Optional Parameters for Images:
  http://boss.yahooapis.com/ysearch/images/v1/iphone?
      appid...
BOSS API: Images XML Response

  http://boss.yahooapis.com/ysearch/images/v1/iphone?appid=…
      &format=xml&dimensions=s...
API Structure: News

  Optional Parameters for News:
  http://boss.yahooapis.com/ysearch/news/v1/ ?
      appid={BOSSappid...
BOSS API: News XML Response

  http://boss.yahooapis.com/ysearch/news/v1/ ?appid=…
      &format=xml&lang=tzh&region=tw&ag...
BOSS API: Spell Check

  http://boss.yahooapis.com/ysearch/spelling/v1/taipai?appid=…
      &format=xml
BOSS Mashup framework

  An experimental Python library which
   provides SQL-like functions for mashing
   up the BOSS AP...
BOSS Mashup framework

  Simple code example:
BOSS Mashup framework

  Output:
BMF+GAE

  Enhanced version of BOSS Mashup
   Framework to Google App Engine:

   http://zooie.wordpress.com/2008/08/04/ya...
Thanks




         Questions / Feedback?
Upcoming SlideShare
Loading in...5
×

Y Boss External 20091017

2,660

Published on

search 自己做主,可以自己餵資料,自己決定rank.

1 Comment
0 Likes
Statistics
Notes
  • hhhhhhhhhhhhhhhh
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Views
Total Views
2,660
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide

Y Boss External 20091017

  1. 1. Build your Own Search Service Fred Meng Yahoo! Search Engineer
  2. 2. Outlines •  Search engines using BOSS •  Big milestones for BOSS •  What else can be built with BOSS •  BOSS API –  What –  Why –  Features •  How to use it –  BOSS API –  BOSS Mashup framework
  3. 3. Search engines using
  4. 4. middlespot - http://middlespot.com
  5. 5. hakia - http://hakia.com
  6. 6. hakia - http://hakia.com
  7. 7. hakia - http://hakia.com
  8. 8. Tartin3 - http://www.tartin3.com Vertical/niche search products
  9. 9. askBoss - http://ask-boss.appspot.com
  10. 10. askBoss - http://ask-boss.appspot.com
  11. 11. askBoss - http://ask-boss.appspot.com
  12. 12. askBoss - http://ask-boss.appspot.com
  13. 13. OneRiot - http://www.oneriot.com New ranking models
  14. 14. tweetnews - http://tweetnews.appspot.com New ranking models
  15. 15. spysee - http://spysee.com/
  16. 16. TechCrunch - http://search.techcrunch.com
  17. 17. TechCrunch - http://search.techcrunch.com
  18. 18. Big Milestone for
  19. 19. Big Milestone for BOSS • 10 million queries per day in Dec 2009 = 300 million monthly queries source: http://www.ysearchblog.com/2008/12/08/boss-reaches-a- milestone/ • 1 billion monthly queries in May 2009 source: http://www.ysearchblog.com/2008/12/08/boss-reaches-a- milestone/
  20. 20. Big Milestone for BOSS
  21. 21. What else can be built with
  22. 22. Get the pic - http://www.getthepicsure.com
  23. 23. Get the pic - http://www.getthepicsure.com
  24. 24. Get the pic - http://www.getthepicsure.com
  25. 25. What can be built with the BOSS API? Client / Browser integrations
  26. 26. What can be built with the BOSS API? Client / Browser integrations
  27. 27. What can be built with the BOSS API? Client / Browser integrations
  28. 28. About APIs
  29. 29. Reality of Search: Huge Barriers of Entry •  Three players (G-Y-M) dominate the market, giving users limited choice •  Becoming a serious Search principal requires a massive capital investment and access to top technical talent
  30. 30. Reality of Search: Huge Barriers of Entry
  31. 31. What? •  Open up Yahoo!'s search infrastructure and enable third parties to build revolutionary search products. •  Unrestricted! •  http://developer.yahoo.com/search/boss All crawled, ranked and presented in a single API
  32. 32. Opening Yahoo! Search Tech All crawled, ranked and presented in a single API
  33. 33. Why? •  Removes entry barriers –  massive capital investment •  Asset to innovate –  New relevancy models –  New presentation styles •  Boom the search market –  Fragment the market, foster more players, choices, competitions
  34. 34. BOSS API Features •  Ability to re-rank results •  Blend results/content sources •  Ability to use any monetization platform •  Present results in any way •  No branding or attribution •  Unlimited queries per day* <BOSS Usage Fees> •  Access to multiple verticals (web search, image, news) •  Spell checks, keyword suggestions (Key Terms) •  40+ supported language and region pairs •  SearchMonkey Structured Data, Delicious data •  Page data from Site Explorer •  Expanded Abstracts: 170 characters to 300! •  Mashup Framework
  35. 35. How to use
  36. 36. Getting Started with BOSS 1)  Info & Docs: http://developer.yahoo.com/boss 2)  Register for an BOSS App ID (free) 3)  Code samples: Javascript, PHP and Python http://www.saurabhsahni.com/boss-examples.zip 4)  Join the BOSS Developer Group http://tech.groups.yahoo.com/group/ysearchboss/ 5)  Starting your hacks
  37. 37. API Structure The Basics: http://boss.yahooapis.com/ysearch/{vert}/v1/{query}? appid={BOSSappid}&format=xml •  {vert} = {web, news, images, spelling} •  {query} = {your search term} •  {appid} = required application id •  {format} = json is the default
  38. 38. API Structure Optional Parameters: http://boss.yahooapis.com/ysearch/{vert}/v1/{query}? appid={BOSSappid}&format=xml&optionalparameter={value} •  lang = {value} : 40+ languages •  count = {value} : number of results request •  start = {value} : first result requested •  sites = {value} : site restricts •  view=keyterms : related words/phrases for each result •  view = searchmonkey_rdf : SearchMonkey structured data •  view = delicious_toptags : most common public tags •  view = delicious_saves : # of delicious saves •  filter = porn / hate : filter out porn or hate-related content •  type = {value} : document format (e.g. word, pdf, etc) •  abstract = long : increases abstract length to 300 words
  39. 39. BOSS API: Web XML Response http://boss.yahooapis.com/ysearch/web/v1/iphone?appid=… &format=xml&lang=tzh&region=tw
  40. 40. BOSS API: Find related keywords http://boss.yahooapis.com/ysearch/web/v1/ ?appid=… &format=xml&lang=tzh&region=tw&age=1d-7d&view=keyterms
  41. 41. API Structure: Images Optional Parameters for Images: http://boss.yahooapis.com/ysearch/images/v1/iphone? appid={BOSSappid}&format=xml&optionalparameter={value} •  dimensions = {value}: all (default), small, medium, large, wallpaper, widewallpaper •  refererurl = {value}: URL, no default. Search for this URL. Depending on other query restrictions, returns all image objects with this referring URL. •  url = {value}: URL, no default. Search for this URL. Returns this exact image result.
  42. 42. BOSS API: Images XML Response http://boss.yahooapis.com/ysearch/images/v1/iphone?appid=… &format=xml&dimensions=small
  43. 43. API Structure: News Optional Parameters for News: http://boss.yahooapis.com/ysearch/news/v1/ ? appid={BOSSappid}&format=xml&optionalparameter={value} •  age = {value}: 7d is the default. (30d, 1w, 12h, 5d-10d, 2w-30d) •  orderby = {value}: relevance is the default. (add orderby=date to sort by date)
  44. 44. BOSS API: News XML Response http://boss.yahooapis.com/ysearch/news/v1/ ?appid=… &format=xml&lang=tzh&region=tw&age=1d-7d
  45. 45. BOSS API: Spell Check http://boss.yahooapis.com/ysearch/spelling/v1/taipai?appid=… &format=xml
  46. 46. BOSS Mashup framework An experimental Python library which provides SQL-like functions for mashing up the BOSS API with third-party data sources. http://developer.yahoo.com/search/boss/ mashup.html
  47. 47. BOSS Mashup framework Simple code example:
  48. 48. BOSS Mashup framework Output:
  49. 49. BMF+GAE Enhanced version of BOSS Mashup Framework to Google App Engine: http://zooie.wordpress.com/2008/08/04/yahoo-boss- google-app-engine-integrated/ Enables quick deployment of BOSS applications online
  50. 50. Thanks Questions / Feedback?
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×