BOSS: HackU IIT Bombay
Upcoming SlideShare
Loading in...5
×
 

BOSS: HackU IIT Bombay

on

  • 3,756 views

An introduction to BOSS API

An introduction to BOSS API

Statistics

Views

Total Views
3,756
Views on SlideShare
3,756
Embed Views
0

Actions

Likes
1
Downloads
36
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

BOSS: HackU IIT Bombay BOSS: HackU IIT Bombay Presentation Transcript

  • Build your Own Search Service Chris Heilmann Saurabh Sahni HackU: IIT Bombay 5th Feb’ 2009
  • Outline •  Search engines using BOSS •  About BOSS API –  What? –  Why? –  Features •  How to use it –  BOSS API –  BOSS Mashup framework -2-
  • Search engines using BOSS -3-
  • hakia: http://hakia.com/ -4-
  • hakia: http://hakia.com/ -5-
  • hakia: http://hakia.com/ -6-
  • Cluuz: http://cluuz.com -7-
  • Cluuz: http://cluuz.com -8-
  • Cluuz: http://cluuz.com -9-
  • Keyword finder - http://keywordfinder.org/ - 10 -
  • askBOSS: http://ask-boss.appspot.com/ - 11 -
  • askBOSS: http://ask-boss.appspot.com/ - 12 -
  • askBOSS: http://ask-boss.appspot.com/ - 13 -
  • askBOSS: http://ask-boss.appspot.com/ - 14 -
  • askBOSS: http://ask-boss.appspot.com/ - 15 -
  • About BOSS API - 16 -
  • What? •  Open Yahoo’s core search features via web services to let 3rd parties revolutionize Search •  Unrestricted http://developer.yahoo.com/search/boss - 17 -
  • Opening the search technology stack Rank Assist EXTRACT Retrieve SPAM <-> Gold Usage CRAWL Web Map Analyze Index Index 50B pages * 20ms page download = 31 years - 18 -
  • Opening the search technology stack Your App here WEB API Rank Assist EXTRACT Retrieve SPAM <-> Gold Usage CRAWL Web Map Analyze Index Index 50B pages * 20ms page download = 31 years - 19 -
  • Why? •  Removes entry barriers –  massive capital investment –  access to top technical talent •  Asset to Innovate –  Develop new relevance models • Leverage user insights • Use tags, bookmarks –  Change presentation style •  Search anywhere –  Improve Vertical Quality w/ Web comprehensiveness –  Fragment the market, foster more players, choice, competition - 20 -
  • BOSS API features •  Unlimited queries per day •  No branding or attribution •  No restrictions on presentation •  Ability to re-order results and blend-in addition content •  Access to multiple verticals (web search, image, news) •  Spell checks, keyword suggestions •  40+ supported language and region pairs •  Ability to monetize - 21 -
  • How to use it? - 22 -
  • Get Started •  Register for an application id http://developer.yahoo.com/wsregapp/ •  Documentation http://developer.yahoo.com/search/boss/boss_guide/ •  Code samples: Javascript, PHP and Python http://www.saurabhsahni.com/boss-examples.zip - 23 -
  • BOSS API Searching Slumdog Millionaire (Source: http://en.wikipedia.org/wiki/File:Slumdog_Millionaire_poster.jpg) - 24 -
  • BOSS API •  Search for slumdog millionaire: –  http://boss.yahooapis.com/ysearch/web /v1/slumdog+millionaire ?appid=xyz&format=xml - 25 -
  • BOSS API: XML response http://boss.yahooapis.com/ysearch/web/v1/slumdog+millionaire?appid=xyz&format=xml - 26 -
  • BOSS API •  Exact search for “slumdog millionaire” –  http://boss.yahooapis.com/ysearch/web /v1/%22slumdog+millionaire%22 ?appid=xyz&format=xml - 27 -
  • BOSS API •  Search for slumdog millionaire only on indiatimes.com: –  Add site:indiatimes.com to your query –  http://boss.yahooapis.com/ysearch/web/v1/slumdog +millionaire+site%3Aindiatimes.com ?appid=xyz&format=xml •  Search for slumdog millionaire on selected movie sites –  Add param sites=indiatimes.com,movies.yahoo.com,imdb.com –  http://boss.yahooapis.com/ysearch/web/v1/slumdog +millionaire?appid=xyz&sites=indiatimes.co m%2Cmovies.yahoo.com&format=xml - 28 -
  • http://boss.yahooapis.com/ysearch/web/v1/slumdog+millionaire? appid=xyz&sites=indiatimes.com%2Cmovies.yahoo.com&format=xml - 29 -
  • BOSS API •  Find related keywords –  Add parameter view=keyterms –  http://boss.yahooapis.com/ysearch/web/v1/slumdog +millionaire?appid=xyz&view=keyterms&format=xml - 30 -
  • http://boss.yahooapis.com/ysearch/web/v1/slumdog +millionaire?appid=xyz&view=keyterms&format=xml - 31 -
  • BOSS API •  Search images –  http://boss.yahooapis.com/ysearch/images/v1/slumdog +millionaire?dimensions=small - 32 -
  • http://boss.yahooapis.com/ysearch/images/v1/ slumdog +millionaire?dimensions=small - 33 -
  • BOSS API •  Search news –  http://boss.yahooapis.com/ysearch/news/v1/slumdog +millionaire?age=15d - 34 -
  • http://boss.yahooapis.com/ysearch/news/v1/slumdog +millionaire?age=15d
 - 35 -
  • BOSS API Spell check request http://boss.yahooapis.com/ysearch/spelling/v1/ milionare?format=xml Response - 36 -
  • BOSS API REST Interface http://boss.yahooapis.com/ysearch/{vert}/v1/{query} •  {query}: term to look for (url-encoded) •  {vert} := {web, news, images, spelling} •  @ required –  appid •  @ optional –  start, count, lang, region, format, callback, sites - 37 -
  • BOSS Mashup Framework •  Python (v2.5+) library •  BOSS Search SDK plus … •  SQL for remixing arbitrary XML/JSON sources http://developer.yahoo.com/search/boss/mashup.html - 38 -
  • BMF + Google App Engine •  Enhanced version of BMF to GAE platform •  http://zooie.wordpress.com/2008/08/04/yahoo-boss-google-app-engine-integrated/ •  Enables quick deployment of BOSS applications online - 39 -
  • One more thing… - 40 -
  • BOSS in Academic Research •  The biggest dataset available on web •  Very useful for Web-mining research experiments –  Natural language processing –  Semantic extraction –  Related keywords –  Similarity detection –  Clustering algorithms –  Spelling corrections - 41 -
  • Thank You Questions? More: http://developer.yahoo.com/search/boss/ - 42 -
  • Appendix - 43 -
  • Search UI Templates are Included in the BOSS Mashup Framework http://www.yahoo.com BOSS Mashup Framework simplifies aggregating and presenting multiple data sources - 44 -
  • BMF Features •  select, group, sort, union, joins, udfs, where •  Text normalization and duplicate removal •  Auto-transformation of resource-oriented API results into tables w/o parsing •  All-in-memory storage and retrieval operations •  Ability to join lists of tables via an arbitrary predicate function (map-like) •  Search UI template framework •  Single search function provides total access to BOSS REST API - 45 -