Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Is Search Broken?! Daniel Tunkelang Chief Scientist, Endeca
howdy! <ul><li>1992: Bachelor’s + Master’s from MIT in CS + Math </li></ul><ul><li>1998: PhD from CMU in CS (ACO program) ...
overview <ul><li>Who is Endeca? </li></ul><ul><li>Is search broken? </li></ul><ul><li>If it is, what can we do about it? <...
who / what is endeca? <ul><li>Software to help people explore, analyze, and understand complex information, guiding them t...
some of our customers
<ul><li>Is search broken? </li></ul>
<ul><li>Search has hit a wall. </li></ul>
search hits a wall in ecommerce
search hits a wall in knowledge management  Current Search:  it outsourcing
search even hits a wall on the web Results  1-10  out of about  344,000,000  for  ir
<ul><li>But is search broken? </li></ul>
the accountants don’t think so
most users don’t think so 75
or do they? <ul><li>78% wish search engines could read their minds. </li></ul><ul><li>What frustrates users most? </li></u...
web search vs. enterprise search <ul><li>“ Search on the internet is solved.   I always find what I need.   But why not in...
<ul><li>Can theory help? </li></ul>
precision  = fraction of retrieved documents that are relevant recall  = fraction of relevant documents that are retrieved...
why improve precision? the truth, nothing but the truth
why improve recall? the whole truth,
what we want… the truth, the whole truth,   nothing but the truth
but there is a trade-off… recall precision
which should we favor? Precision …to avoid annoying users with irrelevant results? Recall …to make sure we don’t throw awa...
<ul><li>Enough stalling…what’s the answer?! </li></ul>
depends on what you want vs.
you get what you pay for <ul><li>There are easy use cases… </li></ul><ul><ul><li>30% of queries are navigational. </li></u...
<ul><li>Great, bring on the insight! </li></ul>
technology alone can’t provide insight <ul><li>The system can’t read your mind. </li></ul><ul><li>Your spouse / best frien...
<ul><li>So should we just give up? </li></ul>
technology is a catalyst <ul><li>Computers are good at analysis. </li></ul><ul><li>People are good at using what they know...
with apologies to luis von ahn
human-computer information retrieval <ul><li>Instead of guessing the user’s intent, optimize communication. </li></ul><ul>...
hcir cheats the trade-off recall precision
<ul><li>But how do we implement HCIR? </li></ul>
endeca's approach: guided summarization <ul><li>Set retrieval that responds to queries with </li></ul><ul><ul><li>an overv...
guided summarization for ecommerce <ul><li>Matching Categories include: </li></ul><ul><ul><li>Appliances > Small Appliance...
guided summarization for KM
<ul><li>Guided summarization starts with faceted search. </li></ul>
facets 101
<ul><li>But faceted search isn’t enough… </li></ul>
showing the right facets: microwaves vs.
showing the right facets: ceiling fans
traditional topic taxonomy
dynamic topic facet <ul><li>Subject </li></ul><ul><ul><li>Electronic data processing  (1002) </li></ul></ul><ul><ul><li>Di...
facets populated using entity extraction apple production
cutting through facets to show the big picture Search : storage
summarization: more than search and browse
guided summarization – a summary <ul><li>Guided summarization enables a dialog </li></ul><ul><li>between the user and the ...
<ul><li>The Moral </li></ul>
think outside the box <ul><li>Search works for many use cases. </li></ul><ul><li>But not for some of the most valuable one...
<ul><li>One More Thing </li></ul>
maybe we should treat search as a game
thank you <ul><li>Questions? </li></ul>
Upcoming SlideShare
Loading in …5

or do they? <ul><li>78% wish Is Search Broken?!


Published on

or do they? 78% wish search engines could read their minds. What frustrates users most? 25%: deluge of results 24%: too many paid listings 19%: inability to understand their keywords 19%: disorganized / random results The State of Search Autobytel & Kelton Research, Oct ’07

Published in: Technology