SlideShare a Scribd company logo
1 of 23
Download to read offline
Internet Search Engines:
         Past and Future

    Jan Pedersen
    Chief Scientist, Yahoo! Search
    11 April 2005
1
Outline

    • Compare and contrast
      – 2005 vs 1998
    • Some underlying trends
    • What’s New




2
Search Landscape 2005

                                  • Three major Players
                                     – Google ($52B)
                                     – Yahoo ($42B)
                                     – MSN ($271B)
                                  • $6+B in Paid Search
                                    Revenues
                                  • >400M searches daily
                                  • 5-8B claimed index size
                                  • Excellent relevance
    Source: Search Engine Watch




3
Search Landscape in1998




4
Infoseek circa 1998

                 • IPO in 1996
                    – Same year as
                      Excite and Yahoo!
                 • 5th ranked destination site
                 • Market cap of $1B
                 • Competed as a portal
                    – Content was king
                 • Ultimately sold to Disney
                    – Go network
                 • Decommissioned in 2001


5
Infoseek Search Technology

    • 1.5 Generation Search
      – Tuned for relevance
         • Proximity
         • Anchor text (ESP)
         • Inlink counting
      – Small but competant index
         • 60M pages
         • Alta Vista was 140M at that time
    • Still exists as Ultraseek server
      – Sold to Inktomi in 2000, later resold to Verity
6
Infoseek UI




7
Comparison to State-of-the-art




8
What was missing?

    • Business Model
      – Monetized via untargeted banner ads
      – Need for increased inventory
        • Portalitis
        • Clutter
    • Lack of focus
        • Search was deprioritized

9
Some Underlying Trends




                         10
Moore’s Law




11
Index Size

                  • ~150M in 1998
                  • ~5B in 2005
                       – 33x increase
                       – Moore would predict 25x
                  • Monthly refresh in 1998
                  • Daily refresh in 2005
                  • What about 2010?
                       – 40B?
                  • Where is the content?
                       – Public Web?
                       – Personal Web?
                  Source: Search Engine Watch and Search Engine Showdown
12
Meaning of Hit Counts

                 • Hits Counts are estimated
                      – Indices are tiered
                      – Estimates can be non-
                        linear




                 Source:

                    http://aixtal.blogspot.com/2005/01/web-googles-counts-faked.html




13
Meaning of Document Counts

                                      • Claimed index Size
                                         – Google: 3B
                                         – FAST: 3B
                                         – AV: 1B
                                      • Not all Documents are equal
                                         – Thin docs
                                      • Disparity between claimed
                                        and reported


     Source: Search Engine Showdown




14
Online Advertising

                 • Internet accounts for
                   30+% of viewing time
                     – Yet only 4% of spend
                     – $370B overall
                            • $10B online

                 • Fastest growing
                   advertising segment
                 • Steady shift toward
                   Online advertising

                  Source: The Economist
15
The Keyword Marketplace




     • The great, unsung, search problem
        – Matching relevant ads to user intent
     • Example of distributed authorship
        – Advertisers bid on keywords
        – Discounts for good performance (relevance)

16
What’s New?




              17
Verticals


                      Image Search




     Product Search




18
Local




19
Personal Search




20
Contextual Search




21
Desktop Search




22
23

More Related Content

Viewers also liked

The Carbon Conversation, February 2010: Joanna Yarrow
The Carbon Conversation, February 2010: Joanna YarrowThe Carbon Conversation, February 2010: Joanna Yarrow
The Carbon Conversation, February 2010: Joanna YarrowEmily Wearmouth
 
Cj Rider Mini Watercolor Pencil Workshop
Cj Rider Mini Watercolor Pencil WorkshopCj Rider Mini Watercolor Pencil Workshop
Cj Rider Mini Watercolor Pencil WorkshopCJ_Rider
 
Testing OSGi-based Applications with DA-Testing
Testing OSGi-based Applications with DA-TestingTesting OSGi-based Applications with DA-Testing
Testing OSGi-based Applications with DA-TestingValery Abu-Eid
 
Challenges in Modeling Believable Social Agents
Challenges in Modeling Believable Social AgentsChallenges in Modeling Believable Social Agents
Challenges in Modeling Believable Social AgentsEva Hudlicka
 
Calcula Tu Consumo de Agua
Calcula Tu Consumo de AguaCalcula Tu Consumo de Agua
Calcula Tu Consumo de AguaAlfredo Caicedo
 
Skf q3 2010_pr_eng
Skf q3 2010_pr_engSkf q3 2010_pr_eng
Skf q3 2010_pr_engSKF
 
AdvancedWord01
AdvancedWord01AdvancedWord01
AdvancedWord01adisg
 
Alatan Jahitan Dan Kelepet
Alatan Jahitan Dan KelepetAlatan Jahitan Dan Kelepet
Alatan Jahitan Dan KelepetgunXsword
 
Basic PC Skills
Basic PC SkillsBasic PC Skills
Basic PC Skillsadisg
 
Life Cycle Applications in the Mining Industry
Life Cycle Applications in the Mining IndustryLife Cycle Applications in the Mining Industry
Life Cycle Applications in the Mining IndustryTurlough Guerin
 
Robert Rafton Photography
Robert Rafton PhotographyRobert Rafton Photography
Robert Rafton PhotographyRobert Rafton
 
The Carbon Conversation, February 2010: Carbon Voyage
The Carbon Conversation, February 2010: Carbon VoyageThe Carbon Conversation, February 2010: Carbon Voyage
The Carbon Conversation, February 2010: Carbon VoyageEmily Wearmouth
 

Viewers also liked (15)

Reflexology
ReflexologyReflexology
Reflexology
 
A föld kora
A föld koraA föld kora
A föld kora
 
Speed
SpeedSpeed
Speed
 
The Carbon Conversation, February 2010: Joanna Yarrow
The Carbon Conversation, February 2010: Joanna YarrowThe Carbon Conversation, February 2010: Joanna Yarrow
The Carbon Conversation, February 2010: Joanna Yarrow
 
Cj Rider Mini Watercolor Pencil Workshop
Cj Rider Mini Watercolor Pencil WorkshopCj Rider Mini Watercolor Pencil Workshop
Cj Rider Mini Watercolor Pencil Workshop
 
Testing OSGi-based Applications with DA-Testing
Testing OSGi-based Applications with DA-TestingTesting OSGi-based Applications with DA-Testing
Testing OSGi-based Applications with DA-Testing
 
Challenges in Modeling Believable Social Agents
Challenges in Modeling Believable Social AgentsChallenges in Modeling Believable Social Agents
Challenges in Modeling Believable Social Agents
 
Calcula Tu Consumo de Agua
Calcula Tu Consumo de AguaCalcula Tu Consumo de Agua
Calcula Tu Consumo de Agua
 
Skf q3 2010_pr_eng
Skf q3 2010_pr_engSkf q3 2010_pr_eng
Skf q3 2010_pr_eng
 
AdvancedWord01
AdvancedWord01AdvancedWord01
AdvancedWord01
 
Alatan Jahitan Dan Kelepet
Alatan Jahitan Dan KelepetAlatan Jahitan Dan Kelepet
Alatan Jahitan Dan Kelepet
 
Basic PC Skills
Basic PC SkillsBasic PC Skills
Basic PC Skills
 
Life Cycle Applications in the Mining Industry
Life Cycle Applications in the Mining IndustryLife Cycle Applications in the Mining Industry
Life Cycle Applications in the Mining Industry
 
Robert Rafton Photography
Robert Rafton PhotographyRobert Rafton Photography
Robert Rafton Photography
 
The Carbon Conversation, February 2010: Carbon Voyage
The Carbon Conversation, February 2010: Carbon VoyageThe Carbon Conversation, February 2010: Carbon Voyage
The Carbon Conversation, February 2010: Carbon Voyage
 

Similar to Pedersen

2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...
2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...
2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...Wouter Schikhof
 
Sos power point mike stewart local search made simple - final
Sos power point   mike stewart local search made simple - finalSos power point   mike stewart local search made simple - final
Sos power point mike stewart local search made simple - finalSMB SEO
 
Semantic Search overview at SSSW 2012
Semantic Search overview at SSSW 2012Semantic Search overview at SSSW 2012
Semantic Search overview at SSSW 2012Peter Mika
 
Analytics for your business final edits
Analytics for your business  final  editsAnalytics for your business  final  edits
Analytics for your business final editsRamon Ray
 
online and offline reputation management
online and offline reputation managementonline and offline reputation management
online and offline reputation managementPraful Baweja
 
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYC
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYCNYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYC
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYCJoel Natividad
 
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009Deepak Nadig
 
Mueller presentation at proofseo
Mueller presentation at proofseoMueller presentation at proofseo
Mueller presentation at proofseoAnna
 
Manage My Site Miami,Fl
Manage My Site Miami,FlManage My Site Miami,Fl
Manage My Site Miami,Flmanage PPC
 
Five Things to Know in 2009
Five Things to Know in 2009Five Things to Know in 2009
Five Things to Know in 2009Dennis O'Neil
 
Advanced SEO Workshop, OMS 2012 Santa Clara
Advanced SEO Workshop, OMS 2012 Santa ClaraAdvanced SEO Workshop, OMS 2012 Santa Clara
Advanced SEO Workshop, OMS 2012 Santa ClaraJohn Thyfault
 
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan Mernit
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan MernitShow Me the Numbers: Basic Metrics to Grow Your Project, by Susan Mernit
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan MernitKDMC
 
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossing
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossingReal-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossing
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossingiCrossing
 
Search Engine Working Technology
Search Engine Working TechnologySearch Engine Working Technology
Search Engine Working TechnologyVidco Digital
 
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptx
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptxMODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptx
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptxMaryJoyPeralta
 
API Management webinar with Redmonk and layer 7
API Management webinar with Redmonk and layer 7API Management webinar with Redmonk and layer 7
API Management webinar with Redmonk and layer 7James Governor
 

Similar to Pedersen (20)

2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...
2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...
2012-Search University 4 - Knewledge-Gerald Claessens & Wouter Schikhof- ...
 
Haifa
HaifaHaifa
Haifa
 
Sos power point mike stewart local search made simple - final
Sos power point   mike stewart local search made simple - finalSos power point   mike stewart local search made simple - final
Sos power point mike stewart local search made simple - final
 
Semantic Search overview at SSSW 2012
Semantic Search overview at SSSW 2012Semantic Search overview at SSSW 2012
Semantic Search overview at SSSW 2012
 
Analytics for your business final edits
Analytics for your business  final  editsAnalytics for your business  final  edits
Analytics for your business final edits
 
online and offline reputation management
online and offline reputation managementonline and offline reputation management
online and offline reputation management
 
Is Your Website Working Hard Enough?
Is Your Website Working Hard Enough?Is Your Website Working Hard Enough?
Is Your Website Working Hard Enough?
 
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYC
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYCNYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYC
NYC Data Web (static version) - A Semantic, Open Public Data Exchange for NYC
 
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009
Web 2.0 - Metrics in a Post Page Impression World - eMetrics 2009
 
Search Engines
Search EnginesSearch Engines
Search Engines
 
Mark Mueller - Search Gets Social
Mark Mueller - Search Gets SocialMark Mueller - Search Gets Social
Mark Mueller - Search Gets Social
 
Mueller presentation at proofseo
Mueller presentation at proofseoMueller presentation at proofseo
Mueller presentation at proofseo
 
Manage My Site Miami,Fl
Manage My Site Miami,FlManage My Site Miami,Fl
Manage My Site Miami,Fl
 
Five Things to Know in 2009
Five Things to Know in 2009Five Things to Know in 2009
Five Things to Know in 2009
 
Advanced SEO Workshop, OMS 2012 Santa Clara
Advanced SEO Workshop, OMS 2012 Santa ClaraAdvanced SEO Workshop, OMS 2012 Santa Clara
Advanced SEO Workshop, OMS 2012 Santa Clara
 
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan Mernit
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan MernitShow Me the Numbers: Basic Metrics to Grow Your Project, by Susan Mernit
Show Me the Numbers: Basic Metrics to Grow Your Project, by Susan Mernit
 
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossing
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossingReal-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossing
Real-time Search 101 - SMX Toronto 2010 - Rob Garner - iCrossing
 
Search Engine Working Technology
Search Engine Working TechnologySearch Engine Working Technology
Search Engine Working Technology
 
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptx
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptxMODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptx
MODULE-5-MEDIA-AND-INFORMATION-SOURCES.pptx
 
API Management webinar with Redmonk and layer 7
API Management webinar with Redmonk and layer 7API Management webinar with Redmonk and layer 7
API Management webinar with Redmonk and layer 7
 

More from Ram Dutt Shukla (20)

Ip Sec Rev1
Ip Sec Rev1Ip Sec Rev1
Ip Sec Rev1
 
Message Authentication
Message AuthenticationMessage Authentication
Message Authentication
 
Shttp
ShttpShttp
Shttp
 
Web Security
Web SecurityWeb Security
Web Security
 
I Pv6 Addressing
I Pv6 AddressingI Pv6 Addressing
I Pv6 Addressing
 
Anycast & Multicast
Anycast & MulticastAnycast & Multicast
Anycast & Multicast
 
Congestion Control
Congestion ControlCongestion Control
Congestion Control
 
Congestion Control
Congestion ControlCongestion Control
Congestion Control
 
Retransmission Tcp
Retransmission TcpRetransmission Tcp
Retransmission Tcp
 
Tcp Congestion Avoidance
Tcp Congestion AvoidanceTcp Congestion Avoidance
Tcp Congestion Avoidance
 
Tcp Immediate Data Transfer
Tcp Immediate Data TransferTcp Immediate Data Transfer
Tcp Immediate Data Transfer
 
Tcp Reliability Flow Control
Tcp Reliability Flow ControlTcp Reliability Flow Control
Tcp Reliability Flow Control
 
Tcp Udp Notes
Tcp Udp NotesTcp Udp Notes
Tcp Udp Notes
 
Transport Layer [Autosaved]
Transport Layer [Autosaved]Transport Layer [Autosaved]
Transport Layer [Autosaved]
 
Transport Layer
Transport LayerTransport Layer
Transport Layer
 
T Tcp
T TcpT Tcp
T Tcp
 
Anycast & Multicast
Anycast & MulticastAnycast & Multicast
Anycast & Multicast
 
Igmp
IgmpIgmp
Igmp
 
Mobile I Pv6
Mobile I Pv6Mobile I Pv6
Mobile I Pv6
 
Mld
MldMld
Mld
 

Recently uploaded

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfhans926745
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 

Recently uploaded (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

Pedersen

  • 1. Internet Search Engines: Past and Future Jan Pedersen Chief Scientist, Yahoo! Search 11 April 2005 1
  • 2. Outline • Compare and contrast – 2005 vs 1998 • Some underlying trends • What’s New 2
  • 3. Search Landscape 2005 • Three major Players – Google ($52B) – Yahoo ($42B) – MSN ($271B) • $6+B in Paid Search Revenues • >400M searches daily • 5-8B claimed index size • Excellent relevance Source: Search Engine Watch 3
  • 5. Infoseek circa 1998 • IPO in 1996 – Same year as Excite and Yahoo! • 5th ranked destination site • Market cap of $1B • Competed as a portal – Content was king • Ultimately sold to Disney – Go network • Decommissioned in 2001 5
  • 6. Infoseek Search Technology • 1.5 Generation Search – Tuned for relevance • Proximity • Anchor text (ESP) • Inlink counting – Small but competant index • 60M pages • Alta Vista was 140M at that time • Still exists as Ultraseek server – Sold to Inktomi in 2000, later resold to Verity 6
  • 9. What was missing? • Business Model – Monetized via untargeted banner ads – Need for increased inventory • Portalitis • Clutter • Lack of focus • Search was deprioritized 9
  • 12. Index Size • ~150M in 1998 • ~5B in 2005 – 33x increase – Moore would predict 25x • Monthly refresh in 1998 • Daily refresh in 2005 • What about 2010? – 40B? • Where is the content? – Public Web? – Personal Web? Source: Search Engine Watch and Search Engine Showdown 12
  • 13. Meaning of Hit Counts • Hits Counts are estimated – Indices are tiered – Estimates can be non- linear Source: http://aixtal.blogspot.com/2005/01/web-googles-counts-faked.html 13
  • 14. Meaning of Document Counts • Claimed index Size – Google: 3B – FAST: 3B – AV: 1B • Not all Documents are equal – Thin docs • Disparity between claimed and reported Source: Search Engine Showdown 14
  • 15. Online Advertising • Internet accounts for 30+% of viewing time – Yet only 4% of spend – $370B overall • $10B online • Fastest growing advertising segment • Steady shift toward Online advertising Source: The Economist 15
  • 16. The Keyword Marketplace • The great, unsung, search problem – Matching relevant ads to user intent • Example of distributed authorship – Advertisers bid on keywords – Discounts for good performance (relevance) 16
  • 18. Verticals Image Search Product Search 18
  • 23. 23