Web Search University Report: Search Engine Features Searching Strategies Searching Multimedia on the Web Elizabeth Brown October 25, 2005

Web Search University www.websearchu.com Organized and produced by Information Today, Inc. Speakers Mary Ellen Bates Randolph Hock Greg Notess Marydee Ojala Gary Price Chris Sherman Genie Tyburski

www.websearchu.com

Organized and produced by Information Today, Inc.

Speakers

Mary Ellen Bates

Randolph Hock

Greg Notess

Marydee Ojala

Gary Price

Chris Sherman

Genie Tyburski

Web Search University Sessions Day One Web Search Update: What Should Searchers Expect (Chris Sherman) Going Beyond Command Line Searching: Strategic Search Techniques (Greg Notess) It’s a Bad, Bad Web: Avoiding the Bad, Embracing the Good (Genie Tyburski) Apres Search (Marydee Ojala) Multimedia Searching (Gary Price) Open Access Information (Marydee Ojala)

Web Search Update: What Should Searchers Expect (Chris Sherman)

Going Beyond Command Line Searching: Strategic Search Techniques (Greg Notess)

It’s a Bad, Bad Web: Avoiding the Bad, Embracing the Good (Genie Tyburski)

Apres Search (Marydee Ojala)

Multimedia Searching (Gary Price)

Open Access Information (Marydee Ojala)

Web Search University Day Two Finding the Ah hah! Moments in Search (Mary Ellen Bates) Desktop Search Tools (Chris Sherman) The New Look of Blogging (Panel) RSS, Blogs, and Current Awareness (Genie Tyburski) Specialty Search Engines (Gary Price) Price’s Pearls (Gary Price)

Finding the Ah hah! Moments in Search (Mary Ellen Bates)

Desktop Search Tools (Chris Sherman)

The New Look of Blogging (Panel)

RSS, Blogs, and Current Awareness (Genie Tyburski)

Specialty Search Engines (Gary Price)

Price’s Pearls (Gary Price)

Web Search Update http://searchenginewatch.com/ Session covered new trends in web search engines and web searching: Emergence of Web 2.0 Local Search Personalization Vertical Searching New shortcuts and search gadgets Email and desktop searching “Consumer Search”

Session covered new trends in web search engines and web searching:

Emergence of Web 2.0

Local Search

Personalization

Vertical Searching

New shortcuts and search gadgets

Email and desktop searching

“Consumer Search”

Web 2.0 Web 1.0 – read-only, static web pages and search engines Web 2.0 – read-write, dynamic, customizable Examples of Web 2.0: Applications Google , Yahoo APIs Bloglines Blogpulse PubSub Wikipedia

Web 1.0 – read-only, static web pages and search engines

Web 2.0 – read-write, dynamic, customizable

Examples of Web 2.0: Applications

Google , Yahoo APIs

Bloglines

Blogpulse

PubSub

Wikipedia

Disruptive Technology An idea not part of the mainstream that changes the playing field for others Some examples: Blogging Introduction of Google search algorithm eBay Federal Express delivery of packages

An idea not part of the mainstream that changes the playing field for others

Some examples:

Blogging

Introduction of Google search algorithm

eBay

Federal Express delivery of packages

Local Search Google Local Yahoo Local Ask Jeeves Local MSN Search Near Me A9 Yellow Pages

Google Local

Yahoo Local

Ask Jeeves Local

MSN Search Near Me

A9 Yellow Pages

Personalization Google My Search History Desktop Search Yahoo My Web Search SmartSort Yahoo 360 AOL Search A9 Google Search Ask Jeeves Findory MSN Newsbot

Google My Search History Desktop Search

Yahoo My Web Search SmartSort Yahoo 360

AOL Search

A9 Google Search

Ask Jeeves

Findory

MSN Newsbot

Vertical Search (Vortals) Specialized search engines that are geared to a specific topic or task Some spoof sites: Smeagle McDoogle Yankovic Ask Cheese SlashNOT

Specialized search engines that are geared to a specific topic or task

Some spoof sites:

Smeagle

McDoogle

Yankovic

Ask Cheese

SlashNOT

New Shortcuts and Search Gadgets Google: Ride Finder , Video , Suggest , Scholar Book Search , Movies , Q & A , Stock quotes , Weather , Firefox results prefetching Google Web Search Features Yahoo: Video Search , Movie Recommendations , Firefox toolbar , Y!Q Everything Yahoo! Ask Jeeves: Smart search options

Google:

Ride Finder , Video , Suggest , Scholar

Book Search , Movies , Q & A , Stock quotes , Weather , Firefox results prefetching

Google Web Search Features

Yahoo:

Video Search , Movie Recommendations , Firefox toolbar , Y!Q

Everything Yahoo!

Ask Jeeves:

Smart search options

Desktop Search Tools Application that searches web sites plus local files (email, personal documents, etc.) System requirements and other information

Application that searches web sites plus local files (email, personal documents, etc.)

System requirements and other information

Before Installation System Requirements Recommend using Windows XP with latest service pack Clean out unnecessary files from computer: IE Tools – Internet Options Delete cookies, files, history Norton Systemworks “Cleanup” deletes temporary installation files Firefox is memory intensive (both the search engine and tabs)

System Requirements

Recommend using Windows XP with latest service pack

Clean out unnecessary files from computer:

IE Tools – Internet Options Delete cookies, files, history

Norton Systemworks “Cleanup” deletes temporary installation files

Firefox is memory intensive (both the search engine and tabs)

Desktop Search Applications Ask Jeeves Google Desktop MSN Desktop Yahoo Desktop Search Copernic Blinkx HotBot Desktop Search Spotlight Search - Mac Tiger OS Longhorn – Microsoft Windows

Ask Jeeves

Google Desktop

MSN Desktop

Yahoo Desktop Search

Copernic

Blinkx

HotBot Desktop Search

Spotlight Search - Mac Tiger OS

Longhorn – Microsoft Windows

Desktop Search Tools: Other Considerations No dominant player yet Try multiple types of desktop searching – each one has different strengths Test each application independently – multiple desktop search applications can cause “index wars” on your computer The lines between desktop, web, and personalized searching to continue to blur over the next year

No dominant player yet

Try multiple types of desktop searching – each one has different strengths

Test each application independently – multiple desktop search applications can cause “index wars” on your computer

The lines between desktop, web, and personalized searching to continue to blur over the next year

Metadata With Web 2.0, companies are discovering metadata “ Tagging used to add metadata to blogs, pictures, etc. Quote “No major search engine has used metadata for search criteria since 1997.” Metadata useful for images, multimedia content

With Web 2.0, companies are discovering metadata

“ Tagging used to add metadata to blogs, pictures, etc.

Quote “No major search engine has used metadata for search criteria since 1997.”

Metadata useful for images, multimedia content

Conclusions No disruptive technologies in the short-term, but definitely coming in the long-term Competition between the biggest companies (Google, Yahoo) will intensify. This will be good for web searchers – more added features and new applications. Vertical searching is popular, and will likely fragment and further specialize

No disruptive technologies in the short-term, but definitely coming in the long-term

Competition between the biggest companies (Google, Yahoo) will intensify. This will be good for web searchers – more added features and new applications.

Vertical searching is popular, and will likely fragment and further specialize

Going Beyond Command Line Searching: Strategic Search Techniques Command Line Options in Search Engines Database Differences

Command Line Options in Search Engines

Database Differences

Current Search Engines Big Companies: Smaller Companies Exalead Gigablast Wisenut (LookSmart)

Big Companies:

Smaller Companies

Exalead

Gigablast

Wisenut (LookSmart)

Current Search Engines Metasearch Engines A9.com Includes Google, Amazon, more Clusty / Vivisimo Clusters search results Dogpile Useful for a quick search of the 4 big search engines: Yahoo!, Google, Ask Jeeves, MSN

Metasearch Engines

A9.com Includes Google, Amazon, more

Clusty / Vivisimo Clusters search results

Dogpile

Useful for a quick search of the 4 big search engines: Yahoo!, Google, Ask Jeeves, MSN

Search Engine Features http:// SearchEngineShowdown .com/features/ Truncation / Stemming Proximity Boolean Field Searching Cache Mining Clustering Multi-Database

Truncation / Stemming

Proximity

Boolean

Field Searching

Cache Mining

Clustering

Multi-Database

Truncation / Stemming Few databases allow truncation or stemming Exalead – use * for truncation - Phonetic Search - Approximate Spelling Stemming – search for grammatical variants of a word Use OR command with the most common forms of the term Google: ~ is a synonym operator

Few databases allow truncation or stemming

Exalead – use * for truncation - Phonetic Search - Approximate Spelling

Stemming – search for grammatical variants of a word Use OR command with the most common forms of the term

Google: ~ is a synonym operator

Wild Card Word in Phrase (Google) Can use this to search when a word in the phrase is unknown Example: “addictive semiconscious * bioblioscopy” Wild Card Word in Phrase search: “ addictive * * * biblioscopy” Useful for searching quotes, song lyrics, etc.

Can use this to search when a word in the phrase is unknown

Example: “addictive semiconscious * bioblioscopy”

Wild Card Word in Phrase search:

“ addictive * * * biblioscopy”

Useful for searching quotes, song lyrics, etc.

Proximity “ Phrase Searching” - put quotes around term Alternate way to search phrases: Phrase + Search + String Faking Proximity: Google API Proximity Search (GAPS) www. staggernation .com/ cgi -bin/gaps.com

“ Phrase Searching” - put quotes around term

Alternate way to search phrases: Phrase + Search + String

Faking Proximity: Google API Proximity Search (GAPS)

www. staggernation .com/ cgi -bin/gaps.com

Boolean Searching Default Boolean operator in databases– AND Alternative to the NOT operator: minus sign search-research (no space) Almost all databases use OR operator Alternative to the OR operator in Google: pipe symbol (|) Nested Boolean searching available in: Yahoo!, Gigablast, Exalead, MSN

Default Boolean operator in databases– AND

Alternative to the NOT operator: minus sign search-research (no space)

Almost all databases use OR operator

Alternative to the OR operator in Google: pipe symbol (|)

Nested Boolean searching available in: Yahoo!, Gigablast, Exalead, MSN

Field Searching Search by Title – approximates a subject search Search by web links – see who links to a particular site. This can locate interlinked web communities http://www.googletutor.com/2005/04/15/voyeur-heaven/ Google Tutor: http://www. googletutor .com/

Search by Title – approximates a subject search

Search by web links – see who links to a particular site. This can locate interlinked web communities

http://www.googletutor.com/2005/04/15/voyeur-heaven/

Google Tutor: http://www. googletutor .com/

A9.com Covers Google Web, Images http://opensearch.a9.com/ Can add additional side tabs to site with XML (possible BU infoLINK or library web site link side tab to A9) Can add library catalogs, databases such as PubMed, full-text sources such as NYTimes

Covers Google Web, Images

http://opensearch.a9.com/

Can add additional side tabs to site with XML

(possible BU infoLINK or library web site link side tab to A9)

Can add library catalogs, databases such as PubMed, full-text sources such as NYTimes

Searching Meta Tags: Gigablast Can create custom topic searches with Gigablast: www. gigablast .com/ cts .html Search and Display Meta Tags Can also add a string to the end of a URL: &dt=keywords+author+generator+description:30

Can create custom topic searches with Gigablast: www. gigablast .com/ cts .html

Search and Display Meta Tags

Can also add a string to the end of a URL: &dt=keywords+author+generator+description:30

Multimedia Searching http://www. freepint .com/ gary /multwsu2005.html The Spoken Word is Quickly Becoming as Searchable as the Written Word Fee-Based and Free Services Available Resources and Concepts Closed Captioning Speech/Voice Recognition Metadata Only Hybrid

The Spoken Word is Quickly Becoming as Searchable as the Written Word

Fee-Based and Free Services Available

Resources and Concepts

Closed Captioning

Speech/Voice Recognition

Metadata Only

Hybrid

Fee-Based Multimedia Search Sources TVEyes U.S. and International TV Networks Real-Time, Alerts Hybrid ShadowTV U.S. and International TV Networks Real-Time, Alerts Hybrid FedNet U.S. Congress Real-Time Closed Captioning Others: Critical Mention , StreamSage , Nexidia

TVEyes

U.S. and International TV Networks

Real-Time, Alerts

Hybrid

ShadowTV

U.S. and International TV Networks

Real-Time, Alerts

Hybrid

FedNet

U.S. Congress

Real-Time

Closed Captioning

Others: Critical Mention , StreamSage , Nexidia

Free Multimedia Search Sources Yahoo Video Metadata Surrounding Video Limited Content from Bloomberg, Search Each Word Spoken Media RSS Google Video Content from Stations in Bay Area, C-SPAN, Discovery Closed-Caption Search Unable to View Full Motion Video on Your Computer, Thumbnails only New Initiative, Will Host Your Video Content BlinkxTV Speech Recognition Search Many Sources (Fox News, CNN, BBC, More) View Full Motion Video on Your Computer Podscope Speech Recognition Keyword search Podcasts

Yahoo Video

Metadata Surrounding Video

Limited Content from Bloomberg, Search Each Word Spoken

Media RSS

Google Video

Content from Stations in Bay Area, C-SPAN, Discovery

Closed-Caption Search

Unable to View Full Motion Video on Your Computer, Thumbnails only

New Initiative, Will Host Your Video Content

BlinkxTV

Speech Recognition Search

Many Sources (Fox News, CNN, BBC, More)

View Full Motion Video on Your Computer

Podscope

Speech Recognition

Keyword search Podcasts

Free Multimedia News Sources Speechbot Demo Project from HP Speech Recognition 15,000+ Hours of Audio Programming Listen Online PBS Video Demos Using Technology From Virage Closed Caption Search View Transcript Online Feedroom .com – local news sources Search Metadata and Descriptions Video News from Local Stations Throughout the Country RSS Feeds SingingFish Open-Web Audio and Video Files Metadata Search

Speechbot

Demo Project from HP

Speech Recognition

15,000+ Hours of Audio Programming

Listen Online

PBS Video Demos

Using Technology From Virage

Closed Caption Search

View Transcript Online

Feedroom .com – local news sources

Search Metadata and Descriptions

Video News from Local Stations Throughout the Country

RSS Feeds

SingingFish

Open-Web Audio and Video Files

Metadata Search

More multimedia sites C-SPAN Search Two Week Archive, Metadata BookTV .org Archive (500 author interviews) Television News Archive @ Vanderbilt University NPR Archive - All Major News Programs Back to 1996 Streaming Audio and Video Sources Radiomat (Feeds from All-News Stations Around the Country) UK Parliament Other Legislative Bodies State Legislative Bodies World Radio Network

C-SPAN Search

Two Week Archive, Metadata

BookTV .org Archive (500 author interviews)

Television News Archive @ Vanderbilt University

NPR Archive - All Major News Programs Back to 1996

Streaming Audio and Video Sources

Radiomat (Feeds from All-News Stations Around the Country)

UK Parliament

Other Legislative Bodies

State Legislative Bodies

World Radio Network

More multimedia sites College Lectures MIT World ResearchChannel Video Library Oyez, U.S. Supreme Court Multimedia The Internet Archive - Multimedia American Memory Collection - Library of Congress Material with a Creative Commons License

College Lectures

MIT World

ResearchChannel Video Library

Oyez, U.S. Supreme Court Multimedia

The Internet Archive - Multimedia

American Memory Collection - Library of Congress

Material with a Creative Commons License

Additional Sessions on the Web Specialty Search Engines http://www. freepint .com/ gary /specwsu05.html Price’s Pearls http://www. freepint .com/ gary /05_pearls_ wsu .html Search Engine Shortcuts http:// onstrat .com/shortcuts.html

Specialty Search Engines

http://www. freepint .com/ gary /specwsu05.html

Price’s Pearls

http://www. freepint .com/ gary /05_pearls_ wsu .html

Search Engine Shortcuts

http:// onstrat .com/shortcuts.html