Your SlideShare is downloading. ×
How different search engines work
How different search engines work
How different search engines work
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

How different search engines work

135

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
135
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. How different search engines workWeb Crawlers: • A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner or in an orderly fashion. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches. Crawlers can also be used for automating maintenance tasks on a Web site, such as checking links or validating HTML code. Also, crawlers can be used to gather specific types of information from Web pages, such as harvesting e-mail addresses, usually for spam.Standard Diagram of Web Crawler
  • 2. Examples of Web Crawler: • Yahoo! Slurp • Msnbot • FAST Crawler • Googlebot • Methabot • PolyBot • RBSE Web. • WebCrawler • Web Fountain • WebRACE Web Directory: A web directory or link directory is a directory on the World Wide Web. It specializes in linking to other web sites and categorizing those links. A web directory is not a search engine and does not display lists of web pages based on keywords; instead, it lists web sites by category and subcategory. Examples of well known web directories are Yahoo! Directory and the Open Directory Project (ODP). ODP is significant due to its extensive categorization and large number of listings and its free availability for use by other directories and search engines. Web Directories Features: • Free submission – there is no charge for the review and listing of the site • Reciprocal link – a link back to the directory must be added somewhere on the submitted site in order to get listed in the directory • Paid submission – a one-time or recurring fee is charged for reviewing/listing the submitted link
  • 3. • No follow – there is a rel="nofollow" attribute associated with the link, meaning search engines will give no weight to the link.• Featured listing – the link is given a premium position in a category (or multiple categories) or other sections of the directory, such as the homepage. Sometimes called sponsored listing.• Bid for position – where sites are ordered based on bids• Affiliate links – where the directory earns commission for referred customers from the listed websites

×