×
  • Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
 

How to use Robots.txt

by on Dec 13, 2011

  • 1,231 views

A Robots.txt file is a file containing restrictions for web spiders, defining all the locations they are permitted to crawl. A Robots.txt file defines rules for search engine spiders (robots) ...

A Robots.txt file is a file containing restrictions for web spiders, defining all the locations they are permitted to crawl. A Robots.txt file defines rules for search engine spiders (robots) regarding what to follow and what not to follow. It allows you to control how search engines crawl your store.

Statistics

Views

Total Views
1,231
Views on SlideShare
1,201
Embed Views
30

Actions

Likes
0
Downloads
16
Comments
0

1 Embed 30

http://wiki.goingo2o.com 30

Accessibility

Upload Details

Uploaded via SlideShare as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
Post Comment
Edit your comment

How to use Robots.txt How to use Robots.txt Presentation Transcript