Google Sitemap and robots.txt Setup Techniques
Upcoming SlideShare
Loading in...5

Google Sitemap and robots.txt Setup Techniques



Concept about Google Sitemap & Robots.txt file for SEO Perspective.

Concept about Google Sitemap & Robots.txt file for SEO Perspective.



Total Views
Views on SlideShare
Embed Views



1 Embed 1 1



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

Google Sitemap and robots.txt Setup Techniques Google Sitemap and robots.txt Setup Techniques Presentation Transcript

  • Google Site Map & Robots.txt File Nasir Uddin Shamim Co Founder DevsTeam
  • What The Hell A Sitemap Is?In the Visitors perspective: It gives user friendly navigation towards every corner of a site.In the Spider Bot perspective: Makes the crawling functionality better. Indexing have been much more faster and targeted.
  • Why You Should Have A Sitemap Each notifies the SE about each updates of your site. It helps the SE to easily find any content from the Web. Your Visitors can go through anywhere of your site as they want. You can have a clear idea where to improve more and what you are missing.
  • Types of Sitemaps HTML Sitemap XML Sitemap ?xml version="1.0" encoding="UTF-Code example of HTML: 8" !DOCTYPE html PUBLIC "- //W3C//DTD XHTML 1.0 Strict//EN"html lang="en" " This is a site map head D/xhtml1-strict.dtd"body htmlh1 header of HTML site map xmlns=" html" xml:lang="en" lang="en"> head This is a site map headp site map paragraph with bodylinks h1 header of XHTML site map h1body p site map paragraph with links phtml body html
  • Types of Sitemap Text Sitemap Special TypesExample of text sitemap file:  Image Sitemap  Video Sitemap  News Sitemap ome-directory/  GEO Sitemap
  • Difference Between HTML & XML SitemapHTML Sitemaps XML Sitemaps  XML sitemaps are used for SEO. HTML sitemaps are user  Makes it easier for search engine sitemaps. "spiders" to "crawl" through a HTML sitemaps enhance the look website. and feel of the website.  Helps search engines to index the Communicates the overall theme content of a site. of the website.  Communicates any website Organizes each section contained changes to search engines. in the website.  External links are not relied on to Makes user navigation easier. index a site. Makes it easier for users to link  All of the pages of a website have within the website. an opportunity to be indexed. Usually used for large websites.  Helps search engine "spiders" to index a site faster.
  • What is robots.txt File?Robots.txt file tells the search engine spider orcrawler, which Web pages or directory of yoursite should be indexed and which Web pagesshould be ignored!
  • Parameters To Be Used User-agent: Indicate Robots (Crawler or spider) * Indicate all robots Disallow: indicate not to crawl the selected directory or page (before writing a directory there should have a /). If there have no / before the selected directory that means it allow the page Allow: Indicate to crawl the directory # this sign is used to write a comment
  • A robots.txt File Examplesitemap: *Disallow: /cgi-bin/Disallow: /go/Disallow: /wp-admin/Disallow: /wp-includes/User-agent: Googlebot-ImageAllow: /wp-content/uploads/User-agent: Mediapartners-GoogleAllow: /
  • The End!Thanking You All……..!!! Shamim DevsTeam