Tutorial completo de wordpress de creacion de archivos robots.txt para posicionar nuestro sitio web

1. WordPress

3. robots.txt

4. 






5. User-Agent: *
User-Agent: *
Disallow: /

6. User-agent: *
Disallow: /admin.php
Disallow: /admin/
Disallow: /directorio-no-indexar/
Allow: /directorio-para-indexar/
Allow: /directorio/fichero.html
Sitemap: http://misitio.com/sitemap.xml
#User-Agent: Google
Disallow: /
User-Agent:
#MSNBot
Disallow: /fichero_prohibido.html
User-Agent: *
Allow: /

7. Disallow: /wp-*
Disallow: *.php

8. 










Disallow: */feed*
Disallow: */trackback*
Disallow: /20*
Disallow: /author/
Disallow: */comments
Disallow: /*?
Disallow: /*?*
Disallow: /tag/
Disallow: /category/*/*

9. Sitemap: http://dominio.com/sitemap.xml
Disallow: /wp-*
Disallow: *.php
Disallow: */feed*
Disallow: */trackback*
Disallow: /20*
Disallow: /author/
Disallow: */comments
Disallow: /*?
Disallow: /*?*
Disallow: /tag/
Disallow: /category/*/*
Sitemap: http://dominio.com/sitemap.xml

10. Disallow: /cgi-bin/
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Googlebot-Mobile
Allow: /

11. Disallow: /wp-*
Disallow: *.php
Disallow: */feed*
Disallow: */trackback*
Disallow: /20*
Disallow: /author/
Disallow: */comments
Disallow: /*?
Disallow: /*?*
Disallow: /tag/
Disallow: /category/*/*
Sitemap: http://dominio.com/sitemap.xml
Disallow: /cgi-bin/
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Googlebot-Mobile
Allow: /