The document discusses the importance of activating SEO with Squirrly before utilizing robots.txt. It notes that Squirrly does not create a physical robots.txt file but manages sitemap links for multisite configurations. Additionally, Squirrly helps inform search engines about restricted areas of the site.

1. Robots.txt

2. Make sure you switch on
the SEO from Squirrly first

3. Now, that the SEO is active, you can
see the /robots.txt URL

4. Squirrly will not physically create
the robots.txt file.
Best option for Multisites

5. Squirrly will automatically add the
Sitemap links.
Squirrly will inform search engines about
the restricted areas from your site