Fun with robots.txt

Columnist Patrick Stox provides some dos and don’ts for creating your robots.txt file — along with examples of companies who have gotten creative with their files.

The post Fun with robots.txt appeared first on Search Engine Land.

Please visit Search Engine Land for the full article.


Source: Search Engine Land
Link: Fun with robots.txt

Be the first to comment

Leave a Reply

Your email address will not be published.


*