Changes are coming to how Google understands some of the unsupported directives in your robots.txt file.
Please visit Search Engine Land for the full article.
Source: Search Engine Land
Link: Google to stop supporting noindex directive in robots.txt
Leave a Reply