“I’d like to avoid adding more directives. I’m still not aware of common issues caused by this documented functionality,” said John Mueller.
Please visit Search Engine Land for the full article.
Source: Search Engine Land
Link: Should robots.txt support a feature for no indexation? Take the survey
