Google Wants to Establish an Official Standard for Using Robots.txt via @MattGSouthern

Google has proposed an official internet standard for the rules included in robots.txt files.The post Google Wants to Establish an Official Standard for Using Robots.txt via @MattGSouthern appeared first on Search Engine Journal.
Source: Search Engine Journal
Link: Google Wants to Establish an Official Standard for Using Robots.txt via @MattGSouthern