Google Webmaster Central Blog

In the previous posts about the Robots Exclusion Protocol (REP) we explored what’s already possible to do with its various components — namely robots.txt and […]

Hello 2025! (Yeah, we know, time flies!) We’ve had some exciting plans in the works for Search Central Live (SCL) Asia Pacific this year, and […]

With the robots.txt file, site owners have a simple way to control which parts of a website are accessible by crawlers. To help site owners […]

A long-standing tool for website owners, robots.txt has been in active use for over 30 years and is broadly supported by crawler operators (such as […]

We’re very excited to announce that Search Central Live is going to Madrid for the first time on April 9! The event will have a […]

On April 2, 2025 we’ll be in Johannesburg, South Africa for the very first Search Central Live event in Africa! We’re excited to welcome you […]

Every now and then we get questions about robots.txt, robots meta tags, and the control functionality that they offer. Following our December series on crawling, […]

We’re excited to announce that Search Central Live is coming to New York City for the first time on March 20, 2025. The Google Search […]

We’re excited to announce that Search Central Live is coming to New York City for the first time on March 20, 2025. The Google Search […]

Mobile searchers will soon see a cleaner, more streamlined look for how URLs appear in search results. Initially introduced as part of the “site hierarchy” […]