Quantcast

Matt Cutts.Robots.txt Articles

Trouble With Googlebot Fetching Robots.txt? Use Fetch As Googlebot Tool Trouble With Googlebot Fetching Robots.txt? Use Fetch As Googlebot Tool

Google has released a new Webmaster Help video in response to a question from a user who has been having trouble getting Google to fetch their robots.txt file. Here’s what the user said: “I’m getting errors from Google Webmaster Tools …