All Posts Tagged Tag: ‘Crawlers’

Google News Now Using Googlebot for Crawling

Google announced today that it will no longer be using a separate crawler for Google News, and will now start using Googlebot. “Google News recently updated our infrastructure to crawl with Google’s primary user-agent,Googlebot. What does this mean? Very little to most publishers,” says Google News Product Specialist David Smydra. “Any news organizations that wish to opt out of Google …

Read More