Quantcast
 
How Googlebot Treats Multiple Breadcrumbs On E-Commerce Pages

How Googlebot Treats Multiple Breadcrumbs On E-Commerce Pages

By Chris Crum March 19, 2014

Google has a new “Webmaster Help” video out about e-commerce pages with multiple breadcrumb trails. This is the second video in a row to deal specifically with e-commerce sites. Last time, Matt Cutts discussed product pages for products that are …

Google Talks Googlebot Hardware/Software Google Talks Googlebot Hardware/Software

Google uploaded a new Webmaster Help video from Matt Cutts, which addresses a question about the hardware/server-side software that powers a typical Googlebot server. “So one of the secrets of Google is that rather than employing these mainframe machines, this …

Google Gets Better At Crawling Smartphone Content Google Gets Better At Crawling Smartphone Content
· 1 Comment

Google announced some improvements for how it indexes smartphone content in mobile search. Googlebot-Mobile will now crawl with a smartphone user-agent in addition to its previous feature phone user-agents. This, the company says, will allow it to increase its coverage …

Making The Googlebot Fetch With URL Submission Making The Googlebot Fetch With URL Submission
· 1 Comment

Is there some new content and/or a new site you want Google to notice sooner rather than later? Well, there’s an official Google utility for that. With the Fetch as Googlebot URL submission tool, site owners can now directly request …

Webmasters: Googlebot Caught in Spider Trap, Ignoring Robots.txt Webmasters: Googlebot Caught in Spider Trap, Ignoring Robots.txt
· 4 Comments

Sometimes webmasters set up a spider trap or crawler trap to catch spambots or other crawlers that waste their bandwidth. If some webmasters are right, Googlebot (Google’s crawler) seems to be having some issues here. In the WebmasterWorld forum, member …

Tips for Getting Crawled Faster by Google
· 28 Comments

Probably the most important step in getting your site found in a search engine is the one in which the search engine crawls it. There are things that can be done and things that can be avoided to make this process as painless as possible for the search engine, which will in turn, make it as painless as possible for the webmaster.

Love Letters from Googlebot
· 3 Comments

In a mildly weird fashion, Google answered some questions regarding HTTP status codes and "if-modified-since" from users who were either made up or had their names changed to protect their anonymity. Names like Little Jimmy, Temp O’Rary, Janet Crinklenose, and Frankie O’Fore (my apologies to any Janet Crinklenoses who may be out there, but I think I’m safe in my assumption that the name is fictitious).

Google Provides Valuable Information On Webserving Techniques

At the Google Webmaster Central Blog, Google has released some valuable information about webserving techniques, especially related to Googlebot.

Googlebot Gets Candid

Googlebot is like a dream which knows us all , , and soul. Here in this interview, Maile Ohye as the website and Jeremy Lilley as the Googlebot from Google Central Webmaster blog would answer all those questions that you ever had.

Question & Answers

Googlebot: ACK

Some New Tags To Play With
· 1

HighRankings.com’s Jill Whalen broke some interesting news about tags webmasters can use to control how their content is shown in Google results. The information comes from Dan Crow, director of crawl systems at Google, speaking at the Search Engine Marketing New England event in Rhode Island.

Controlling How Your Site Is Indexed

Over at the Google Blog, Dan Crow is publishing a series of how-to’s about controlling what the Googlebot says about your site through the Robots Exclusion Protocol. This is the cheap-and-easy version.

Don’t Index That Link!

Get That Site Back Up Before It’s Delisted

If you’re site goes down for whatever reason, get it back up quickly or risk being de-listed from Google’s index.

Though it has been thought there may be somewhat of a grace period, it now seems robots only notice what’s there when they arrive.

GoogleBot Crawls CSS Files

Barry Schwartz spotted a thread in the Cre8site Forums discussing a report by Ekstreme.com that Googlebot requested a CSS file. This is a very interesting, but not surprising development.

Google Enhances Webmaster Tools
· 1

Vanessa Fox unveiled new features included with Google’s Webmaster Tools in an entry this week on the Official Google Webmaster Central Blog.

Googlebot Wields New Crawl Tools

Bringing your website into the voluminous BigTable of Google’s index involves sending out pieces of code, referred to as spiders or crawlers affectionately named “Googlebot,” to pick up your site. Google Webmaster Central has some tips for webmasters showing how they can learn more about Googlebot.

When Was the Last Time You Saw the Googlebot?

The Google crew cleared up a bit about how the Googlebot caches webpages. The date at the cached page reflects the last time the page was modified.

Quoth The Googlebot, “304!”

The latest news from Google Webmaster Central disclosed how the search engine’s spider saves a webmaster from unnecessary bandwidth costs.