Got one of those nifty calendars on your site that expands month after month with the click of a mouse? Be kind to the Googlebot and slap a nofollow tag on the link—he might just follow it forever!
Well, Torrey Hoffman says the Googlebot isn't quite that stupid, but he's close. The calendar conundrum is a classic one the bot should be already familiar with and knows not to keep clicking that button like a heroin-addicted rat. It's also a classic example of what the search engineers at Google call an "infinite space."
If you don't know what else qualifies as an infinite space, the Webmaster Central team has already started notifying webmasters about the problem when it occurs. The team recommends verifying your site at Webmaster Tools and checking the Message Center.
Hoffman mentions another scenario where a website will provide filtering for a set of product search results, dividing items according to color, brand, price, etc, resulting in thousands of automatically generated URLs for the bot to follow. Again, think of a nofollow tag to give the robot a break, or follow other guidelines provided by the Webmaster Help Center.
webmaster tool
Publish A Comment
| Popular WPN Business Resources |
-

Latest Features from Digg and StumbleUpon
Although news outlets continually bring reports about new features on... -

What's Next for Twitter API?
Although Twitter's homepage gets a tremendous amount of traffic, it... -

The Rise of Horizontal Content Sites
Over the last year, the search industry has seen a large rise in...
iEntry 10th Anniversary
RSS
Newsletter
Advertising





















Aww, poor google bot!!
this is brilliant!! With all the intelligence google and their bot has, could it really be stupid enough to crawl a calander?!?
Kinda makes me wanna set up a test page just to see!!!
Lol, Love It!!