iEntry 10th Anniversary RSS Newsletter Advertising
Visit Twellow.com
Text: Decrease Font Size Increase Font Size | Print Print Article | Share: Delicious Digg StumbleUpon Post to Twitter Post to Facebook
3 commentsTuesday, December 2, 2008

Blogspot's Content Warning Blocking Spiders

Crawlers can’t access content

Edgy bloggers using Google’s Blogspot might have been miffed already—but likely also understood—at Google slapping content warnings over their adult-oriented material and demanding age verification. But what might deter (poorly) minors from viewing is also preventing search crawlers from accessing the content at all.

Blogspot's Content Warning Blocking Spiders

Erotica blogger Rebecca Molay broaches the subject on Google Groups amid fears her blog will disappear from search engines entirely:

My blog has erotic content, which have led Blogger to put up a content warning page. Users will have to click on a link on that page to get to the blog.

 This is fair, and the content warning page itself has actually had no effect on the number of visitors.

The reason I hadn't put up one myself was that I was afraid of the effect it would have on search engine visibility. Unfortunately my fear turned out to be based on a real problem.

The content warning page uses a DIV-tag/javascript for the relevant button. There is no regular link from the Content Warning page to the blog itself.

Even if Blogger is a part of Google, no one has apparently told the Google spiders how to find away around this javascript. Nor has anyone told the Blogger people to change the code of the content warning page
(or to give the spiders another route around this hurdle).

Blogspot's Content Warning Blocking Spiders

 

The theme was picked up in another thread by “Grey,” who explains the problem this way:

Google Blogger blogs with Content Warning splash pages (http://help.blogger.com/bin/answer.py?hl=en&answer=86944) aren't friendly with Google Webmaster Tools. The forced splash page is evidently to confusing for the Webmasters Tool to bypass. Attempted verification causes errors. Blogspot blogs without the warning work perfectly fine.



John Mueller, Webmaster Trends Analyst at Google Zurich, responded with a less than reassuring post in that thread:

This is something the teams here are already looking into, but I don't have more information than that at the moment. I agree that it would be great if we could get all websites at least verified in Webmaster Tools, as well as being indexed in the normal web search index.



It seems reasonable no one would object to a content warning, but if Google is true to its commitment to index the world’s information, erotic content on its own blogging service should be on the list to include.

More on this topic if and when Google addresses it.

Hat tip to Search Engine Roundtable.


 

 

News Tags: Search, Google, SEO, SEM

Great article Check out my

Great article

Check out my Florida web design company, my website design portfolio and learn more about my web design companies website

Blogger blogs and content warning

I think in Blogger, user itself is having an option to set the content type .I hope after hearing this ,bloggers would consider setting the content type .And there is no way if Google itself is having some methods to detect these blogs .

Publish A Comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
2 + 8 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
SEARCH
Popular WPN Business Resources












Subscribe to WebProNews


Send me relevant info