Visit Twellow.com

Become Crawler Info For Webmasters

A few days ago I told you about the new Become shopping search engine and gave you a glimpse at what you can expect from it.

Michael wanted me to clarify one point from that post. I said that there is a way to guarantee your site is crawled by the Become crawler/spider. But it needs a bit of clarification.

Currently, Become has no plans to offer a 'submit your site here' form and the only way to guarantee your site is listed in the Become index is to be linked to from another site the BecomeBot has already crawled.

Since they'll be launching the engine with approximately 2.5 billion pages in their index, that should make it pretty easy to ensure your site is crawled by the BecomeBot.

It's also important to note that the mere fact the BecomeBot has spidered your site doesn't mean you'll be listed in their index. Once their crawler fetches your site the indexer determines whether or not your site is shopping related, if it's not then it will not make it into the search results.

More information can be found at their webmasters page.

I hope that clarifies things a bit. Let me know if and of you have any questions.

Jason Dowdell is a technology entrepreneur and operates the Marketing Shift blog.

Digg This! StumbleUpon This!
AddThis Social Bookmark Widget

About the author:
Jason Dowdell is a technology entrepreneur and operates the Marketing Shift blog.

Comments

Post new comment

The content of this field is kept private and will not be shown publicly.
CAPTCHA
This question is for testing whether you are a human visitor and to prevent automated spam submissions.
1 + 0 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Subscribe to WebProNews


Send me relevant info