Users of Google’s Webmaster Central tools have access to an effective module for creating robots.txt files for their sites.

Singapore has launched a contest for developing a next-generation multi-media online search engine.

The contest has allowed for eight months time to build the engine and the reward is a 100,000 US dollar cash prize, as has been reported at Physorg.

Wiep Knol put together a fantastic document on internal and external linking values.

Nearly all search engines utilize spiders (which are also known by their original name, robots) to go out and scour the web looking for web pages. These search engine spiders then bring the data back to be indexed by the engine.

Quite a few bloggers out there have clued-in to how using Eurekster’s Swickis on their blogs can be a cool feature enhancement, providing custom thematic search engines for their users.

Anyone who’s seen Alfred Hitchcock’s “The Birds” has realized that lots of little creatures can constitute an extremely dangerous force.  And as Halloween approaches, we have to ask: does Google, with its many competitors, have anything to be worried about?

"Chinese Wall – The ethical (not physical) barrier between different divisions of a financial (or other) institution to avoid conflict of interest…"

Investopedia.com

"While Google never sells better ranking in our search results, several other search engines combine pay-per-click or pay-for-inclusion results with their regular web search results."

Google’s Webmaster Help Center FAQ

Users of Facebook will have their profiles indexed by the likes of Google and Yahoo unless they opt to keep their listings from appearing in search engines.

While America’s busy celebrating Labor Day (mmm, ribs), Europe will be hard at work farming a Google competitor.

Nielsen//NetRatings has announced the leaders in three Web categories. Search, career development and multi-category travel have had high month- over- month visitor retention rates from June to July, but also had audience overlap with other competitors in their categories.

DoubleClick Performics, the marketing division of DoubleClick, has released data from a search usage study that focused on "moms" which was conducted with Microsoft and ROI Research.

A new search engine has launched called QueryCat that has indexed frequently asked questions (FAQ) from across the web and made them searchable.

The US uses just four search engines mainly, and one of them almost two-thirds of the time. The same one dominates traffic driven to most ecommerce sites. Can you guess which?

Retail Web sites received 25 percent of their traffic from search engines for May 2007, according to findings from Hitwise. This was an increase of 0.7 percent over May 2006.

First page results on Google, Yahoo, Windows Live and Ask overlap less than one percent according to a new study from InfoSpace, "Different Engines, Different Results".