Probably the most important step in getting your site found in a search engine is the one in which the search engine crawls it. There are things that can be done and things that can be avoided to make this process as painless as possible for the search engine, which will in turn, make it as painless as possible for the webmaster.
In a mildly weird fashion, Google answered some questions regarding HTTP status codes and "if-modified-since" from users who were either made up or had their names changed to protect their anonymity. Names like Little Jimmy, Temp O'Rary, Janet Crinklenose, and Frankie O'Fore (my apologies to any Janet Crinklenoses who may be out there, but I think I'm safe in my assumption that the name is fictitious).
At the Google Webmaster Central Blog, Google has released some valuable information about webserving techniques, especially related to Googlebot.
Googlebot is like a dream which knows us all , , and soul. Here in this interview, Maile Ohye as the website and Jeremy Lilley as the Googlebot from Google Central Webmaster blog would answer all those questions that you ever had. Question & Answers Googlebot: ACK
HighRankings.com's Jill Whalen broke some interesting news about tags webmasters can use to control how their content is shown in Google results. The information comes from Dan Crow, director of crawl systems at Google, speaking at the Search Engine Marketing New England event in Rhode Island.
Over at the Google Blog, Dan Crow is publishing a series of how-to's about controlling what the Googlebot says about your site through the Robots Exclusion Protocol. This is the cheap-and-easy version.
Don't Index That Link!
If you're site goes down for whatever reason, get it back up quickly or risk being de-listed from Google's index.
Though it has been thought there may be somewhat of a grace period, it now seems robots only notice what's there when they arrive.
Barry Schwartz spotted a thread in the Cre8site Forums discussing a report by Ekstreme.com that Googlebot requested a CSS file. This is a very interesting, but not surprising development.
Vanessa Fox unveiled new features included with Google's Webmaster Tools in an entry this week on the Official Google Webmaster Central Blog.
Bringing your website into the voluminous BigTable of Google's index involves sending out pieces of code, referred to as spiders or crawlers affectionately named "Googlebot," to pick up your site. Google Webmaster Central has some tips for webmasters showing how they can learn more about Googlebot.
iEntry 10th Anniversary
RSS
Newsletter
Advertising
