Quantcast

Google Site Search On-Demand Indexing Triggers Re-Crawling

Google Updates Site Search Functionality

Get the WebProNews Newsletter:


[ Search]

Google has introduced some new functionality to its Site Search product, which allows customers to search within your own site. The feature that everyone is talking about is the ability to add pages on-demand to be indexed by site search, so customers have access to these new pages as soon as they’re ready.

Google Site Search

Some wonder why such a tool isn’t available for Google Web Search. "OK, Google, so when do we get the same functionality for instant indexing by Google web search? That would be cool," writes Andy Beal at Marketing Pilgrim. InfoWorld reports however, that the feature gives control to web publishers over the frequency with which Google refreshes its index of the site’s content, or in other words triggering a re-crawl.

"On demand indexing is like supercharging the Site Search product so that our customers — the Web site owners — can come to Google as their Web sites are changing and say ‘I just added 100 or 1,000 pages — please index them now,’" says Google Lead Product Manager for Enterprise Search, Nitin Mangtani.


Andrew Goodman at Traffick spoke with Mangtani further about Google Site Search:

I asked Nitin specifically if "smart" algorithm ranking factors like clickstream and behavioral data would be used to bubble relevant results to the top. By all means, the advantages of Google’s proprietary technology are brought to bear on every query, was his answer. But here is where some customers might get uneasy. There is an uncertain mix between rank weightings you can customize yourself, and black box ranking factors that will run in Googly fashion and never be revealed to you. Those who wish to control or understand their site search algorithm won’t enjoy this black box product, and this is where Google’s status as a public search engine that must guard its ranking secrets against spammers becomes as much of a liability as a strength, given that now, you’re guarding the algorithm against potential developers of custom ranking solutions for localized use, as opposed to would-be rank mavens trying to game the system in the case of the adversarial indexing environment of the public Web.

Even still, web publishers should be happy about the on-demand indexing as to get their sites crawled as often as possible. With On-Demand indexing:

- Site owners get an "Index Now" button to quickly and easily update their site search results with new and updated content.

– New pages are searchable within hours – taking no longer than a day to appear within site search results.

Adobe is one company that has utilized Site Search to great advantage, thus far. “On-Demand Indexing was essential for our recent launch of Adobe Creative Suite 4, the biggest software release in the company’s history,” said Tanya Wendling, senior director for Learning Resources at Adobe. “Google Site Search made it easy to implement search across our Creative Suite product line and online sites, and we are now able to index thousands of new pages and make them available to millions of users worldwide within hours. For more on Site Search,  Google provides resources to learn the ins and outs.

Google Site Search On-Demand Indexing Triggers Re-Crawling


Top Rated White Papers and Resources
  • http://facebookjunkie.blogspot.com facebook junkie

    Call me when google has this for web search. I’d love to see my pages show up right away….

    • http://www.siteupdatenotification.com Craig Henderson

      check out my project homepage at http://www.siteupdatenotification.com where I am implementing a notification system for on-demand crawling

  • http://www.cabinsplusmore.com Marian

    Does this mean that if I purchase the $100 Google Site Search Annual Plan, and I add 100 pages, I click on a button and all of my new pages get refreshed, indexed & recrawled into the Google Web Search Results shortly, instead of waiting a month or so for the new pages to appear in the SERP’s???

    I am not a professional SEO guru, I am self-taught and am still learning every day.  I am a little confused after reading sentences from the above paragraphs.  I cut & pasted sentences from above that made it a little confusing for me… Thank you, Marian 

    the feature gives control to web publishers over the frequency with which Google refreshes its index of the site’s content, or in other words triggering a re-crawl.

    "On demand indexing is like supercharging the Site Search product so that our customers — the Web site owners — can come to Google as their Web sites are changing and say ‘I just added 100 or 1,000 pages — please index them now

    Even still, web publishers should be happy about the on-demand indexing as to get their sites crawled as often as possible. With On-Demand indexing:

    - Site owners get an "Index Now" button to quickly and easily update their site search results with new and updated content.

    - New pages are searchable within hours – taking no longer than a day to appear within site search results.

  • http://www.technotate.com TechNotate.com

    It appears another affordable option. This being most beneficial to larger sites who consistently add bundles of new web pages.

    Yet, it doesn’t quite specify whether the optional indexing translates to faster web index additions.  I would suppose it certainly does, which in such a situation would seriously disadvantage smaller firms online.

    "… feature that everyone is talking about is the ability to add pages on-demand to be indexed by site search, so customers have access to these new pages as soon as they’re ready."

  • http://www.buy-hybrid-car.com toyota camry hybrid

    Thanks for your update google information. I keep this page in bookmark to following update.

  • http://www.daarzijnweweer.nl KoffieVerkeerd

    It sounds like a great feature, but I hope it wont be abused too much by people trying to get their pages reindexed faster and faster

  • Join for Access to Our Exclusive Web Tools
  • Sidebar Top
  • Sidebar Middle
  • Sign Up For The Free Newsletter
  • Sidebar Bottom