Search Engines Index 85% of Visible Web Content

Get the WebProNews Newsletter:

[ Search]

According to a recent study co-written by Ask Jeeves Director of Advanced Products Antonio Gulli and University of Iowa’s Alessio Signorini, the major search engines have managed to index nearly 85% of the estimated 11.5 billion documents that make up the “visible web”.

While there are likely over 500 billion documents on the web, most are invisible files hidden in databases and password protected regions search spiders don’t travel. Collectively, the four major search engines are estimated to have indexed about 9.1 billion unique documents.

Google carries the most indexed content boasting 8.1 billion documents or 69.6% of the visible web in its search database. Yahoo comes in second with an estimated 6.6 billion or 57.4%. Ask Jeeves slips past MSN with an estimated 5.3 billion indexed documents (46.1%) to the 5.1 billion pages (44.3%) in MSN’s database.

While the study relies heavily on estimates and on reporting from search engines, it is one of the only recent examinations of the actual size of the web and of search engine coverage.

Jim Hedger is the SEO Manager of StepForth Search Engine Placement Inc. Based in Victoria, BC, Canada, StepForth is the result of the consolidation of BraveArt Website Management, Promotion Experts, and Phoenix Creative Works, and has provided professional search engine placement and management services since 1997. http://www.stepforth.com/ Tel – 250-385-1190 Toll Free – 877-385-5526 Fax – 250-385-1198

Search Engines Index 85% of Visible Web Content
Comments Off
About Jim Hedger
Jim Hedger works with Metamend Search Engine Marketing as a SEO Consultant, lead copywriter and head blog writer. Jim has been involved in the SEO field since the days of the dinosaurs and felt he had lost a personal friend when Disney went "ol' Yeller" on Infoseek. Over the course of his career, Jim has gotten drunk with Jeeves the Butler, tossed sticks to that sock-puppet dog from Pets.com and come out of a staring contest with Googlebot confidently declaring a tie. When not traveling between conferences, Jim lives with a perpetually annoyed cat named Hypertext in the Pacific techno-outport of Victoria British Columbia. WebProNews Writer
Top Rated White Papers and Resources

Comments are closed.

  • Join for Access to Our Exclusive Web Tools
  • Sidebar Top
  • Sidebar Middle
  • Sign Up For The Free Newsletter
  • Sidebar Bottom