Alternative search engine blekko announced today that it has integrated new crawl technology to power its search index, and is now claiming to offer more comprehensive, real time updates to its SEO pages. This, a representative for the company tells WebProNews, is “transparent data that no other search engine offers for free.”
“Blekko is now one of only a handful of search companies that has more than 4 billion pages indexed and crawls more than 100 million pages daily, with top sites being indexed hourly,” the representative says.
Blekko shared the following graphic with us:
“When it comes to pages crawled, the sweet spot for blekko is a little more than 4 billion pages and we update at least 100 million pages each day,” says blekko’s director of engineering, Robert Saliba. “As soon as our crawler, Scoutjet, crawls a webpage, users have access to information about it through blekko’s SEO product. We want to allow people to see the Internet the way a search engine sees it, especially what the rest of the internet is saying about an url.”
“Scoutjet updates the top ranked starting pages on the Internet around every hour, while other high quality pages are checked at least every week,” he explains. “The continuous updates to blekko’s SEO data include page content, meta data, duplicate text, and inbound link counts. Since staying up-to-date is as much about forgetting the old as finding the new, inbound links that are no longer live and duplicate content that is no longer available disappear.”
Saliba says blekko is bringing more machines into the service, since traffic continues to “grow rapidly”.
Blekko says it is is getting over 5.5 million unique monthly visitors (a 500% increase over the beginning of the year) and over 100 million queries per month.