<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>WebProNews &#187; server logs</title>
	<atom:link href="http://www.webpronews.com/tag/server-logs/feed" rel="self" type="application/rss+xml" />
	<link>http://www.webpronews.com</link>
	<description>Breaking News in Tech, Search, Social, &#38; Business</description>
	<lastBuildDate>Mon, 13 Feb 2012 14:41:35 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
		<item>
		<title>Yahoo Slurps Somewhere Else</title>
		<link>http://www.webpronews.com/yahoo-slurps-somewhere-else-2007-06</link>
		<comments>http://www.webpronews.com/yahoo-slurps-somewhere-else-2007-06#comments</comments>
		<pubDate>Thu, 07 Jun 2007 17:44:23 +0000</pubDate>
		<dc:creator>WebProNews Staff</dc:creator>
				<category><![CDATA[Search]]></category>
		<category><![CDATA[blog]]></category>
		<category><![CDATA[SEO]]></category>
		<category><![CDATA[server logs]]></category>
		<category><![CDATA[Web Crawlers]]></category>
		<category><![CDATA[Webmasters]]></category>
		<category><![CDATA[WebMasterWorld]]></category>
		<category><![CDATA[Yahoo]]></category>
		<category><![CDATA[Yahoo Slurp]]></category>

		<guid isPermaLink="false">http://www.webpronews.com/?p=38284</guid>
		<description><![CDATA[<p>The migration of the Slurp is complete, says Yahoo. Over the past few weeks, the search engine has been transitioning its crawler, dubbed (disgustingly) &#34;Slurp,&#34; to a new address at crawl.yahoo.net. Adjust your server logs as necessary and join the curmudgeons who are unimpressed. <br />
]]></description>
			<content:encoded><![CDATA[<p>The migration of the Slurp is complete, says Yahoo. Over the past few weeks, the search engine has been transitioning its crawler, dubbed (disgustingly) &quot;Slurp,&quot; to a new address at crawl.yahoo.net. Adjust your server logs as necessary and join the curmudgeons who are unimpressed. <br />
<span id="more-38284"></span> <br />
Too little (or too much, by some complaints), too late, it would seem. </p>
<p>The <a title="Yahoo Slurps" href="http://www.ysearchblog.com/archives/000460.html">Yahoo Search Blog</a> reads: </p>
<blockquote><p><em>&#8230;all machines crawling as Slurp are now in crawl.yahoo.net. You can see this change in your web server logs, where the page accesses from inktomisearch.com are being fully replaced by crawl.yahoo.net contacts. Note that this does not cover other Yahoo! crawlers, such Yahoo! China, and other verticals, like Yahoo! Shopping, Yahoo! Travel, etc., which have their own user-agent.</em></p>
<p><em>Don&#8217;t fret though; there is no need to change your robots.txt file because the crawler user-agent is still Yahoo! Slurp. If you use IP based filtering, there is no need to change that either, since the IP addresses from which we crawl remain the same. However, please ensure that your network or firewall setup does not keep crawl.yahoo.net out as we won&#8217;t be able to include your content in our results.</em></p>
</blockquote>
<p>Be sure to click that link to get more enumerated information. </p>
<p>Over at <a title="WebmasterWorld" href="http://www.webmasterworld.com/yahoo_search/3359251.htm">WebmasterWorld</a>, the crowd is a bit mixed about it (but only a bit), the loudest complaint, from &quot;IncrediBill,&quot; who notes not only is it the move a year-and-a-half too late, but has gone overboard.</p>
<blockquote><p>
<em>Why do we need to allow an army of Yahoo spiders to redundantly abuse our servers? </em></p>
<p><em>Is it a conceptual problem that Yahoo can&#8217;t share pages already downloaded? </em></p>
<p><em>When I posed that question to one of their engineers I was given a lame excuse that the various crawlers had different needs&hellip;.</em></p>
<p><em>Funny, Google managed to make some of their crawlers share CACHE, so we know it can be done.</em></p>
</blockquote>
<p>Negativity often rings louder and truer than other things, but there is at least one voice in that forum who thinks Yahoo&#8217;s update is &quot;a small evolutionary improvement above&quot; Google.</p>
<p>Even if in our hearts, we know that&#8217;s not true. <img src='http://www.webpronews.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> <br />
&nbsp;
</p></p>
]]></content:encoded>
			<wfw:commentRss>http://www.webpronews.com/yahoo-slurps-somewhere-else-2007-06/feed</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

<!-- Performance optimized by W3 Total Cache. Learn more: http://www.w3-edge.com/wordpress-plugins/

Page Caching using memcached
Database Caching 1/9 queries in 0.004 seconds using memcached
Object Caching 209/222 objects using memcached

Served from: webpronews.com @ 2012-02-13 09:46:04 -->
