Originally Posted by apkano
What's with these "yahoo! slurp spider" things.......there's like 2100 of 'em here right now. (5:26 PM Eastern)
You can alter the .txt file to slow down the crawl. You can also ban the slurp all together, but then no one will be able to find the site, 'cept for word of mouth.