[Chuckit]

Looking through our usage statistics, I see Yahoo's Slurp bot hits my site about as much as all the other spiders put together. The second highest is the Google bot, with 1/4 as many hits. I was just wondering if anybody else is seeing similar numbers.

[zro]

I get more msnbot hits with slurp number two and googlebot a fairly distant third.

[calcop]

use a robots.txt file. it will help.

[zro]

What, something like...

"Dear msnbot,

I'd like to take this opportunity to ask you to reduce the number of times you crawl my files and directories. Pretty please?

Yours,
zro"

[tomrock]

Try this robotstxt.org

[zro]

That doesn't address the issue. It's not that you want them to stop, just to tone it down. A robots.txt file can't do that. It's either index or not.