 |
 |
stopping google
|
 |
|
 |
|
Professional Poster
Join Date: Jan 2000
Location: south
Status:
Offline
|
|
Is there anyway to stop googlebots from indexing your site etc?
|
|
|
| |
|
|
|
 |
|
 |
|
Mac Enthusiast
Join Date: Jul 2001
Location: Silicon Valley
Status:
Offline
|
|
I think Google's Bots will respect the 'robots text' tags.
Just make sure you have those tags in your site.
Heck you could probably e-mail them and ask how you can avoid having your site Googled.
|
|
Reality is the playground of the unimaginative
|
| |
|
|
|
 |
|
 |
|
Clinically Insane
Join Date: Nov 1999
Status:
Offline
|
|
http://www.robotstxt.org
Google respects robots.txt. Unfortunately, many spambots don't, and those may be what you're really after.
|
|
You are in Soviet Russia. It is dark. Grue is likely to be eaten by YOU!
|
| |
|
|
|
 |
|
 |
|
Mac Elite
Join Date: Mar 2001
Status:
Offline
|
|
Originally posted by OSX Abuser:
I think Google's Bots will respect the 'robots text' tags.
Just make sure you have those tags in your site.
Heck you could probably e-mail them and ask how you can avoid having your site Googled.
It's robots.txt, not tags. Well, you could put tags in your pages for robots to not index.
I'd do both.
Remember, bots don't index your site voluntairily... they don't have to respect the robots.txt file..
|
|
|
| |
|
|
|
 |
|
 |
|
Grizzled Veteran
Join Date: Jun 2001
Location: Melbourne, Australia
Status:
Offline
|
|
Originally posted by Raman:
It's robots.txt, not tags. Well, you could put tags in your pages for robots to not index.
I'd do both.
Remember, bots don't index your site voluntairily... they don't have to respect the robots.txt file..
And if you're really annoyed with them, you could modify your apache config to deny all requests from certain user agents with a string pattern matching the name of the particular robot(s) you wish to hide from. But that's a pretty heavy measure, only to be used if all else fails.
|
|
Computer thez nohhh...
|
| |
|
|
|
 |
 |
|
 |
|
|
|
|
|

|
|
 |
Forum Rules
|
 |
 |
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
|
HTML code is Off
|
|
|
|
|
|
 |
 |
 |
 |
|
 |