Welcome to the MacNN Forums.

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

You are here: MacNN Forums > Software - Troubleshooting and Discussion > Developer Center > How to Lock web pages

How to Lock web pages
Thread Tools
prakash
Junior Member
Join Date: Feb 2005
Status: Offline
Reply With Quote
Feb 4, 2007, 04:02 PM
 
Hi

I have set up a separate folder called dev , where I work on development files,before moving them to production.

I call it dev.sitename.com

How can i make sure, that google or other web search spiders do not access pages,images in the dev folder under public_html.

Can someone suggest a simple efficient way to continue development, without exposing my development pages to search spiders.

Kindly help.

Thanks

Prakash
     
mduell
Posting Junkie
Join Date: Oct 2005
Location: Houston, TX
Status: Offline
Reply With Quote
Feb 4, 2007, 04:22 PM
 
     
SirCastor
Professional Poster
Join Date: Jan 2001
Location: Salt Lake City, UT USA
Status: Offline
Reply With Quote
Feb 4, 2007, 11:36 PM
 
I would password protect the directory. Not all robots respect a robot.txt file.

Alternatively, you ought to know that search robots go through web pages. They traverse links that exist on the pages of your site, If you don't submit dev.sitename.com and don't provide links into the directory, it's pretty unlikely that they'll end up there.
2008 iMac 3.06 Ghz, 2GB Memory, GeForce 8800, 500GB HD, SuperDrive
8gb iPhone on Tmobile
     
prakash  (op)
Junior Member
Join Date: Feb 2005
Status: Offline
Reply With Quote
Feb 9, 2007, 03:44 PM
 
Sircastor

Thanks a lot. I password protected the directory.

It seemed like the simple straight forward way, and i am not submitting the dev url for search.

I have a auth.net question , posting it as a separate thread.
     
   
 
Forum Links
Forum Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Top
Privacy Policy
All times are GMT -4. The time now is 12:50 PM.
All contents of these forums © 1995-2017 MacNN. All rights reserved.
Branding + Design: www.gesamtbild.com
vBulletin v.3.8.8 © 2000-2017, Jelsoft Enterprises Ltd.,