Welcome to the MacNN Forums.

If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.

You are here: MacNN Forums > Software - Troubleshooting and Discussion > Applications > wget question

wget question
Thread Tools
genevish
Mac Enthusiast
Join Date: Jan 1999
Location: Marietta, GA, USA
Status: Offline
Reply With Quote
Sep 27, 2008, 12:11 PM
 
I'm not sure if MacNN is the right place to ask this (or if this is the right forum on MacNN if it is), but I'm curious about an issue I'm having with wget. I'm trying to download all of the files for a homework project my professor posted here, and I'm using this line for wget:

wget http://science.kennesaw.edu/~jgarrid...otes/mcarwash/ -r -l 1 -nd -R "*.gif","*.html*","*.txt"

The robots.txt file is still being downloaded, despite the exclusion option. Is this normal? It's not a big deal, as I can easily delete it, but it's annoying my obsessive side...

Thanks,

-Scott
Scott Genevish
scott AT genevish DOT org
     
   
 
Forum Links
Forum Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Top
Privacy Policy
All times are GMT -4. The time now is 02:38 PM.
All contents of these forums © 1995-2017 MacNN. All rights reserved.
Branding + Design: www.gesamtbild.com
vBulletin v.3.8.8 © 2000-2017, Jelsoft Enterprises Ltd.,