wget --wait=20 --limit-rate=20K -r -p -U Mozilla http://www.stupidsite.com/restricedplace.html
1) -r = download sites recursive
2) -U = tells the site you are using some commonly accepted browser:
3) --limit-rate= and
4) --wait=. You should add --wait=20 to pause 20 seconds between retrievals, this makes sure you are not manually added to a blacklist. --limit-rate defaults to bytes, add K to set KB/s.
5) --no-parent is a very handy option that guarantees wget will not download anything from the folders beneath the folder you want to acquire. Use this to make sure wget does not fetch more than it needs to if just just want to download the files in a folder.
source=http://linuxreviews.org/quicktips/wget/
Comments
Post a Comment