I been trying to download data from a website using wget but it does not seems to work. It only seems to work when i download via a browser. Is there anyway i can force wget to get the data?
You may be getting a proxy error. Are there proxy settings in your browser not present in wget .wgetrc ??
Could also be security on the site itself designed to thwart wholesale download of the entire site.
SEP
Steven E Protter Owner of ISN Corporation http://isnamerica.com http://hpuxconsulting.com Sponsor: http://hpux.ws Twitter: http://twitter.com/hpuxlinux Founder http://newdatacloud.com
If you look at the wget output the URL is different from the one you supplied. If the string "$File" is a literal part of the URL and not something you're supposed to get from your environment you'll need to either escape the $ or enclose the URL in single quotes.
To add to Heironimus' comments, you would be best advised to enclose any interpolated variables (parameter substitution) in curly braces to avoid ambiguity. Thus, instead of:
I've operated web servers for a few years right now. I've read in the trade press that its possible to block wget from grabbing the web content.
I assume it's either a firewall or httpd.conf configuration fix. I believe the operator of the website wishes to prevent this type of access.
I can't say I know the details but I can see why an operator would want to do this.
SEP
Steven E Protter Owner of ISN Corporation http://isnamerica.com http://hpuxconsulting.com Sponsor: http://hpux.ws Twitter: http://twitter.com/hpuxlinux Founder http://newdatacloud.com
