Download web page from cron

[Vladimir Fabecic]

Hello
I need to download a web page (to a text file) from a cron script. Web page is also a text file.
Any good idea from where to start?

[spex]

Hi,

I would use curl or wget.

http://hpux.connect.org.uk/hppd/hpux/Networking/WWW/curl-7.15.5/
http://hpux.connect.org.uk/hppd/hpux/Gnu/wget-1.10.2/

PCS

[spex]

A textual web browser, such as lynx or links would also do the trick.

http://hpux.connect.org.uk/hppd/hpux/Networking/WWW/lynx-2.8.5/
http://hpux.connect.org.uk/hppd/hpux/Networking/WWW/links-0.99/

[Murat SULUHAN · Accepted solution]

Hi Vladimir,

wget http:/www.hp.com/index.html -O myTextFile.txt

Best Regards

[Peter Godron]

Vladimir,
I installed wget, but ran into problems as our company does not allow direct access to external Web (proxy setup).
Check this before you start !

[spex]

If you don't want to install new software, telnet will also work.

#!/usr/bin/sh

{
telnet www.google.com 80 << _EOF_
GET / HTTP/1.1


exit
_EOF_
} > index.html

exit

[Murat SULUHAN]

Hi Spex

thanks for excellent tip

Best Regards

[Vladimir Fabecic]

Thanks guys
I forgot wget. Very good idea.
Solution with telnet is also good.

[Arunvijai_4]

Hi Vladimir,

I would also consider HTTrack if it going to be a linux machine.

-Arun

[Vladimir Fabecic]

No, it is a HP-UX machine. Wget idea is perfect.
HTTrack? Is there something like that for HP-UX?