topic Re: FTP Scripts in Operating System - HP-UX

FTP Scripts

Ishmael — Tue, 10 Sep 2002 05:50:54 GMT

I wrote the following Script to ftp files from ServerA to ServerB. How do I modify the script to only transfer new files which I haven't copied.
#!/usr/bin/sh
{ echo "open ServerB
user user pass
hash
cd /directory/
mget *
close"
} | ftp -i -n -v 2>&1 | tee /tmp/ftplog

Re: FTP Scripts

Patrick Chim — Tue, 10 Sep 2002 06:17:15 GMT

Hi,

Here is a script for you.

#!/bin/ksh

if [ ! -f filename.txt ]
then
cp /dev/null filename.txt
fi

mv filename.txt filename.prev

ftp -n < filename.curr
user
cd
nlist
quit
EOF

comm -23 filename.curr filename.prev > filename.diff

for i in `cat filename.diff`
do
ftp -n <user
cd
get $i
quit
EOF
done

This is just a simple script but it works (I have try it). You can further enhance it to fulfill your requirement !

Regards,
Patrick

Re: FTP Scripts

Paula J Frazer-Campbell — Tue, 10 Sep 2002 06:20:53 GMT

Hi

Before you start the ftp you will have to extend your script to do an ls -l on the dir, sending the output to a file.

E.G.

ls -l | awk @{print $9}' > /tmp/ftplist

Each time you do an ftp compare it with this file and if there are new files then ftp them, The script should then update it if there are new files, so that at next run time these files do not get sent again.

HTH

Paula

Re: FTP Scripts

Patrick Chim — Tue, 10 Sep 2002 06:29:02 GMT

Hi,

Sorry about that ! I've forgotten to rename the file after the testing.

By the way, your have to replace the 'filename.txt' with 'filename.curr'

Regards,
Patrick

Re: FTP Scripts

Christian Fandel — Wed, 11 Sep 2002 04:17:58 GMT

Hello,
everything looks nice especially the latest reply. But there is little weakness. Use -lL. The "L" looks for links. And I have a question:
why don't u use PERL?? If u do the last reply, you will run into trouble with awk. Awk (and sed) is restricted to 3000 values to be processed and about this number it will go unpredictible. I experienced this very fact and have been using PERL exclusively since.
The algorithm could look alike.
(:

Re: FTP Scripts

Ishmael — Wed, 11 Sep 2002 05:55:33 GMT

Thanks,

Patrick, the comm command after the first ftp doesn't seem to be executed. Any idea why?

Re: FTP Scripts

Patrick Chim — Thu, 12 Sep 2002 03:10:33 GMT

Hi,

Sorry for the late reply as I cannot login to the forum this morning as it show 'services unavailable'.

BTW, what error did you get ?

Did you submit the job by cron ? If so, you have to specific the full path of comm, i.e. /usr/bin/comm

Regards,
Patrick

Re: FTP Scripts

Ishmael — Thu, 12 Sep 2002 06:17:31 GMT

Hi Patrick,

Thanks for the response.
I ran the complete script from the command line and it gave the folliwng error :-
cat: Cannot open tempfile.diff: No such file or directory

tempfile.diff doesn't seem to be created by comm. But if I run the full comm command manully from cmd line it works fine.
I forced it run as /usr/bin/ksh and /usr/bin/sh but nothing works.

Re: FTP Scripts

Patrick Chim — Thu, 12 Sep 2002 07:48:21 GMT

Hi,

Can you attach the script so that I can have a look ??

Does the file tempfile.diff create by you or other ? Do you have write permission on it ? How about if you specific all file with absolute path ?

Regards,
Patrick

Re: FTP Scripts

Ishmael — Thu, 12 Sep 2002 13:41:02 GMT

Script as requested.
#!/usr/bin/ksh
#set -x
cd /testdata/temp_data/test
if [ ! -f tempfile.curr ]
then
cp /dev/null tempfile.curr
fi

mv tempfile.curr tempfile.prev

ftp -n -v -i machineB << EOF > tempfile.curr
user login password
cd /IN/TEMP/
nlist c*
close
quit
EOF

/usr/bin/ksh comm -23 tempfile.curr tempfile.prev > tempfile.diff

for i in `cat tempfile.diff`
do
ftp -n machineB << EOF
user login password
cd /IN/TEMP/
get $i
quit
EOF
done

Re: FTP Scripts

Patrick Chim — Fri, 13 Sep 2002 00:06:17 GMT

Hi,

It seems that there is a space at the end of each line of the set of ftp statement. I think you just copy the content from the browser and paste it in your terminal, right ? Because I use this step that it will paste one more space at each end of line.

If you delete all these spaces then it will ok and I've try it !

Regards,
Patrick

Re: FTP Scripts

Patrick Chim — Fri, 13 Sep 2002 01:51:56 GMT

Hi,

Furthermore, you need not to make a ksh to run the command 'comm'. Just change it to '/usr/bin/comm -23 ...' and that's OK.

Regards,
Patrick