topic Re: Transfer problem in Operating System - HP-UX

Transfer problem

haeman — Thu, 17 Jul 2008 11:04:52 GMT

To ensure the file can be transferred to remote server , I try to write a script to do transfer file from local server ( directory: dir1 ) to remote server ( directory: dir1 ) , then get the files back from remote server ( directory: dir1 ) to local server ( directory: dir2 ), then compare the files in local server ( directory: dir1 & dir2 ) , if found any files missing , then send me alert .

I have below script to do it , when run it , the file could be transfer to remote server , but can't get it back , it pops "Failed to open file." , it seems can't find the file in remote server , can advise what is the problem ? thx

ftp remote_server<prompt off
lcd dir1
passive
cd dir1
put *
lcd dir2
get *
EOF

Re: Transfer problem

Kenan Erdey — Thu, 17 Jul 2008 11:13:34 GMT

hi,

try mget and mput.

Kenan.

Re: Transfer problem

haeman — Thu, 17 Jul 2008 11:28:34 GMT

thx Kenan Erdey ,

you are right , it works now , I have a few more questions ,

1. it could get back the file to dir2 now , can advise how to compare the files in dir1 and dir2 , if found any file difference , then send me mail ?

2. do you think is it a good way to check the file transfer successful or not ? thx

Re: Transfer problem

Kenan Erdey — Thu, 17 Jul 2008 12:04:13 GMT

Hi,

have a look at diff command. you can write a script using it and mailx command. diff can also compare files so if there has been a problem because of transfer, you'll be aware of it.

Re: Transfer problem

haeman — Thu, 17 Jul 2008 12:17:38 GMT

thx kenan ,

diff is file content comparsion , as this is binary file , I think compare the file existence will do , if any files is not exist in dir2 , then send me alert , can advise how to do it ? thx

Re: Transfer problem

haeman — Thu, 17 Jul 2008 13:58:56 GMT

thx reply ,

could advise what can i do ? thx

Re: Transfer problem

Steven Schweda — Thu, 17 Jul 2008 14:10:04 GMT

> diff is file content comparsion , as this
> is binary file , I think compare the file
> existence will do [...]

Why would you think this? Are non-text files
somehow more robust than text files?

> 2. do you think is it a good way to check
> the file transfer successful or not ?

If the FTP server says "2xy", I'd probably
relax and be happy. Or, I'd package the
files using a program like Info-ZIP Zip,
which includes some data integrity info, so
that UnZip will complain if the archive is
corrupt.

The best solution depends on details of the
requirements which you have not supplied.

> could advise what can i do ?

More than you've already been advised? Not
really, not for free. A forum search for
"mailx" should find some scripts which send
e-mail, if that part is still a mystery.

Re: Transfer problem

Steven Schweda — Thu, 17 Jul 2008 14:16:59 GMT

Or is this all simply more of this?:

http://forums.itrc.hp.com/service/forums/questionanswer.do?threadId=1248225

Re: Transfer problem

haeman — Fri, 18 Jul 2008 02:45:54 GMT

thx replies,

I wrote it already , but still have problem ,

1. after get back the files , I want to remove all files on remote site , I tried to use del file_name is OK to remove the file , but if I want to remove all files in dir1 on remote site , what can i do ?

2. use diff will compare the file includes file and sub-directory , how can i only compare files ? thx

Re: Transfer problem

Steven Schweda — Fri, 18 Jul 2008 03:45:23 GMT

> [...] but still have problem [...]

Yes, and your main problem seems to be that
you haven't read "man ftp" or "man diff".

> [...] if I want to remove all files [...]

"man ftp". Remember "mget" and "mput"? Try
"mdelete"?

> [...] diff will compare the file includes
> file and sub-directory [...]

"man diff". As usual, it would help if you
showed the actual command you used, as
different commands can behave differently.

"diff -r" compares directories recursively.
"diff" without "-r" compares two directories
or two files, doesn't it?

Re: Transfer problem

haeman — Fri, 18 Jul 2008 04:25:20 GMT

thx reply

I tried mdelete , it is OK to remove the file in remote site , but still show the below message after run it , can advise what is wrong ? thx

Delete operation failed.

Re: Transfer problem

haeman — Fri, 18 Jul 2008 06:41:31 GMT

I have one more question ,

I edited this ftp script , it can put and get the files well ,if I want to add a comparsion script (eg. comparsion_script) to this ftp script , can advise what can i do ? Thx

ftp remote_server<prompt off
lcd dir1
passive
cd dir1
put *
lcd dir2
get *
mdelete *
comparsion_script
EOF

Re: Transfer problem

haeman — Fri, 18 Jul 2008 07:41:33 GMT

thx reply ,

what I want is after mdelete the file , then run the comparsion script , if I just add the script name to the ftp script , it will pop "?Invalid command" , can advise what can i do ?ã ï½ ï½ ï½

Re: Transfer problem

Dennis Handly — Fri, 18 Jul 2008 07:42:49 GMT

>but still show the below message after run it, can advise what is wrong?

You may not have permission to remove files on the remote system. Can you manually use "del" on a single file? Can you manually use "mdel" on another single file?
What does "ls -d ." show?

Re: Transfer problem

Dennis Handly — Fri, 18 Jul 2008 07:46:01 GMT

>then run the comparison script

To run a script you must exit ftp.

Re: Transfer problem

haeman — Fri, 18 Jul 2008 07:54:46 GMT

thx dennis,

To run a script you must exit ftp.

if exit ( bye ), how to run its next script ? thx

Re: Transfer problem

Dennis Handly — Fri, 18 Jul 2008 08:01:31 GMT

>how to run its next script?

Your current script has:
ftp remote_server<...
mdelete *
EOF

You either invoke your "comparsion_script" here or put the compare commands inline.

Re: Transfer problem

Steven Schweda — Fri, 18 Jul 2008 10:34:07 GMT

> I tried mdelete , it is OK to remove the
> file in remote site , but still show the
> below message after run it , can advise
> what is wrong ? [...]

Not without some useful information.

> To run a script you must exit ftp.

Not really. It might help if you would read
"man ftp", but I'm beginning to doubt it.

[...]
COMMANDS
[...]
![command [args]]
Invoke a shell on the local host. [...]

Have you considered hiring someone who can do
your job for you?

Re: Transfer problem

Dennis Handly — Fri, 18 Jul 2008 12:02:25 GMT

>> To run a script you must exit ftp.

>Not really

Oops, right. But ! would be next to useless at the end of ftp, when you can just exit back to the shell.
And just about the only commands I use are !pwd and !ls. Otherwise when interactive I use control-Z and use a real shell.

Re: Transfer problem

Chris Vail — Fri, 18 Jul 2008 14:39:28 GMT

This is NOT a good idea! You need to get all thoughts of ftp out of your mind, and use the secure shell equivalent, scp. This command scripts much more easily, it is secure and does not send passwords unencrypted as ftp does.

Rather than comparing the files before and after the transfer, use the sum command to get a checksum.

CSUM1=`sum $FILE|awk '{ print $1 }'`
scp $FILE $DESTHOST:/$DESTDIR
CSUM2=`ssh $DESTHOST sum $DESTDIR/$FILE|awk '{ print $1 }'`

if test "$CSUM1" -ne "$CSUM2"
then
echo "There is a problem with the file transfer."
fi

If you have not yet installed or configured ssh on your systems, I have previously posted instructions on how to to do this.

Chris