topic Re: cannot transfer CSV Files from linux to windows correctly in Networking

cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 07:00:24 GMT

hi

I have a big problem and need really help.
I should transfer CSV files from linux to the WIN2000 ftp server via perl script, but all files after transfer are currupt.
and no matter how I ftp these files:
perl script, from shell Konsole,gftp,
passive transfer,ascii or binary.
they are always corrupt after ftp transfer.

should I encode or convert to the MS Windows format and how it works using perl ?

I can only transfer via ftp these files.

windows to windows transfer all files correctly.

kind regards
chris

Re: cannot transfer CSV Files from linux to windows correctly

harry d brown jr — Tue, 22 Jun 2004 07:35:14 GMT

Because windows is stupid, you probably have to do a unix2dos conversion first before transfering them. It adds a carriage return or line feed (I forgot which is which) (^M) to the end of each line.

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 08:13:33 GMT

hi

I've tried to convert with unix2dos, but still doesn't work.

greetings
chris

Re: cannot transfer CSV Files from linux to windows correctly

harry d brown jr — Tue, 22 Jun 2004 08:16:23 GMT

on your windoze box try using "rcp":

C:\stupidmachine\ rcp -b linuxbox.root:/some directory/* .

your linux box has to "trust" the windoze box (man that is scary).

live free or die
harry

Re: cannot transfer CSV Files from linux to windows correctly

Victor BERRIDGE — Tue, 22 Jun 2004 08:25:39 GMT

Hi,
How about considering the use of samba?
That should work as I do something of the sort for my SAS users who need to recuperate the csv file into excel from a shared drive mounted on their PCs.

All the best
Victor

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 08:43:11 GMT

I can use ftp only.
I cannot use samba over the internet.

Re: cannot transfer CSV Files from linux to windows correctly

Victor BERRIDGE — Tue, 22 Jun 2004 08:52:42 GMT

Could it be something to do with charset? Like for mail?
set crt=21
set encoding=8bit
set charset=iso-8859-1

Just thoughts...

Good luck

Victor

Re: cannot transfer CSV Files from linux to windows correctly

harry d brown jr — Tue, 22 Jun 2004 08:57:05 GMT

Are you ftp'ing from windows or TO windoze? If TO, what FTP server on windoze are you using?

Have you tried to move a single file manually to windoze, then move it back to linux to see if it is actually corrupted? (of course use BINARY mode both ways).

What errors on windoze do you get?

live free or die
harry

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 09:00:32 GMT

maybe yes and I think so, but how to encode these files using perl ?

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 09:18:54 GMT

hi harry

I cannot control the remote server.

I transfer all files from LINUX TO WINDOWS.

on the remote site it's:
220 szhstorage Microsoft FTP Service (Version 5.0).

if I do ftp transfer from any windows maschine to this remote Mickysoft server all files are OK.

but all files transfered from linux are corrupt.

I've tried to move this file from linux to windows, move back to linux, transfer again, but still corrupt.

Re: cannot transfer CSV Files from linux to windows correctly

Victor BERRIDGE — Tue, 22 Jun 2004 09:27:09 GMT

Could you describe what corruption you have, since you transmetted file is pur ascii how does it get modified?

Courage!

Re: cannot transfer CSV Files from linux to windows correctly

Ganesh Babu — Tue, 22 Jun 2004 09:37:14 GMT

could u post a corrupted file and a good one???

Ganesh

Re: cannot transfer CSV Files from linux to windows correctly

Bruno Ganino — Tue, 22 Jun 2004 11:08:12 GMT

Try with xftp
http://www.download.com/Xftp/3000-2160-10293316.html?tag=lst-0-6

Bruno

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 16:50:35 GMT

good file looks:
---------------------------------------------------------------------------------------
I,ZZ0387778,Name Firstname,USD,street 166,city,,,,B:266.27.07,3654,USD,P:351.15.79,,,DE,USD107,
I,ZZ0387780,Name Firstname,USD,street,city,,,,B:792.58.50,6344,USD,P:485.29.85,,,DE,USD001,
I,ZZ0274516,Name Firstname,USD,street 2,city,,,,B:834.33.23,3292,USD,P:284.89.60,,,DE,USD033,
I,ZZ0558613,Name Firstname,USD,street 102,city,,,,,8032,USD,P:383.31.96,,,DE,USD999,
---------------------------------------------------------------------------------------

bed file (after ftp transfer) looks:
---------------------------------------------------------------------------------------
I,ZZ0387778,Name Firstname,USD,street 166,city,,,,B:266.27.07,3654,USD,P:351.15.79,,,DE,USD107,
I,ZZ0387780,Name Firstname,USD,street,city,,,,B:Ã Ã dÃ®Ã Ã kÂ£Ã°9Ã Å¡Ã Ã Ã¼Â±RÃ©Ã ZÃ¹Ã¼Ã¡Ã Ã Ã Ã¾
I,ZZ0274516,Name Firstname,USD,street 2,city,,,,B:834.33.23,3292,USD,P:284.89.60,,,DE,USD033,
I,ZZ0558613,Name Firstname,USD,street 102,city,,,,,8032,USD,P:383.31.96,,,DE,USD999,
---------------------------------------------------------------------------------------

with xftp works, but I cannot use it in my case.
what can xftp, what the others cannot do ?
how to to simulate xftp using perl ?
may

Re: cannot transfer CSV Files from linux to windows correctly

Ganesh Babu — Tue, 22 Jun 2004 16:57:40 GMT

do u want to check this out??

http://support.microsoft.com/default.aspx?scid=kb;en-us;q188956

Ganesh

Re: cannot transfer CSV Files from linux to windows correctly

Ganesh Babu — Tue, 22 Jun 2004 17:01:48 GMT

i am not sure whether this will work.. but try transfer of file in binary mode itself..

Because in the More information section of my previous link says

The FTP protocol offers two types of transfers: binary and ASCII. In a binary download (which is always used by the ITC), the FTP server sends to the client the exact contents of a file. In a binary upload, the FTP server stores exactly what the client sends. This is desirable behavior for most types of files, such as executable programs, images, word processor documents, and so on.

Ganesh

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Tue, 22 Jun 2004 17:33:15 GMT

hi

I've tried already to transfer binary, but it doesn't work either.

I get these files from a IBM machine and they are encoded in EBCDIC, I think.
I should rename files and send automatically via ftp to the remote windows machine.

the solution can be, to encode using perl from EBCDIC to the windows standard ?

Re: cannot transfer CSV Files from linux to windows correctly

Bruno Ganino — Wed, 23 Jun 2004 03:09:33 GMT

Hi Chris, read this document. It is interesting...
http://www.microsoft.com/technet/itsolutions/migration/linux/mvc/lintowin.mspx

HTH
Bruno

Re: cannot transfer CSV Files from linux to windows correctly

Victor BERRIDGE — Wed, 23 Jun 2004 07:21:33 GMT

Hi chris,
Is your IBM an mainframe mvs/OS390 ?
I would start by looking at the files transmetted from IBM to linux.
Is the file what you expect? when you look at it with vi , all seems mormal?

There are 2 cases with tranfer to mainframes:
ascii/ebcdic and block format
You can ask the mainframe to translate to ascii
From /to a GCOS system I had to use dd:
dd if= of= cbs= conv=unblock
I would try with the option conv=unblock, then pass this file through ux2dos> "file_for_win"
If I can think of something else I will let you know, keep us informed

Good luck and all the best
Kind regards
Victor

Re: cannot transfer CSV Files from linux to windows correctly

'chris' — Wed, 23 Jun 2004 08:36:10 GMT

hi

OS from the IBM maschine is AS400.
If I look this file with vi or kwrite looks always fine.

and what about lenght for fixed block size ?

The files, which I get from AS400 have each time differnt size.

I played a little bit with language settings from linux and for a short time all transfers were correctly, but after reboot like before.

and xftp from
http://www.llnl.gov/ia/xftp.html
transfer all files always correctly.

knows someone, if I can use xftp from shell Konsole or use it in combination with a perl script ?

greetings
chris