topic Re: Polish unicode file in Operating System - HP-UX

Polish unicode file

Phil Smith_6 — Tue, 23 Nov 2004 06:22:34 GMT

I am trying to transfer a file from Windows to HPUX that contains Polish characters żźŻŹłł. The environment on the HP machine is set up to read in pl_PL.iso88592 and my Putty session is set up with the same translation settings.

However, I believe that when I FTP the file it is being corrupted. Perhaps something to do with transfer in 7-bit rather than 8-bit ??

Any ideas to either a) create the file on the UNIX machine (including how to type the characters) or b) settings to transfer the file correctly or c) any settings I have ommitted on the HP side ?

Thank you

Phil

Re: Polish unicode file

Steve Steel — Tue, 23 Nov 2004 07:21:10 GMT

Hi

1)Extended chars so use 8 bit

2)Use a utf8 locale

You may need a patch like

Patch Name: PHCO_30241

Patch Description: s700_800 11.11 Eastern Europe utf8 locales patch

Creation Date: 04/01/21

Post Date: 04/02/26

Hardware Platforms - OS Releases:
s700: 11.11
s800: 11.11

Products: N/A

Filesets:
International.BULGARIAN,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP
International.CZECH,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP
International.HUNGARIAN,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP
International.POLISH,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP
International.RUMANIAN,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP
International.RUSSIAN,fr=B.11.11,fa=HP-UX_B.11.11_32/64,v=HP

Make sure terminal stty is set to
"cs8", "-istrip" and "-parenb".

Steve Steel

Re: Polish unicode file

Wim Rombauts — Tue, 23 Nov 2004 07:41:05 GMT

It could indeed be that you have received a file based on the utf8 character set.
Since this character set uses different binary codes to represent characters compared to the iso8859 character set, you can see gibberish if you open the file with an iso8859 locale.
However, most of the standard (english) characters should look OK. If you only see gibberish, there is something else going wrong.

Re: Polish unicode file

Bill Hassell — Tue, 23 Nov 2004 07:46:12 GMT

Always transfer special files as binary in ftp. This makes an exact copy and the content of the file is unmodified. The character codes should be correct but the end-of-line terminator may be the Windows CR/LF pair which will show up as extra ^M characters (the CR) in some applications. You can use dos2ux to remove the extra ^M characters.

Re: Polish unicode file

Phil Smith_6 — Tue, 23 Nov 2004 08:18:10 GMT

Thanks to all so far.

Update:
I have installed the patch.
Transfered in binary (using a few choice ftp clients).
confirmed $LANG=pl_PL.iso88592

Still the file is "corrupted"

# cat abox.txt
Ë Å£START -e - POLTEST - [[BB||zzyyÃ³Ã³DD
SW_QPARAM1,[[BB||zzyyÃ³Ã³DD
STOP

The first characters appear to be the unicode header, the english is fine, but the special characters are incorrect.

Any further suggestions would be appriec

Re: Polish unicode file

Steve Steel — Tue, 23 Nov 2004 08:20:57 GMT

Hi

Did you do the stty I recommended

Steve Steel

Re: Polish unicode file

Phil Smith_6 — Tue, 23 Nov 2004 08:24:49 GMT

sorry, yes, I did the following:

# stty cs8 -istrip -parenb
# stty -a
speed 9600 baud; line = 0;
rows = 24; columns = 113
min = 4; time = 0;
intr = ^C; quit = ^\; erase = DEL; kill = ^U
eof = ^D; eol = ^@; eol2 ; swtch
stop = ^S; start = ^Q; susp ; dsusp
werase ; lnext
-parenb -parodd cs8 -cstopb hupcl -cread -clocal -loblk -crts
-ignbrk brkint ignpar -parmrk -inpck -istrip -inlcr -igncr icrnl -iuclc
ixon -ixany ixoff -imaxbel -rtsxoff -ctsxon -ienqak
isig icanon -iexten -xcase echo echoe echok -echonl -noflsh
-echoctl -echoprt -echoke -flusho -pendin
opost -olcuc onlcr -ocrnl -onocr -onlret -ofill -ofdel -tostop

Re: Polish unicode file

H.Merijn Brand (procura — Tue, 23 Nov 2004 08:33:36 GMT

Just for the record. UTF-8 and UTF-16 (Unicode) are NOT the same as iso-8859-1 .. iso8859-15.

For Unicode environment, you do not need special locales for each country. utf-8 will cover for all. I'm using iso10646-1 myself, and that will cover the whole of Europe, and since Unicode is far more portable than any of the other limited iso8859 standards, it might be a better option in the long run

Enjoy, Have FUN! H.Merijn

Re: Polish unicode file

Wim Rombauts — Wed, 24 Nov 2004 02:44:00 GMT

Do this to switch your environment to unicode :

$ export LC_ALL=univ.utf8

Try to open the file now.