topic Re: ICONV returns empty output buffer in Operating System - OpenVMS

ICONV returns empty output buffer

rakesh patel — Fri, 11 May 2007 04:53:58 GMT

Hello,
I have another question. I'm probably doing something stupid but...
I have the internationalization kit installed, so I have all the .ICONV files.
I'm reading a UTF-8 encoded message, which I try to converted using iconv.

However the output buffer after calling iconv contains nothing, but the inbytesleft is 0, so all characters should have been converted.

Regards
Rakesh

Re: ICONV returns empty output buffer

Robert Gezelter — Fri, 11 May 2007 06:49:21 GMT

Rakesh,

Most likely, the code has an error. Without the code, any comments would be pure random speculation.

Please post a code segment that reproduces the problem that you are encountering. Before posting the code segment, please verify that the code segment is complete (e.g., it compiles, links, and produces the reported problem when executed).

- Bob Gezelter, http://www.rlgsc.com

Re: ICONV returns empty output buffer

Hoff — Fri, 11 May 2007 08:02:15 GMT

To expand on Bob's comments, I'd suggest first creating and testing something with the default encoding, and then work your way up to your own conversions.

It took a couple of reads through the C environment to get the hang of wide characters and UTC stuff.

I'd expect there are examples of using these calls available. And there are ports of libiconv available from various sources, as well.

Here's an earlier discussion:
http://forums1.itrc.hp.com/service/forums/questionanswer.do?threadId=726740

There are also ports of libxml2 around, and xml can help deal with file structuring and "weird" data.

Re: ICONV returns empty output buffer

rakesh patel — Fri, 11 May 2007 09:18:09 GMT

Hello,
I'm reading a message from MQ queue. The message is an UTF-8 xml message.

I have the following...
Call iconv_open
iconv_struct = iconv_open("ISO8859-1", "UTF-8");

Then I have my input message from MQ
char *input

size_t len = strlen(input);
char* outbuf = calloc(sizeof(char),len*2);
size_t outlen = len*2;

if(iconv(iconv_struct,&input,&len,&outbuf,&outlen) != 0)
{
printf("error\n");
}
else
{
printf("Success\n");
printf("[%s]\n",outbuf);
}

Re: ICONV returns empty output buffer

Hoff — Fri, 11 May 2007 09:54:31 GMT

UTF-8 XML?

I'd probably use libxml2 to read and process it. There's a port of libxml2 on the Freeware distro; it's the version that was current with the Freeware V8 distro.

There's certainly more information here, but still not enough to go on. In particular, we're going to need a little data, and it would be best to attach a text file (mumble.txt) to a reply here, with a full standalone example of your failing C code and a line or two of the UTF-8 text you're working with.

The other option is to call in some help with this sort of thing, as I'm guessing you're on a schedule to get this done.

Stephen Hoffman
HoffmanLabs.com

Re: ICONV returns empty output buffer

rakesh patel — Fri, 11 May 2007 10:01:05 GMT

thanks for you help.
I'll try and get a simple example application done for monday. I'll also attach a file created from the UTF-8 message written by MQ.

I also look into lib2xml
thanks again

Rakesh

Re: ICONV returns empty output buffer

rakesh patel — Mon, 14 May 2007 08:01:38 GMT

Hellom
I've tried using lib2xml and I still get an empty output buffer.

Attached is an example program source and a test file to decode.

Re: ICONV returns empty output buffer

rakesh patel — Mon, 14 May 2007 08:02:33 GMT

Here's the UTF-8 file

Re: ICONV returns empty output buffer

rakesh patel — Mon, 14 May 2007 09:01:00 GMT

I got lib2xml working. I made a stupid mistake in the program.