Rsync & HP-UX 11.11 64bit + largefiles

[Unix OnCall]

I am trying to install rsync-2.5.6 on a HP-UX 11.11 64bit system, patched to June2003. I downloaded source from archieve site and commpiled. When trying to rsync a file GT 2 Giga from one filesystem to another on the same system it dies once it gets to 2 gig.

Anyone have any experience with rsync on 11.11 and large files?

[Brian Bergstrand]

rsync itself probably has an internal limit of 2GB. There are several utilities that have this limit, including tar (but not gnutar).

Have you checked the man page or distro notes to see if this is the case?

[A. Clay Stephenson]

The first obvious question is "Have you enabled largefiles for the destination filesystem?".

[A. Clay Stephenson]

Ooops, I hit [Submit] too quickly. Determine if largefiles are enabled thusly:

fsadm -F vxfs /home

It will report "largefiles" or "nolargefiles". You can then change this with a subsequent fsadm command. Man fsadm_vxfs for details.

[Unix OnCall]

Both filesystem that are associated with the rsync copy are set to "largefiles". fsadm confirms this.

[Brian Bergstrand]

Found this in the rsync README.

"Note that on some systems you will have to force configure not to use
gcc because gcc may not support some features (such as 64 bit file
offsets) that your system may support. Set the environment variable CC
to the name of your native compiler before running configure in this case."

So if this was built with a version of gcc that didn't support 64bit offsets, then rsync will be limited to 2GB files.

Your only choice then is to download the rsync source and compile it with HP's compiler or a newer version of GCC that (may) support 64bits.

[A. Clay Stephenson]

I never use gcc so if you are using it, you will need to find the options thast allow 64-bit i/o operations -- especially lseeks and fstats.

[Paulo A G Fessel]

In 11.00, I've got to build rsync-2.5.6 from Software Port and Archive Center with 64-bit file addressing using gcc-3.2 (gcc-3.3 currently) from "Merijn's HP Software for ITRC Members" (https://www.beepz.com/personal/merijn/):

[root@berc0004:~/rsync-2.5.6]# rsync --help
rsync version 2.5.6 protocol version 26
Copyright (C) 1996-2002 by Andrew Tridgell and others
<>
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, no IPv6, 32-bit system inums, 64-bit internal inums

When compiling using gcc, you are likely to have the following error:

gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt -c lib/snprintf.c -o lib/snprintf.o
lib/snprintf.c: In function `dopr':
lib/snprintf.c:199: warning: signed and unsigned type in conditional expression
lib/snprintf.c:219: warning: signed and unsigned type in conditional expression
lib/snprintf.c: At top level:
lib/snprintf.c:760: conflicting types for `snprintf'
/usr/local/lib/gcc-lib/hppa2.0n-hp-hpux11.00/3.2/include/stdio.h:493: previous declaration of `snprintf'
gmake: *** [lib/snprintf.o] Error 1

To fix this, edit config.h on the main directory of rsync's source and change the line "/* undef HAVE_C99_VSNPRINTF */" to "define HAVE_C99_VSNPRINTF" (make sure that you removed all comments). Then, issue a "(g)make clean ; (g)make" and rsync will compile cleanly.

Don't worry with gcc warnings; rsync works allright. We have it here in production usage to synchronize Oracle archive logs between two (geographically separated) servers without any problems.

HTH
Paulo Fessel

[Paulo A G Fessel]

BTW, don't forget to assign the corresponding points on this thread.

TIA
Paulo Fessel