cannot rsync from HPUX 11.23 ai64 to HPUX 11.11 risc

[Dennis Nitz]

Hi there,

is have a problem syncing files via rsync.
Listing the files works but transferig not :-(

sourcehost is a HPUX ia64 11.23
desthost is a HPUX 9000 11.11

On both systems i installed rsync 2.6.8

My /etc/rsyncd.conf on sourcehost:
# read only = true
uid = root
gid = root
max connections = 0 # no limit
pid file = /var/run/rsyncd.pid
log file = /var/adm/rsync.log
transfer logging = true
log format = %h %o %f %l %b
timeout = 300

[segment]
path=/fs/vg03/lvol1


Now i want to sync files from the sourcehost::segment to my destination:

1. listing files works correctly:
root on desthost# /usr/local/bin/rsync sourcehost::segment
drwxr-xr-x 4096 2006/08/28 16:24:53 .
-rw------- 585524 2007/01/02 13:59:22 core
-rw-r--r-- 108 2005/12/30 10:24:20 smb.config
-rw-r--r-- 93 2005/12/30 10:19:45 smb.config.ORG
drwxr-xr-x 96 2005/11/26 10:02:25 lost+found
root on desthost#

2. but when i want to sync a file i get an error:
root on desthost# /usr/local/bin/rsync -a sourcehost::segment/smb.config .
rsync: connection unexpectedly closed (0 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [receiver=2.6.8]
root on desthost#

3. i started the rsyc-daemon with the help of tusc:
root on sourcehost# /usr/local/bin/tusc /usr/local/bin/rsync --daemon --no-detach >/tmp/rsync.log


Here is the output of the tusc:

execve("/usr/local/bin/rsync", 0x9ffffffffffff7e0, 0x9ffffffffffff800) ....... = 0 [32-bit]
mmap(NULL, 8192, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7effb000
open("/usr/lib/hpux32/dld.so", O_RDONLY, 0) .................................. = 3
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 52, SEEK_SET) ....................................................... = 52
read(3, "\0\0\006\0\0\04 \0\0\04 \0\0\0\0".., 288) ........................... = 288
mmap(NULL, 456944, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_FILE|MAP_SHLIB, 3, 0) . = 0xc0016000
sysconf(_SC_PAGE_SIZE) ....................................................... = 4096
mmap(NULL, 4168, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS|MAP_SHLIB, -1, 0) = 0x7eff9000
mmap(0x7eff5000, 12312, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FILE|MAP_SHLIB, 3, 458752) = 0x7eff500
0
close(3) ..................................................................... = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7eff3000
audctl(0x9, NULL, NULL, F_OK) ................................................ = 0
procxsec(4, -1, 0x7ffff460, 40) .............................................. ERR#251 ENOSYS
sysconf(_SC_PAGE_SIZE) ....................................................... = 4096
getuid() ..................................................................... = 0 (0)
getuid() ..................................................................... = 0 (0)
getgid() ..................................................................... = 3 (3)
getgid() ..................................................................... = 3 (3)
stat("/usr/lib/hpux32/dpd", 0x7ffff410) ...................................... = 0
open("/usr/lib/hpux32/dpd", O_RDONLY, 0) ..................................... = 3
fcntl(3, F_SETFD, 0) ......................................................... = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7efec000
getdents(3, 0x7efec028, 8192) ................................................ = 80
getdents(3, 0x7efec028, 8192) ................................................ = 0
close(3) ..................................................................... = 0
open("/usr/local/bin/rsync", O_RDONLY, 0) .................................... = 3
lseek(3, 404, SEEK_SET) ...................................................... = 404
read(3, "\0\0\002\0\0\0, \0\0\0\aH P \0\0".., 60) ............................ = 60
close(3) ..................................................................... = 0
open("/usr/local/lib/hpux32/libintl.so", O_RDONLY, 0) ........................ = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 0, SEEK_SET) ........................................................ = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 1024) .......................... = 1024
mmap(NULL, 67632, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 3, 0) ........... = 0xc60fb000
mmap(NULL, 2632, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_SHLIB, 3, 131072) = 0x7eff2000
close(3) ..................................................................... = 0
open("/usr/local/lib/hpux32/libpopt.so", O_RDONLY, 0) ........................ = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 0, SEEK_SET) ........................................................ = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 1024) .......................... = 1024
mmap(NULL, 55104, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 3, 0) ........... = 0xc660c000
mmap(NULL, 1472, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_SHLIB, 3, 57344) = 0x7eff1000
close(3) ..................................................................... = 0
open("/usr/local/lib/hpux32/libc.so.1", O_RDONLY, 0) ......................... ERR#2 ENOENT
open("/usr/local/lib/libc.so.1", O_RDONLY, 0) ................................ ERR#2 ENOENT
open("/usr/lib/hpux32/libc.so.1", O_RDONLY, 0) ............................... = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 0, SEEK_SET) ........................................................ = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 1024) .......................... = 1024
mmap(NULL, 2629312, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 3, 0) ......... = 0xc0122000
madvise(0xc0122000, 0x281ec0, MADV_NORMAL) ................................... = 0
mmap(NULL, 41256, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANONYMOUS|MAP_SHLIB, -1, 0) = 0x7e
fe0000
madvise(0x7efe0000, 0xa128, MADV_NORMAL) ..................................... = 0
mmap(0x7efd9000, 26548, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_SHLIB, 3, 2629632) = 0x7efd9
000
madvise(0x7efd9000, 0x67b4, MADV_NORMAL) ..................................... = 0
close(3) ..................................................................... = 0
mmap(NULL, 8192, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7efd7000
open("/usr/lib/hpux32/libiconv.so", O_RDONLY, 0) ............................. = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 0, SEEK_SET) ........................................................ = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 1024) .......................... = 1024
mmap(NULL, 1013744, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 3, 0) ......... = 0xc661a000
mmap(NULL, 11496, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_SHLIB, 3, 1048576) = 0x7efd4000
close(3) ..................................................................... = 0
open("/usr/local/lib/hpux32/libc.so.1", O_RDONLY, 0) ......................... ERR#2 ENOENT
open("/usr/lib/hpux32/libc.so.1", O_RDONLY, 0) ............................... = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
close(3) ..................................................................... = 0
open("/usr/lib/hpux32/libdl.so.1", O_RDONLY, 0) .............................. = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
lseek(3, 0, SEEK_SET) ........................................................ = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 1024) .......................... = 1024
mmap(NULL, 15728, PROT_READ|PROT_EXEC, MAP_SHARED|MAP_SHLIB, 3, 0) ........... = 0xc03a4000
mmap(NULL, 224, PROT_READ|PROT_WRITE|PROT_EXEC, MAP_PRIVATE|MAP_SHLIB, 3, 16384) = 0x7eff0000
close(3) ..................................................................... = 0
open("/usr/lib/hpux32/libc.so.1", O_RDONLY, 0) ............................... = 3
fstat(3, 0x7ffff330) ......................................................... = 0
read(3, "7fE L F 0102010101\0\0\0\0\0\0\0".., 52) ............................ = 52
close(3) ..................................................................... = 0
open("/opt/graphics/OpenGL/lib/hpux32/libogltls.so", O_RDONLY, 0) ............ ERR#2 ENOENT
sigsetreturn(NULL, 0x6211988, 48640) ......................................... = 0
mmap(NULL, 3336, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) ..... = 0x7efeb000
sigsetreturn(NULL, 0x6211988, 48640) ......................................... = 0
sigaction(SIGUSR1, 0x40006840, NULL) ......................................... = 0
sigaction(SIGUSR2, 0x40006840, NULL) ......................................... = 0
sigaction(SIGCLD, 0x40006840, NULL) .......................................... = 0
time(NULL) ................................................................... = 1167994230
getuid() ..................................................................... = 0 (0)
umask(0) ..................................................................... = 022
sysconf(_SC_CPU_VERSION) ..................................................... = 768
brk(0x400099d0) .............................................................. = 0
brk(0x4000b9c0) .............................................................. = 0
brk(0x4000c000) .............................................................. = 0
brk(0x4000e000) .............................................................. = 0
open("/usr/lib/nls/loc/hpux32/locales.1/C", O_RDONLY, 0) ..................... ERR#2 ENOENT
brk(0x40018000) .............................................................. = 0
brk(0x40019000) .............................................................. = 0
open("/etc/popt", O_RDONLY, 0) ............................................... ERR#2 ENOENT
getuid() ..................................................................... = 0 (0)
getuid() ..................................................................... = 0 (0)
open("//.popt", O_RDONLY, 0) ................................................. ERR#2 ENOENT
sigaction(SIGINT, 0x40006840, NULL) .......................................... = 0
sigaction(SIGHUP, 0x40006840, NULL) .......................................... = 0
sigaction(SIGTERM, 0x40006840, NULL) ......................................... = 0
sigprocmask(SIG_UNBLOCK, 0x7fffe4a0, NULL) ................................... = 0
sigaction(SIGPIPE, 0x40006840, NULL) ......................................... = 0
sigaction(SIGXFSZ, 0x40006840, NULL) ......................................... = 0
sysfs(GETFSIND, 0xc015c5c8, 0xc016fba0) ...................................... = 7
lstat(".", 0x7fffd570) ....................................................... = 0
open("../", O_RDONLY|0x200000, 0) ............................................ = 3
fstat(3, 0x7fffd650) ......................................................... = 0
fcntl(3, F_SETFD, 0) ......................................................... = 0
sysfs(GETFSIND, 0xc0163d20, 0x7efdb218) ...................................... = 10
brk(0x4001e000) .............................................................. = 0
close(3) ..................................................................... = 0
getsockopt(0, SOL_SOCKET, SO_TYPE, 0x7fffe480, 0x7fffe484) ................... ERR#216 ENOTSOCK
open("/etc/rsyncd.conf", O_RDONLY|0x800, 0666) ............................... = 3
ioctl(3, TCGETA, 0x7fffe060) ................................................. ERR#25 ENOTTY
read(3, "# r e a d o n l y = t r ".., 8192) .......................... = 355
lseek(3, 4294967177, SEEK_CUR) ............................................... = 236
close(3) ..................................................................... = 0
time(NULL) ................................................................... = 1167994230
stat("/usr/lib/tztab", 0x7fffe2d0) ........................................... = 0
open("/usr/lib/tztab", O_RDONLY, 01210) ...................................... = 3
mmap(NULL, 16266, PROT_READ, MAP_PRIVATE, 3, 0) .............................. = 0x7efd0000
close(3) ..................................................................... = 0
umask(022) ................................................................... = 0
open("/var/adm/rsync.log", O_WRONLY|O_APPEND|O_CREAT|0x800, 0666) ............ = 3
lseek64(3, 0, SEEK_END) ...................................................... = 22140
umask(0) ..................................................................... = 022
time(NULL) ................................................................... = 1167994230
getpid() ..................................................................... = 28187 (28161)
ioctl(3, TCGETA, 0x7fffc7a0) ................................................. ERR#25 ENOTTY
write(3, "2 0 0 7 / 0 1 / 0 5 1 1 : 5 0 ".., 81) ........................... = 81
getpid() ..................................................................... = 28187 (28161)
open("/var/run/rsyncd.pid", O_WRONLY|O_CREAT|O_TRUNC|0x800, 0644) ............ = 4
write(4, "2 8 1 8 7 \n", 6) .................................................. = 6
close(4) ..................................................................... = 0
socket(AF_INET, SOCK_STREAM, 0) .............................................. = 4
setsockopt(4, SOL_SOCKET, SO_REUSEADDR, 0x7fffe280, 4) ....................... = 0
bind(4, 0x40018090, 16) ...................................................... = 0
listen(4, 5) ................................................................. = 0
close(3) ..................................................................... = 0
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... [sleeping]
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... = 1
accept(4, 0x7fffe388, 0x7fffe280) ............................................ = 3
sigaction(SIGCLD, 0x40008e98, NULL) .......................................... = 0
fork() ....................................................................... = 28837
close(3) ..................................................................... = 0
Received signal 18, SIGCLD, in select(), [caught], no siginfo
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... ERR#4 EINTR
waitpid(-1, NULL, WNOHANG) ................................................... = 28837
waitpid(-1, NULL, WNOHANG) ................................................... ERR#10 ECHILD
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... [sleeping]
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... = 1
accept(4, 0x7fffe388, 0x7fffe280) ............................................ = 3
sigaction(SIGCLD, 0x40008e98, NULL) .......................................... = 0
fork() ....................................................................... = 11476
close(3) ..................................................................... = 0
Received signal 18, SIGCLD, in select(), [caught], no siginfo
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... ERR#4 EINTR
waitpid(-1, NULL, WNOHANG) ................................................... = 11476
waitpid(-1, NULL, WNOHANG) ................................................... ERR#10 ECHILD
select(5, 0x7fffe288, NULL, NULL, NULL) ...................................... [sleeping]

What does the "ERR#4 EINTR" and the "ERR#10 ECHILD" mean?

I can't figure out why the file transfer doesn't work :-(

[Peter Godron]

Dennnis,
have you tried listing a subdirectory ?

http://lists.samba.org/archive/rsync/2006-September/016249.html

[Dennis Nitz]

oh you're right - it seems to be the same problem :-(

i've found a corefile on the sourcehost:

root on sourcehost# file core
core: ELF-32 core file - IA64 from 'rsync' - received SIGSEGV
root on sourcehost#
root on sourcehost# what core
core:
$ PATCH_11.23/PHCO_34191 Feb 14 2006 06:00:26 $
92453-07 linker dld HP Itanium(R) B.12.34
92453-07 linker uld HP Itanium(R) B.12.34
root on sourcehost#

root on sourcehost# strings core
/lib/hpux32/libnss_dns.so.1
root on sourcehost#

Is it a library-error?

[Ermin Borovac]

Can you please run tusc with -f option to follow forks? That will provide more info on rsync child process that's spawned with fork().

You can run tusc as follows

tusc -o tusc.log -ccc -f -l -n -p -E -v -T%T -b 80 -r all -w all

Perhaps it would be worthwhile to trace both rsync instances (src and dst).

Also it would be useful to run rsync with -v (verbose) option. Multiple -v options can be specified for debugging.

I assume there's nothing interesting in /var/adm/rsync.log.

Finally, in case you haven't already please check disk space utilisation on both systems with bdf.

[Dennis Handly]

>i've found a corefile on the sourcehost:
>core: ELF-32 core file - IA64 from 'rsync' - received SIGSEGV

Then you need to use gdb to debug it.
gdb rsync core
bt

>Is it a library-error?

Why would you think that without looking at a stack trace??

If you are going to use tusc, you need to have it trace child processes, -f and use -l to get the PIDs listed.

[Dennis Nitz]

rsync -vvv says:
opening tcp connection to segment_hp11.ibd.porsche.de port 873
opening connection using --server --sender -vvv --list-only . segment/segment_hp10
rsync: connection unexpectedly closed (0 bytes received so far) [receiver]
rsync error: error in rsync protocol data stream (code 12) at io.c(463) [receiver=2.6.8]
_exit_cleanup(code=12, file=io.c, line=463): about to call exit(12)

rsyncd.log on sourcehost is untalkative:
2007/01/05 12:55:35 [13215] rsyncd version 2.6.8 starting, listening on port 873
2007/01/05 12:56:07 [19400] connect from desthost

attached you can find the tusc-output from sourcehost and desthost


Thank you very much for your help so far...

[Peter Godron]

Hi,
I would say the socket client did not start successful, which results in no data being read from the port, which is interpreted as a fail condition.

See section 3 in http://samba.anu.edu.au/rsync/issues.html

[Ermin Borovac]

The child rsync process dies with SIGSEGV.

12:56:07 [/usr/local/b][19400]{4872411} <-0.000000> Received signal 11, SIGSEGV, in user mode, [SIG_DFL], partial siginfo
12:56:07 [/usr/local/b][19400]{4872411} <-0.000000> Siginfo: si_code: SEGV_ACCERR, faulting address: 0, si_errno: 0
12:56:07 [/usr/local/b][19400]{4872411} <-0.000000> PC: 00000001000000a0.0 break.m 0x16000
12:56:07 [/usr/local/b][19400]{4872411} <0.000044> exit(11) [implicit] .......................................... WIFSIGNALED(SIGSEGV)
12:56:07 [/usr/local/b][13215]{4866161} <-0.000000> Received signal 18, SIGCLD, in select(), [caught], no siginfo

Next step would be to debug rsync with gdb to see where it fails.

Would you be able to get gdb backtrace (see Dennis's post)?

We are also running rsync server (version 2.6.9 on 11.11) and haven't noticed any problems.

The other option is to download rsync from Internet Express bundle provided by HP, but I suspect it will have the same problem.

http://h20293.www2.hp.com/portal/swdepot/displayProductInfo.do?productNumber=HPUXIEXP1123

[Jeff_Traigle]

Did you create the /usr/bin/rsync symlink pointing to /usr/local/bin/rsync? Don't know if that might be the problem for you using it in daemon mode, but I know it wouldn't work for me in regular mode until the symlink was created. The HP P&A site depot doesn't create it unfortunately.

[Dennis Nitz]

Hi again,

sorry for the late reply.
I updated to rsync 2.6.9. The problem seems to be solved...

Thank you very much for your help!!!!!

[Dennis Nitz]

Installed rsync 2.6.9 on the sourcehost.