I experienced another cfservd hang on linux this weekend. I've placed
the (slightly munged) diagnostic data I was able to gather below. Any
ideas what the problem was? Have there been any changes to the newer
versions of cfservd that might improve matters?
Version Information:
GNU cfengine-2.1.14 daemon
Linux xxx 2.4.9-e.30smp #1 SMP Fri Nov 28 07:18:53 EST 2003 i686 unknown
Red Hat Enterprise Linux ES release 2.1 (Panama)
Telnet to port 5308 hung with:
# telnet localhost 5308
Trying 127.0.0.1...
GDB backtrace of the surviving process:
(gdb) bt
#0 0x40169be5 in __sigsuspend (set=0xbffece00) at
../sysdeps/unix/sysv/linux/sigsuspend.c:45
#1 0x400f02a9 in __pthread_wait_for_restart_signal (self=0x400f5000) at
pthread.c:1027
#2 0x400f037c in __pthread_create_2_1 (thread=0xbffecf88,
attr=0x815e2a0, start_routine=0x804c378 <HandleConnection>,
arg=0x42a0b6d0) at restart.h:34
#3 0x0804c0b8 in SpawnConnection (sd_reply=39, ipaddr=0xbffed0a0
"1.2.3.4") at cfservd.c:978
#4 0x0804bb1f in StartServer (argc=1, argv=0xbffed544) at cfservd.c:692
#5 0x0804aba2 in main (argc=1, argv=0xbffed544) at cfservd.c:156
#6 0x40157687 in __libc_start_main (main=0x804ab50 <main>, argc=1,
ubp_av=0xbffed544, init=0x8049fd8 <_init>, fini=0x80d7ce0 <_fini>,
rtld_fini=0x4000dc54 <_dl_fini>, stack_end=0xbffed53c) at
../sysdeps/generic/libc-start.c:129
Strace of pid 12067 yielded no output.
CFServd processes running:
# ps -efwww|grep [c]fservd
root 12067 1 0 Oct22 ? 00:00:04
/var/cfengine/bin/cfservd
root 12111 12067 0 Oct22 ? 00:00:02 [cfservd <defunct>]
LSOF output of surviving process:
# lsof -p 12067
COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME
cfservd 12067 root cwd DIR 8,11 4096 3719270
/data/var_cfengine
cfservd 12067 root rtd DIR 8,2 4096 2 /
cfservd 12067 root txt REG 8,11 1852242 3719893
/data/var_cfengine/bin/cfservd
cfservd 12067 root mem REG 8,2 495474 14637
/lib/ld-2.2.4.so
cfservd 12067 root mem REG 8,7 815885 163961
/usr/local/cfengine-test/BerkeleyDB.4.3.27/lib/libdb-4.3.so
cfservd 12067 root mem REG 8,2 325316 14676
/lib/libnss_nis-2.2.4.so
cfservd 12067 root mem REG 8,2 533336 14633
/lib/i686/libpthread-0.9.so
cfservd 12067 root mem REG 8,2 626466 14631
/lib/i686/libm-2.2.4.so
cfservd 12067 root mem REG 8,2 5797952 15873
/lib/i686/libc-2.2.4.so
cfservd 12067 root mem REG 8,2 436448 14655
/lib/libnsl-2.2.4.so
cfservd 12067 root mem REG 8,2 262396 14671
/lib/libnss_files-2.2.4.so
cfservd 12067 root mem REG 8,2 355364 14679
/lib/libnss_nisplus-2.2.4.so
cfservd 12067 root mem REG 8,2 72990 14668
/lib/libnss_dns-2.2.4.so
cfservd 12067 root mem REG 8,2 263059 14684
/lib/libresolv-2.2.4.so
cfservd 12067 root 0u CHR 1,3 30874 /dev/null
cfservd 12067 root 1u CHR 1,3 30874 /dev/null
cfservd 12067 root 2u CHR 1,3 30874 /dev/null
cfservd 12067 root 4u IPv4 922313540 TCP *:cfengine
(LISTEN)
cfservd 12067 root 5u unix 0xe8b6c040 922315962 socket
cfservd 12067 root 6r FIFO 0,0 922315963 pipe
cfservd 12067 root 7w FIFO 0,0 922315963 pipe
cfservd 12067 root 29u IPv4 923873448 TCP
xxx:cfengine->1.2.3.4:52050 (ESTABLISHED)
cfservd 12067 root 39u IPv4 923874636 TCP
xxx:cfengine->3.4.5.6:38411 (ESTABLISHED)
cfservd 12067 root 51u IPv4 923872982 TCP
xxx:cfengine->7.8.9.10:33550 (ESTABLISHED)
cfservd 12067 root 57u IPv4 923873866 TCP
xxx:cfengine->11.12.13.14:57945 (ESTABLISHED)
Last syslog message from cfservd overall:
Oct 22 08:15:56 xxx cfservd[10340]: Couldn't stat filename /some/dir
from host w.x.y.z
Oct 22 08:15:56 xxx cfservd[10340]: lstat
Oct 22 08:15:56 xxx cfservd[10340]: Host authorization/authentication
failed or access denied
Oct 22 08:15:56 xxx cfservd[10340]: From
(host=w.x.y.z,user=root,ip=7.8.9.10)
Oct 22 08:15:56 xxx cfservd[10340]: ID from connecting host: (SYNCH
1129994156 STAT /some/dir)
Last log message of defunct pid 12111 @4:36am oct 22. Client did not
have $(masterfiles) defined.
Oct 22 04:36:52 xxx cfservd[12111]: Couldn't stat filename
$(masterfiles)/inputs from host tt.yy.uu.ii
Oct 22 04:36:52 xxx cfservd[12111]: lstat
Oct 22 04:36:52 xxx cfservd[12111]: Host authorization/authentication
failed or access denied
Oct 22 04:36:52 xxx cfservd[12111]: From
(host=tt.yy.uu.ii,user=root,ip=66.77.88.99)
Oct 22 04:36:52 xxx cfservd[12111]: ID from connecting host: (SYNCH
1129980810 STAT $(masterfiles)/inputs)
Oct 22 04:36:52 xxx cfservd[12111]: Couldn't stat filename
$(masterfiles)/scripts from host tt.yy.uu.ii
Oct 22 04:36:52 xxx cfservd[12111]: lstat
Oct 22 04:36:52 xxx cfservd[12111]: Host authorization/authentication
failed or access denied
Oct 22 04:36:52 xxx cfservd[12111]: From
(host=tt.yy.uu.ii,user=root,ip=66.77.88.99)
Oct 22 04:36:52 xxx cfservd[12111]: ID from connecting host: (SYNCH
1129980811 STAT $(masterfiles)/scripts)
Oct 22 04:36:52 xxx cfservd[12111]: Couldn't stat filename
$(masterfiles)/modules from host tt.yy.uu.ii
Oct 22 04:36:52 xxx cfservd[12111]: lstat
Oct 22 04:36:52 xxx cfservd[12111]: Host authorization/authentication
failed or access denied
Oct 22 04:36:52 xxx cfservd[12111]: From
(host=tt.yy.uu.ii,user=root,ip=66.77.88.99)
Oct 22 04:36:52 xxx cfservd[12111]: ID from connecting host: (SYNCH
1129980811 STAT $(masterfiles)/modules)
Oct 22 04:36:52 xxx cfservd[12111]: Couldn't stat filename
$(masterfiles)/pkgs from host tt.yy.uu.ii
Oct 22 04:36:52 xxx cfservd[12111]: lstat
Oct 22 04:36:52 xxx cfservd[12111]: Host authorization/authentication
failed or access denied
Oct 22 04:36:52 xxx cfservd[12111]: From
(host=tt.yy.uu.ii,user=root,ip=66.77.88.99)
Oct 22 04:36:52 xxx cfservd[12111]: ID from connecting host: (SYNCH
1129980811 STAT $(masterfiles)/pkgs)
Thank you,
-Jason Martin
_______________________________________________
Bug-cfengine mailing list
address@hidden
http://lists.gnu.org/mailman/listinfo/bug-cfengine