Re: [libvirt-users] libvirtd hangs

On Thu, Jan 18, 2018 at 11:30:16AM +0700, Artem Likhachev wrote:

> # strace -p 5786 > read(53, "\0\0\0\34", 4) = 4 > read(53, "keep\0\0\0\1\0\0\0\2\0\0\0\2\0\0\0\0\0\0\0\0", 24) = 24 > poll([{fd=5, events=POLLIN}, {fd=7, events=POLLIN}, {fd=12, > events=POLLIN}, {fd=13, events=POLLIN}, {fd=14, events=POLLIN}, > {fd=15, > events=POLLIN}, {fd=19, events=POLLIN}, {fd=23, > events=POLLIN|POLLERR|POLLHUP}, {fd=21, > events=POLLIN|POLLERR|POLLHUP}, > {fd=27, events=POLLIN|POLLERR|POLLHUP}, {fd=25, > events=POLLIN|POLLERR|POLLHUP}, {fd=22, > events=POLLIN|POLLERR|POLLHUP}, > {fd=24, events=POLLIN|POLLERR|POLLHUP}, {fd=26, > events=POLLIN|POLLERR|POLLHUP}, {fd=29, > events=POLLIN|POLLERR|POLLHUP}, > {fd=30, events=POLLIN|POLLERR|POLLHUP}, {fd=31, > events=POLLIN|POLLERR|POLLHUP}, {fd=33, > events=POLLIN|POLLERR|POLLHUP}, > {fd=32, events=POLLIN|POLLERR|POLLHUP}, {fd=36, > events=POLLIN|POLLERR|POLLHUP}, {fd=35, > events=POLLIN|POLLERR|POLLHUP}, > {fd=39, events=POLLIN|POLLERR|POLLHUP}, {fd=40, > events=POLLIN|POLLERR|POLLHUP}, {fd=41, > events=POLLIN|POLLERR|POLLHUP}, > {fd=44, events=POLLIN|POLLERR|POLLHUP}, {fd=42, > events=POLLIN|POLLERR|POLLHUP}, {fd=43, > events=POLLIN|POLLERR|POLLHUP}, > {fd=48, events=POLLIN|POLLERR|POLLHUP}, {fd=49, > events=POLLIN|POLLERR|POLLHUP}, {fd=59, > events=POLLIN|POLLERR|POLLHUP}, > {fd=46, events=POLLIN|POLLERR|POLLHUP}, {fd=50, > events=POLLIN|POLLERR|POLLHUP}, ...], 43, 5000 > > # gdb -p 5786 > (gdb) thread apply all bt > > Thread 17 (Thread 0x7f411a9d7700 (LWP 5788)): > #0 pthread_cond_wait@(a)GLIBC_2.3.2 () at > ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 > #1 0x00007f4129c2a2e6 in virCondWait (c=c@entry=0x7f412b18ebb8, > m=m@entry=0x7f412b18eb90) at util/virthread.c:154 > #2 0x00007f4129c2ada3 in virThreadPoolWorker > (opaque=opaque@entry=0x7f412b183ab0) at util/virthreadpool.c:124 > #3 0x00007f4129c2a078 in virThreadHelper (data=<optimized out>) at > util/virthread.c:206 > #4 0x00007f4127033dc5 in start_thread (arg=0x7f411a9d7700) at > pthread_create.c:308 > #5 0x00007f4126d6273d in clone () at > ../sysdeps/unix/sysv/linux/x86_64/clone.S:113 > > Thread 16 (Thread 0x7f411a1d6700 (LWP 5789)): > #0 pthread_cond_wait@(a)GLIBC_2.3.2 () at > ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 > #1 0x00007f4129c2a2e6 in virCondWait (c=c@entry=0x7f412b18ebb8, > m=m@entry=0x7f412b18eb90) at util/virthread.c:154 > #2 0x00007f4129c2ada3 in virThreadPoolWorker > (opaque=opaque@entry=0x7f412b183a00) at util/virthreadpool.c:124 > #3 0x00007f4129c2a078 in virThreadHelper (data=<optimized out>) at > util/virthread.c:206 > #4 0x00007f4127033dc5 in start_thread (arg=0x7f411a1d6700) at > pthread_create.c:308 > #5 0x00007f4126d6273d in clone () at > ../sysdeps/unix/sysv/linux/x86_64/clone.S:113 > > Thread 15 (Thread 0x7f41199d5700 (LWP 5790)): > #0 pthread_cond_wait@(a)GLIBC_2.3.2 () at > ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 > #1 0x00007f4129c2a2e6 in virCondWait (c=c@entry=0x7f412b18ebb8, > m=m@entry=0x7f412b18eb90) at util/virthread.c:154 > #2 0x00007f4129c2ada3 in virThreadPoolWorker > (opaque=opaque@entry=0x7f412b183950) at util/virthreadpool.c:124 > #3 0x00007f4129c2a078 in virThreadHelper (data=<optimized out>) at > util/virthread.c:206 > #4 0x00007f4127033dc5 in start_thread (arg=0x7f41199d5700) at > pthread_create.c:308 > #5 0x00007f4126d6273d in clone () at > ../sysdeps/unix/sysv/linux/x86_64/clone.S:113 > > Thread 14 (Thread 0x7f41191d4700 (LWP 5791)): > #0 pthread_cond_wait@(a)GLIBC_2.3.2 () at > ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 > #1 0x00007f4129c2a2e6 in virCondWait (c=c@entry=0x7f412b18ebb8, > m=m@entry=0x7f412b18eb90) at util/virthread.c:154 > #2 0x00007f4129c2ada3 in virThreadPoolWorker > (opaque=opaque@entry=0x7f412b1838a0) at util/virthreadpool.c:124 > #3 0x00007f4129c2a078 in virThreadHelper (data=<optimized out>) at > util/virthread.c:206 > #4 0x00007f4127033dc5 in start_thread (arg=0x7f41191d4700) at > pthread_create.c:308 > #5 0x00007f4126d6273d in clone () at > ../sysdeps/unix/sysv/linux/x86_64/clone.S:113 > These are all idle workers. > Thread 13 (Thread 0x7f41189d3700 (LWP 5792)): > ---Type <return> to continue, or q <return> to quit--- > You omitted the backtrace of the other threads. Jan