Eric Covener <covener@xxxxxxxxx> wrote: > - the old gen should not be able to accept new connections > - generally if it's left running, I would want to look at what > threads were left running (pstack or often better the few gdb commands > here: https://httpd.apache.org/dev/debugging.html#backtrace Here is the gdb session against process 31708, the old-gen worker, running the stock Slackware 15.0 httpd executable. # gdb httpd 31708 GNU gdb (GDB) 11.2 Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-slackware-linux". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from httpd... (No debugging symbols found in httpd) Attaching to program: /usr/sbin/httpd, process 31708 [New LWP 31736] [New LWP 31737] [New LWP 31738] [New LWP 31739] [New LWP 31740] [New LWP 31741] [New LWP 31742] [New LWP 31743] [New LWP 31744] [New LWP 31745] [New LWP 31746] [New LWP 31747] [New LWP 31748] [New LWP 31749] [New LWP 31750] [New LWP 31751] [New LWP 31752] [New LWP 31753] [New LWP 31754] [New LWP 31755] [New LWP 31756] [New LWP 31757] [New LWP 31758] [New LWP 31759] [New LWP 31760] [New LWP 31761] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007f12c8d573fc in read () from /lib64/libpthread.so.0 (gdb) where #0 0x00007f12c8d573fc in read () from /lib64/libpthread.so.0 #1 0x00005611890d9d27 in ap_mpm_podx_check () #2 0x00007f12c61a187f in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #3 0x00007f12c61a1cda in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c61a1d51 in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #5 0x00007f12c61a2812 in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #6 0x00005611890adf60 in ap_run_mpm () #7 0x00005611890a6060 in main () (gdb) thread apply all bt Thread 27 (Thread 0x7f12a9feb640 (LWP 31761) "httpd"): #0 0x00007f12c8c6d7d6 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f12c8e06fec in ?? () from /usr/lib64/libapr-1.so.0 #2 0x00007f12c61a4368 in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #3 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f12aa7ec640 (LWP 31760) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f12aafed640 (LWP 31759) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f12ab7ee640 (LWP 31758) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f12abfef640 (LWP 31757) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f12ac7f0640 (LWP 31756) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f12acff1640 (LWP 31755) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f12ad7f2640 (LWP 31754) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f12adff3640 (LWP 31753) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f12ae7f4640 (LWP 31752) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f12aeff5640 (LWP 31751) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f12af7f6640 (LWP 31750) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f12afff7640 (LWP 31749) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f12b07f8640 (LWP 31748) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f12b0ff9640 (LWP 31747) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f12b17fa640 (LWP 31746) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f12b1ffb640 (LWP 31745) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f12b27fc640 (LWP 31744) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f12b2ffd640 (LWP 31743) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f12b37fe640 (LWP 31742) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f12b3fff640 (LWP 31741) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f12b8b70640 (LWP 31740) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f12b9371640 (LWP 31739) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f12b9b72640 (LWP 31738) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f12ba373640 (LWP 31737) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f12bab74640 (LWP 31736) "httpd"): #0 0x00007f12c8d5a1ae in __futex_abstimed_wait_cancelable64 () from /lib64/libpthread.so.0 #1 0x00007f12c8d53d41 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #2 0x00005611890dab85 in ap_queue_pop_something () #3 0x00007f12c61a5cbc in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c8d4de45 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f12c8c6d4af in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f12c61cf7c0 (LWP 31708) "httpd"): #0 0x00007f12c8d573fc in read () from /lib64/libpthread.so.0 #1 0x00005611890d9d27 in ap_mpm_podx_check () #2 0x00007f12c61a187f in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #3 0x00007f12c61a1cda in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #4 0x00007f12c61a1d51 in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #5 0x00007f12c61a2812 in ?? () from /usr/lib64/httpd/modules/mod_mpm_event.so #6 0x00005611890adf60 in ap_run_mpm () #7 0x00005611890a6060 in main () (gdb) detach Detaching from program: /usr/sbin/httpd, process 31708 [Inferior 1 (process 31708) detached] (gdb) quit --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscribe@xxxxxxxxxxxxxxxx For additional commands, e-mail: users-help@xxxxxxxxxxxxxxxx