[389-users] Re: Unable to promote a replica

On 8/3/2021 4:59 PM, Mark Reynolds wrote:
> Are you saying the server is crashing when trying to disable
> replication?

a'yep In the simplest recreation, I create a new instance and
initialize a suffix in it. Then enable replication as a 'consumer'. Then
try to disable replication. . . . the instance crashes with a segfault
recorded in /var/log/messages. I've done more complicated experiments,
including defining a 'supplier' and populating a 'consumer' with data,
but they all end with a segfault.

> Aug 4 13:06:24 ancds10 ns-slapd[15781]: [04/Aug/2021:13:06:24.328812089 -0800] - WARN - NSMMReplicationPlugin - replica_config_delete - The changelog for replica o=state.ak.us is no lo
> nger valid since the replica config is being deleted. Removing the changelog.
> Aug 4 13:06:24 ancds10 kernel: ns-slapd[15793]: segfault at e4 ip 00007fdaee5f3fe2 sp 00007fdabe9fbd00 error 6 in libreplication-plugin.so[7fdaee5cb000+ad000]
> Aug 4 13:06:24 ancds10 kernel: Code: 8b 30 31 c0 e8 8f 98 ff ff eb 87 e8 b8 b0 ff ff 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 53 48 89 fb e8 03 87 ff ff 48 89 df 31 f6 <c7> 80 e4 00 00 00 0
> 1 00 00 00 5b e9 0e ce ff ff 66 66 2e 0f 1f 84
> Aug 4 13:06:24 ancds10 systemd[1]: Started Process Core Dump (PID 15853/UID 0).
> Aug 4 13:06:24 ancds10 systemd[1]: dirsrv@consumerdata.service: Main process exited, code=killed, status=11/SEGV
> Aug 4 13:06:24 ancds10 systemd[1]: dirsrv@consumerdata.service: Failed with result 'signal'.
> Aug 4 13:06:25 ancds10 systemd-coredump[15854]: Process 15781 (ns-slapd) of user 389 dumped core.#012#012Stack trace of thread 15793:#012#0 - snip-
> Aug 4 13:06:25 ancds10 systemd[1]: systemd-coredump@1-15853-0.service: Succeeded.


> If it is can you please get a stack trace of the core dump?

Yes, but I can't figure out how to install any debuginfo/symbols :(


> GNU gdb (GDB) Red Hat Enterprise Linux 8.2-15.el8
> Copyright (C) 2018 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.
> Type "show copying" and "show warranty" for details.
> This GDB was configured as "x86_64-redhat-linux-gnu".
> Type "show configuration" for configuration details.
> For bug reporting instructions, please see:
> <http://www.gnu.org/software/gdb/bugs/>.
> Find the GDB manual and other documentation resources online at:
> <http://www.gnu.org/software/gdb/documentation/>.
>
> For help, type "help".
> Type "apropos word" to search for commands related to "word"...
> Reading symbols from /usr/sbin/ns-slapd...Reading symbols from .gnu_debugdata for /usr/sbin/ns-slapd...(no debugging symbols found)...done.
> (no debugging symbols found)...done.
> [New LWP 15793]
> [New LWP 15792]
> [New LWP 15796]
> [New LWP 15799]
> [New LWP 15798]
> [New LWP 15783]
> [New LWP 15801]
> [New LWP 15800]
> [New LWP 15787]
> [New LWP 15803]
> [New LWP 15788]
> [New LWP 15802]
> [New LWP 15805]
> [New LWP 15789]
> [New LWP 15804]
> [New LWP 15806]
> [New LWP 15790]
> [New LWP 15807]
> [New LWP 15791]
> [New LWP 15794]
> [New LWP 15785]
> [New LWP 15795]
> [New LWP 15797]
> [New LWP 15781]
> [New LWP 15782]
> [New LWP 15786]
> [New LWP 15784]
> [Thread debugging using libthread_db enabled]
> Using host libthread_db library "/lib64/libthread_db.so.1".
> Core was generated by `/usr/sbin/ns-slapd -D /etc/dirsrv/slapd-consumerdata -i /run/dirsrv/slapd-consu'.
> Program terminated with signal SIGSEGV, Segmentation fault.
> #0 0x00007fdaee5f3fe2 in cldb_RemoveReplicaDB ()
> from /usr/lib64/dirsrv/plugins/libreplication-plugin.so
> [Current thread is 1 (Thread 0x7fdabe9fe700 (LWP 15793))]
>
> Thread 27 (Thread 0x7fdac4edb700 (LWP 15784)):
> #0 0x00007fdaf983729f in select () at /lib64/libc.so.6
> #1 0x00007fdafcc12124 in DS_Sleep () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaeef13087 in trickle_threadmain () at /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 26 (Thread 0x7fdac3bff700 (LWP 15786)):
> #0 0x00007fdaf983729f in select () at /lib64/libc.so.6
> #1 0x00007fdafcc12124 in DS_Sleep () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaeef1337c in locks_monitoring_threadmain () at /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 25 (Thread 0x7fdac5edd700 (LWP 15782)):
> #0 0x00007fdaf983729f in select () at /lib64/libc.so.6
> #1 0x00007fdafcc12124 in DS_Sleep () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaeef12b67 in deadlock_threadmain () at /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 24 (Thread 0x7fdafd5591c0 (LWP 15781)):
> #0 0x00007fdaf9834a41 in poll () at /lib64/libc.so.6
> #1 0x00007fdafa711298 in _pr_poll_with_poll () at /lib64/libnspr4.so
> #2 0x000055dd53ffa45e in slapd_daemon ()
> #3 0x000055dd53fedc2f in main ()
>
> Thread 23 (Thread 0x7fdabbfff700 (LWP 15797)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 22 (Thread 0x7fdabd5ff700 (LWP 15795)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 21 (Thread 0x7fdac46da700 (LWP 15785)):
> #0 0x00007fdaf983729f in select () at /lib64/libc.so.6
> #1 0x00007fdafcc12124 in DS_Sleep () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaeef13214 in perf_threadmain () at /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 20 (Thread 0x7fdabe1fd700 (LWP 15794)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 19 (Thread 0x7fdac05fc700 (LWP 15791)):
> #0 0x00007fdafa0b66e8 in pthread_cond_timedwait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x00007fdafcb975ae in eq_loop_rel () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #3 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #4 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 18 (Thread 0x7fdab67f6700 (LWP 15807)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 17 (Thread 0x7fdac0dfd700 (LWP 15790)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x00007fdafa70f848 in PR_WaitCondVar () at /lib64/libnspr4.so
> #2 0x00007fdafcb97ee3 in eq_loop () at /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 16 (Thread 0x7fdab6ff7700 (LWP 15806)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 15 (Thread 0x7fdab7ff9700 (LWP 15804)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 14 (Thread 0x7fdac15fe700 (LWP 15789)):
> #0 0x00007fdafa0b66e8 in pthread_cond_timedwait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ffe96a in housecleaning ()
> #2 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #3 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #4 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 13 (Thread 0x7fdab77f8700 (LWP 15805)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 12 (Thread 0x7fdab8ffb700 (LWP 15802)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 11 (Thread 0x7fdac1dff700 (LWP 15788)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x00007fdafcbfd8fd in slapi_wait_condvar_pt () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaed34aa31 in roles_cache_wait_on_change () at /usr/lib64/dirsrv/plugins/libroles-plugin.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 10 (Thread 0x7fdab87fa700 (LWP 15803)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 9 (Thread 0x7fdac2bff700 (LWP 15787)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x00007fdafcbfd8fd in slapi_wait_condvar_pt () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaef992609 in cos_cache_wait_on_change () at /usr/lib64/dirsrv/plugins/libcos-plugin.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 8 (Thread 0x7fdab9ffd700 (LWP 15800)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 7 (Thread 0x7fdab97fc700 (LWP 15801)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 6 (Thread 0x7fdac56dc700 (LWP 15783)):
> #0 0x00007fdaf983729f in select () at /lib64/libc.so.6
> #1 0x00007fdafcc12124 in DS_Sleep () at /usr/lib64/dirsrv/libslapd.so.0
> #2 0x00007fdaeef1cfda in checkpoint_threadmain () at /usr/lib64/dirsrv/plugins/libback-ldbm.so
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 5 (Thread 0x7fdabb1ff700 (LWP 15798)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 4 (Thread 0x7fdaba9fe700 (LWP 15799)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 3 (Thread 0x7fdabcbfe700 (LWP 15796)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 2 (Thread 0x7fdabf1ff700 (LWP 15792)):
> #0 0x00007fdafa0b62fc in pthread_cond_wait@@GLIBC_2.3.2 () at /lib64/libpthread.so.0
> #1 0x000055dd53ff41f7 in [IDLE THREAD] connection_wait_for_new_work ()
> #2 0x000055dd53ff5870 in connection_threadmain ()
> #3 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #4 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #5 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6
>
> Thread 1 (Thread 0x7fdabe9fe700 (LWP 15793)):
> #0 0x00007fdaee5f3fe2 in cldb_RemoveReplicaDB () at /usr/lib64/dirsrv/plugins/libreplication-plugin.so
> #1 0x00007fdaee61ccf9 in replica_config_delete () at /usr/lib64/dirsrv/plugins/libreplication-plugin.so
> #2 0x00007fdafcb89037 in dse_call_callback.isra () at /usr/lib64/dirsrv/libslapd.so.0
> #3 0x00007fdafcb8cab3 in dse_delete () at /usr/lib64/dirsrv/libslapd.so.0
> #4 0x00007fdafcb816ec in op_shared_delete () at /usr/lib64/dirsrv/libslapd.so.0
> #5 0x00007fdafcb81a46 in do_delete () at /usr/lib64/dirsrv/libslapd.so.0
> #6 0x000055dd53ff6629 in connection_threadmain ()
> #7 0x00007fdafa7155a8 in _pt_root () at /lib64/libnspr4.so
> #8 0x00007fdafa0b014a in start_thread () at /lib64/libpthread.so.0
> #9 0x00007fdaf983fdc3 in clone () at /lib64/libc.so.6




--
Do things because you should, not just because you can.

John Thurston 907-465-8591
John.Thurston@alaska.gov
Department of Administration
State of Alaska
_______________________________________________
389-users mailing list -- 389-users@lists.fedoraproject.org
To unsubscribe send an email to 389-users-leave@lists.fedoraproject.org
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/389-users@lists.fedoraproject.org
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure