[389-users] nsslapd-referral remove issues

Hi List

we are running the following  389-DS version : 

389-ds-base-libs-1.3.10.2-16.el7_9.x86_64.

I  need to remove a referral entry from dse.ldif , there are 2 servers cfg  in master to master replication  with two slaves each master. 

I tried removing referrals from one of the master but after  ldap server restart the referral was added and same for the entries in replication agreement.

Do I need to disable the replication plugging  with DS online to be able to remove referrals and also  the  old entries  from replication agreement ?

Thank  you

Isabella