Univention Bugzilla – Bug 55863
Notifier indexing slows rapidly down the last pending 999 transactions to index
Last modified: 2023-03-15 13:43:41 CET
+++ This bug was initially created as a clone of Bug #54797 +++ If /usr/share/univention-directory-notifier/univention-translog stat shows an AssertionError this indicates that the transaction.index is corrupt or uses wrong data. AssertionError: (25775045, 11269137) So removing the /var/lib/univention-ldap/notify/transaction.index and restarting the univention-directory-notifier it starts reindexing. In larger environments it starts really fast 2022-05-25 13:17:40,881:WARNING:Index=1962147 < translog=11269137 entries 2022-05-25 13:18:20,087:WARNING:Index=11268138 < translog=11269137 entries → 11269137−11268138 = 999 2022-05-25 13:19:02,318:WARNING:Index=11268138 < translog=11269137 entries 2022-05-25 13:20:05,220:WARNING:Index=11268140 < translog=11269137 entries This seems always to slow down the last 999 transactions to index. Approximately 45 sec for one index entry. -------------------------------------------- In the other environment it is the same: → 7120940−7119941 = 999 2022-05-24 12:37:22,619:WARNING:Index=2859957 < translog=7120940 entries 2022-05-24 12:37:46,503:WARNING:Index=7119941 < translog=7120940 entries 2022-05-24 12:37:57,075:WARNING:Index=7119941 < translog=7120940 entries So indexing finished next day. During this time replication is not working at all.
Created attachment 11049 [details] univention-translog backport to Python 2.7 / UCS 4.4-x (
Customer effected 2023030810000052 We use the python script from the attachement and the replication works now. For an workaround that's ok but we need a errata update for that please.
UCS 4.4-9 is out-of-maintenance since end of February 2023. As such this will only get released to extended-security-maintenance! [4.4-9] f41c7b05cd feat(udn): univention-translog reindex doc/errata/staging/univention-directory-notifier.yaml | 15 +++++++++++++ management/univention-directory-notifier/debian/changelog | 6 ++++++ management/univention-directory-notifier/univention-translog | 36 +++++++++++++++++++++++++++++--- 3 files changed, 54 insertions(+), 3 deletions(-) Package: univention-directory-notifier Version: 13.0.3-11A~4.4.0.202303080852 Branch: ucs_4.4-0 Scope: errata4.4-9 [4.4-9] 3a0bf94b1f Bug #55863: univention-directory-notifier 13.0.3-11A~4.4.0.202303080852 doc/errata/staging/univention-directory-notifier.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
OK: Indexing works as expected OK: python2 OK: YAML REOPEN: You removed the executable flag from the univention-translog file in your commit. I am getting a "Permission denied" error after upgrading the notifier.
Successful build Package: univention-directory-notifier Version: 13.0.3-11A~4.4.0.202303082249 Branch: ucs_4.4-0 Scope: errata4.4-9 5c17e321b8 Bug #55863: yaml update 0aea18db3c Bug #55863: make univention-translog executable again The feature itself was already successfully QAed by me. Changing assignee and QA for you to review my commit.
<https://errata.software-univention.de/#/?erratum=4.4x1391>