Univention Bugzilla – Bug 54794
Broken univention-translog import --min
Last modified: 2022-06-01 16:51:15 CEST
`univention-translog import --min XXX` does not work. There's a bug in `univention-translog import --min`, which ist *not* used. > 492 start = max(1, min(c_tid, p_tid, s_tid), translog.first) which should be > 492 start = max(1, min(c_tid, p_tid, s_tid), translog.first, opt.min) root@primary:~# /usr/share/univention-directory-notifier/univention-translog -v import -i -m 12 -M 12 2022-05-24 12:04:48,267:INFO:Reading transactions from file '/var/lib/univention-ldap/notify/transaction'... 2022-05-24 12:04:48,267:INFO:Index of size 9935 contains 1103 entries 2022-05-24 12:04:48,275:INFO:Processing transaction from offset 0 .. 12 2022-05-24 12:04:48,276:CRITICAL:ldap_add(Transaction(tid=1, dn='zoneName=schein.ig,cn=dns,dc=schein,dc=ig', command='a')): Already exists -i` == `--index` → "Do not use index to find transactions" `-m` == `--min` → "First transaction ID to process" `-M` == `--max` → "Last transaction ID to process" `--min`/`-m` and `--max`/`-M` are *hard* limits, while `--count`/`-c` and `--percent`/`-p` and `--size`/`-s` are *soft* limits: The later are used to limit the number of TIDs to import; otherwise in a busy domain any Backup/Replica would need to import all transactions starting at TID 1; technical any DC only needs the TID starting with the lowest ListenerID in the domain: any previous TID already has been processed by *all* listeners; only the following TIDs are required for that (and maybe other) Listeners. As we do not have any feedback from Listeners back to Primary/Backups, we do not know the lowest TID in the domain. As an approximation we only import the last 100.000 TIDs or last 10 MiB from the transaction file, whichever is earlier. Your given command will export 10⁵ TID or 10 MiB from the end of the file, but only if they are in range [12…12]. So only TID 12. Your index (which is *not* used despite the message "Index of size …" as you have given `-i`; otherwise the message would have been "Processing transactions %d .. %d") indicates it contains only the last 1103 TIDs, the other 9935-1103=8802 TID are not in the index. As `univention-translog --import -i` is not allowed to use the index, it must walk *all* TID in `translog` *from the beginning*, starting with TID 1.
[5.0-1] 3e3be4f295 refactor[UDN]: Improve univention-translog --help management/univention-directory-notifier/univention-translog | 32 ++++++++++++++++---------------- 1 file changed, 16 insertions(+), 16 deletions(-) [5.0-1] 9a8119a80f refactor[UDN]: Remove default action="store" management/univention-directory-notifier/univention-translog | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) [5.0-1] 5f497c200d fix[UDN]: Heed univention-translog import --min TID doc/errata/staging/univention-directory-notifier.yaml | 10 ++++++++++ management/univention-directory-notifier/debian/changelog | 6 ++++++ management/univention-directory-notifier/univention-translog | 2 +- 3 files changed, 17 insertions(+), 1 deletion(-) Package: univention-directory-notifier Version: 14.0.5-9A~5.0.0.202205250707 Branch: ucs_5.0-0 Scope: errata5.0-1 [5.0-1] 7e09914f48 Bug #54794: univention-directory-notifier 14.0.5-9A~5.0.0.202205250707 doc/errata/staging/univention-directory-notifier.yaml | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) OK: univention-translog import --min 1 --max 2 OK: univention-translog lookup -1 OK: univention-translog lookup 0 OK: univention-translog lookup 1 OK: univention-translog load --help OK: univention-translog lookup --help OK: univention-translog ldap --help OK: univention-translog stat --help OK: univention-translog index --help OK: univention-translog check --help OK: univention-translog prunt --help
OK: --min option is used OK: Adjustments of help messages Verified.
<https://errata.software-univention.de/#/?erratum=5.0x321>