Bug 46372 - 10_ldap.71schema_replication.test fails in 4.3 (backup, slave s4 non-samba)
10_ldap.71schema_replication.test fails in 4.3 (backup, slave s4 non-samba)
Status: CLOSED FIXED
Product: UCS
Classification: Unclassified
Component: Listener (univention-directory-listener)
UCS 4.3
Other Linux
: P5 normal (vote)
: UCS 4.3
Assigned To: Felix Botner
Stefan Gohmann
: interim-3
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2018-02-22 13:17 CET by Felix Botner
Modified: 2018-03-14 14:38 CET (History)
0 users

See Also:
What kind of report is it?: Development Internal
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Felix Botner univentionstaff 2018-02-22 13:17:54 CET
* BEGIN *** ['/usr/bin/python2.7', '71schema_replication'] ***
*** 10_ldap/71schema_replication *** Test schema replication ***
*** START TIME: 2018-02-21 21:41:32 ***
Creating settings/extended_attribute object with /usr/sbin/udm-test settings/extended_attribute create --set name=d2qodkaleu --set objectClass=univentionTestAttributes29665 --set module=container/cn --set CLIName=d7ixv2vmsc --set ldapMapping=univentionTestAttribute29665 --set shortDescription=nv352ga4su
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Error: replication incomplete.
Traceback (most recent call last):
  File "71schema_replication", line 79, in <module>
    extended_attribute = udm.create_object('settings/extended_attribute', **properties)
  File "/usr/lib/pymodules/python2.7/univention/testing/udm.py", line 236, in create_object
    utils.wait_for_replication(verbose=False)
  File "/usr/lib/pymodules/python2.7/univention/testing/utils.py", line 349, in wait_for_replication
    raise LDAPReplicationFailed()
univention.testing.utils.LDAPReplicationFailed
*** END TIME: 2018-02-21 21:47:06 ***

listener log on master
21.02.18 21:38:13.559  LISTENER    ( PROCESS ) : updating 'cn=hir638w68d,cn=ldapschema,cn=univention,dc=autotest092,dc=local' command m
4824
21.02.18 21:41:00.842  LISTENER    ( PROCESS ) : updating 'cn=hir638w68d,cn=ldapschema,cn=univention,dc=autotest092,dc=local' command d
4824
21.02.18 21:41:18.410  LISTENER    ( PROCESS ) : ldap_extension: Reloading LDAP server.
Restarting slapd (via systemctl): slapd.service.
21.02.18 21:41:32.691  LISTENER    ( PROCESS ) : updating 'cn=d2qodkaleu,dc=autotest092,dc=local' command a
21.02.18 21:47:12.912  LISTENER    ( PROCESS ) : updating 'cn=rxs08y7y2u,cn=ldapschema,cn=univention,dc=autotest092,dc=local' command a
21.02.18 21:47:17.025  LISTENER    ( ERROR   ) : ldap_extension: validation failed:
5a8e2f35 /var/lib/univention-ldap/local-schema/rxs08y7y2u: line 5 objectclass: Duplicate objectClass: "1.3.6.1.4.1.7165.2.2.11"
slapschema: bad configuration file!
.
Comment 1 Felix Botner univentionstaff 2018-02-22 19:02:15 CET
> 'cn=hir638w68d,cn=ldapschema,cn=univention,dc=autotest092,dc=local' command d
> 4824
> 21.02.18 21:41:18.410  LISTENER    ( PROCESS ) : ldap_extension: Reloading
> LDAP server.
> Restarting slapd (via systemctl): slapd.service.
> 21.02.18 21:41:32.691  LISTENER    ( PROCESS ) : updating
> 'cn=d2qodkaleu,dc=autotest092,dc=local' command a
> 21.02.18 21:47:12.912  LISTENER    ( PROCESS ) : updating
> 'cn=rxs08y7y2u,cn=ldapschema,cn=univention,dc=autotest092,dc=local' command a
> 21.02.18 21:47:17.025  LISTENER    ( ERROR   ) : ldap_extension: validation
> failed:
> 5a8e2f35 /var/lib/univention-ldap/local-schema/rxs08y7y2u: line 5
> objectclass: Duplicate objectClass: "1.3.6.1.4.1.7165.2.2.11"
> slapschema: bad configuration file!

this has nothing to do with the failed test (comes from a test which checks if broken schema files are not included)


the problem seems to come from /usr/share/ucs-test/10_ldap/60failedldif

after this test the univention-directory-listener is in some kind of  state beetween stopped and started, and non functional which breals the 71schema test

ps aux| grep liste
root     12707  0.0  0.0   4060   700 ?        Ss   13:45   0:00 runsv univention-directory-listener
root     16149  0.0  0.0   4288  1512 ?        S    18:43   0:00 /bin/sh /etc/init.d/univention-directory-listener start
root     16155  0.0  0.1  41128  2180 ?        S    18:43   0:00 /bin/systemctl --no-pager start univention-directory-listener.service
root     20037  0.0  0.0  14320  1012 pts/1    S+   19:00   0:00 grep liste
Comment 2 Felix Botner univentionstaff 2018-02-23 11:45:51 CET
problem was

master + slave

stoppped the slapd on the slave, now a udm object is created, the listener on the slave can not connect to the local ldap and (after some timeouts) starts to write the failed ldif

now the slapd is restart, the init script starts univention-directory-replication-resync, which kill the listener, applies the ldif to the local ldap and restarts the listener

problem here, a (systemd) service starts another (systemd) service, which can lead to timeouts

Feb 22 21:37:30 backup093 systemd[1]: slapd.service: Start operation timed out. Terminating.
Feb 22 21:37:30 backup093 systemd[1]: Failed to start LSB: OpenLDAP standalone server (Lightweight Directory Access Protocol).
Feb 22 21:37:30 backup093 slapd[22684]: Found failed.ldif. Importing ...
Feb 22 21:37:30 backup093 systemd[1]: slapd.service: Unit entered failed state.
Feb 22 21:37:30 backup093 systemd[1]: slapd.service: Failed with result 'timeout'.
Feb 22 21:39:00 backup093 systemd[1]: Starting Clean php session files...
Feb 22 21:39:01 backup093 systemd[1]: Started Clean php session files.

i could reliable reproduce this on my master/slave setup.

fixed with at job instead of directly restarting the listener in univention-directory-replication-resync

wait for the tests ....
Comment 3 Felix Botner univentionstaff 2018-02-26 10:36:05 CET
seems to work, test OK
Comment 4 Stefan Gohmann univentionstaff 2018-02-27 13:24:17 CET
OK, works now.
Comment 5 Stefan Gohmann univentionstaff 2018-03-14 14:38:26 CET
UCS 4.3 has been released:
 https://docs.software-univention.de/release-notes-4.3-0-en.html
 https://docs.software-univention.de/release-notes-4.3-0-de.html

If this error occurs again, please use "Clone This Bug".