Bug 52173 - Higher count of imports in database causes timeout
Summary: Higher count of imports in database causes timeout
Status: CLOSED FIXED
Alias: None
Product: UCS@school
Classification: Unclassified
Component: UMC - User Import UI
Version: UCS@school 4.4
Hardware: Other Linux
: P5 normal
Target Milestone: UCS@school 5.2 v3
Assignee: Johannes Königer
QA Contact: Jürn Brodersen
URL: https://git.knut.univention.de/univen...
Keywords:
Depends on:
Blocks:
 
Reported: 2020-10-01 17:18 CEST by Dirk Schnick
Modified: 2025-06-25 12:17 CEST (History)
10 users (show)

See Also:
What kind of report is it?: Bug Report
What type of bug is this?: 5: Major Usability: Impairs usability in key scenarios
Who will be affected by this bug?: 3: Will affect average number of installed domains
How will those affected feel about the bug?: 3: A User would likely not purchase the product
User Pain: 0.257
Enterprise Customer affected?:
School Customer affected?: Yes
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number: 2020092121000162, 2021011921000607, 2021020521000257, 2021060421000279, 2021101821000217, 2023103121000126, 2025012321000299, 2025030321000046
Bug group (optional):
Customer ID: 05017, 05797, 39720
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Dirk Schnick univentionstaff 2020-10-01 17:18:01 CEST
In the customer environment were 321 imports saved. The module was not opened and a 504 Error was displayed.
I have seen that the logfile /var/log/univention/ucs-school-import/gunicorn_error.log has logged even more entries than the 504 was already reported.
So I reduced the database entries and the module is shown again.

Currently the problem will not occur so often, but with time the entries will have a higher value for many customers.

An automatic reduction of the entries or an increase of the timeout time should be implemented. 

How to solve the problem manually see first attached ticket Notice 16
Comment 3 Dirk Schnick univentionstaff 2021-01-21 15:43:06 CET
Happened in another customer environment.
Comment 4 Dirk Schnick univentionstaff 2021-02-05 08:57:50 CET
More and more customers are complaining this.
Comment 5 Patrick Ziegler univentionstaff 2021-02-05 11:21:09 CET
Added to backlog: https://taiga.knut.univention.de/project/oschwieg-ucs-5/us/5247
Comment 6 Daniel Tröder univentionstaff 2021-06-03 09:31:20 CEST
When working on this, also check bug 53383. It may be a duplicate or it may add an additional problem (many OUs).
Comment 7 Dirk Schnick univentionstaff 2021-06-04 11:47:40 CEST
And again in a customer environment.
Comment 8 Dirk Schnick 2024-04-18 10:41:40 CEST
To point on that again. There are some environments where the webimport is absolutely essential. Bildungslogin f.e.
In these environments a lot of imports take place and the database grows fast...
Comment 10 Mirac Erdemiroglu univentionstaff 2024-10-16 14:09:11 CEST
The reduce and cleanup old import jobs, could fix the timeout issue.
Here is an article to use a py script to clean older import jobs.

Workaround und:

https://help.univention.com/t/how-to-reduce-entries-of-ucs-school-web-import-database/16222#optional-step-delete-old-import-jobs-14
Comment 11 Christina Scheinig univentionstaff 2025-01-24 16:37:56 CET
Happend again 2025012321000299
Comment 12 Christina Scheinig univentionstaff 2025-03-03 11:58:12 CET
Hit an other school environment 2025030321000046
Comment 14 Jürn Brodersen univentionstaff 2025-06-25 11:13:20 CEST
Looks good to me:

    Old imports are deleted if configured -> OK
    Max number of shown imports in the umc module can be configured -> OK
    Sort order changed -> OK
    jenkins -> OK
Comment 15 Jürn Brodersen univentionstaff 2025-06-25 12:17:44 CEST
Errata updates for UCS@school 5.2 v3 have been released.

https://docs.software-univention.de/ucsschool-changelog/5.2v3/en/changelog.html
https://docs.software-univention.de/ucsschool-changelog/5.2v3/de/changelog.html

If this error occurs again, please clone this bug.