Bug 31695 - Tests with more than 5000 users
Tests with more than 5000 users
Status: CLOSED FIXED
Product: UCS
Classification: Unclassified
Component: General
UCS 3.1
Other Linux
: P5 enhancement (vote)
: UCS 3.2
Assigned To: Stefan Gohmann
Felix Botner
: interim-2
Depends on: 32213 32274 32276 32322 32323
Blocks:
  Show dependency treegraph
 
Reported: 2013-06-11 07:31 CEST by Stefan Gohmann
Modified: 2013-11-19 06:41 CET (History)
1 user (show)

See Also:
What kind of report is it?: ---
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional): Release Goal, UCS Performance
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Stefan Gohmann univentionstaff 2013-06-11 07:31:44 CEST
UCS should be tested with different environments with more than 5000 users, specially UMC and Samba 4. The tests should be modeled on existing UCS@school environments.

We should test these two scenarios:
 1. nearly 30.000 users with all users in Domain Users
 2. nearly 65.000 users split into different schools

Both scenarios should be tested with a central Samba 4 + S4 connector.
Comment 1 Stefan Gohmann univentionstaff 2013-08-21 06:18:28 CEST
Tests with UCS 3.1-1 in a large EC2 system (30.000 users but not all users in Domain Users):
 * user import took 18140 seconds
 * user import sync to s4 took 33955 seconds
 * UMC authentication took 8 seconds
 * create test user took 96 seconds
 * samba4 auth took 1 seconds
 * user password reset took 106 seconds

The same test with UCS 3.2 MS1:
 * user import took 18442 seconds
 * user import sync to s4 took 33974 seconds
 * UMC authentication took 1 seconds
 * create test user took 93 seconds
 * samba4 auth took 0 seconds
 * user password reset took 111 seconds
Comment 2 Stefan Gohmann univentionstaff 2013-08-23 21:44:35 CEST
In the same environment after changing the bugs 32213 32274 32276 32322 32323:
* user import took 12194 seconds
* user import sync to s4 took 30084 seconds
* UMC authentication took 1 seconds
* create test user took 93 seconds
* samba4 auth took 0 seconds
* user password reset took 109 seconds
Comment 3 Stefan Gohmann univentionstaff 2013-08-31 10:58:13 CEST
EC2 test with 50.000 users:
 - user import took 57156 seconds
 - user import sync to s4 took 108953 seconds
 - UMC authentication took 4 seconds
 - create test user took 102 seconds
 - samba4 auth took 1 seconds
 - user password reset took 116 seconds
Comment 4 Stefan Gohmann univentionstaff 2013-09-11 06:29:29 CEST
It is a difference if the DRS replication is active or not. In particular the sync to S4 is more than twice as fast:

Master + Backup (30.000 not all users in Domain Users):
INFO: user import took 19054 seconds
INFO: user import sync to s4 took 82903 seconds
INFO: UMC authentication took 1 seconds
INFO: create test user took 93 seconds
INFO: samba4 auth took 0 seconds
INFO: user password reset took 121 seconds

Master only (30.000 not all users in Domain Users):
INFO: user import took 17417 seconds
INFO: user import sync to s4 took 31732 seconds
INFO: UMC authentication took 1 seconds
INFO: create test user took 82 seconds
INFO: samba4 auth took 0 seconds
INFO: user password reset took 104 seconds
Comment 5 Stefan Gohmann univentionstaff 2013-09-11 06:33:20 CEST
These are the results of the 65.000 users import:

INFO: user import took 57156 seconds → nearly 16 hours
INFO: user import sync to s4 took 108953 seconds → 30 hours
INFO: UMC authentication took 4 seconds
INFO: create test user took 102 seconds
INFO: samba4 auth took 1 seconds
INFO: user password reset took 116 seconds
Comment 6 Stefan Gohmann univentionstaff 2013-09-16 07:14:51 CEST
Tests with 30.000 users and all users in Domain Users + DRS replication:

INFO: user import took 76052 seconds → 21 hours
INFO: user import sync to s4 took 459402 seconds → 127 hours
INFO: UMC authentication took 5 seconds
INFO: create test user took 135 seconds
INFO: samba4 auth took 19 seconds
INFO: user password reset took 329 seconds
Comment 7 Stefan Gohmann univentionstaff 2013-09-16 14:56:07 CEST
The values are OK so far. We will document that all users in domain users is not a good idea in such a large environment: Bug #32602.

The results have been added to the test cases.

Test cases: ucs-test-import-performance
Jenkins definitions ucs-3.2/ucs-3.2-0/test/ucs-ec2-tools/examples/jenkins/:
 ucsschool-performance-30000.cfg
 ucsschool-performance-65000.cfg

Changelog: r44075
Comment 8 Felix Botner univentionstaff 2013-09-23 17:33:45 CEST
OK - appropriate ucs test are available
OK - results/notes will be added to product test (Bug #32608)
OK - Changelog
Comment 9 Stefan Gohmann univentionstaff 2013-11-19 06:41:32 CET
UCS 3.2 has been released:
 http://docs.univention.de/release-notes-3.2-en.html
 http://docs.univention.de/release-notes-3.2-de.html

If this error occurs again, please use "Clone This Bug".