Bug 39657 - Add SAML tests
Summary: Add SAML tests
Status: CLOSED FIXED
Alias: None
Product: UCS Test
Classification: Unclassified
Component: UMC
Version: unspecified
Hardware: Other Linux
: P5 normal
Target Milestone: UCS 4.1-0-errata
Assignee: Jürn Brodersen
QA Contact: Florian Best
URL:
Keywords:
: 39616 (view as bug list)
Depends on:
Blocks:
 
Reported: 2015-10-28 17:56 CET by Jürn Brodersen
Modified: 2016-04-17 19:59 CEST (History)
5 users (show)

See Also:
What kind of report is it?: ---
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):
Customer ID:
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jürn Brodersen univentionstaff 2015-10-28 17:56:27 CET
ucs-test scripts for SAML should be added.
Comment 1 Jürn Brodersen univentionstaff 2015-10-28 18:24:59 CET
UCS4.1-0:
r64948: Added tests for SAML SSO
Package: ucs-test
Version: 6.0.11-1.1303.201510281816
Comment 2 Florian Best univentionstaff 2015-10-29 13:38:01 CET
Some tests are failing, can you have a look?

Some tests require that there is a DC backup installed. (I don't know how to ensure this):
http://jenkins.knut.univention.de:8080/job/UCS-4.1/job/UCS-4.1-0/job/Autotest%20MultiEnv/84/SambaVersion=s3,Systemrolle=master/testReport/83_saml-sso/06_sso_on_dc_backup/test/

Also the RelayState is not always set in responses, if it is not contained in the form the attribute just shouldn't be set. (SAMLResponse must always exists)

http://jenkins.knut.univention.de:8080/job/UCS-4.1/job/UCS-4.1-0/job/Autotest%20MultiEnv/84/SambaVersion=s3,Systemrolle=master/testReport/83_saml-sso/05_saml_login/test/

http://jenkins.knut.univention.de:8080/job/UCS-4.1/job/UCS-4.1-0/job/Autotest%20MultiEnv/84/SambaVersion=s3,Systemrolle=master/testReport/83_saml-sso/08_saml_session_ldap_after_restart/test/

Please also set the expiry date more dynamically in 11_saml_user_expire.
Comment 3 Stefan Gohmann univentionstaff 2015-10-30 07:07:39 CET
Please move thetest cases to the package ucs-test-saml (tests/82_saml/).
Comment 4 Alexander Kläser univentionstaff 2015-10-30 10:32:02 CET
AFAIS, the tests are only executed for the S3-Master tests and not even for S4-Master.
Comment 5 Jürn Brodersen univentionstaff 2015-11-02 13:43:50 CET
*** Bug 39616 has been marked as a duplicate of this bug. ***
Comment 6 Jürn Brodersen univentionstaff 2015-11-02 14:05:57 CET
UCS4.1-0:
r65082: * Fixed SAML tests (Bug #39657)
        * Make sure a master is running if needed
        * Don't use a fixed date
        * moved to folder 82_saml/
Package: ucs-test
Version: 6.0.12-8.1313.201511021353
Comment 7 Jürn Brodersen univentionstaff 2015-11-03 10:25:07 CET
UCS4.1-0:
r65105: * use isoformat for date in 82_saml/11_saml_user_expire
Package: ucs-test
Version: 6.0.12-10.1315.201511031019
Comment 8 Alexander Kläser univentionstaff 2015-11-03 15:19:48 CET
Looks good! It would be nice to have some idea of what exactly is being tested if the test succeeds (or fails). Just a print with some sort of progress information would be sufficient, e.g., "Requesting login at UMC..." or "Sending login information at IdP...".
Comment 9 Jürn Brodersen univentionstaff 2015-11-05 18:04:15 CET
UCS4.1-0:
r65250: * Fix bug in error handling (Bug #39657)
        * Enhanced verbosity
Package: ucs-test
Version: 6.0.13-3.1324.201511051758
Comment 10 Florian Best univentionstaff 2015-12-14 17:06:02 CET
07_sso_global_logout:
The following line is incorrect:
 37 »   »   samltest.test_logout(cookies, hostname=master_hostname)
As a session on the master exists one isn't automatically logged out of the DC master when one clicks logout on the Slave. The test have to check if the automatic SSO-login doesn't work anymore on all the hosts.
Comment 11 Jürn Brodersen univentionstaff 2016-02-22 15:16:10 CET
UCS4.1-1:
r67607: * 82_saml/05_saml_login check that SAML session is closed after logout
Package: ucs-test
Version: 6.0.33-16.1427.201602221508
Comment 12 Florian Best univentionstaff 2016-03-15 06:36:31 CET
(In reply to Jürn Brodersen from comment #11)
> UCS4.1-1:
> r67607: * 82_saml/05_saml_login check that SAML session is closed after
> logout
> Package: ucs-test
> Version: 6.0.33-16.1427.201602221508
OK: This looks fine!
Comment 13 Janek Walkenhorst univentionstaff 2016-04-17 19:59:20 CEST
Published