Bug 34014 - Invalid Jenkins-Format
Invalid Jenkins-Format
Status: CLOSED FIXED
Product: UCS Test
Classification: Unclassified
Component: Framework
unspecified
Other Linux
: P5 normal (vote)
: UCS 3.2-0-errata
Assigned To: Philipp Hahn
Stefan Gohmann
:
Depends on:
Blocks: 36797
  Show dependency treegraph
 
Reported: 2014-01-29 17:32 CET by Philipp Hahn
Modified: 2014-11-18 11:18 CET (History)
2 users (show)

See Also:
What kind of report is it?: ---
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):
Max CVSS v3 score:


Attachments
Fix JUnit output format (2.20 KB, patch)
2014-01-29 17:32 CET, Philipp Hahn
Details | Diff

Note You need to log in before you can comment on or make changes to this bug.
Description Philipp Hahn univentionstaff 2014-01-29 17:32:39 CET
Created attachment 5765 [details]
Fix JUnit output format

The generated JUnit XML Format is causing problems with Jenkins:

1. The testsuite/@timestamp attribute includes nano-seconds, which is not expected.

2. Instead of a class-name, currently the description is used to identify the test-case. This is a long test and quiet unhandy.

3. The class-name uses a file-name, where the section and test-case are separated by "/", while for Jenkins a dot (".") must be used. Because of that all tests are put in the "(root)" package and are not separated by sections.

4. The testsuite-element currently has a non-int @id attribute, which is not allowed.

5. The testsuite-element has a @id and @package attribute, which are not allowed for single-testsuite. Only when multiple suits are aggregated in a parent testsuites-element are those attributes allowed.

Impact:
1. The reports would be better readable, since the names are hard to read because of the long names.

2. Jenkins uses the name to calculate its trend; when the names change, the counter will probably restart.

3. The long description of each test would no longer be available in the Jenkins report; it could be printed to stdout/stderr instead if it should be still available through Jenkins.
Comment 1 Philipp Hahn univentionstaff 2014-01-30 16:32:38 CET
r47540 | Bug #34014: ucs-test: Remove .py suffix
r47539 | Bug #34014: ucs-test: Fix JUnit output format
The Jenkins jobs have been changed to keep max 31 days.
The Jenkins jobs have been changed to no longer keep large outputs.

Successful built <http://jenkins.knut.univention.de:8080/job/ucs-test_BUILD/536/>
Waiting for dimma: ucs-test_4.0.161-35.*.2014013016??
Comment 2 Philipp Hahn univentionstaff 2014-01-31 08:55:26 CET
The 68_udm-extendedattribute/* tests have been renamed, since the ".py"-suffix triggered Jenkins to interpret the name as a dot-separated fully-qualified class-name and put the results into its own package.

ucs-test_4.0.161-35.673.201401310829

OK: aptitude install '?source-package(ucs-test)?installed'
OK: ucs-test -s base -F junit -v
OK: test-reposrts/00_base/*.xml
QA TODO: Check Jenkins outut
Comment 3 Stefan Gohmann univentionstaff 2014-02-10 06:53:39 CET
OK, looks good.
Comment 4 Moritz Muehlenhoff univentionstaff 2014-03-17 14:51:48 CET
Released as an errata update for unmaintained.