Bug 54263 - All tests missing Recommends - many unmaintained packages
All tests missing Recommends - many unmaintained packages
Status: NEW
Product: UCS Test
Classification: Unclassified
Component: General
unspecified
Other Linux
: P5 normal (vote)
: UCS 5.0
Assigned To: UCS maintainers
https://git.knut.univention.de/groups...
:
Depends on: 52453 52834
Blocks:
  Show dependency treegraph
 
Reported: 2021-12-20 09:35 CET by Philipp Hahn
Modified: 2023-12-12 13:34 CET (History)
3 users (show)

See Also:
What kind of report is it?: Development Internal
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):
Max CVSS v3 score:


Attachments
Why unmaintained packages (190.00 KB, image/svg+xml)
2023-06-19 07:55 CEST, Philipp Hahn
Details
Why2 (190.00 KB, image/svg+xml)
2023-06-19 08:24 CEST, Philipp Hahn
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Philipp Hahn univentionstaff 2021-12-20 09:35:15 CET
Currently most of our test still use
> profile:
>  packages_install=

# git grep -l '^ *packages_install=' | wc -l
132

git:release-5.0-0~860 from Bug #52453 just disabled the "software" page of USS, but the profile setting is still used by "usr/lib/univention-system-setup/scripts/50_software/10software": As this step happens *before* UCRV `repository/online=true` is set the packages are installed *without* their `Recommends` as they are (mostly) not included on the ISO and/or in the EC2/KVM/VirtualBox/VMWare image.

<https://jenkins.knut.univention.de:8181/job/UCS-5.0/job/UCS-5.0-1/job/CheckMaintainedList/12/console> show this discrepancy. 

All tests should stop using "packages_install" and use `univention-app install …` instead so the test environment matches the reality of our customers:

1. Additional packages might lead to extra functionality in packages being  enabled leading to different behavior.

2. `univention-list-installed-unmaintained-packages` shows many packages from "unmaintained" after 
# univention-app install --skip-checks must_have_valid_license -- admindiary-backend admindiary-frontend cups dhcp-server mailserver pkgdb prometheus-node-exporter radius samba4 self-service self-service-backend squid
# univention-list-installed-unmaintained-packages | sed '1d;s/^ //;y/ /\n/' 
altermime
ca-certificates-java
default-jre-headless
gconf2-common
ibverbs-providers
ifplugd
intel-cmt-cat
java-common
libatasmart4
libboost-atomic1.67.0
libboost-iostreams1.67.0
libboost-regex1.67.0
libboost-system1.67.0
libboost-thread1.67.0
libc-ares2
libcephfs2
libcgi-fast-perl
libconfuse-common
libconfuse2
libdaemon0
libdbi1
libdigest-bubblebabble-perl
libencode-locale-perl
libesmtp6
libexif12
libfcgi-perl
libfile-copy-recursive-perl
libftdi1-2
libganglia1
libgconf-2-4
libgfapi0
libgfrpc0
libgfxdr0
libglusterfs0
libgoogle-perftools4
libgphoto2-6
libgphoto2-l10n
libgphoto2-port12
libgps23
libgrpc++1
libgrpc6
libgusb2
libhiredis0.14
libhttp-message-perl
libi2c0
libibverbs1
libieee1284-3
libio-html-perl
libio-pty-perl
libipc-run-perl
libjim0.77
liblouisutdml-bin
liblouisutdml-data
liblouisutdml8
liblwp-mediatypes-perl
libmcrypt4
libmicrohttpd12
libmodbus5
libmosquitto1
libnet-cidr-lite-perl
libnet-dns-sec-perl
libnet-patricia-perl
libnet-snmp-perl
libnotify4
libnss-mdns
libopenipmi0
liboping0
libow-3.2-3
libowcapi-3.2-3
libprotobuf17
librabbitmq4
libradcli4
librados2
librdkafka1
libriemann-client0
librrd8
librte-acl18.11
librte-bbdev18.11
librte-bitratestats18.11
librte-bpf18.11
librte-cfgfile18.11
librte-cmdline18.11
librte-compressdev18.11
librte-cryptodev18.11
librte-distributor18.11
librte-eal18.11
librte-efd18.11
librte-ethdev18.11
librte-eventdev18.11
librte-flow-classify18.11
librte-gro18.11
librte-gso18.11
librte-hash18.11
librte-ip-frag18.11
librte-jobstats18.11
librte-kni18.11
librte-kvargs18.11
librte-latencystats18.11
librte-lpm18.11
librte-mbuf18.11
librte-member18.11
librte-mempool18.11
librte-meter18.11
librte-metrics18.11
librte-net18.11
librte-pci18.11
librte-pdump18.11
librte-pipeline18.11
librte-port18.11
librte-power18.11
librte-rawdev18.11
librte-reorder18.11
librte-ring18.11
librte-sched18.11
librte-security18.11
librte-table18.11
librte-telemetry18.11
librte-timer18.11
librte-vhost18.11
libsane
libsane-common
libsnmp-session-perl
libtcmalloc-minimal4
libtk8.6
libtokyocabinet9
libtokyotyrant3
libupsclient4
libvarnishapi2
libvirt0
libxencall1
libxendevicemodel1
libxenevtchn1
libxenforeignmemory1
libxengnttab1
libxenmisc4.11
libxenstore3.0
libxentoolcore1
libxentoollog1
libxss1
libyajl2
linux-image-4.19.0-17-amd64
linux-image-4.19.0-18-amd64
moreutils
mscompress
notification-daemon
openjdk-11-jre-headless
owfs-common
policycoreutils
printer-driver-brlaser
printer-driver-dymo
printer-driver-fujixerox
printer-driver-pnm2ppa
prometheus-node-exporter
python-egenix-mxdatetime
python-egenix-mxtools
python-sqlalchemy
python-sqlalchemy-ext
python3-markdown
python3-sqlalchemy
python3-sqlalchemy-ext
rrdtool
sane-utils
smartmontools
sysstat
tcl
tix
tk
tk8.6
usb-modeswitch
usb-modeswitch-data
Comment 1 Philipp Hahn univentionstaff 2023-06-19 07:55:32 CEST
Created attachment 11070 [details]
Why unmaintained packages

#!/bin/bash
set -e -u

mapfile -t PKGS < <(univention-list-installed-unmaintained-packages | sed '1d;s/^ //;y/ /\n/')

echo "graph LR"
for pkg in "${PKGS[@]}"
do
        LC_ALL=C.UTF-8 aptitude why "${pkg}" |
        sed -e '
s/^i [ A] /    /
s/ |.\+$//
s/ ([^)]*)//g
s/\s\+$//
s/ \+/ /g
s/ PreDepends / ==> /
s/ Depends / --> /
s/ Recommends / -.-> /
'
done | grep -v aptitude | sort -u

echo " classDef um fill:#f96"
IFS=','
echo " class ${PKGS[*]/default-jre-jeadless/Default-jre-headless} um"
Comment 2 Philipp Hahn univentionstaff 2023-06-19 08:24:55 CEST
Created attachment 11071 [details]
Why2
Comment 3 Philipp Hahn univentionstaff 2023-06-19 12:59:22 CEST
For now the list of maintained packages in 5.0-4 has been extended:

https://git.knut.univention.de/univention/ucs-maintained/

[main] 186e0af fix(5.0-4): more maintained packages
 ucs_5.0-0-ucs5.0-4.txt | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[main] 7c0c532 fix(5.0-4): more maintained packages
 ucs_5.0-0-ucs5.0-4.txt | 31 ++++++++++++++++++++++++++++++-
 1 file changed, 30 insertions(+), 1 deletion(-)

[main] 5fab724 fix(5.0-4): unmaintained packages
 README.md              |  2 +-
 ucs_5.0-0-ucs5.0-4.txt | 35 +++++++++++++++++++++++++++++++++++
 2 files changed, 36 insertions(+), 1 deletion(-)

https://git.knut.univention.de/univention/ucs/

[5.0-4] 1f91fb6046 fix(errata): maintain more packages 4
 .gitignore                                           |   2 +
 base/univention-errata-level/debian/changelog        |   2 +-
 base/univention-errata-level/maintained-packages.txt | 356 ++++++++++++++++++++++++++++++++++++++-
 3 files changed, 358 insertions(+), 2 deletions(-)

[5.0-4] 0fe834e71c test(maintained): Trim down test
 test/scenarios/check-maintained/check-maintained.cfg | 17 +++--------------
 1 file changed, 3 insertions(+), 14 deletions(-)

[5.0-4] c4013fcd72 fix(errata): maintain more packages
 base/univention-errata-level/debian/changelog | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[5.0-4] 26d567191e fix(errata): maintain more packages
 base/univention-errata-level/debian/changelog | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

[5.0-4] 78e18294dc fix(errata): maintain more packages
 base/univention-errata-level/debian/changelog        |   6 +
 base/univention-errata-level/debian/compat           |   2 +-
 base/univention-errata-level/debian/control          |   4 +-
 base/univention-errata-level/debian/rules            |   2 +-
 base/univention-errata-level/maintained-packages.txt | 236 ++++++++++++++++++++++++++++++++++++++-
 5 files changed, 243 insertions(+), 7 deletions(-)

The real profile issue remains unsolved.
Comment 4 Philipp Hahn univentionstaff 2023-12-12 13:34:08 CET
[5.0-6] 0d084702c5 feat(ISO): Install recommended packages by default
 base/univention-dvd/UNIVENTION_NEW_UCS_RELEASE |  7 ++--
 base/univention-dvd/debian/changelog           |  5 ++-
 base/univention-dvd/tasks/ucs506/task-ucs506   | 96 ----------------------------------------------
 base/univention-dvd/ucs506.conf                |  1 -
 4 files changed, 7 insertions(+), 102 deletions(-

[main] 0d6ea3c feat(ISO): Install recommended packages by default 2
 ucs_5.0-0-ucs5.0-6.txt | 3 +++
 1 file changed, 3 insertions(+)

[main] 902cf9b feat(ISO): Install recommended packages by default
 README.md              |   2 +-
 ucs_5.0-0-ucs5.0-6.txt | 121 +++++++++++++++++++--------------------------------------------------
 2 files changed, 34 insertions(+), 89 deletions(-)

https://jenkins2022.knut.univention.de/view/Alle/job/Mitarbeiter/job/phahn/job/CalculateMaintained/29/console