Bug 31701 - New upstream kernel: 3.10.x
New upstream kernel: 3.10.x
Status: CLOSED FIXED
Product: UCS
Classification: Unclassified
Component: Kernel
UCS 3.1
Other Linux
: P5 enhancement (vote)
: UCS 3.2
Assigned To: Moritz Muehlenhoff
Philipp Hahn
: interim-1
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2013-06-11 07:59 CEST by Stefan Gohmann
Modified: 2013-11-19 06:41 CET (History)
1 user (show)

See Also:
What kind of report is it?: ---
What type of bug is this?: ---
Who will be affected by this bug?: ---
How will those affected feel about the bug?: ---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional): Release Goal
Max CVSS v3 score:


Attachments
ec2.png (38.13 KB, image/png)
2013-07-04 09:10 CEST, Stefan Gohmann
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Stefan Gohmann univentionstaff 2013-06-11 07:59:03 CEST
The kernel should be updated for UCS 3.2.

We should check the stable plans and decide which kernel is the best for UCS 3.2.
Comment 1 Felix Botner univentionstaff 2013-06-12 13:58:37 CEST
Please ensure (postup or preup) that at least one univention kernel meta package is installed (univention-kernel-image). 

We had a test environment with open-xchange where no univention kernel meta package was installed after the update to 3.1
Comment 2 Moritz Muehlenhoff univentionstaff 2013-06-28 14:15:24 CEST
3.10~rc7 has been imported. This will not be the final kernel, but it allows to adapt the rest of the system to the new kernel.

The existing patches have been ported:

Dropped patches:
10_config-changes.patch:
The changes to compile BLK_DEV_RAM, SCSI and EXT2 into the kernel instead of as modules are legacy changes for apparently very old versions of the installer. CONFIG_LEGACY_PTYS was required for python-expect/univention-ssh in the past, but the tool was fixed in Bug 11870. The actication of BLK_DEV_TAP is now handlded through the add-blktap-driver.patch patch.

16-disable-rt-flavour.patch:
This patch is currently not needed, since the rt patchset isn't available for 3.10. I've renamed the patch to .disabled for now.


Updated patches:
12_disable_abicheck.patch
14_ucs_version.patch
20-disable-xz-compression.patch
22-disable-udeb-generation.patch
24-ordereddict-backport.patch
26-quilt-compat.patch
28-use-gcc-4.4.patch
30-add-blktap-driver.patch
32-fix-python-dep.patch (Renamed to 32-fix-python-dep-and-drop-kernelwedge.patch)
Comment 3 Moritz Muehlenhoff univentionstaff 2013-07-02 13:27:51 CEST
initramfs-tools was updated to 0.112 and univention-initrd was updated along.
Comment 4 Moritz Muehlenhoff univentionstaff 2013-07-02 14:46:08 CEST
The univention-kernel-image meta packages have been updated. A test update from 3.1-1 to 3.2 was successful, after a reboot 3.10 was used.
Comment 5 Moritz Muehlenhoff univentionstaff 2013-07-02 15:39:09 CEST
Basic tests with KVM were successful: Two virtual machines (UCS 3.1-1 and Win7 without virtio drivers) which had been installed with the 3.2 kernel were still working as expected with the 3.10 kernel.
Comment 6 Moritz Muehlenhoff univentionstaff 2013-07-03 13:10:09 CEST
The UCS installation DVD for 3.2 now uses Linux 3.10. A test installation on amd64 worked fine.
Comment 7 Moritz Muehlenhoff univentionstaff 2013-07-03 16:32:08 CEST
The KMS module for Nvidia graphics adapters (nouveau) is incompatible with our Xorg version: No console output is listed, X refuses to load and dmesg is spammed with messages like " nouveau E[ PFB][0000:01:00.0] trapped read at 0x01010cc0a0 on channel 0x0003fee0 BAR/PFIFO_READ/IN reason: PAGE_NOT_PRESENT" 

Also, a loaded nouveau KMS driver prevents the VESA driver from being used.
The KMS module is now blacklisted through UCR (Bug #19892), so that systems with Nvidia graphic adapters have a proper text console and VESA for the minimal UCS desktop.
Comment 8 Stefan Gohmann univentionstaff 2013-07-04 09:10:57 CEST
Created attachment 5302 [details]
ec2.png

The UCS systems do not boot with Kernel 3.10 in Amazon EC2, see attached Screenshot.
Comment 9 Moritz Muehlenhoff univentionstaff 2013-07-04 09:23:24 CEST
The kernel configuration from Debian compresses the kernel image using XZ starting with the 3.6 kernel. 

Since our version of Xen doesn't support the decompression of XZ-compressed images yet, I've applied a patch to revert to the Gzip compression as used in previous kernels.

I've filed a bug to add support for booting Xz compressed images to our Xen: Bug 31888
Comment 10 Moritz Muehlenhoff univentionstaff 2013-07-04 09:24:37 CEST
(In reply to Stefan Gohmann from comment #8)
> Created attachment 5302 [details]
> ec2.png
> 
> The UCS systems do not boot with Kernel 3.10 in Amazon EC2, see attached
> Screenshot.

Should be fixed with 08-use-gz-compression.patch, the build is already running.
Comment 11 Moritz Muehlenhoff univentionstaff 2013-07-04 11:13:57 CEST
(In reply to Moritz Muehlenhoff from comment #7)
> The KMS module for Nvidia graphics adapters (nouveau) is incompatible with
> our Xorg version: 

I've successfully tested UCS 3.2 with the 3.10 Linux kernel and our Squeeze Xorg with a system using an ATI Radeon card (one of the Lynx systems in our training room) and an Intel graphics adapter (Thinkpad X200).
Comment 12 Moritz Muehlenhoff univentionstaff 2013-07-05 10:02:38 CEST
(In reply to Moritz Muehlenhoff from comment #10)
> (In reply to Stefan Gohmann from comment #8)
> > Created attachment 5302 [details]
> > ec2.png
> > 
> > The UCS systems do not boot with Kernel 3.10 in Amazon EC2, see attached
> > Screenshot.
> 
> Should be fixed with 08-use-gz-compression.patch, the build is already
> running.

I've successfully tested Xen Dom0 operation by installing a paravirtualised UCS 3.1-1 (amd64) and a non-PV Win7 (amd64).
Comment 13 Moritz Muehlenhoff univentionstaff 2013-07-05 12:46:03 CEST
A current 3.10 kbuild is needed to build out of tree modules. I made a local build based 3.9-1 from sid, a locally prepared tarball of linux-tools 3.10  and the debian-kernel SVN trunk. 
With these changes DKMS and the kernel headers are installable.
Comment 14 Moritz Muehlenhoff univentionstaff 2013-07-10 15:20:04 CEST
xen6 fails to mount the volume group in the initrd, but boots with a configured rootdelay. This needs to be analysed further, maybe there's a difference in the new initramfs-tools.
Comment 15 Moritz Muehlenhoff univentionstaff 2013-07-11 16:40:35 CEST
firmware-nonfree was updated to 0.38. Version 0.37 added a new binary package firmware-adi, which has been added to the univention-kernel-image meta packages.

firmware-free was updated to 3.2.
Comment 16 Moritz Muehlenhoff univentionstaff 2013-07-12 13:37:03 CEST
(In reply to Moritz Muehlenhoff from comment #14)
> xen6 fails to mount the volume group in the initrd, but boots with a
> configured rootdelay. This needs to be analysed further, maybe there's a
> difference in the new initramfs-tools.

univention-grub was updated to add a standard root delay of 5 seconds. This configures the time the initrd wait until a mount of the root device is attempted. See also http://www.thomas-krenn.com/de/wiki/GRUB_Bootloader_bootet_nicht_von_LVM_Volume

This fixes the issues on the systems xen11 and xen6.

The root delay can be disabled by setting grub/rootdelay to 0
Comment 17 Moritz Muehlenhoff univentionstaff 2013-07-18 14:16:45 CEST
(In reply to Moritz Muehlenhoff from comment #15)
> firmware-nonfree was updated to 0.38. Version 0.37 added a new binary
> package firmware-adi, which has been added to the univention-kernel-image
> meta packages.

firmware-nonfree 0.39 has been released and was integrated. It brings several new and updated firmwares, but no new binary packages.
Comment 18 Moritz Muehlenhoff univentionstaff 2013-07-19 11:45:37 CEST
linux-tools has been updated to 3.10-2

tp-smapi-dkms from 3.1-1 still builds without additional changes on Linux 3.10.

openafs was updated to 1.6.4-1, openafs-modules-dkms builds in that version.

xtables-addons was updated to 2.3-1, xtables-addons-dkms builds in that version.

virtualbox was updated to 4.2.10-dfsg-1, virtualbox-ose-dkms and virtualbox-ose-guest-dkms build in that version.
Comment 19 Moritz Muehlenhoff univentionstaff 2013-08-05 14:56:50 CEST
ndiswrapper was updated to 1.58-2, ndiswrapper-dkms builds in that version.
Comment 20 Moritz Muehlenhoff univentionstaff 2013-08-09 09:03:10 CEST
Fixed. The kernel will be updated one more time before release, see Bug 32203.
Comment 21 Philipp Hahn univentionstaff 2013-08-23 16:23:12 CEST
(In reply to Moritz Muehlenhoff from comment #2)
OK: 3.10~rc7
OK: 3.10.0-ucs36-686 @ kvm
OK: 3.10.0-ucs36-amd64 @ kvm
OK: 3.10.0-ucs36-amd64 @ xen12


> 10_config-changes.patch:
FYI: was renamed to 08_config-changes-for-univention-installer.patch

> The changes to compile BLK_DEV_RAM, SCSI and EXT2 into the kernel instead of
> as modules are legacy changes for apparently very old versions of the
> installer.
OK: The installer still uses an compressed ext2 filesystem (initrd) instead of the modern InitRamFS (Bug #26772), thus BLK_DEV_RAM and EXT2 are still required.
RFC: SCSI is still enabled. Why?
FYI: The patch was renamed to 08_config-changes-for-univention-installer.patch

> CONFIG_LEGACY_PTYS was required for python-expect/univention-ssh
> in the past, but the tool was fixed in Bug 11870.
OK

> The actication of
> BLK_DEV_TAP is now handlded through the add-blktap-driver.patch patch.
OK

> 16-disable-rt-flavour.patch:
OK

> Updated patches:
> 12_disable_abicheck.patch
OK

> 14_ucs_version.patch
OK

> 20-disable-xz-compression.patch
OK

> 22-disable-udeb-generation.patch
OK

> 24-ordereddict-backport.patch
OK

> 26-quilt-compat.patch
OK

> 28-use-gcc-4.4.patch
OK

> 30-add-blktap-driver.patch
OK: split into two patches

> 32-fix-python-dep.patch (Renamed to
> 32-fix-python-dep-and-drop-kernelwedge.patch)
OK: split later on


(In reply to Moritz Muehlenhoff from comment #3)
> initramfs-tools was updated to 0.112 and univention-initrd was updated along.
OK: initramfs-tools 0.112~bpo70+1.29.201307011324


(In reply to Moritz Muehlenhoff from comment #4)
> The univention-kernel-image meta packages have been updated. A test update
> from 3.1-1 to 3.2 was successful, after a reboot 3.10 was used.
OK: 3.1-1 amd64 → 3.2-0
OK: 3.1-1 i386 → 3.2-0


(In reply to Moritz Muehlenhoff from comment #6)
> The UCS installation DVD for 3.2 now uses Linux 3.10. A test installation on
> amd64 worked fine.
OK


(In reply to Moritz Muehlenhoff from comment #7)
> The KMS module is now blacklisted through UCR (Bug #19892)
OK: kernel/blacklist: nouveau


(In reply to Moritz Muehlenhoff from comment #10)
> (In reply to Stefan Gohmann from comment #8)
> > The UCS systems do not boot with Kernel 3.10 in Amazon EC2, see attached
> > Screenshot.
> 
> Should be fixed with 08-use-gz-compression.patch, the build is already
> running.
OK: 3.10.0-ucs36-amd64 @ EC2


(In reply to Moritz Muehlenhoff from comment #13)
> A current 3.10 kbuild is needed to build out of tree modules. I made a local
> build based 3.9-1 from sid, a locally prepared tarball of linux-tools 3.10 
> and the debian-kernel SVN trunk. 
> With these changes DKMS and the kernel headers are installable.
SPLIT: apt-get install open-vm-dkms → Bug #32203
 Error!  Build of vmblock.ko failed for: 3.10.0-ucs36-686-pae (i686)
 Error!  Build of vmblock.ko failed for: 3.10.0-ucs36-amd64 (x86_64)


(In reply to Moritz Muehlenhoff from comment #15)
> firmware-nonfree was updated to 0.38. Version 0.37 added a new binary
> package firmware-adi, which has been added to the univention-kernel-image
> meta packages.
OK: apt-cache rdepends firmware-adi

> firmware-free was updated to 3.2.
OK: firmware-linux-free     3.2.11.201307111636


(In reply to Moritz Muehlenhoff from comment #16)
> (In reply to Moritz Muehlenhoff from comment #14)
> univention-grub was updated to add a standard root delay of 5 seconds.
OK: univention-grub 7.0.0-1.101.201307121334

> The root delay can be disabled by setting grub/rootdelay to 0
OK: ucr info grub/rootdelay


(In reply to Moritz Muehlenhoff from comment #17)
> firmware-nonfree 0.39 has been released and was integrated.
OK: firmware-linux-nonfree  0.39

(In reply to Moritz Muehlenhoff from comment #18)
> linux-tools has been updated to 3.10-2
OK: apt-cache policy linux-tools-3.10

> tp-smapi-dkms from 3.1-1 still builds without additional changes on Linux
> 3.10.
OK: tp-smapi-dkms (0.41-1.4.201303082227) @ i386
OK: tp-smapi-dkms (0.41-1.4.201303082227) @ amd64

> openafs was updated to 1.6.4-1, openafs-modules-dkms builds in that version.
FAIL: 
openafs-client (1.6.5-1.8.201307301143) wird eingerichtet ...
update-alternatives: Fehler: Alternativen-Pfad /usr/bin/pagsh.openafs existiert nicht
dpkg: Fehler beim Bearbeiten von openafs-client (--configure):
 Unterprozess installiertes post-installation-Skript gab den Fehlerwert 2 zurück
# dpkg -c /var/cache/apt/archives/openafs-client_1.6.5-1.8.201307301143_amd64.deb  | grep pagsh
-rwxr-xr-x root/root    129736 2013-07-30 12:38 ./usr/bin/pagsh
-rw-r--r-- root/root      3836 2013-07-30 12:38 ./usr/share/man/man1/pagsh.1.gz
# grep pagsh /var/lib/dpkg/info/openafs-client.postinst 
update-alternatives --install /usr/bin/pagsh pagsh \
    /usr/bin/pagsh.openafs 100  \
    --slave /usr/share/man/man1/pagsh.1.gz pagsh.1.gz \
    /usr/share/man/man1/pagsh.openafs.1.gz


> xtables-addons was updated to 2.3-1, xtables-addons-dkms builds in that
> version.
OK: xtables-addons-dkms (2.3-1.5.201307190903) @ amd64
OK: xtables-addons-dkms (2.3-1.5.201307190903) @ i386

> virtualbox was updated to 4.2.10-dfsg-1, virtualbox-ose-dkms and
> virtualbox-ose-guest-dkms build in that version.
OK: virtualbox-ose-dkms (4.2.10-dfsg-1.5.201307190947) @ i386
OK: virtualbox-ose-dkms (4.2.10-dfsg-1.5.201307190947) @ amd64
OK: virtualbox-ose-guest-dkms (4.2.10-dfsg-1.5.201307190947) @ i386
OK: virtualbox-ose-guest-dkms (4.2.10-dfsg-1.5.201307190947) @ amd64


(In reply to Moritz Muehlenhoff from comment #19)
> ndiswrapper was updated to 1.58-2, ndiswrapper-dkms builds in that version.
OK: ndiswrapper-dkms (1.58-2.12.201308051443) @ amd64
OK: ndiswrapper-dkms (1.58-2.12.201308051443) @ i386


OK: Changelog
Comment 22 Moritz Muehlenhoff univentionstaff 2013-08-26 14:53:49 CEST
> RFC: SCSI is still enabled. Why?

We had a problem with accessing a DVD drive in the past. This might be cargo cult programming with the current kernel/installer, but better safe than sorry.

> FAIL: 
> openafs-client (1.6.5-1.8.201307301143) wird eingerichtet ...
> update-alternatives: Fehler: Alternativen-Pfad /usr/bin/pagsh.openafs
> existiert nicht
> dpkg: Fehler beim Bearbeiten von openafs-client (--configure):
>  Unterprozess installiertes post-installation-Skript gab den Fehlerwert 2
> zurück
> # dpkg -c
> /var/cache/apt/archives/openafs-client_1.6.5-1.8.201307301143_amd64.deb  |
> grep pagsh
> -rwxr-xr-x root/root    129736 2013-07-30 12:38 ./usr/bin/pagsh
> -rw-r--r-- root/root      3836 2013-07-30 12:38
> ./usr/share/man/man1/pagsh.1.gz
> # grep pagsh /var/lib/dpkg/info/openafs-client.postinst 
> update-alternatives --install /usr/bin/pagsh pagsh \
>     /usr/bin/pagsh.openafs 100  \
>     --slave /usr/share/man/man1/pagsh.1.gz pagsh.1.gz \
>     /usr/share/man/man1/pagsh.openafs.1.gz

This was caused by the recent update to Heimdal 1.6. Now fixed by not installing the specific manpages. However, the built DKMS package is currently broken, I moved that to Bug 32203 for now.
Comment 23 Philipp Hahn univentionstaff 2013-08-27 08:09:22 CEST
(In reply to Moritz Muehlenhoff from comment #22)
> > RFC: SCSI is still enabled. Why?
> 
> We had a problem with accessing a DVD drive in the past. This might be cargo
> cult programming with the current kernel/installer, but better safe than
> sorry.
OK.

> > FAIL: 
> > openafs-client (1.6.5-1.8.201307301143) wird eingerichtet ...
> I moved that to Bug 32203 for now.
OK
Comment 24 Stefan Gohmann univentionstaff 2013-11-19 06:41:45 CET
UCS 3.2 has been released:
 http://docs.univention.de/release-notes-3.2-en.html
 http://docs.univention.de/release-notes-3.2-de.html

If this error occurs again, please use "Clone This Bug".