Bug 56846 - Cannot import files encoded as UTF-16
Cannot import files encoded as UTF-16
Status: CLOSED FIXED
Product: UCS@school
Classification: Unclassified
Component: Import scripts
UCS@school 5.0
Other Linux
: P5 normal (vote)
: UCS@school 5.0 v5
Assigned To: Alexander Steffen
Johannes Königer
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2023-11-17 11:24 CET by Jan-Luca Kiok
Modified: 2024-03-21 15:49 CET (History)
2 users (show)

See Also:
What kind of report is it?: Bug Report
What type of bug is this?: 5: Major Usability: Impairs usability in key scenarios
Who will be affected by this bug?: 1: Will affect a very few installed domains
How will those affected feel about the bug?: 2: A Pain – users won’t like this once they notice it
User Pain: 0.057
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional): Regression
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jan-Luca Kiok univentionstaff 2023-11-17 11:24:01 CET
Currently the importer fails if the file supplied uses any variation of UTF-16 (with BOM little endian, no BOM little endian, no BOM big endian). The latter are detected as binary, the former is decoded wrong.

This is especially unfortunate as our provided example is a UTF-16 file: https://docs.software-univention.de/ucsschool-import/latest/de/configuration/mapping.html

After making sure this works again we should also mention the encoding support in our manual.
Comment 3 Johannes Königer univentionstaff 2024-02-23 09:29:01 CET
Fixed with the following commits / package updates:

Commit: bd59028cdf2d02e2febd5abb257e874540f63772

ucs-school-import (18.0.44) unstable; urgency=medium

  * Bug #56846: version bump

Commit: af0414d580f3cfe090e215b0406c5ca8e5149c84

ucs-school-import (18.0.43) unstable; urgency=medium

  * Bug #56846: Re-enabled support for UTF-16.
Comment 4 Johannes Königer univentionstaff 2024-03-21 15:49:47 CET
UCS@school 5.0 v5 has been released.

- https://docs.software-univention.de/ucsschool-changelog/5.0v5/en/changelog.html
- https://docs.software-univention.de/ucsschool-changelog/5.0v5/de/changelog.html

If this error occurs again, please clone this bug.