Bug 52135 – apt-mirror replacement

Bug 52135 - apt-mirror replacement


Summary:	apt-mirror replacement

Status:	NEW

Product:	UCS
Classification:	Unclassified
Component:	Update - Repository administration
Version:	UCS 5.0
Hardware:	Other Linux

Importance:	P5 normal (vote)
Target Milestone:	---
Assigned To:	UCS maintainers
QA Contact:	UCS maintainers

URL:
Keywords:

Depends on:
Blocks:
	Show dependency tree / graph

Reported:	2020-09-25 12:14 CEST by Philipp Hahn
Modified:	2020-09-30 11:35 CEST (History)
CC List:	2 users (show)

See Also:
What kind of report is it?:	Development Internal
What type of bug is this?:	---
Who will be affected by this bug?:	---
How will those affected feel about the bug?:	---
User Pain:
Enterprise Customer affected?:
School Customer affected?:
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):	Further conceptual development
Max CVSS v3 score:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Philipp Hahn

2020-09-25 12:14:26 CEST

`univention-repository-update net` is based on `apt-mirror`: <https://github.com/apt-mirror/apt-mirror>

- it is looking for a new maintainer since 2019
- no real development has happened since 2017
- it has a growing list of issues
- we already carry many patches for it internally:
  $ ls -1 ~/REPOS/patches/apt-mirror/5.0-0-0-ucs/0.5.4-1/
  00_Bug-22199-No-default-mirror-list.patch
  04_Check-normalized-clean-path.quilt
  05_Bug-27761-Only-run-existing-postmirror.sh.quilt
  06_Bug-28048-Don-t-strip-1st-dir-for-clean.sh.quilt
  07_Bug-17838-Bug-39582-Protect-UCS-updater-scripts-from.quilt
  08_Bug-13951-Bug-17838-No-host-directory.quilt
  10_Bug-48424-Fix-parent-path-normalization.quilt
  11_Disable-.bz2-and-.xz.quilt
  12_Bug-27761-apt-mirror-Skip-post-mirror.quilt
  13_Bug-48424-Calculate-destination-once.quilt
  14_Fix-URL-normalization.quilt
- it does not mirror and use the newer `InRelease` files
- it does not mirror by-hash/: this might break APT in the future
- it does not delete files removed on our upstream mirror: e.g. an old Packages.gz is preferred over a new Packages.xz
- no progress report: Bug #48144
- no secure APT support: Bug #29434
- does not handle ENOSPC
- its written in Perl and uses `wget` for downloading

Alternatives:
- ftpsync <https://salsa.debian.org/mirror-team/archvsync/> (main Debian tool, we're using it for debian.knut.univention.de internally)
- <https://linux.die.net/man/1/debmirror> (requires rsync)
- apt-mirror-python (WIP)
- https://www.aptly.info/ (looking for a new maintainer, currently using it for GitLab until https://gitlab.com/gitlab-org/gitlab/-/issues/5835)
- https://pulpproject.org/ (oversized)

Comment 1 Philipp Hahn

2020-09-30 11:35:02 CEST

(In reply to Philipp Hahn from comment #0)
> - it is looking for a new maintainer since 2019

I contacted Brandon and asked Brandon to take over maintainership of apt-mirror

> - it does not mirror and use the newer `InRelease` files

I got that wrong: InRelease is already mirrored.


> - apt-mirror-python (WIP)
https://github.com/sir-xw/apt-mirror-python