Bug 45030 - (4.2) provide Celery integration
(4.2) provide Celery integration
Status: CLOSED FIXED
Product: UCS
Classification: Unclassified
Component: General
UCS 4.2
Other Linux
: P5 normal (vote)
: UCS 4.3
Assigned To: Daniel Tröder
Dirk Wiesenthal
: interim-3
Depends on:
Blocks: 44786 45024 45029 46514
  Show dependency treegraph
 
Reported: 2017-07-18 10:05 CEST by Daniel Tröder
Modified: 2018-03-14 14:38 CET (History)
6 users (show)

See Also:
What kind of report is it?: Bug Report
What type of bug is this?: 2: Improvement: Would be a product improvement
Who will be affected by this bug?: 2: Will only affect a few installed domains
How will those affected feel about the bug?: 2: A Pain – users won’t like this once they notice it
User Pain: 0.046
Enterprise Customer affected?:
School Customer affected?: Yes
ISV affected?:
Waiting Support:
Flags outvoted (downgraded) after PO Review:
Ticket number:
Bug group (optional):
Max CVSS v3 score:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Daniel Tröder univentionstaff 2017-07-18 10:05:22 CEST
+++ This bug was initially created as a clone of Bug #44950 +++

Provide an integration package to use Celery (http://www.celeryproject.org/) in UCS.
Comment 1 Daniel Tröder univentionstaff 2017-07-18 12:20:16 CEST
r81215: fork from r80945
r81216: fix missing quoting, bump for UCS 4.2

TODO: library code to manage queues
  * list queues
  * list jobs in queue
  * add job to queue

No further functions for this project required. In the future code to cancel jobs etc. could be added.
Comment 2 Daniel Tröder univentionstaff 2017-07-18 20:59:08 CEST
r81232: enhance init script, fix rabbitmq configuration file

TODO++: move required packages from unmaintained to maintained
Comment 3 Daniel Tröder univentionstaff 2017-08-04 13:19:00 CEST
r81788: move univention-celery (and its deps) to maintained

I did what's written here https://hutten.knut.univention.de/blog/wip-verandertes-verfahren-fur-maintained-paketei/ but I get error messages. Not sure if it worked, so I didn't announce.

Handing release bug over to Sönke.
Comment 4 Daniel Tröder univentionstaff 2017-10-26 17:43:08 CEST
For a customer scope for 4.2 I had to import on omar from:

ucs_4.2-0/all/rabbitmq-server_3.3.5-1.1+deb8u1_all.deb
ucs_4.2-0/all/celeryd_3.1.13-3_all.deb
ucs_4.2-0/all/python-celery*.deb
ucs_4.2-0/all/python-billiard-doc_3.3.0.18-2_all.deb
ucs_4.2-0/all/python-kombu_3.0.21-2_all.deb
ucs_4.2-0/all/python-kombu-doc_3.0.21-2_all.deb
ucs_4.0-0/all/python-mailer_0.7-1.4.201403130738_all.deb
ucs_4.2-0/all/python-amqp*.deb
ucs_4.2-0/all/python-anyjson_0.3.3-1_all.deb
ucs_4.2-0-errata4.2-2/all/univention-celery_1.0.0-3A~4.2.0.201709060754_all.deb
ucs_4.2-0/i386/python-billiard_3.3.0.18-2_i386.deb
ucs_4.2-0/amd64/python-billiard_3.3.0.18-2_amd64.deb
Comment 5 Daniel Tröder univentionstaff 2017-11-15 12:52:25 CET
To install univention-celery in a UCS 4.2 I had to:

* (get univention-celery from omar)
* activate unmaintained for the following binary packages:
all   rabbitmq-server 3.3.5-1.1+deb8u1
amd64 python-billiard 3.3.0.18-2
all   python-celery-common
all   python-amqp 1.4.5-2
all   python-anyjson 0.3.3-1
all   python-kombu 3.0.21-2
all   python-mailer 0.7-1.4.201403130738
all   python-celery 3.1.13-3
all   celeryd 3.1.13-3
Comment 6 Daniel Tröder univentionstaff 2017-11-27 13:44:36 CET
univention-celery will be released with UCS 4.2-3:

http://updates-test.software-univention.de/4.2/maintained/4.2-3/all/
Comment 7 Daniel Tröder univentionstaff 2017-11-27 15:09:14 CET
(In reply to Daniel Tröder from comment #1)
> r81215: fork from r80945
> r81216: fix missing quoting, bump for UCS 4.2
> 
> TODO: library code to manage queues
>   * list queues
>   * list jobs in queue
>   * add job to queue
> 
> No further functions for this project required. In the future code to cancel
> jobs etc. could be added.
No queues management library code was written, as the project didn't need it.
The package contains only example configuration and package dependencies.
Comment 8 Florian Best univentionstaff 2017-11-27 15:32:39 CET
It seems there are packages missing in maintained of apt.knut.univention.de:

# univention-install univention-celery
 univention-celery : Hängt ab von: rabbitmq-server ist aber nicht installierbar
                     Hängt ab von: celeryd ist aber nicht installierbar
                     Hängt ab von: python-celery ist aber nicht installierbar

There is a YAML file but the release is not an errata update.
→ Remove it and add a changelog entry.
Comment 9 Daniel Tröder univentionstaff 2017-11-27 18:39:38 CET
I'm not doing this anymore.

I have spent more than 1/2 day trying to get the package and its dependencies published to either the the errata4.2-3 or the 4.2-3 scope. Neither worked.
Comment 10 Arvid Requate univentionstaff 2017-12-07 17:11:03 CET
There is still an Advisory in the 4.2-2 branch. Please check if there are other things that need to be reverted.
Comment 11 Daniel Tröder univentionstaff 2017-12-11 11:19:09 CET
There is no advisory in the 4.2-2 branch. It was removed in commit f4446bda.
The advisory was added to the 4.2-3 branch with commit 9c1c05d3.

It was decided to not remove unpublished code from old branches.
(Otherwise the complete directory services/univention-celery would be removed, as it is the first release of this package.)
Comment 12 Daniel Tröder univentionstaff 2018-02-15 10:31:55 CET
This bug (the univention-celery package) is a dependency for Bug #44786 for UCS 4.2-3-errata. So I retagged it accordingly.

The package dependencies of univention-celery will be released through the errata process, so YAML files were created:

[4.2-3 0c6a2c3b3f] Bug #45030: move dependencies of univention-celery to maintained

No packages have to be build, as they all already exist since 4.2-0 (and one since 4.0-0) in unmaintained.
Comment 13 Dirk Wiesenthal univentionstaff 2018-03-04 22:59:00 CET
4.2: Please remove YAMLs for the celery packages (and its dependencies)
4.3: Please add a changelog entry
Comment 14 Daniel Tröder univentionstaff 2018-03-05 12:10:12 CET
[4.2-3 fb3bc59bbd] Bug #45030: remove univention-celery and dependencies from 4.2-3 errata

[4.3-0 49d375299f] Bug #45030: add changelog entry

http://jenkins.knut.univention.de:8080/job/UCS-4.3/job/UCS-4.3-0/view/All/job/ReleaseNotes/lastSuccessfulBuild/artifact/webroot/release-notes-4.3-0-de.html#changelog:service:celery
Comment 15 Dirk Wiesenthal univentionstaff 2018-03-06 14:28:52 CET
OK, works
Comment 16 Stefan Gohmann univentionstaff 2018-03-14 14:38:34 CET
UCS 4.3 has been released:
 https://docs.software-univention.de/release-notes-4.3-0-en.html
 https://docs.software-univention.de/release-notes-4.3-0-de.html

If this error occurs again, please use "Clone This Bug".