I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
Hi Sebastian,
Old images were (more or less manually) cleaned up a few days ago. While I'm not aware of an explicit policy, these images were just using resources and weren't in use AFAICT. Is this assumption wrong?
Thanks,
Kamila Součková (they/them) Senior Site Reliability Engineer Wikimedia Foundation
On Mon, Jan 20, 2025 at 9:21 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
The images are used in a service, which is used by an extension that we're developing (Wikispeech https://www.mediawiki.org/wiki/Extension:Wikispeech). We haven't been actively working on it for a few years, but have recently started again.
We need the images for local development. Luckily, the two images that have been removed weren't strictly required to run the service, but we still want them 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Mon, 20 Jan 2025 at 19:51, Kamila Součková ksouckova@wikimedia.org wrote:
Hi Sebastian,
Old images were (more or less manually) cleaned up a few days ago. While I'm not aware of an explicit policy, these images were just using resources and weren't in use AFAICT. Is this assumption wrong?
Thanks,
Kamila Součková (they/them) Senior Site Reliability Engineer Wikimedia Foundation
On Mon, Jan 20, 2025 at 9:21 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Hello Sebastian,
I believe that by unused, Kamila meant unused in the WMF production environment.
The reason these weren't rebuilt is that they are based on the deprecated and deleted docker-registry.wikimedia.org/wikimedia-buster image. For some reason, these two images escaped our search when we did that deprecation, sorry about that.
If python2.7 is still required, for instance because of an in-progress transition to python3, I've taken the liberty of creating the two CRs [0] [1] changing them to use docker-registry.wikimedia.org/buster. There seems to be an unrelated pipeline failure for ahotts though.
In the longer term, we would certainly advise migrating these services to python3 and using one of the up to date bullseye images.
Hope this helps, please tell us if you need further assistance,
Best,
[0] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/ahotts/+/1113... [1] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/mishkal/+/111...
On Tue, Jan 21, 2025 at 9:18 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
The images are used in a service, which is used by an extension that we're developing (Wikispeech https://www.mediawiki.org/wiki/Extension:Wikispeech). We haven't been actively working on it for a few years, but have recently started again.
We need the images for local development. Luckily, the two images that have been removed weren't strictly required to run the service, but we still want them 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Mon, 20 Jan 2025 at 19:51, Kamila Součková ksouckova@wikimedia.org wrote:
Hi Sebastian,
Old images were (more or less manually) cleaned up a few days ago. While I'm not aware of an explicit policy, these images were just using resources and weren't in use AFAICT. Is this assumption wrong?
Thanks,
Kamila Součková (they/them) Senior Site Reliability Engineer Wikimedia Foundation
On Mon, Jan 20, 2025 at 9:21 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Thanks for the explanation and the CRs. I'll take a look at the one that didn't go through.
We certainly should upgrade to Python 3. As I said, we've recently started working on these components again, so we're in the process of figuring out what still works and what needs to be updated 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Tue, 21 Jan 2025 at 12:35, Clément Goubert cgoubert@wikimedia.org wrote:
Hello Sebastian,
I believe that by unused, Kamila meant unused in the WMF production environment.
The reason these weren't rebuilt is that they are based on the deprecated and deleted docker-registry.wikimedia.org/wikimedia-buster image. For some reason, these two images escaped our search when we did that deprecation, sorry about that.
If python2.7 is still required, for instance because of an in-progress transition to python3, I've taken the liberty of creating the two CRs [0] [1] changing them to use docker-registry.wikimedia.org/buster. There seems to be an unrelated pipeline failure for ahotts though.
In the longer term, we would certainly advise migrating these services to python3 and using one of the up to date bullseye images.
Hope this helps, please tell us if you need further assistance,
Best,
[0] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/ahotts/+/1113... [1] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/mishkal/+/111...
On Tue, Jan 21, 2025 at 9:18 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
The images are used in a service, which is used by an extension that we're developing (Wikispeech https://www.mediawiki.org/wiki/Extension:Wikispeech). We haven't been actively working on it for a few years, but have recently started again.
We need the images for local development. Luckily, the two images that have been removed weren't strictly required to run the service, but we still want them 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Mon, 20 Jan 2025 at 19:51, Kamila Součková ksouckova@wikimedia.org wrote:
Hi Sebastian,
Old images were (more or less manually) cleaned up a few days ago. While I'm not aware of an explicit policy, these images were just using resources and weren't in use AFAICT. Is this assumption wrong?
Thanks,
Kamila Součková (they/them) Senior Site Reliability Engineer Wikimedia Foundation
On Mon, Jan 20, 2025 at 9:21 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
-- Clément 'claime' Goubert (they/them) Senior SRE Wikimedia Foundation _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Looks like mishkal has a new image at least [0]
[0] https://docker-registry.wikimedia.org/wikimedia/mediawiki-services-wikispeec...
On Tue, Jan 21, 2025 at 2:17 PM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
Thanks for the explanation and the CRs. I'll take a look at the one that didn't go through.
We certainly should upgrade to Python 3. As I said, we've recently started working on these components again, so we're in the process of figuring out what still works and what needs to be updated 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Tue, 21 Jan 2025 at 12:35, Clément Goubert cgoubert@wikimedia.org wrote:
Hello Sebastian,
I believe that by unused, Kamila meant unused in the WMF production environment.
The reason these weren't rebuilt is that they are based on the deprecated and deleted docker-registry.wikimedia.org/wikimedia-buster image. For some reason, these two images escaped our search when we did that deprecation, sorry about that.
If python2.7 is still required, for instance because of an in-progress transition to python3, I've taken the liberty of creating the two CRs [0] [1] changing them to use docker-registry.wikimedia.org/buster. There seems to be an unrelated pipeline failure for ahotts though.
In the longer term, we would certainly advise migrating these services to python3 and using one of the up to date bullseye images.
Hope this helps, please tell us if you need further assistance,
Best,
[0] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/ahotts/+/1113... [1] https://gerrit.wikimedia.org/r/c/mediawiki/services/wikispeech/mishkal/+/111...
On Tue, Jan 21, 2025 at 9:18 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
The images are used in a service, which is used by an extension that we're developing (Wikispeech https://www.mediawiki.org/wiki/Extension:Wikispeech). We haven't been actively working on it for a few years, but have recently started again.
We need the images for local development. Luckily, the two images that have been removed weren't strictly required to run the service, but we still want them 🙂
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84
On Mon, 20 Jan 2025 at 19:51, Kamila Součková ksouckova@wikimedia.org wrote:
Hi Sebastian,
Old images were (more or less manually) cleaned up a few days ago. While I'm not aware of an explicit policy, these images were just using resources and weren't in use AFAICT. Is this assumption wrong?
Thanks,
Kamila Součková (they/them) Senior Site Reliability Engineer Wikimedia Foundation
On Mon, Jan 20, 2025 at 9:21 AM Sebastian Berlin < sebastian.berlin@wikimedia.se> wrote:
I noticed that some of our Docker images, created via the Gerrit CI, are no longer on https://docker-registry.wikimedia.org. In common for these are that they're both a couple of years old. Is there a clean up policy for old images in the registry or is there another reason that they're no longer there?
The repos that the images in question are created from are https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/aho... and https://gerrit.wikimedia.org/r/admin/repos/mediawiki/services/wikispeech/mis... .
*Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin@wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
-- Clément 'claime' Goubert (they/them) Senior SRE Wikimedia Foundation _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
wikitech-l@lists.wikimedia.org