Cloud January 2022

cloud@lists.wikimedia.org

12 participants
9 discussions

[Cloud-announce] Eliminating Debian Stretch in Cloud VPS
by Andrew Bogott 14 Oct '22

14 Oct '22

Debian Stretch's security support ends in mid 2022, and the Foundation's OS policy already discourages use of existing Stretch machines. That means that it's time for all project admins to start rebuilding your VMs with Bullseye (or, if you must, Buster.) Any webservices running in Kubernetes created in the last year or two are most likely using Buster images already, so there's no action needed for those. Older kubernetes jobs should be refreshed to use more modern images whenever possible. If you are still using the grid engine for webservices, we strongly encourage you to migrate your jobs to Kubernetes. For other grid uses, watch this space for future announcements about grid engine migration; we don't yet have a solution prepared for that. Details about the what and why for this process can be found here: https://wikitech.wikimedia.org/wiki/News/Stretch_deprecation Here is the deprecation timeline: March 2021: Stretch VM creation disabled in most projects July 6, 2021: Active support of Stretch ends, Stretch moves into LTS <- You are Here -> January 1st, 2022: Stretch VM creation disabled in all projects, deprecation nagging begins in earnest. Stretch alternatives will be available for tool migration in Toolforge May 1, 2022: All active Stretch VMs will be shut down (but not deleted) by WMCS admins. This includes Toolforge grid exec nodes. June 30, 2022: LTS support for Debian Stretch ends, all Stretch VMs will be deleted by WMCS admins _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 1

preferred proxy
by Tim Moody 27 Jan '22

27 Jan '22

Which is the preferred domain for dns proxies wmcloud.org or wmflabs.org? Thanks

3 3

ToolForge: Unale to install library on tool server
by aniket.code.ars＠gmail.com 25 Jan '22

25 Jan '22

Hi, All I'm new to maillist, starting this thread to ask help for following error: **ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device** Which is occuring on installing liraries on server using **pip**. I was following https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python

2 1

[Cloud-announce] Do you use /mnt/nfs/secondary-scratch?
by Andrew Bogott 20 Jan '22

20 Jan '22

Hello, all! We are in the process of re-engineering and virtualizing[0] the NFS service provided to Toolforge and VMs. The transition will be rocky and involve some service interruption... I'm still running tests to determine exactly host much disruption will be required. The first volume that I'd like to replace is 'scratch,' typically mounted as /mnt/nfs/secondary-scratch. I'm seeking feedback about how vital scratch uptime is to your current workflow, and how disruptive it would be to lose data there. If you have a project or tool that uses scratch, please respond with your thoughts! My preference would be to wipe out all existing data on scratch and also subject users to several unannounced periods of downtime, but I also don't want anyone to suffer. If you have important/persistent data on that volume then the WMCS team will work with you to migrate that data somewhere safer, and if you have an important workflow that will break due to Scratch downtime then I'll work harder on devising a low-impact roll-out. Thank you! -Andrew [0] https://phabricator.wikimedia.org/T291405 _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

2 4

Coolest Tool Award 2021: Tomorrow, 17:00 UTC!
by Andre Klapper 14 Jan '22

14 Jan '22

Hi everyone! A reminder that the Coolest Tool Award event https://meta.wikimedia.org/wiki/Coolest_Tool_Award will happen online tomorrow, Friday 14 January at 17:00 UTC. See https://zonestamp.toolforge.org/1642179615 for your timezone. Here is more information about the venues: * The event will be live streamed on Youtube in the MediaWiki channel: https://www.youtube.com/watch?v=cdnwhDAdrxE * The following venues can be used for socializing: - Youtube live stream chat: https://www.youtube.com/user/watchmediawiki - Twitter #CoolestToolAward : https://twitter.com/search?q=%23CoolestToolAward&f=live - #wmhack Telegram group : https://t.me/wmhack - #wikimedia-hackathon on Libera IRC We hope to see you there! andre, for the Coolest Tool Academy 2021 -- Andre Klapper (he/him) | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

1 0

elasticsearch.exceptions.UnsupportedProductError
by Roy Smith 11 Jan '22

11 Jan '22

I'm exploring using elasticsearch in Toolforge. I'm running Python 3.7, with elasticsearch==7.16.2 installed. When I run: def main(): es = Elasticsearch(['elasticsearch.svc.tools.eqiad1.wikimedia.cloud:80']) print(es.info()) I get: > elasticsearch.exceptions.UnsupportedProductError: The client noticed that the server is not a supported distribution of Elasticsearch Any idea what's wrong? Are we running some very old version of elasticsearch server?

2 3

How many kubernetes jobs is too many?
by Roy Smith 11 Jan '22

11 Jan '22

I'm starting on a project which will process every edit comment in the enwiki dumps using k8s jobs on toolforge. There's 736 enwiki-20211201-pages-meta-history*.xml*bz2 files. Would kicking off 736 jobs (one per file) be a reasonable thing to do from the resource consumption point of view, or would that lead to a WTF response from the sysadmins?

2 1

[Cloud-announce] Fwd: Cloud VPS users, please claim your projects (and, introducing Komla)
by Seyram Komla Sapaty 05 Jan '22

05 Jan '22

Hello cloud-vps users, There are still about 84 unclaimed projects at https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge Please take a moment to look at that page and mark projects that you are using. Unclaimed projects will be in danger of shutdown on February 1st, 2022. Thank you to those of you who have already acted on this. Thank you! - Komla -------- Forwarded Message -------- Subject: Cloud VPS users, please claim your projects (and, introducing Komla) Date: Thu, 2 Dec 2021 14:42:08 -0600 From: Andrew Bogott <abogott(a)wikimedia.org> <abogott(a)wikimedia.org> Reply-To: abogott(a)wikimedia.org Organization: The Wikimedia Foundation To: Cloud-announce(a)lists.wikimedia.org CC: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> <wikitech-l(a)lists.wikimedia.org> Hello cloud-vps users! It's time for our annual cleanup of unused projects and resources. Our new developer advocate Komla Sapaty will be guiding this process; please respond promptly to his emails and do your best to make him feel welcome! Every year or so the Cloud Services team tries to identify and clean up unused projects and VMs. We do this via an opt-in process: anyone can mark a project as 'in use,' and that project will be preserved for another year. I've created a wiki page that lists all existing projects, here: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2021_Purge If you are a VPS user, please visit that page and mark any projects that you use as {{Used}}. Note that it's not necessary for you to be a project admin to mark something -- if you know that you're currently using a resource and want to keep using it, go ahead and mark it accordingly. If you /are/ a project admin, please take a moment to mark which VMs are or aren't used in your projects. When February arrives, I will shut down and begin the process of reclaiming resources from unused projects. If you think you use a VPS project but aren't sure which, I encourage you to poke around on https://tools.wmflabs.org/openstack-browser/ to see what looks familiar. Worst case, just email cloud(a)lists.wikimedia.org with a description of your use case and we'll sort it out there. Exclusive toolforge users are free to ignore this email and future related things. Thank you! -Andrew and the WMCS team _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

2 2

www.google.com
by Pipeak Teapruksa 02 Jan '22

02 Jan '22

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

Cloud January 2022