Cloud December 2022

cloud@lists.wikimedia.org

13 participants
9 discussions

[Cloud-announce] Cloud VPS users, please claim your projects
by Andrew Bogott 11 Mar '23

11 Mar '23

Hello cloud-vps users! It's time for our annual cleanup of unused projects and resources. Every year or so the Cloud Services team tries to identify and clean up unused projects and VMs. We do this via an opt-in process: anyone can mark a project as 'in use,' and that project will be preserved for another year. I've created a wiki page that lists all existing projects, here: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge If you are a VPS user, please visit that page and mark any projects that you use as {{Used}}. Note that it's not necessary for you to be a project admin to mark something -- if you know that you're currently using a resource and want to keep using it, go ahead and mark it accordingly. If you /are/ a project admin, please take a moment to mark which VMs are or aren't used in your projects. When February arrives, I will shut down and begin the process of reclaiming resources from unused projects. If you think you use a VPS project but aren't sure which, I encourage you to poke around on https://tools.wmflabs.org/openstack-browser/ to see what looks familiar. Worst case, just email cloud(a)lists.wikimedia.org with a description of your use case and we'll sort it out there. Exclusive toolforge users are free to ignore this email. Thank you! -Andrew and the WMCS team _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

3 5

[Cloud-announce] openstack + Horizon upgrades Monday, 2022-11-14
by Andrew Bogott 17 Jan '23

17 Jan '23

I will be upgrading the cloud-vps openstack install on Monday afternoon my time (beginning around 18:00 UTC). Here's what to expect: - Intermittent Horizon and API downtime (maybe an hour or two total) - Inability to schedule new VMs (also for an hour or two) - Some mild Horizon dashboard changes as I'll also be upgrading the dashboards to version 'Zen'. Toolforge users will be unaffected by this outage. Existing, running services and VMs on cloud-vps should also be unaffected. -Andrew + the WMCS team _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 4

Wikimedia Hackathon 2023: registration and scholarship application open
by Léa Lacroix 09 Jan '23

09 Jan '23

Hello all, As you may have heard, the Wikimedia Hackathon <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023> is back in person on May 19-21 in Athens, Greece. We are now opening the registration form that also includes an optional scholarship application form open until January 14th. Registration is required to attend the onsite Wikimedia Hackathon in Athens. The registration form remains open until we reach the capacity of the venue (around 220 people). The event is free of charge - participants are expected to book their travel arrangements individually, unless they are granted a scholarship. You can register here by getting yourself a (free) ticket for the hackathon! <https://pretix.eu/wikimedia/wmhack2023/> (see also the detailed instructions <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Participate#Registr…> ) In order to support the technical community and participants from diverse backgrounds, the Wikimedia Foundation provides scholarships that cover travel and accommodation for a selected number of technical contributors. The application form is part of the registration process, and is open until January 14th. You can find more information about the scholarship process, committee and criteria on the related page <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Participate#Scholar…> . The registration and scholarship application form runs with Pretix, an open source third-party service, which may subject it to additional terms. For more information on privacy and data-handling, see the privacy statement <https://foundation.wikimedia.org/wiki/Legal:Wikimedia_Hackathon_2023_regist…> . If you’d like to connect with others on plans for the hackathon, the talk page <https://www.mediawiki.org/wiki/Talk:Wikimedia_Hackathon_2023/Connect> and the other channels listed here <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Connect> are good places to get started! If you have any questions or issues with the registration form and/or the scholarship application, feel free to reach out to the organization team on the talk page or at hackathon(a)wikimedia.org. For the organization team, -- *Léa Lacroix *(she/her) Hackathon Event Coordinator Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Proposing a Tool sweep
by Kunal Mehta 30 Dec '22

30 Dec '22

Hi everyone, tl;dr: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep It has been nearly a decade since Toolforge came online. Since then, there have a been a lot of improvements to tool infrastructure, but many tools have not yet caught up. For example, new tools are required to have metadata in toolsadmin, and unused tools can now be archived/deleted. I am proposing that we "sweep" through all tools, checking each one for: * Indicating a OSI-approved license in the source code/metadata * Having source code published somewhere * Not loading external resources (for web applications) * Having tool information and metadata in Toolsadmin or Toolhub This is explained further on the wiki page, with proposed remediation steps. There are roughly ~3,200 tools, if we split it up into batches by month, it's about 250 tools per month. Depending on how many people are interested sweeping, it could be doable :) ...or it might take multiple years to clear through. Ultimately the goal is to support tool maintainers with bringing their tools up to standard rather than criticizing them for not doing so. If you're interested in participating, please add your name to the wiki page :) I would like to kick this off in the first week of January. Please let me know if you have any concerns, questions or suggestions. Thanks, -- Kunal / Legoktm

5 4

[Cloud-announce] Limited WMCS staff availability 2022-12-22 through 2023-01-03
by Andrew Bogott 14 Dec '22

14 Dec '22

Due to Foundation holidays + personal time off, WMCS staff will be hard to reach during the end of December and beginning of January. We /may/ be reachable during serious outages or emergencies, but I recommend a light touch on any existing, working projects. For those of you who also have time off, I hope you have an enjoyable break be it at the keyboard or away from it. -Andrew + WMCS staff _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

Scratch space for Toolforge jobs?
by Sascha Brawer 10 Dec '22

10 Dec '22

Can a Toolforge job get access to about 10G of reasonably fast, ephemeral scratch space? My job crunches /public/dumps to build a file (an LMDB database) which it publishes on behalf of other tools. However, on Toolforge Kubernetes, the tool runs about 20 times slower than on my laptop or in a commercial cloud. I wonder how come Toolforge is so awfully slow, and I/O seems like an obvious reason. Basically, my code inserts many millions of keys in random order into a btree in an mmap-ed file. This works super well on local disk or also on a remote Cinder or Ceph volume, but not so well over NFS. — Sascha

1 0

Key errors on toolsdb database
by Russell Blau 09 Dec '22

09 Dec '22

This morning I'm getting a bunch of errors that look like the following: ERROR: CREATE TABLE IF NOT EXISTS admin_list ( admin varchar(255) binary NOT NULL default '', PRIMARY KEY (admin) ) ENGINE=InnoDB ROW_FORMAT=DYNAMIC: Specified key was too long; max key length is 767 bytes I don't know whether this might be related to yesterday's database outage. I also don't understand the error message, since the primary key clearly is 255 bytes, which is less than 767. -- Russell Blau russblau(a)imapmail.org

4 7

[Cloud-announce] small toolsdb outage, just now
by Andrew Bogott 07 Dec '22

07 Dec '22

While troubleshooting an infrastructure issue I just now accidentally triggered a reboot of a few VMs, including the primary host of toolsdb. If you see a little storm of alert in your tool logs about timeouts and disconnections, that was what that was. Everything should be back to normal now! -Andrew _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

2 1

Save the date! Coolest Tool Award 2022: Friday, Dec 16th, 17:00 UTC
by Seyram Komla Sapaty 07 Dec '22

07 Dec '22

Hi everyone! The fourth edition of the Coolest Tool Award https://meta.wikimedia.org/wiki/Special:MyLanguage/Coolest_Tool_Award will happen online on Friday 16 December 2022 at 17:00 UTC! The event will be live streamed on Youtube in the MediaWiki ( https://www.youtube.com/user/watchmediawiki) channel. See <https://zonestamp.toolforge.org/1642179615> https://zonestamp.toolforge.org/1671210028 for your timezone. The awarded tools will be showcased in a virtual event, with broadcasted video and chat channels for socializing. We will send more details and links soon. Save the date, and join us celebrating the great work volunteer developers do for the Wikimedia communities. We hope to see you there! Komla, for the Coolest Tool Academy 2022 -- Seyram Komla Sapaty Developer Advocate Wikimedia Cloud Services

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

Cloud December 2022