Hello cloud-vps users!
It's time for our annual cleanup of unused projects and resources. Every
year or so the Cloud Services team tries to identify and clean up unused
projects and VMs. We do this via an opt-in process: anyone can mark a
project as 'in use,' and that project will be preserved for another year.
I've created a wiki page that lists all existing projects, here:
https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge
If you are a VPS user, please visit that page and mark any projects that
you use as {{Used}}. Note that it's not necessary for you to be a
project admin to mark something -- if you know that you're currently
using a resource and want to keep using it, go ahead and mark it
accordingly. If you /are/ a project admin, please take a moment to mark
which VMs are or aren't used in your projects.
When February arrives, I will shut down and begin the process of
reclaiming resources from unused projects.
If you think you use a VPS project but aren't sure which, I encourage
you to poke around on https://tools.wmflabs.org/openstack-browser/ to
see what looks familiar. Worst case, just email
cloud(a)lists.wikimedia.org with a description of your use case and we'll
sort it out there.
Exclusive toolforge users are free to ignore this email.
Thank you!
-Andrew and the WMCS team
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
I will be upgrading the cloud-vps openstack install on Monday afternoon
my time (beginning around 18:00 UTC). Here's what to expect:
- Intermittent Horizon and API downtime (maybe an hour or two total)
- Inability to schedule new VMs (also for an hour or two)
- Some mild Horizon dashboard changes as I'll also be upgrading the
dashboards to version 'Zen'.
Toolforge users will be unaffected by this outage. Existing, running
services and VMs on cloud-vps should also be unaffected.
-Andrew + the WMCS team
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
Hello all,
As you may have heard, the Wikimedia Hackathon
<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023> is back in person
on May 19-21 in Athens, Greece. We are now opening the registration form
that also includes an optional scholarship application form open until
January 14th.
Registration is required to attend the onsite Wikimedia Hackathon in
Athens. The registration form remains open until we reach the capacity of
the venue (around 220 people). The event is free of charge - participants
are expected to book their travel arrangements individually, unless they
are granted a scholarship.
You can register here by getting yourself a (free) ticket for the hackathon!
<https://pretix.eu/wikimedia/wmhack2023/> (see also the detailed
instructions
<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Participate#Registr…>
)
In order to support the technical community and participants from diverse
backgrounds, the Wikimedia Foundation provides scholarships that cover
travel and accommodation for a selected number of technical contributors.
The application form is part of the registration process, and is open
until January
14th. You can find more information about the scholarship process,
committee and criteria on the related page
<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Participate#Scholar…>
.
The registration and scholarship application form runs with Pretix, an open
source third-party service, which may subject it to additional terms. For
more information on privacy and data-handling, see the privacy statement
<https://foundation.wikimedia.org/wiki/Legal:Wikimedia_Hackathon_2023_regist…>
.
If you’d like to connect with others on plans for the hackathon, the talk
page <https://www.mediawiki.org/wiki/Talk:Wikimedia_Hackathon_2023/Connect>
and the other channels listed here
<https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2023/Connect> are good
places to get started!
If you have any questions or issues with the registration form and/or the
scholarship application, feel free to reach out to the organization team on
the talk page or at hackathon(a)wikimedia.org.
For the organization team,
--
*Léa Lacroix *(she/her)
Hackathon Event Coordinator
Wikimedia Foundation <https://wikimediafoundation.org/>
Hi everyone,
tl;dr: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Tool_sweep
It has been nearly a decade since Toolforge came online. Since then,
there have a been a lot of improvements to tool infrastructure, but many
tools have not yet caught up. For example, new tools are required to
have metadata in toolsadmin, and unused tools can now be archived/deleted.
I am proposing that we "sweep" through all tools, checking each one for:
* Indicating a OSI-approved license in the source code/metadata
* Having source code published somewhere
* Not loading external resources (for web applications)
* Having tool information and metadata in Toolsadmin or Toolhub
This is explained further on the wiki page, with proposed remediation steps.
There are roughly ~3,200 tools, if we split it up into batches by month,
it's about 250 tools per month. Depending on how many people are
interested sweeping, it could be doable :) ...or it might take multiple
years to clear through.
Ultimately the goal is to support tool maintainers with bringing their
tools up to standard rather than criticizing them for not doing so.
If you're interested in participating, please add your name to the wiki
page :) I would like to kick this off in the first week of January.
Please let me know if you have any concerns, questions or suggestions.
Thanks,
-- Kunal / Legoktm
Due to Foundation holidays + personal time off, WMCS staff will be hard
to reach during the end of December and beginning of January.
We /may/ be reachable during serious outages or emergencies, but I
recommend a light touch on any existing, working projects. For those of
you who also have time off, I hope you have an enjoyable break be it at
the keyboard or away from it.
-Andrew + WMCS staff
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
Can a Toolforge job get access to about 10G of reasonably fast, ephemeral
scratch space?
My job crunches /public/dumps to build a file (an LMDB database) which it
publishes on behalf of other tools. However, on Toolforge Kubernetes, the
tool runs about 20 times slower than on my laptop or in a commercial cloud.
I wonder how come Toolforge is so awfully slow, and I/O seems like an
obvious reason. Basically, my code inserts many millions of keys in random
order into a btree in an mmap-ed file. This works super well on local disk
or also on a remote Cinder or Ceph volume, but not so well over NFS.
— Sascha
This morning I'm getting a bunch of errors that look like the following:
ERROR: CREATE TABLE IF NOT EXISTS admin_list ( admin varchar(255) binary NOT NULL default '', PRIMARY KEY (admin) ) ENGINE=InnoDB ROW_FORMAT=DYNAMIC: Specified key was too long; max key length is 767 bytes
I don't know whether this might be related to yesterday's database outage. I also don't understand the error message, since the primary key clearly is 255 bytes, which is less than 767.
--
Russell Blau
russblau(a)imapmail.org
While troubleshooting an infrastructure issue I just now accidentally
triggered a reboot of a few VMs, including the primary host of toolsdb.
If you see a little storm of alert in your tool logs about timeouts and
disconnections, that was what that was.
Everything should be back to normal now!
-Andrew
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
Hi everyone!
The fourth edition of the Coolest Tool Award
https://meta.wikimedia.org/wiki/Special:MyLanguage/Coolest_Tool_Award will
happen online on Friday 16 December 2022 at 17:00 UTC!
The event will be live streamed on Youtube in the MediaWiki (
https://www.youtube.com/user/watchmediawiki) channel.
See <https://zonestamp.toolforge.org/1642179615>
https://zonestamp.toolforge.org/1671210028 for your timezone.
The awarded tools will be showcased in a virtual event, with broadcasted
video and chat channels for socializing. We will send more details and
links soon.
Save the date, and join us celebrating the great work volunteer developers
do for the Wikimedia communities.
We hope to see you there!
Komla, for the Coolest Tool Academy 2022
--
Seyram Komla Sapaty
Developer Advocate
Wikimedia Cloud Services