July 2023 - Cloud - lists.wikimedia.org

Reminder about the externallinks migration
by Amir Sarabadani 13 Dec '23

13 Dec '23

Hello, We have communicated <https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/…> this change in August 2022 but here is a reminder that if you query externallinks table in wikireplicas, you will need to rework your queries. Changes are: el_to, el_index and el_index_60 fields will be dropped and you need to query el_to_domain_index and el_to_path fields instead. The data has been migrated in all wikis except English Wikipedia, Wikimedia Commons and Wikidata, you can keep track of the data migration in T326314 <https://phabricator.wikimedia.org/T326314>. In late June, we will stop updating the old fields and will start dropping them This is done to optimize storage of external links (drastically reducing its size by removing duplication) and enabling user requested features such as resolving two <https://phabricator.wikimedia.org/T14810> fifteen-year-old tickets <https://phabricator.wikimedia.org/T17218> or easier aggregating of external links domain [1], something that wasn’t possible until now. [1] For example, If you want to get list of the top-linked websites, you can query `SELECT el_to_domain_index, count(*) from externallinks group by el_to_domain_index order by count(*) desc limit 50;` Thank you and sorry for the inconvenience. -- *Amir Sarabadani (he/him)* Staff Database Architect Wikimedia Foundation <https://wikimediafoundation.org/>

3 4

[Cloud-announce] Updated WMCS terms of use
by Andrew Bogott 07 Sep '23

07 Sep '23

After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_Terms_of_use and the terms of use for visitors to WMCS sites can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_End_User_Terms_… There is one significant change in these terms: Cloud-vps projects which collect personal data will need to include an explicit privacy policy for their projects. This is section 7.3. For other WMCS users and admins these documents do not represent any significant change in policy, but do clarify and finalize many things that were poorly-worded in the previous TOU, or policies that we have enforced informally without officially stating. Please feel free to reach out to WMCS staff if you find any part of these documents concerning or disruptive to your work on our platforms. -Andrew _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

4 8

wikistats.wmcloud.org moving to Debian Bookworm
by RhinosF1 - 01 Aug '23

01 Aug '23

Hello, Tomorrow at 6PM UTC, Myself and Arnold will be switching wikistats.wmcloud.org to Debian Bookworm. You can access the bookworm instance from wikistats-new.wmcloud.org If you notice anything strange, please report it on https://phabricator.wikimedia.org/T342813. Otherwise, Happy stat collecting. Sam/RhinosF1

1 1

Announcing the Wikimania Hackathon 2023 in Singapore!
by Szymon Grabarczuk 29 Jul '23

29 Jul '23

Hey everyone, The Wikimania Hackathon 2023 <https://wikimania.wikimedia.org/wiki/2023:Hackathon> is coming to Singapore ! This is our first in-person Wikimania Hackathon since 2019. It will take place August 15–19 at the Suntec Singapore Convention and Exhibition Centre. Whether you're a newcomer or an experienced technical contributor, there's a place for you. We have a Newcomer Track with introductory sessions and workshops, and an Unconference Track with breakout rooms for sessions identified during the event. A main hacking space will also be available throughout the event for collaborative work. Check out our Diff post <https://diff.wikimedia.org/2023/07/24/save-the-date-the-wikimania-hackathon…> for more details about the event, including how to prepare and participate. Important! If you're registered for Wikimania <https://wikimania.eventyay.com/> but *didn't opt in for Hackathon updates*, you may miss out on specific Hackathon emails. To receive these, email sstefanova(a)wikimedia.org, and we'll add you to the Hackathon mailing list. If you have any questions, feel free to ask on the Wikimania help desk page <https://wikimania.wikimedia.org/wiki/2023_talk:Help_desk>. See you in Singapore, or online! On behalf of the Wikimania Hackathon organizing team *Tar Lócesilion / Szymon Grabarczuk* Wikimania 2024 Core Organizing Team Wikimania 2023 Technology Committee

1 0

Rotating logs on Toolforge
by Sebastian Berlin 23 Jul '23

23 Jul '23

What's a good way of rotating logs on Toolforge? I haven't found anything in the documentation on Wikitech. For context, in this case I'm looking to use it for logs from Celery workers. I figured I can create a scheduled job that runs logrotate in the tools home directory. Is there any other, recommended or better way to do this? *Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE) E-post/*E-Mail*: sebastian.berlin(a)wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84

3 2

[Cloud-announce] mwdiffs and mwpersistence removed from PAWS 2023-07-24
by Vivian Rook 21 Jul '23

21 Jul '23

These libraries are preventing PAWS from building. It would appear they were last updated 8 years ago. https://github.com/mediawiki-utilities/python-mwdiffs https://github.com/mediawiki-utilities/python-mwpersistence Due to their lack of maintenance they are being removed to unblock PAWS. https://phabricator.wikimedia.org/T342144 -- *Vivian Rook (They/Them)* Site Reliability Engineer Wikimedia Foundation <https://wikimediafoundation.org/> _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

2 1

Codex now available on Toolforge CDNjs
by Lucas Werkmeister 19 Jul '23

19 Jul '23

Hi all, Tool developers may be interested to know that Codex [1], the design system for Wikimedia, is now available on the Toolforge CDNjs Mirror [2] (and on upstream CDNjs [3], but you should prefer the Toolforge mirror :P). This means you can relatively easily use the Codex components, icons, and/or design tokens in your tools if you want, just like e.g. Bootstrap. See [4] for an example in one of my tools. (The most important technical bits are the importmap, import statements, createApp call, and `components: codex` and `...codexIcons`, if you want to search for those parts in particular.) The Codex maintainers would probably like me to remind you that Codex has not reached version 1.0 yet ;) I gather that it’s coming up (and not, like, years away), but until then you should probably be ready for breaking changes to happen. Once version 1.0 is out, CDNjs and the Toolforge mirror should pick it up automatically, but you’ll need to adjust the URLs in your tools like for any version upgrade (since the version number is part of the URL – CDNjs doesn’t offer auto-updating “latest” URLs). The Phabricator task for Codex being available on CDNjs is T338834 [5]; if you experience any issues, you can bring them up there. Enjoy! Lucas [1]: https://doc.wikimedia.org/codex/latest/ [2]: https://cdnjs.toolforge.org/ [3]: https://cdnjs.com/ [4]: https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/commit/0e… [5]: https://phabricator.wikimedia.org/T338834

1 0

pb.toolforge.org is down
by Hadron Higgs 19 Jul '23

19 Jul '23

2 1

Re: Admin Samyar
by Samyar music 10 Jul '23

10 Jul '23

How good that we announce our presence on this page

1 0

[Cloud-announce] Cloud VPS statsd/Graphite service retirement + other monitoring changes
by Taavi Väänänen 03 Jul '23

03 Jul '23

Hi, We are planning to do some changes to the Cloud VPS monitoring systems. Most notably: * The Graphite and statsd servers will be shut down. Please migrate your clients to use Prometheus metrics instead. * The Grafana instance at https://grafana-cloud.wikimedia.org (or grafana-labs.wikimedia.org) will be shut down and replaced by a new instance at https://grafana.wmcloud.org. Please migrate dashboards you rely on to the new server. Toolforge users are unaffected by these changes. Also, the popular "Cloud VPS project board" Grafana dashboard has already been migrated to use Prometheus. For more details and the timeline for these changes, see: https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes Taavi _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

2024

2023

2022

2021

2020

2019

2018

2017

Cloud July 2023