- Cloud - lists.wikimedia.org

[Cloud-announce] Moving superset.wmcloud.org database 2023-09-11
by Vivian Rook 07 Sep '23

07 Sep '23

In order to get long running queries running in superset moving to the in cluster database is needed. Further description in https://phabricator.wikimedia.org/T340623 Unfortunately the external mysql db is not directly compatible with the internal postgres db. Described in https://phabricator.wikimedia.org/T343526 As such the database move will drop the existing data. However for anything that is of interest, the old instance will be available until 2023-10-16 at: https://old-superset.wmcloud.org/ From there you should be able to login, go to the section with the desired object (Dashboards, charts, datasets, saved queries), mark "Bulk Select" select anything that is desired, then export. On the new superset (available at superset.wmcloud.org starting on 2023-09-11), go to the same section and push the import button (which looks suspiciously like a download button) and import the file that you exported from the old superset. -- *Vivian Rook (They/Them)* Site Reliability Engineer Wikimedia Foundation <https://wikimediafoundation.org/> _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

[Cloud-announce] Updated WMCS terms of use
by Andrew Bogott 07 Sep '23

07 Sep '23

After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_Terms_of_use and the terms of use for visitors to WMCS sites can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_End_User_Terms_… There is one significant change in these terms: Cloud-vps projects which collect personal data will need to include an explicit privacy policy for their projects. This is section 7.3. For other WMCS users and admins these documents do not represent any significant change in policy, but do clarify and finalize many things that were poorly-worded in the previous TOU, or policies that we have enforced informally without officially stating. Please feel free to reach out to WMCS staff if you find any part of these documents concerning or disruptive to your work on our platforms. -Andrew _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

4 8

[Cloud-announce] Brief toolsdb outage just now, 2023-08-15 at 23:10 UTC
by Andrew Bogott 15 Aug '23

15 Aug '23

Just now the toolsdb database server ran out of memory and died[0] -- it took us a few minutes to get things rolling again but all service should be restored. The service first went down Aug 15 23:09:12; RO only service was restored about 45 minutes later and RW service shortly after that. Probably no action is needed on the part of tool maintainers, but if your tools are upset this is a good thing to suspect. Sorry for the downtime! -Andrew + the WMCS team [0] https://phabricator.wikimedia.org/T344298 _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

[Cloud-announce] Removing sparql from PAWS after 2023-08-14
by Vivian Rook 08 Aug '23

08 Aug '23

https://phabricator.wikimedia.org/T320934 was opened last year to note that sparql was no longer building on more recent versions of notebook. A patch submitted to the upstream to fix the issue has not been noted or merged. Indeed the upstream has not been updated since 2020. https://phabricator.wikimedia.org/T121478 meanwhile has been unblocked upstream with a new version of notebook. That sparql integration with jupyterlab appears to lack support it will be removed to unblock notebook upgrades. Sparql will be removed as part of https://phabricator.wikimedia.org/T338981 which has a slightly fuzzy deployment date, but not until at least 2023-08-14 -- *Vivian Rook (They/Them)* Site Reliability Engineer Wikimedia Foundation <https://wikimediafoundation.org/> _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

[Cloud-announce] ORES API endpoints deprecated; Lift Wing API endpoints available as replacement
by Bryan Davis 03 Aug '23

03 Aug '23

The Foundation's Machine Learning team has announced [0] that users of ORES models should begin migrating their code to the newer Lift Wing system. They have prepared a page on Wikitech to help bot and tool maintainers understand what steps will be needed and where they can go to ask for help with the process [1]. [0]: https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/… [1]: https://wikitech.wikimedia.org/wiki/ORES Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

1 0

wikistats.wmcloud.org moving to Debian Bookworm
by RhinosF1 - 01 Aug '23

01 Aug '23

Hello, Tomorrow at 6PM UTC, Myself and Arnold will be switching wikistats.wmcloud.org to Debian Bookworm. You can access the bookworm instance from wikistats-new.wmcloud.org If you notice anything strange, please report it on https://phabricator.wikimedia.org/T342813. Otherwise, Happy stat collecting. Sam/RhinosF1

1 1

Announcing the Wikimania Hackathon 2023 in Singapore!
by Szymon Grabarczuk 28 Jul '23

28 Jul '23

Hey everyone, The Wikimania Hackathon 2023 <https://wikimania.wikimedia.org/wiki/2023:Hackathon> is coming to Singapore ! This is our first in-person Wikimania Hackathon since 2019. It will take place August 15–19 at the Suntec Singapore Convention and Exhibition Centre. Whether you're a newcomer or an experienced technical contributor, there's a place for you. We have a Newcomer Track with introductory sessions and workshops, and an Unconference Track with breakout rooms for sessions identified during the event. A main hacking space will also be available throughout the event for collaborative work. Check out our Diff post <https://diff.wikimedia.org/2023/07/24/save-the-date-the-wikimania-hackathon…> for more details about the event, including how to prepare and participate. Important! If you're registered for Wikimania <https://wikimania.eventyay.com/> but *didn't opt in for Hackathon updates*, you may miss out on specific Hackathon emails. To receive these, email sstefanova(a)wikimedia.org, and we'll add you to the Hackathon mailing list. If you have any questions, feel free to ask on the Wikimania help desk page <https://wikimania.wikimedia.org/wiki/2023_talk:Help_desk>. See you in Singapore, or online! On behalf of the Wikimania Hackathon organizing team *Tar Lócesilion / Szymon Grabarczuk* Wikimania 2024 Core Organizing Team Wikimania 2023 Technology Committee

1 0

Rotating logs on Toolforge
by Sebastian Berlin 22 Jul '23

22 Jul '23

What's a good way of rotating logs on Toolforge? I haven't found anything in the documentation on Wikitech. For context, in this case I'm looking to use it for logs from Celery workers. I figured I can create a scheduled job that runs logrotate in the tools home directory. Is there any other, recommended or better way to do this? *Sebastian Berlin* Utvecklare/*Developer* Wikimedia Sverige (WMSE) E-post/*E-Mail*: sebastian.berlin(a)wikimedia.se Telefon/*Phone*: (+46) 0707 - 92 03 84

3 2

[Cloud-announce] mwdiffs and mwpersistence removed from PAWS 2023-07-24
by Vivian Rook 20 Jul '23

20 Jul '23

These libraries are preventing PAWS from building. It would appear they were last updated 8 years ago. https://github.com/mediawiki-utilities/python-mwdiffs https://github.com/mediawiki-utilities/python-mwpersistence Due to their lack of maintenance they are being removed to unblock PAWS. https://phabricator.wikimedia.org/T342144 -- *Vivian Rook (They/Them)* Site Reliability Engineer Wikimedia Foundation <https://wikimediafoundation.org/> _______________________________________________ Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…

2 1

Codex now available on Toolforge CDNjs
by Lucas Werkmeister 19 Jul '23

19 Jul '23

Hi all, Tool developers may be interested to know that Codex [1], the design system for Wikimedia, is now available on the Toolforge CDNjs Mirror [2] (and on upstream CDNjs [3], but you should prefer the Toolforge mirror :P). This means you can relatively easily use the Codex components, icons, and/or design tokens in your tools if you want, just like e.g. Bootstrap. See [4] for an example in one of my tools. (The most important technical bits are the importmap, import statements, createApp call, and `components: codex` and `...codexIcons`, if you want to search for those parts in particular.) The Codex maintainers would probably like me to remind you that Codex has not reached version 1.0 yet ;) I gather that it’s coming up (and not, like, years away), but until then you should probably be ready for breaking changes to happen. Once version 1.0 is out, CDNjs and the Toolforge mirror should pick it up automatically, but you’ll need to adjust the URLs in your tools like for any version upgrade (since the version number is part of the URL – CDNjs doesn’t offer auto-updating “latest” URLs). The Phabricator task for Codex being available on CDNjs is T338834 [5]; if you experience any issues, you can bring them up there. Enjoy! Lucas [1]: https://doc.wikimedia.org/codex/latest/ [2]: https://cdnjs.toolforge.org/ [3]: https://cdnjs.com/ [4]: https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/commit/0e… [5]: https://phabricator.wikimedia.org/T338834

1 0

2024

2023

2022

2021

2020

2019

2018

2017

Cloud