Hello,
We have communicated
<https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/…>
this change in August 2022 but here is a reminder that if you query
externallinks table in wikireplicas, you will need to rework your queries.
Changes are: el_to, el_index and el_index_60 fields will be dropped and you
need to query el_to_domain_index and el_to_path fields instead.
The data has been migrated in all wikis except English Wikipedia, Wikimedia
Commons and Wikidata, you can keep track of the data migration in T326314
<https://phabricator.wikimedia.org/T326314>.
In late June, we will stop updating the old fields and will start dropping
them
This is done to optimize storage of external links (drastically reducing
its size by removing duplication) and enabling user requested features such
as resolving two <https://phabricator.wikimedia.org/T14810> fifteen-year-old
tickets <https://phabricator.wikimedia.org/T17218> or easier aggregating of
external links domain [1], something that wasn’t possible until now.
[1] For example, If you want to get list of the top-linked websites, you
can query `SELECT el_to_domain_index, count(*) from externallinks group by
el_to_domain_index order by count(*) desc limit 50;`
Thank you and sorry for the inconvenience.
--
*Amir Sarabadani (he/him)*
Staff Database Architect
Wikimedia Foundation <https://wikimediafoundation.org/>
After nearly a decade of mishap and delay, we have updated the WMCS
terms of use. The updated document for toolforge and cloud-vps admins
can be found here:
https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_Terms_of_use
and the terms of use for visitors to WMCS sites can be found here:
https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_End_User_Terms_…
There is one significant change in these terms: Cloud-vps projects which
collect personal data will need to include an explicit privacy policy
for their projects. This is section 7.3. For other WMCS users and admins
these documents do not represent any significant change in policy, but
do clarify and finalize many things that were poorly-worded in the
previous TOU, or policies that we have enforced informally without
officially stating.
Please feel free to reach out to WMCS staff if you find any part of
these documents concerning or disruptive to your work on our platforms.
-Andrew
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…
Hey everyone,
The Wikimania Hackathon 2023
<https://wikimania.wikimedia.org/wiki/2023:Hackathon> is coming to Singapore
! This is our first in-person Wikimania Hackathon since 2019. It will take
place August 15–19 at the Suntec Singapore Convention and Exhibition Centre.
Whether you're a newcomer or an experienced technical contributor, there's
a place for you. We have a Newcomer Track with introductory sessions and
workshops, and an Unconference Track with breakout rooms for sessions
identified during the event. A main hacking space will also be available
throughout the event for collaborative work.
Check out our Diff post
<https://diff.wikimedia.org/2023/07/24/save-the-date-the-wikimania-hackathon…>
for more details about the event, including how to prepare and participate.
Important! If you're registered for Wikimania
<https://wikimania.eventyay.com/> but *didn't opt in for Hackathon updates*,
you may miss out on specific Hackathon emails. To receive these, email
sstefanova(a)wikimedia.org, and we'll add you to the Hackathon mailing list.
If you have any questions, feel free to ask on the Wikimania help desk page
<https://wikimania.wikimedia.org/wiki/2023_talk:Help_desk>.
See you in Singapore, or online!
On behalf of the Wikimania Hackathon organizing team
*Tar Lócesilion / Szymon Grabarczuk*
Wikimania 2024 Core Organizing Team
Wikimania 2023 Technology Committee
What's a good way of rotating logs on Toolforge? I haven't found anything
in the documentation on Wikitech. For context, in this case I'm looking to
use it for logs from Celery workers. I figured I can create a scheduled job
that runs logrotate in the tools home directory. Is there any other,
recommended or better way to do this?
*Sebastian Berlin*
Utvecklare/*Developer*
Wikimedia Sverige (WMSE)
E-post/*E-Mail*: sebastian.berlin(a)wikimedia.se
Telefon/*Phone*: (+46) 0707 - 92 03 84
Hi all,
Tool developers may be interested to know that Codex [1], the design
system for Wikimedia, is now available on the Toolforge CDNjs Mirror [2]
(and on upstream CDNjs [3], but you should prefer the Toolforge mirror
:P). This means you can relatively easily use the Codex components,
icons, and/or design tokens in your tools if you want, just like e.g.
Bootstrap. See [4] for an example in one of my tools. (The most
important technical bits are the importmap, import statements, createApp
call, and `components: codex` and `...codexIcons`, if you want to search
for those parts in particular.)
The Codex maintainers would probably like me to remind you that Codex
has not reached version 1.0 yet ;) I gather that it’s coming up (and
not, like, years away), but until then you should probably be ready for
breaking changes to happen. Once version 1.0 is out, CDNjs and the
Toolforge mirror should pick it up automatically, but you’ll need to
adjust the URLs in your tools like for any version upgrade (since the
version number is part of the URL – CDNjs doesn’t offer auto-updating
“latest” URLs).
The Phabricator task for Codex being available on CDNjs is T338834 [5];
if you experience any issues, you can bring them up there.
Enjoy!
Lucas
[1]: https://doc.wikimedia.org/codex/latest/
[2]: https://cdnjs.toolforge.org/
[3]: https://cdnjs.com/
[4]:
https://gitlab.wikimedia.org/toolforge-repos/wd-image-positions/-/commit/0e…
[5]: https://phabricator.wikimedia.org/T338834
Hi,
We are planning to do some changes to the Cloud VPS monitoring systems.
Most notably:
* The Graphite and statsd servers will be shut down. Please migrate your
clients to use Prometheus metrics instead.
* The Grafana instance at https://grafana-cloud.wikimedia.org (or
grafana-labs.wikimedia.org) will be shut down and replaced by a new
instance at https://grafana.wmcloud.org. Please migrate dashboards you
rely on to the new server.
Toolforge users are unaffected by these changes. Also, the popular
"Cloud VPS project board" Grafana dashboard has already been migrated to
use Prometheus.
For more details and the timeline for these changes, see:
https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes
Taavi
_______________________________________________
Cloud-announce mailing list -- cloud-announce(a)lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.…