Hi,

Do I understand correctly that I can’t use the old columns on s3, s4 and s5 anymore, but I can’t use the new columns on s1 and s8 yet? Please don’t do that, I don’t want to write code that first needs to consult some list of wikis to decide how to query the database. I want to migrate once I can use the new columns everywhere. (I have linkscount in mind, but any other tool would be similarly affected.)

Tacsipacsi

On 1/16/24 11:56, Amir Sarabadani wrote:
Hello,
The data migration for several sections have been completed. We will start dropping the old columns on s4 and s5 this and next week and right after will start dropping the old columns on s3.

The data has not been fully migrated in s1 (enwiki) and s8 (wikidata) but migrated in some wikis of the rest of the sections.

If your tools rely on pagelinks, you might need to update your tools now.

Best

Am Mi., 18. Okt. 2023 um 13:46 Uhr schrieb Amir Sarabadani <asarabadani@wikimedia.org>:

(If you don’t work with pagelinks table, feel free to ignore this message)

Hello,

Here is an update and reminder on the previous announcement regarding normalization of links tables that was sent around a year ago.


As part of that work, soon the pl_namespace and pl_title columns of pagelinks table will be dropped and you will need to use pl_target_id joining with the linktarget table instead. This is basically identical to the templatelinks normalization that happened a year ago.


Currently, MediaWiki writes to both data schemes of pagelinks for new rows in all wikis except English Wikipedia and Wikimedia Commons (we will start writing to these two wikis next week). We have started to backfill the data with the new schema but it will take weeks to finish in large wikis.


So if you query this table directly or your tools do, You will need to update them accordingly. I will write a reminder before dropping the old columns once the data has been fully backfilled.


You can keep track of the general long-term work in T300222 and the specific work for pagelinks in T299947. You can also read more on the reasoning in T222224 or the previous announcement.


Thank you,

--
Amir Sarabadani (he/him)
Staff Database Architect
Wikimedia Foundation

_______________________________________________
Cloud mailing list -- cloud@lists.wikimedia.org
List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/