Just a quick update since it's late on a Friday. (I'll send a more complete train summary on Monday.)
We've performed an emergency deployment of https://gerrit.wikimedia.org/r/c/mediawiki/core/+/737153 which seems to have fixed the outstanding issue with TOCs and language conversion, with a more comprehensive fix planned for next week.
A huge thanks to cscott and subbu for collaborating on a patch, and to legoktm for graciously sticking around as our SRE for the Friday evening emergency deployment.
Kindly, Dan (*ahem*, Your loving train conductor)
On Fri, Nov 5, 2021 at 4:11 PM Dan Duvall dduvall@wikimedia.org wrote:
Hi all,
The 1.38.0-wmf.7 train is currently deployed to all wikis albeit in a regressive state due to UBN T295187.[1][2]
From the UBN summary: "Since yesterday, multiple users have reported that Chinese conversion no longer functions in ToC on Chinese Wikipedia."
A rollback to 1.38.0-wmf.6 was performed, initially to group1 before rolling back from all wikis, before a further report that the parser cache had already been polluted in a backwards incompatible way causing the TOC to completely disappear from many wikis. All wikis were again rolled forward to 1.38.0-wmf.7 to avoid the broader of the two regressions.[2]
The train is not blocked, but cannot be safely rolled back either to fix UBN T295187.[2] Some fine folks are already helping to resolve this issue before the weekend, but any further assistance is appreciated as always.
To keep up with the most current status please watch the train blocker task in Phabricator.[1]
--
- 💕🚂🌈 - Your loving train conductor.
[1] https://train-blockers.toolforge.org/ [2] https://phabricator.wikimedia.org/T295187