[Wikitech-l] The deployment of 1.37.0-wmf.3: rocky, but good now

This is a summary of this week's deployment of the 1.37.0-wmf.3 branch of MediaWiki and its extensions (also known as "the train"). The primary person in charge this week was me, Lars Wirzenius, with Jeena Huneidi as backup, both from the Release Engineering team. The summary task for this week is https://phabricator.wikimedia.org/T278347 This week was a little more rocky than usual. I achieved three personal records: largest number of rollbacks in a week (two), largest number of errors in logstash after a deployment (63367), and largest number of deer seen from my window while conducting the train (eight, in pairs on three different days). The new version is running all sites. There were a total of six blockers reported and resolved: - T281180 - DiscussionTools: Precondition failed: This Title instance does not represent a proper page, but merely a link target https://phabricator.wikimedia.org/T281180 - T281184 - PHP Fatal Error: Access level to CentralAuthPrimaryAuthenticationProvider::$userNameUtils must be protected (as in class MediaWiki\Auth\AbstractPasswordPrimaryAuthenticationProvider) or weaker https://phabricator.wikimedia.org/T281184 - T281226 - PHP Notice: Only variables should be assigned by reference https://phabricator.wikimedia.org/T281226 - T281361 - TypeError: Argument 2 passed to Wikibase\Client\DataAccess\Scribunto\WikibaseLanguageIndependentLuaBindings::trackUsageForSitelink() must be an instance of Wikibase\DataModel\Entity\ItemId, instance of Wikibase\MediaInfo\DataMo https://phabricator.wikimedia.org/T281361 - T281405 - Wikimedia\Rdbms\DBQueryError: Error 1054: Unknown column 'img_actor' https://phabricator.wikimedia.org/T281405 - T281480 - SqlBlobStore no longer caching blobs (DBConnectionError Too many connections) https://phabricator.wikimedia.org/T281480 The last task is still open, as it was worked around quickly, on Thursday, to avoid a service outage (read: taking down all sites), but is waiting for a proper fix later. As usual, a whole bunch of people helped to find, triage, analyze, fix, or work around problems this. Release Engineering thanks everyone, without help we wouldn't be able to deploy MediaWiki. - Aaron Schulz - Addshore - Bartosz Dziewoński - Daimona - DannyS712 - Gergő Tisza - Giuseppe Lavagetto - Jaime Crespo - Jakob Warkotsch - James D. Forrester - Kosta Harlan - Lucas Werkmeister - Martin Urbanec - Pchelolo - Taavi Väänänen - Timo Tijhof - Tim Starling There may have been other people, and if so, I apologize for not including them on the list above. Have a good weekend. Be well. Be safe. For more information, please see: - https://phabricator.wikimedia.org/T278347 - https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys - https://versions.toolforge.org/ -- WMF release engineering team | he/him or they/them "Imagine a world in which every single human being can freely share in the sum of all knowledge."