Wikitech-l July 2019

wikitech-l@lists.wikimedia.org

54 participants
68 discussions

Wikimedia production excellence (June 2019)
by Krinkle 31 Jul '19

31 Jul '19

📘 Read on Phabricator at https://phabricator.wikimedia.org/phame/live/1/post/163/ ------- How’d we do in our strive for operational excellence last month? Read on to find out! ## 📊 Month in numbers * ⚠️11 documented incidents. [1] * 39 new Wikimedia-prod-error reports. [2] * 25 Wikimedia-prod-error reports closed. [3] The number of incidents in June was high compared to previous years. At 11 incidents, this is higher than this year’s median (5), the 2018 median (4), and the 2017 median (5). It is also higher than any month of June in the last 4 years. – More data at <https://codepen.io/Krinkle/full/wbYMZK>. To read more about these incidents, their investigations, and pending actionables; check < https://wikitech.wikimedia.org/wiki/Incident_documentation#2019>. There are currently 204 open Wikimedia-prod-error reports (up from 186 in April, and 201 in May). [4] ------- ## *️⃣ [Op-ed] Integrated maintenance cost Hereby a shoutout to the Wikidata and Core Platform teams, at WMDE and WMF respectively. They both recently established a rotating subteam that focuses on incidental work. Such as maintenance, and other work that might otherwise hinder feature development. I expect this to improve efficiency by avoiding context switches between feature and incidental work. The rotational aspect should distribute the work more evenly among team members (avoiding burnout). And, it may increase exposure to other teams, and lesser-known areas of our code; which provide opportunities for personal growth and to retain institutional knowledge. ------- ## 📉 Current problems Take a look at the workboard and look for tasks that might need your help. The workboard lists known issues, grouped by the month in which they were first observed. → https://phabricator.wikimedia.org/tag/wikimedia-production-error/ Breakdown of recent months (past two weeks not included): * November: 1 issue got fixed! (1 issue left). * December: 3 issues left (unchanged). ⚠️ * January: 1 issue left (unchanged). ⚠️ * February: 2 issues left (unchanged). ⚠️ * March: 4 issues left (unchanged). ⚠️ * April: 2 issues got fixed! (10 of 14 issues, that survived April, remain open). * May: 4 issues got fixed! (6 of 10 issues, that survived May, are left). * June: 11 new issues from last month remain unresolved. By steward and software component, the unresolved issues that survived June: * CPT / MW Auth (PHP fatal): https://phabricator.wikimedia.org/T228717 * CPT / MW Actor (DB contention): https://phabricator.wikimedia.org/T227739 * CPT or Multimedia / Thumb handler (MultiCurl error): https://phabricator.wikimedia.org/T225197 * Multimedia / File metadata (PHP error): https://phabricator.wikimedia.org/T226751 * Wikidata / Commons page view (PHP fatal): https://phabricator.wikimedia.org/T227360 * Wikidata / Jobrunner (PHP memory fatal): https://phabricator.wikimedia.org/T227450 * Wikidata / Jobrunner (Trx error): https://phabricator.wikimedia.org/T225098 * Product-Infra / ReadingList API (PHP fatal): https://phabricator.wikimedia.org/T226593 * (Unknown?) / Special:ConfirmEmail (PHP fatal): https://phabricator.wikimedia.org/T226337 * (Unknown?) / Page renaming (DB timeout): https://phabricator.wikimedia.org/T226898 * (Unknown?) / Page renaming (Bad revision fatal): https://phabricator.wikimedia.org/T225366 ------- ## 🎉 Thanks! Thank you to everyone who has helped by reporting, investigating, or resolving problems in Wikimedia production. Including: Brad Jorsch, Brion Vibber, Roan Kattouw, CScott, Daniel Kinzler, David Causse, DerFussi, Ebe123, Filippo Giunchedi, James Forrester, Kosta Harlan, Legoktm, Lucas Werkmeister, Bartosz Dziewoński, Matthias Mullie, Michael Große, Niklas Laxström, Stephane Bisson, Stas Malyshev, Tchanders, Gergő Tisza, Tpt, Umherirrender, and Urbanecm. Thanks! Until next time, – Timo Tijhof 🔮 “These are his marbles...” “Ha! He really did lose his marbles, didn't he?” “Yeah, he lost them good.” ------------------------------------------------- Footnotes: [1] Incidents. – https://wikitech.wikimedia.org/wiki/Special:PrefixIndex?prefix=Incident+doc… [2] Tasks created. – https://phabricator.wikimedia.org/maniphest/query/barA9u0RtzE3/#R [3] Tasks closed. – https://phabricator.wikimedia.org/maniphest/query/zXZdtEhocO1a/#R [4] Open tasks. – https://phabricator.wikimedia.org/maniphest/query/47MGY8BUDvRD/#R

1 0

[Train] 1.34.0-wmf.16 status update
by Brennen Bearnes 31 Jul '19

31 Jul '19

The 1.34.0-wmf.16 version of MediaWiki is no longer blocked[0]! Thanks to Krinkle, tstarling, and everyone else who worked on unblocking the train. We plan to deploy the new version to both group0 and group1[1] today. [0]. <https://phabricator.wikimedia.org/T220741> [1]. <https://tools.wmflabs.org/versions/> -- Your unassuming train minion Brennen Bearnes

1 0

[Train] 1.34.0-wmf.16 status update
by Brennen Bearnes 30 Jul '19

30 Jul '19

The 1.34.0-wmf.16 version of MediaWiki is blocked[0]. The new version can't proceed to group0[1] until this issue is resolved: * serialize(): "" returned as member variable from __sleep() but does not exist - https://phabricator.wikimedia.org/T229366 Once this issue is resolved train can resume. If this issue is resolved on a Friday the train will resume Monday. Thank you for your help resolving these issues! -- Your unassuming train minion [0]. <https://phabricator.wikimedia.org/T220741> [1]. <https://tools.wmflabs.org/versions/>

1 0

Wikidata db primary master switchover (read-only required) 30th July 05:00 AM UTC
by Manuel Arostegui 29 Jul '19

29 Jul '19

Hello, We have requested a 30 minutes read-only window for s8 (wikidata) for the 30th July from 05:00-05:30 UTC to switchover our primary wikidata database master (T227063) db1071 is an old host and out of warranty that will be decommissioned (T217396). This will also unblock some migration stages of the new redesign for the wb_terms table (T221764) We are going to do this on Tuesday 30th July from 05:00 to 05:30 AM UTC (we do not expect to use the 30 minutes window, if everything goes as expected). Impact: Writes will be blocked, reads will remain unaffected. Communication will happen at #wikimedia-operations If you are around at that time and want to help with the monitoring, please join us! Thanks

1 2

CI now runs selenium tests from extension/skin
by Antoine Musso 29 Jul '19

29 Jul '19

Hello, Adam Wight enhanced our MediaWiki test runner (Quibble) so that it now detects whether an extension / skins has a 'selenium-test' script defined in package.json. If so, for each repositories it will: npm install npm run selenium-test The feature has been long awaited, that will lets developers upgrade webdriver.io at their own pace and use their preferred framework (mocha or cucumber). Until now, we were running the Selenium tests from mediawiki/core which made it next to impossible to upgrade webdriver.io. The task was: https://phabricator.wikimedia.org/T199116 cheers, -- Antoine "hashar" Musso

2 1

InnoDB / MyISAM
by Aran 28 Jul '19

28 Jul '19

Hello, I've recently noticed that in a wiki farm I look after, about 20% of the tables are MyISAM, but it doesn't seem very consistent - i.e. some tables that are MyISAM in some wikis are InnoDB in others. searchindex and math look to be all MyISAM. From what I've read about them it seems that InnoDB is the best option, especially for recent versions. Would it be a good idea to change them all to InnoDB? Thanks, Aran

3 4

submission
by Amorn Kingthong 28 Jul '19

28 Jul '19

i submit

2 1

TechCom Radar 2019-07-24
by Daniel Kinzler 26 Jul '19

26 Jul '19

Hi All, Here are the minutes from this week's TechCom meeting: Two RFCs are going on Last Call until August 27: * "Heredoc" arguments for templates <https://phabricator.wikimedia.org/T114432> * Abstract schemas and schema changes <https://phabricator.wikimedia.org/T191231> If no objections remain unaddressed by August 7, these RFCs will be approved as proposed and amended. If you care about this RFCs, please comment on phabricator -- in support, or raising concerns. The Last Call period is not just for raising objections, but also for confirming consensus. We had an IRC meeting about "Merge Extension:Theme into core". There was good progress made on the mechanics of adding support for theme based LESS variables to Resource Loader. The discussion about actually merging the extension into core is ongoing on the ticket. <https://phabricator.wikimedia.org/T122924> Other topics under active discussion: * strategy for handling PHP interface changes <https://phabricator.wikimedia.org/T193613> * future of relational datastore at WMF after the upgrade of MariaDB 10.1 <https://phabricator.wikimedia.org/T193224> * Store WikibaseQualityConstraint check data in persistent storage <https://phabricator.wikimedia.org/T214362> You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

2 2

Coolest Tool Award 2019: Call for Nominations
by Birgit Mueller 25 Jul '19

25 Jul '19

Dear all, we’re really happy to announce the first ever Coolest Tool Award <https://meta.wikimedia.org/wiki/Coolest_Tool_Award>! Tools play an essential role at Wikimedia, and so do the many volunteer developers who experiment with new ideas, develop & maintain local & global solutions and bridge workflow gaps for the Wikimedia communities. There are incredible many great tools out there. It’s time to celebrate this & to make the work volunteer developers do more visible to everyone :-) The Coolest Tool Award ceremony will take place at Wikimania, as part of the official program: https://wikimania.wikimedia.org/wiki/2019:Technology_outreach_%26_innovatio… The award is organized & selected by this year's Coolest Tool Academy. The plan is to award the greatest tools in a variety of categories: For example: “best Commons tool” to recognize the value of a tool for a specific project, or “best newcomer” to award the work of a fairly new developer. As no one can possibly know all the cool tools out there, we’re looking for some help & inspiration: Please point us to the tools that you think are great - out of any reason you can think of! Please use this form: https://docs.google.com/forms/d/1Ip5Sb_CDvgO6IN2f51V3WjkVYU9Sa-nneX5PoY0sjo… to recommend tools by July 29, 2019. You can nominate as many tools as you want by filling out the form multiple times. This survey will be conducted via a third-party service, which may subject it to additional terms. For more information on privacy and data-handling, see the survey privacy statement: https://foundation.wikimedia.org/wiki/Coolest_Tool_Award_2019_Survey_Privac… Thank you very much for your ideas & recommendation(s)! We will continue to spread the word over the next 1-2 days, but if you get the chance, please feel welcome to share this information with others too! If you have any questions, please contact us at https://meta.wikimedia.org/wiki/Coolest_Tool_Award. Thanks :-) Birgit, for the Coolest Tool Academy 2019 -- Birgit Müller (she/her) Director of Technical Engagement Wikimedia Foundation <https://wikimediafoundation.org/>

4 3

Thank you Thursday
by Kunal Mehta 25 Jul '19

25 Jul '19

Hi, This week I'd like to thank: * Daimona, bawolff, and sbassett for their work on v2.0 of the phan-taint-check-plugin, which has been instrumental in catching real security issues. * James_F for picking up a lot of CI maintenance * MatmaRex for seeing through a patch to allow skins to have custom OOUI themes, 2 years after beginning work on it! If there's anyone you want to thank or give a shout out to - please do! -- Legoktm

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l July 2019