Wikitech-l November 2020

wikitech-l@lists.wikimedia.org

38 participants
38 discussions

TechCom meeting 2020-11-25
by Krinkle 26 Nov '20

26 Nov '20

This is the weekly TechCom board review in preparation of our meeting on Wednesday. If there are additional topics for TechCom to review, please let us know by replying to this email. However, please keep discussion about individual RFCs to the Phabricator tickets. Activity since Monday 2020-11-02 on the following boards: https://phabricator.wikimedia.org/tag/techcom/ https://phabricator.wikimedia.org/tag/techcom-rfc/ Committee inbox: - T268328: Automatically index extensions in Codesearch <https://phabricator.wikimedia.org/T268328> - Daniel is raising that people effectively use Codesearch to guide deprecation efforts under theStable Interface policy. As such, we should define what inclusion criteria it has (or should have), and simply or document how to implement that in practice through adding and removing repositories from its index (esp those not hosted by Wikimedia). - T267085 <https://phabricator.wikimedia.org/T267085>: Clarify deprecation of method overrides - A question about the stable interface policy. Committee board activity: - T175745 <https://phabricator.wikimedia.org/T175745>: Do not overwrite edits when conflicting with self - Some renewed interest on this question about how MW should handle when e.g. someone starts editing the same page from multiple tabs and then submits those edits. - T227776 <https://phabricator.wikimedia.org/T227776>: General ParserCache service class - Addshore asking for an update. New RFCs: - T268326: RFC: Amendment to the Stable interface policy (Nov 2020) <https://phabricator.wikimedia.org/T268326> - Proposal by Daniel, to: - … fill some gaps (e.g. traits, and member fields). - … allow for removal without (released) deprecation if it is unused in code we know about and is considered "maintained". Input welcome. Phase progression: - T266866 RFC <https://phabricator.wikimedia.org/T266866>: Bump Basic browser support to require TLS 1.2 for MediaWiki core - Ed lists which Web APIs and other browser capabilities would become safe to use in the base layer (HTML/CSS), as well as some JS features that will automatically become available to Grade A. - Ed confirmed TLS 1.2 mapping to browser names/versions. - Moved to Phase 3: Explore. - T260330 RFC: PHP microservice for containerized shell <https://phabricator.wikimedia.org/T260330> - Moved to Last Call last week, until 2 December (next week). - Tim answered and added a section to clarify the backwards compatible nature of the PHP interface in core, for third-parties that would not or have not installed Shellbox. - T259771: RFC: Drop support for database upgrade older than two LTS <https://phabricator.wikimedia.org/T259771> - Last week's concerns about detection and failure prevention have been answered by Amir. - The Platform Engineering Team has filled the ownership gap for this policy. - Moved to Phase 4: Tune. IRC meeting request: - Later today (Wed 25 Nov), this RFC will be discussed in #wikimedia-office on Freenode IRC: RFC: Provide mechanism for configuration sets for development and tests https://phabricator.wikimedia.org/T267928 Other RFC activity: - T263841 RFC <https://phabricator.wikimedia.org/T263841>: Expand API title generator to support other generated data - Rescoped from potential software change to policy update. - Awaiting resourcing from core API steward to confirm support, risk, compatibility as proposed. - T250406 RFC: Hybrid extension management <https://phabricator.wikimedia.org/T250406 > - Conversation about what we would need to commit to for WMF software, and seeking placing and approval of said resourcing. - T119173: RFC: Discourage use of MySQL ENUM type <https://phabricator.wikimedia.org/T119173> - Next step is for the consensus to be turned into concrete wording for the policy. - T40010: RFC: Re-evaluate librsvg as SVG renderer for WMF wikis <https://phabricator.wikimedia.org/T40010:> - Some general clarifications, and statistics from production. -- Timo

2 2

Congratulations to all interns selected for Outreachy Round 21!!!
by Gopa Vasanth 26 Nov '20

26 Nov '20

Hello everyone, Please join me in welcoming 7 interns we have accepted through Outreachy Round 21! :) We received over 28 applications for 8 projects we promoted during the application period. See below for more information on the accepted projects: *Outreachy Round 21* * Name, Project <link>, Mentor(s)* 1. Aisha Khatun, Analyze community authored functions that build Wikipedia infoboxes and more <https://phabricator.wikimedia.org/T263678>, Adam Baso 2. Liudmila Kalina, Analyze community authored functions that build Wikipedia infoboxes and more <https://phabricator.wikimedia.org/T263678>, Adam Baso 3. Jesse Amamgbu, Build a tool for inferring what countries are associated with a given Wikipedia article <https://phabricator.wikimedia.org/T263646>, Isaac Johnson 4. Harshinee Sriram, Create a Not Safe for Work (NSFW) media Classifier for Wikimedia Commons <https://phabricator.wikimedia.org/T264045>, Daniyal Abbasi and Chaitanya Mittal 5. Kay Wong, Create Machine Learning datasets to measure content reliability on Wikipedia <https://phabricator.wikimedia.org/T263860>, Miriam Redi and Diego Saez-Trumper 6. Harriet, Evaluate Microsoft Playwright as replacement for our browser automation <https://phabricator.wikimedia.org/T262682>, Željko Filipin and Vidhi Mody and Soham Parekh 7. Ogechi O, Review and improve Lua documentation on meta and mediawiki < https://phabricator.wikimedia.org/T254956>, Doug Taylor and Pavithra Eswaramoorthy You can stay up to date on the progress of selected projects by keeping an eye on https://www.mediawiki.org/wiki/Outreachy/Round_ <https://www.mediawiki.org/wiki/Outreachy/Round_21>21/Bi-weekly_Reports We wish all interns have a wonderful winter working on projects and a huge thank you to all the mentors involved in this edition! Cheers, Gopa Vasanth, Pavithra & Srishti (Wikimedia org admins) -- Regards Gopa Vasanth <https://www.mediawiki.org/wiki/User:Gopavasanth> Amrita Vishwa Vidyapeetham <http://www.amrita.edu/> | Blog <https://gopavasanth.wordpress.com/> amFOSS <https://amfoss.in/@gopavasanth> | GitHub <https://github.com/gopavasanth> | Gerrit <https://gerrit.wikimedia.org/r/#/q/gopavasanth> “Yesterday is not ours to recover, but tomorrow is ours to win or lose.”

1 0

2020-11-25 Scrum of Scrums meeting notes
by Grace Gellerman 25 Nov '20

25 Nov '20

https://www.mediawiki.org/wiki/Scrum_of_scrums/2020-11-25 = 2020-11-25 = == Callouts == * Language->Performance: Removal of wfMemckey in MediaWiki created a deployment blocker for translatewiki.net ( https://phabricator.wikimedia.org/T266502#6648828) * FR-Tech: English-language fundraising campaign starts this week, please help keep the front-end stable! * Performance: statsv was broken for a week due to a Python 3 migration gone wrong (sorry), if you have a gap in your mw.track() metrics that's why == No Updates == Tech Com, Anti-Harassment Tools, Editing, Growth, iOS, Android, Web, Prod Infra, Parsing, UI Standardization, OKAPI, Library, Analytics, Cloud Services, Platform, Machine Learning Platform, Research, SRE, Wikidata, German Technical Wishlist == SoS Meeting Bookkeeping == * Updates: ** when posting the notes, I will remove teams whose updates are blank and list those teams in a "no updates" section at the top. == Product == === Community Tech === * Blocked by: * Blocking: * Updates: ** Sifting through the 300 or so community wishlist suggestions. === Structured Data === * Blocked by: - * Blocking: - * Updates: ** MediaSearch: implementing support for complex queries ** MediaSearch: launched tool to get feedback on image quality ** Next week: team offsite === Abstract Wikipedia === * Blocked by: — * Blocking: — * Updates: ** Continuing work on using ZType data to enforce structure when editing ZObjects. ** New engineer starting on Monday. === Language === * Blocked by: Removal of wfMemckey in MediaWiki created a deployment blocker for translatewiki.net ( https://phabricator.wikimedia.org/T266502#6648828) * Blocking: * Updates: === Inuka === * Blocked by: * Blocking: * Updates: ** Various KaiOS app updates based on usability study results. == Technology == === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Adding CiviCRM to our docker dev environment: https://phabricator.wikimedia.org/T262975 ** Starting to build out email preference center: https://phabricator.wikimedia.org/T125272 ** Investigating some failing recurring donations: https://phabricator.wikimedia.org/T268690 ** Reviewing some CentralNotice code: https://phabricator.wikimedia.org/T268646 === Engineering Productivity === ==== Quality and Test Engineering ==== * Blocked by: * Blocking: * Updates: ** Spin up a basic local Phabricator instance with Docker https://phabricator.wikimedia.org/phame/post/view/214/spin_up_a_basic_local… ==== Release Engineering ==== * Blocked by: * Blocking: * Updates: ** [All] Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19 ** Train Health *** Last week: 1.36.0-wmf.18 [[phab:T263184]]  *** This week: No Train *** Next week: 1.36.0-wmf.20 [[phab:T263186]]  *** Rest of the year: https://wikitech.wikimedia.org/wiki/Deployments#Upcoming_Release_Train_disr… === Search Platform === * Updates: ** PHP fatal/ Js exception TypeError: haystack is undefined in stringEndsWith -https://phabricator.wikimedia.org/T266163 ** Enable adaptive replica selection on CirrusSearch Elasticsearch clusters -https://phabricator.wikimedia.org/T259539 ** Bug: Airflow reports Mjolnir connection to Hive is already open - https://phabricator.wikimedia.org/T268180 ** Unallocated shards on elasticsearch codfw cluster after switch failure - https://phabricator.wikimedia.org/T267903 ** Prepare wdqs1009 to run the streaming updater - https://phabricator.wikimedia.org/T255399 ** Analysis of Method 2 Suggestion results - https://phabricator.wikimedia.org/T244800 ** Disable cirrus sanitizer job - https://phabricator.wikimedia.org/T266911 ** The streaming updater should identify all shared statements properly - https://phabricator.wikimedia.org/T266751 ** The streaming updater consumer should stop accumulating patches if it cannot handle them -https://phabricator.wikimedia.org/T266750 ** CategoryChangesAsRdfTest::testCategorization: Failed asserting that two strings are equal. - https://phabricator.wikimedia.org/T266850 === Security === * Blocked by: * Blocking: * Updates: ** In progress: Security Readiness Review For GlobalWatchlist extension ( https://phabricator.wikimedia.org/T260466) ** In progress: Security Readiness Review For geoip2/geoip2 ( https://phabricator.wikimedia.org/T262963)

1 0

Save the date! Coolest Tool Award 2020: December 11th, 17:00 UTC
by Joaquin Oltra Hernandez 25 Nov '20

25 Nov '20

Hi Everyone! The second edition of the Coolest Tool Award <https://meta.wikimedia.org/wiki/Coolest_Tool_Award> will happen online on Friday 11 December 2020 at 17:00 UTC[^1]. The awarded tools will be showcased in a virtual event, with broadcasted video and chat channels for socializing. We will send more details and links soon. Save the date, and join us celebrating the great work volunteer developers do for the Wikimedia communities. We hope to see you there! Joaquin, for the Coolest Tool Academy 2020 [^1]: 17:00 UTC is 9:00 PST, 18:00 CEST, 22:30 IST. More timezones in timeanddate.com <https://www.timeanddate.com/worldclock/fixedtime.html?iso=20201211T17> -- Joaquin Oltra Hernandez Developer Advocate - Wikimedia Foundation

1 0

Fwd: [Wikimedia-l] Call for insights on ways to better communicate the work of the movement
by Chris Koerner 25 Nov '20

25 Nov '20

Hello again everyone, We have received a good amount of interest in the focus groups so far, but are still looking for more technical contributors! We are hoping to have a focus group devoted entirely to technical contributors in order to understand your specific communications needs, so please sign up! Focus groups will be happening throughout January. A note as well that we are offering stipends for participation in the focus groups, in the hopes that those who might not otherwise be able to participate can. Sign-up and stipend information can be found on the Meta page [1]. [1] https://meta.wikimedia.org/wiki/Movement_communications_insights Thanks, take care, and hope to hear from you soon. Yours, Chris Koerner (he/him) Community Relations Specialist Wikimedia Foundation

1 0

VisualEditor inheriting from TransclusionNode in parser function extension?
by Lucien Anti-Spam 25 Nov '20

25 Nov '20

Hi, I am struggling to succeed with inheriting from TransclusionNode in parser function extension? Inheriting a dialog from "ve.ui.MWTransclusionDialog" contains the "Add Template" input and button,what is the right level to inherit from if this is a supported flow? As well as inheriting into the DM for MWTransclusion which works, but recognizes {{PAGEName}} that contains a <div> as a function parser node. Any help would be greatly appreciated as the code is a little overwhelming. Cheers,Luc

2 1

Production Excellence #25: October 2020
by Krinkle 23 Nov '20

23 Nov '20

How’d we do in our strive for operational excellence last month? Read on to find out! Or read on Phabricator at https://phabricator.wikimedia.org/phame/post/view/213/ 📈 Incidents 2 documented incidents in October. [1] Historically, that's just below the median of 3 for this time of year. [3] Learn about recent incidents at Incident documentation <https://wikitech.wikimedia.org/wiki/Incident_documentation> on Wikitech, or Preventive measures <https://phabricator.wikimedia.org/project/view/4758/> in Phabricator. ------- 📊 Trends Figure 1, Figure 2: Unresolved error reports stacked by month. <https://phabricator.wikimedia.org/phame/post/view/213/production_excellence…> Month-over-month plots based on spreadsheet data. [5] ------- 📖 Outstanding errors Take a look at the workboard and look for tasks that could use your help. → https://phabricator.wikimedia.org/tag/wikimedia-production-error/ Summary over recent months: - ⚠️ July 2019 (3 of 18 tasks): One task closed. - ⚠️ August 2019 (1 of 14 tasks): *no change*. - ⚠️ September 2019 (3 of 12 tasks): *no change*. - ⚠️ October 2019 (5 of 12 tasks): One task closed. - ⚠️ November 2019 (1 of 5 tasks): Two tasks closed. - December (3 of 9 tasks left), *no change*. - January 2020 (4 of 7 tasks left), *no change*. - February (2 of 7 tasks left), *no change*. - March (2 of 2 tasks left), *no change*. - April (9 of 14 tasks left): One task closed. - May (7 of 14 tasks left): *no change*. - June (7 of 14 tasks left): *no change*. - July 2020 (9 of 24 new tasks <https://phabricator.wikimedia.org/maniphest/query/s__D8Kd0xuQH/#R>): One task closed. - August 2020 (26 of 53 new tasks <https://phabricator.wikimedia.org/maniphest/query/hu1yhWu4sXkP/#R>): Five tasks closed. - September 2020 (15 of 33 new tasks <https://phabricator.wikimedia.org/maniphest/query/CGFQViLShnOY/#R>): Two tasks closed. - *October 2020*: 45 of 69 new tasks <https://phabricator.wikimedia.org/maniphest/query/MYnnBybPTYpd/#R> survived the month of October and remain open today. Recent tally 110 as of Excellence #24 <https://phabricator.wikimedia.org/phame/post/view/205/production_excellence…> (23rd Oct). -13 closed of the 110 recent tasks. +45 survived October 2020. 142 as of today, 23rd Nov. For the on-going month of November, there are 25 new tasks <https://phabricator.wikimedia.org/maniphest/query/CkC_VqQq5VC0/#R> so far. ------- 🎉 Thanks! Thank you to everyone else who helped by reporting, investigating, or resolving problems in Wikimedia production. Thanks! Until next time, – Timo Tijhof ------- Footnotes: [1] Incident documentation 2020, Wikitech <https://wikitech.wikimedia.org/wiki/Incident_documentation#2019> [2] Open tasks in Wikimedia-prod-error, Phabricator <https://phabricator.wikimedia.org/maniphest/query/Fw3RdXt1Sdxp/#R> [3] Wikimedia incident stats by Krinkle, CodePen <https://codepen.io/Krinkle/full/wbYMZK> [4] Month-over-month, Production Excellence (spreadsheet) <https://docs.google.com/spreadsheets/d/1tRCh8aB0UYyLlhftvcHvhWH4-e7cF5V01Xv…>

1 0

MediaWiki at SMWCon this week
by Krabina Bernhard 23 Nov '20

23 Nov '20

Dear MediaWiki community, tomorrow the free and online Semantic MediaWiki Conference will start! For participation, please register at [ https://hopin.com/events/smwcon | https://hopin.com/events/smwcon ] We will have several MediaWiki related talks ranging from use-cases to technical topics, new extensions etc. For details see [ https://www.semantic-mediawiki.org/wiki/SMWCon_Fall_2020 | https://www.semantic-mediawiki.org/wiki/SMWCon_Fall_2020 ] Hope to see you there! regards, Bernhard

1 0

How to get a list of usercontribs for a given date range?
by Shrinivasan T 20 Nov '20

20 Nov '20

Hello all, I want to get a usercontrib details of a wikisource user in given date range. Trying this https://ta.wikisource.org/wiki/Special:ApiSandbox#action=query&format=json&… Shaila if I give only ucstart, it works fine. adding ucend gives 0 result. Need help on solving this. Share your thoughts on how to solve this. Thanks. -- Regards, T.Shrinivasan My Life with GNU/Linux : http://goinggnu.wordpress.com Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com Get Free Tamil Ebooks for Android, iOS, Kindle, Computer : http://FreeTamilEbooks.com

3 5

TechCom meeting 2020-11-18
by Krinkle 20 Nov '20

20 Nov '20

The minutes from TechCom's triage meeting on 18 November 2020. Present: Tim S, Daniel K, Timo T. New RFC: Provide mechanism for overriding configuration for browser tests - https://phabricator.wikimedia.org/T267928 - TT: High time we resource this. Some previous research on this when we transitioned browser tests from Ruby to Node/WebdriverIO. At the time, we wanted to keep the ability to run the same tests against local+CI+beta, which made this rather difficult. - Moved to P2. RFC: Discourage use of MySQL's ENUM type - https://phabricator.wikimedia.org/T119173 - DK: yes discourage by default - TS: Jaime mentioned that ENUM's sort differently from text, but also said we shouldn't ban it outright. - TT: as proposed sounds right. generally there are better solutions, but as justified optimization specific high-scale uses could be allowed. RFC: Drop support for database upgrade older than two LTS releases - https://phabricator.wikimedia.org/T259771 - TT: principally seems fine, not aware of concerns. we'd want to make sure we cover the failure scenarios, e.g. not just soft documentation, but actually programmatically detected and prevent disaster. I'll comment on-task. - DK: Platform team as stakeholder for ..? - TT: I guess potential veto in terms of what the minimum support should be, and if okay with trailing/dropping, then how long it has to be. RFC: Expiring watch list entries - https://phabricator.wikimedia.org/T262946 - Last Call ended. Approved. RFC: Shellbox microservice for MediaWiki - https://phabricator.wikimedia.org/T260330 - TT: Worth noting that it is an optional service. The current logic remains the same as before and Shell-exec call API also remains compatible. The library can effectively now be put into a container and MW configured to use that rather than calling directly. - Put on Last Call until 2 December. Next week IRC office hoursNo IRC discussion scheduled for next week. You can also find our meeting minutes at https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes If you prefer you can subscribe to our newsletter here https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar -- Timo

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2020