Wikitech-l December 2019

wikitech-l@lists.wikimedia.org

39 participants
63 discussions

TechCom Radar 2019-12-04
by Alexandra Paskulin 05 Dec '19

05 Dec '19

Hi all, Here are the minutes from this week's TechCom meeting: * Discussed: RFC OpenGraph descriptions in wiki pages < https://phabricator.wikimedia.org/T213505>. This RFC discusses possible approaches for adding and maintaining OpenGraph metadata for wiki pages, allowing for rich link previews. * Last call for comments: RFC Where to implement Desktop Improvements project <https://phabricator.wikimedia.org/T234907>. This RFC proposes implementing broad UI changes to the desktop interface of Wikimedia projects by modifying the existing Vector skin. This RFC will be approved as proposed if no concerns remain unaddressed by December 11. * Last call for comments: MediaWiki database policy and/or guidelines <https://phabricator.wikimedia.org/T220056>. This RFC proposes re-implementing the 2015 MediaWiki schema change policy. This RFC will be approved as proposed if no concerns remain unaddressed following the last call period. * No IRC discussion next week. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks! - Alex -- Alex Paskulin Technical Writer Wikimedia Foundation

1 0

First and last call: removing ApiQueryReferences
by Adam Wight 05 Dec '19

05 Dec '19

The Cite extension implements an API `action=query&prop=references`[1], which was written to support a reference lazy-loading feature for mobile clients but never used. This was a beta feature and the API was never enabled on Wikimedia sites.[2] If you query it, you'll see nothing but an error response. My team is currently refactoring the Cite extension, and we would prefer to remove the API rather than continue maintaining dead code. Please respond by the end of the week if you know of any non-Wikimedia sites where the API is enabled and in use, otherwise we'll continue with the plan to remove it without a deprecation period. Thank you, Adam [1] https://en.wikipedia.org/w/api.php?action=help&modules=query%2Breferences [2] https://phabricator.wikimedia.org/T222373 -- Adam Wight - Developer - Wikimedia Deutschland e.V. - https://wikimedia.de

1 1

Removal of the old extension schema update globals
by Klaas Skelte van der Werf 05 Dec '19

05 Dec '19

Hello everyone, Change 554602 [1] proposes the removal without deprecation of the old extension schema update globals. Those globals ($wgExtNewTables, $wgExtNewFields, $wgExtNewIndexes, $wgExtPGNewFields, $wgExtPGAlteredFields and $wgExtModifiedFields) became obsolete with 1.17 and were replaced with the LoadExtensionSchema hook that passed a DatabaseUpdater instance. The phabricator task [2] lists all extensions that still reference those globals, but these are already migrated to the hook and only use the globals for backwards compatibility. The task also has a link to the code search query that lists all extensions still referencing the globals. [1] https://gerrit.wikimedia.org/r/c/mediawiki/core/+/554602 [2] https://phabricator.wikimedia.org/T237873 Mainframe98

1 0

[Train] 1.35.0-wmf.8 status update (blocked)
by Brennen Bearnes 04 Dec '19

04 Dec '19

The 1.35.0-wmf.8 version of MediaWiki is blocked[0]. The new version can't proceed to group1 and group2 [1] until these issues are resolved: * After deploy of 1.35.0-wmf.8 to group1, surge of "Cannot access the database: Unknown error" - https://phabricator.wikimedia.org/T239877 Additionally, an incident report has been started for the outage caused by T239877: * https://wikitech.wikimedia.org/wiki/Incident_documentation/20191204-MediaWi… If these issues are resolved, the train can resume on Thursday 2019-12-05. If these issues are resolved on a Friday the train will resume Monday. Thank you for your help resolving these issues! -- Your frazzled train drudge [0]. <https://phabricator.wikimedia.org/T233856> [1]. <https://tools.wmflabs.org/versions/>

1 0

Scrum of scrums/2019-12-04
by Željko Filipin 04 Dec '19

04 Dec '19

Hi, for HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-12-04 Željko -- = 2019-12-04 = == Callouts == * Release Engineering - unusual train schedule: ** This week: 1.35.0-wmf.8 - group1 + group2 ** Next week: 1.35.0-wmf.10 ** December 23-January 3rd - No deploys (including train), Holiday break == Product == === Editing === * Updates: ** Finalizing work on high fidelity prototype for replies on talk pages === Growth === * Updates: ** Cleaning up remaining bugs from v1.0 release of newcomer tasks === iOS native app === * Updates: **Released 6.5 on 12/2 - [[phab:project/view/4245]] ***Fundraising announcement on article ***History & Diffs screens **Beginning exploratory work on 6.6 [[phab:project/view/4273]] ***Mobile-html ***Bug fixes === Android native app === * Updates: ** Suggested Edits v3 is live, as well as fundraising announcement (article banner in newest app version, and in the Feed in older versions) ** Continuing integration with mobile-html, and continuing to test the latest Parsoid / content service with language variant support. === Readers Web === * Updates: ** Summary: planning for desktop improvements and tapering off of advanced mode. ** [[[Reading/Web/Desktop_Improvements]] Desktop Improvements Project (Vector / DIP)]: *** Planning, research, and task creation *** [[[phab:T239248]] <nowiki>Divide VectorTemplate into components</nowiki>] ** Responsive website (MinervaNeue / MobileFrontend / Portals): *** [[[Reading/Web/Advanced_mobile_contributions]] Advanced mode]: **** [[[phab:T232652]] <nowiki>Add History to article toolbar for all logged-in users</nowiki>] **** [[[phab:T232594]] <nowiki>Add article and discussion tabs to all logged-in users on mobile</nowiki>] *** Miscellaneous: **** [[[phab:T232734]] <nowiki>Mobile logout should not involve an interstitial</nowiki>] **** [[[phab:T225213]] <nowiki>Main Menu should work without JavaScript to be more accessible and a better user experience</nowiki>] **** [[[phab:T214045]] <nowiki> Drawers should be removed from DOM after close</nowiki>] === Product Infrastructure === * Updates: ** Computer-Aided Tagging will launch soon (TM), after the go-ahead from Performance ** mobileapps flapping is under investigation ([[phab:T239344]]) *** seems related to increased request rate associated with the Parsoid/PHP rollout ([[phab:T238832#5708029]]) *** There are also some unexplained MW API request timeouts for which I'm adding more logging for further investigation === Structured Data === * Updates: ** rdfDumps now unblocked ** getting recentchanges by slot merged, so unblocking search ** work continues on new input types for structured data ** tech talk on Structured Data on Commons 1 week from today === Parsing === * Updates: ** Parsoid/PHP deployed to all wikis and all products except (a) linter (b) language converter. These 2 products are served by Parsoid/JS === Language === * Updates: ** Team is back from Offsite. ** More Apertium MT updates coming up. ** Exploring MarianMT at: [[phab:T234194]] === Inuka === * Updates: ** KaiOS better pagination [[phab:T234436]] === UI Standardization === * Updates: ** Design Style Guide https://design.wikimedia.org/style-guide/ *** Polishing tasks *** Improving responsive layout *** Adding further components, like recently Comboboxes ** OOUI release v0.35.2 in preparation == Technology == === Fundraising Tech === * Updates: ** Monitoring fundraiser, tuning parameters to keep receipts and stats flowing smoothly ** Yesterday donors gave us more money by far than any other single day in the foundation's history *** For publicly available stats (as CSVs), see https://frdata.wikimedia.org ** Seeing lower-than-expected CentralNotice banner impressions for US, AU, and IE but that may be all because of bots: [[phab:T239748]] ** Small tweaks to Civi custom code to reduce logspam and cache a few more db lookups. === Core Platform === * Blocking: ** Product Infrastructure - mobileapps flapping is under investigation ([[phab:T239344]]), seems related to increased request rate associated with the Parsoid/PHP rollout * Updates: ** Next round of Core REST API work ** Virtual offsite next week (Dec 10-12) === Engineering Productivity === ==== Release Engineering ==== * Blocking: ** Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for wikibase/vuejs-components repository: [[gerrit:551829]] * Updates: ** Train Health *** Last week: 1.35.0-wmf.8 - [[phab:T233856]] - group0 only because of Thanksgiving *** This week: 1.35.0-wmf.8 - [[phab:T233856]] - group1 + group2 *** Next week: 1.35.0-wmf.10 - [[phab:T233858]] === Scoring Platform === * Blocking: *** Ack that we're blocking [[phab:T233448#5638765]] * Updates: *** Jade API code is ready for review again - [[phab:T199834]] *** Model improvements coming for euwiki and cawiki - [[phab:T238839]] *** Model improvements coming for nowiki - [[phab:T130291]] *** Looking at SpaCy and other "industrial strength" NLP to boost ORES models fitness and performance. *** Extending our documentation around deployment prep: [[wikitech:ORES/Prepare_deployment]] *** Developing improved topic taxonomies. See https://github.com/halfak/wikitax === Security === * Updates: ** Password Reset Update: Security Proposal - [[phab:T237755]] - complete ** Security Review For Page Content Service route /page/mobile-html - [[phab:T227114]] - nearly complete ** A Large-scale Study of Wikipedia Users' Quality of Experience: data release - [[phab:T217318]] - nearly complete ** Security Review for whichbrowser/parser - [[phab:T239259]] - in progress ** Data Map (GDPR) update period closes 12/6 == Wikimedia DE == === Wikidata === * Blocked by: ** Release Engineering: Setting up Pipeline CI job for wikibase/vuejs-components repository: [[gerrit:551829]]

1 0

Fwd: [Wiki-research-l] Survey on data visualization for Wikipedia
by Pine W 03 Dec '19

03 Dec '19

Forwarding in case this is of interest to people on other mailing lists. Pine ( https://meta.wikimedia.org/wiki/User:Pine ) ---------- Forwarded message --------- From: Jaqen <nataliofosco(a)gmail.com> Date: Tue, Dec 3, 2019 at 11:52 AM Subject: [Wiki-research-l] Survey on data visualization for Wikipedia To: Research into Wikimedia content and communities < wiki-research-l(a)lists.wikimedia.org>, <glam(a)lists.wikimedia.org> Hi! As a part of my job at OBC Transeuropa <https://www.balcanicaucaso.org/eng> among the other things I contribute to Wikipedia and Commons with graphs and text coming from EDJNet <https://www.europeandatajournalism.eu/>, a data journalism network we promote that is publishing its content with a free license. In the attempt of inserting graphs using MediaWiki instead of svg images I realised the tool now available are cumbersome and there is the possibilities for improvement. Thus we are making a survey to understand if Wikipedia users are interested in having better tools, allowing to publish better graphs more easily. So I ask you to please spend a few minutes of your time to let us now what you think :) https://surveys.europeandatajournalism.eu/quiz/data-visualization-for-wikip… The survey is anonymous. You will be given the opportunity to leave your e-mail address to receive updates on developments, but this is optional. The results of the survey will be published on EDJNet and on Meta, and I will also link them here. Let me know if you have any questions! Thank you! Niccolò "Jaqen" Caranti _______________________________________________ Wiki-research-l mailing list Wiki-research-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l

1 0

Major trouble with Cirrus forceSearchIndex.php script
by Aran 02 Dec '19

02 Dec '19

Hi all, We're having terrible trouble with the Cirrus search maintenance script for initialising the elastic indexes: forceSearchIndex.php --skipLinks --indexOnSkip... It's happening with MW 1.31 .. 1.33, we're using redis job queue and a single instance of Elastic on the same host (these are low traffic wikis). Debian 10.2, PHP 7.3. No matter what parameters we use (--queue or not, different --maxJobs, or --fromId/--toId, --batchSize etc etc) we're always finding that hundreds of elastic docs are not being created. There's nothing about the articles themselves that are preventing it, if we run the maintenance script on just a single missing one afterwards it gets created no problem, and also each time this problem happens, there are many differences in the missing docs. Please if anyone has heard of this kind of things and could point us in the right direction here that would be awesome! Thanks a lot, Aran

3 3

Upcoming Search Platform Office Hours—December 6th
by Trey Jones 02 Dec '19

02 Dec '19

The Search Platform Team <https://www.mediawiki.org/wiki/Wikimedia_Search_Platform> usually holds office hours the first Wednesday of each month. Come talk to us about anything related to Wikimedia search! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, Dec 6th, 2019 Time: 16:00-17:00 GMT / 08:00-09:00 PST / 11:00-12:00 EST / 17:00-18:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vyc-jvgq-dww Hope to talk to you in a week! *Note that our January Office Hours will be on January 8th.* Trey Jones Sr. Software Engineer, Search Platform Wikimedia Foundation UTC-5 / EST

1 1

PHP 7.4.0 code testing now available in Wikimedia CI
by James Forrester 02 Dec '19

02 Dec '19

All, Over the US holiday weekend, PHP 7.4.0 final was released, and so I've made it available in Wikimedia CI as an experimental job.[0] Although it will generally work as a drop-in replacement for PHP 7.3.x testing, because of the breadth and depth of our code bases it's likely that there will be some issues; there are already some known problems with MediaWiki core and extensions.[1] If you and other owners of your codebase wants to enable PHP74, you can run 'check experimental' on a patch in gerrit to see if it passes already. If it does pass, enabling it is pretty trivial (e.g. for Parsoid it worked immediately[2]) – just file a quite Phabricator task on #Continuous-Integration-Config[3] and we'll get it done. If your codebase doesn't work in PHP74 yet, drop into #wikimedia-dev or #wikimedia-tech IRC and there are a number of us that'd be happy to help. If you have any questions or concerns, please shout out so I can help get them fixed for you. [0] https://phabricator.wikimedia.org/T236132 [1] https://phabricator.wikimedia.org/T233012 [2] https://gerrit.wikimedia.org/r/c/integration/config/+/554110 [3] https://phabricator.wikimedia.org/project/view/1208/ Yours, -- *James D. Forrester* (he/him <http://pronoun.is/he> or they/themself <http://pronoun.is/they/.../themself>) Wikimedia Foundation <https://wikimediafoundation.org/>

2 1

Google Code-in 2019 has started (and runs until January 23)!
by Andre Klapper 02 Dec '19

02 Dec '19

Google Code-in 2019 just started: https://www.mediawiki.org/wiki/Google_Code-in/2019 You might have seen the previous email about it: https://lists.wikimedia.org/pipermail/wikitech-l/2019-November/092802.html In the next seven weeks, many young people are going to make their first contributions to Wikimedia. Expect many questions on IRC and on mailing lists by newcomers who have never used IRC or lists before. Your help and patience is welcome to provide a helping hand. Thanks to all mentors who have already registered & provided tasks. If you have not become a mentor yet, please consider it: See https://www.mediawiki.org/wiki/Google_Code-in/Mentors and ask if something is unclear. Thank you again for giving young contributors the opportunity to learn about and work on all aspects of Free & Open Source Software projects. Cheers, andre -- Andre Klapper (he/him) | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l December 2019