Wikitech-l October 2019

wikitech-l@lists.wikimedia.org

53 participants
70 discussions

s6 primary master switchover (read-only required) 19th Nov 05:00 AM UTC
by Manuel Arostegui 19 Nov '19

19 Nov '19

Hello, We have requested a 30 minutes read-only window for s6 wikis (T235475) for the 19th Nov from 05:00-05:30 AM UTC to switchover that section primary database master (T235469) db1061 is an old host and out of warranty that will be decommissioned (T217396). The new master will be db1131. We are going to do this on Tuesday 19th Nov from 05:00 to 05:30 AM UTC (we do not expect to use the 30 minutes window, if everything goes as expected). Impact: Writes will be blocked on the following wikis frwiki jawiki ruwiki Reads will remain unaffected. Communication will happen at #wikimedia-operations If you are around at that time and want to help with the monitoring, please join us! Thanks

1 2

s1 (enwiki) primary master switchover (read-only required) 14th Nov 05:00 AM UTC
by Manuel Arostegui 14 Nov '19

14 Nov '19

Hello, We have requested a 30 minutes read-only window for s1 (enwiki) (T234801) for the 14th November from 05:00-05:30 AM UTC to switchover that section primary database master (T234800) db1067 is an old host and out of warranty that will be decommissioned (T217396). The new master will be db1083 We are going to do this on Thursday 14th Nov from 05:00 to 05:30 AM UTC (we do not expect to use the 30 minutes window, if everything goes as expected). Impact: Writes will be blocked on the following wiki: enwiki Reads will remain unaffected. Communication will happen at #wikimedia-operations If you are around at that time and want to help with the monitoring, please join us! Thanks

1 2

Upcoming Search Platform Office Hours—November 6th
by Trey Jones 05 Nov '19

05 Nov '19

*Note that the time is different for this session because of Daylight Savings time and a scheduling conflict.* The Search Platform Team <https://www.mediawiki.org/wiki/Wikimedia_Search_Platform> usually holds office hours the first Wednesday of each month. Come talk to us about anything related to Wikimedia search! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, Nov 6th, 2019 Time: 17:00-18:00 GMT / 09:00-10:00 PST / 12:00-13:00 EST / 18:00-19:00 CST Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vyc-jvgq-dww Hope to talk to you in a week! —Trey Trey Jones Sr. Software Engineer, Search Platform Wikimedia Foundation UTC-4 / EDT

1 1

URL parameter fetching (mediawiki)
by John Shepherd 01 Nov '19

01 Nov '19

Is there a “special” way in mediawiki to get parameters passed by URL or do you just use the conventional PHP way ($_GET)? I am trying to check if “Special:CreateAccount?reason=“ is set/has a value (and what that value is). Thank you for your assistance, trying to be convention compliant. -TheSandDoctor

3 2

TechCom Radar 2019-10-30
by Kate Chapman 01 Nov '19

01 Nov '19

Hi All, Here are the minutes from this week's TechCom meeting: * Discussed RFC: Where to implement Desktop Improvements project. <https://phabricator.wikimedia.org/T234907> Thinking probably not required to be an RFC. Will discuss again next week and make final decision. * Closed: Drop IE6 and IE7 basic compatibility and security support. <https://phabricator.wikimedia.org/T232563> Already approved RFC and the relevant patches were merged so the ticket was closed. * No IRC meeting next week. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org

1 0

MediaWiki Language Extension Bundle 2019.10 release
by Kartik Mistry 31 Oct '19

31 Oct '19

Hello all, I would like to announce the release of MediaWiki Language Extension Bundle 2019.10. This bundle is compatible with MediaWiki 1.32 or above and requires PHP 7.1 or above. Next MLEB is expected to be released in 3 months. If there are very important bug fixes, we will do an intermediate release. Please give us your feedback at [[Talk:MLEB|https://www.mediawiki.org/wiki/Talk:MLEB]]. * Download: https://translatewiki.net/mleb/MediaWikiLanguageExtensionBundle-2019.10.tar… * sha256sum: b7d6afdb365c7333829ab5b4e286c2f28e3a5f6f48d1584c1f43439e74a60de6 * Signature: https://translatewiki.net/mleb/MediaWikiLanguageExtensionBundle-2019.10.tar… Quick links: * Installation instructions are at: https://www.mediawiki.org/wiki/MLEB * Announcements of new releases will be posted to a mailing list: https://lists.wikimedia.org/mailman/listinfo/mediawiki-i18n * Report bugs to: https://phabricator.wikimedia.org/ * Talk with us at: #mediawiki-i18n @ Freenode Release notes for each extension are below. -- Kartik Mistry == Highlights and upgrade notes == MLEB 2019.10 now requires PHP 7.1. There are plans to move to PHP 7.2 for the next MLEB release. == Babel, CleanChanges and cldr == * Localisation and maintenance updates only. == LocalisationUpdate == * Dropped PHP message file support, since MediaWiki > 1.30 is now required. == Translate == * Translate extension now requires PHP 7.1.x and has dropped support for HHVM. * PHP entry point has been deprecated. To load the Translate extension, please use the following, <pre> wfLoadExtension( 'Translate' ); </pre> === Noteworthy changes === * Removed deprecated and unmaintained SolrTTMServer. Recommendation is to migrate to ElasticSearch. ([https://phabricator.wikimedia.orgT87985 Phab:T87985]) * Universal Language Selector is no longer listed as composer dependency. Make sure you have Universal Language Selector installed by other means. * Fixed regression that broke saving translations. ([https://phabricator.wikimedia.org/T233200 Phab:T233200]) * Fixed an issue that prevented moving translatable pages in namespace without subpages. ([https://phabricator.wikimedia.org/T215202 Phab:T215202]) * Dropped support for HHVM. * Avoid usage of deprecated <code>$wgContLang</code> global ([https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Translate/+/533738 Gerrit Patch]) * Fix expanding of multiple times nested groups on Special:LanguageStats ([https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Translate/+/543459 Gerrit Patch]) * Removed <code>hr</code> element from page translation header ([https://phabricator.wikimedia.org/T220841 Phab:T220841]) * Implemented used X times in translation memory suggestions ([https://phabricator.wikimedia.org/T47686 Phab:T47686]) * Convert Translate to use extension registration ([https://phabricator.wikimedia.org/T87985 Phab:T87985]) * Page translation section names can no longer contain underscore or dash. * Addition of new types of validators to check quality of translations ([https://phabricator.wikimedia.org/T231181 Phab:T231181], [https://phabricator.wikimedia.org/T231707 Phab:T231707]) * Special:ManageMessageGroups gained support for renaming message keys. * Various stability and performance improvements ([https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Translate/+/534571 1][https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Translate/+/538892 2]) == UniversalLanguageSelector == * Localisation and maintenance updates only. -- Kartik Mistry | કાર્તિક મિસ્ત્રી kartikm.wordpress.com

1 0

Scrum of scrums/2019-10-30
by Željko Filipin 30 Oct '19

30 Oct '19

Hi, For HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-10-30 Željko -- = 2019-10-30 = == Callouts == * SRE: Product Infrastructure needs advice on making requests to third-party APIs from MediaWiki. Please see [[phab:T236797]] * CPT: SRE Infrastructure foundations Blocked by CPT on service-runner PR, requesting follow-up https://github.com/wikimedia/service-runner/pull/221 * Release Engineering ** Next week train last train (1.35.0-wmf.5 - [[phab:T233853]]) is the last train before two week break ** v3 of architecture document for new continuous integration wants review and feedback [[User:LarsWirzenius/NewCI]] == Product == === Editing === * Updates: ** Developing talk pages prototype v1.0: Replying to specific comments === Growth === * Updates: ** Mobile summary for suggested edits (task [[phab:T235810]]) ** Newcomer tasks: task explanation widget (task [[phab:T235046]]) ** Mobile homepage: Don't clone module DOM in overlays ** Homepage: Refactor StartEditing.js to not use global selectors ** Homepage: Refactor SuggestedEditsModule to not use global selectors ** Suggested Edits: Add placeholder image (task [[phab:T232423]]) ** Suggested Edits: Implement difficulty filters (task [[phab:T235042]]) ** Suggested Edits: Save task types to user preference (task [[phab:T235042]]) === iOS native app === * Blocked by: ** Core Platform I think? (Need last followup wikidiff2 patch, version++ & release for section info returned in JSON [[gerrit:546231]]) * Updates: ** 6.4.1 in testing ***3D touch fix in article view ** 6.5 in active development - [[phab:project/view/4245]] *** History & diffs feature (user testing this week) *** Blocked by last followup wikidiff2 patch, version++ & release [[gerrit:546231]] === Android native app === * Updates: ** Finishing up API provisions work with PI team, in preparation for a major release with Suggested Edits V3 feature. **App now supports the red bordered announcement for fundraising. === Product Infrastructure === * Blocked by: * SRE: Product Infrastructure needs advice on making requests to third-party APIs from MediaWiki. Please see [[phab:T236797]] * Updates: ** Aiming to enable the MachineVision extension in production (Commons and Test Commons only) ASAP (pending results of security and performance reviews) *** Note: For an initial, two-week testing period, the extension functionality will only be exposed to specific testing users === Structured Data === * Blocking: ** Search Platform: Data dumps for SDC: [[phab:T221917]] === Inuka === * Updates: ** KaiOS app search feature: [[phab:T236262]] ** KaiOS app article pagination: [[phab:T234436]] === UI Standardization === * Updates: ** Design Style Guide *** “Components” section: Finishing up basic components for official publication [[phab:T229333]] & [[phab:T217154]] *** Changing over to scap deployment of Style Guide to enable Git LFS for large binary files ** OOUI release this week delayed, cause Volker being sick == Technology == === Fundraising Tech === * Blocking: ** Release Engineering: [Low priority] Fundraising Tech: Code review on [[gerrit:544071]] appreciated to unblock [[phab:T192167]] * Updates: ** Tweaks to monthly conversion form to ensure donors don't continue seeing banners [[phab:T235209]] ** Investigating data discrepancies in initial tests of new CentralNotice data pipeline. ** CentralNotice: Reviewing contractor-written code for sub-national targeting. [[phab:T226438]] ** CiviCRM: More improvements for contact record de-duplication === Core Platform === * Blocking: **iOS - Need last followup wikidiff2 patch, version++ & release for section info returned in compare endpoint [[gerrit:546231]] ***Will need to pass in those section byte offsets for it to work ** SRE Infrastructure foundations Blocked by CPT on service-runner PR, requesting follow-up https://github.com/wikimedia/service-runner/pull/221 * Updates: ** Finishing page history API ** Starting minimal client API ** Rolling out new echo notification storage on test wikis ** Supporting rollout of Parsoid/PHP === Engineering Productivity === ==== Release Engineering ==== * Blocked: ** Site Reliability Engineering: logstash-beta.wmflabs.org does not receive any mediawiki events [[phab:T233134]] ** [Low priority] Fundraising Tech: Code review on [[gerrit:544071]] appreciated to unblock [[phab:T192167]] * Updates: ** v3 of architecture document for new continuous integration wants review and feedback [[User:LarsWirzenius/NewCI]] ** Train Health *** Last week: 1.35.0-wmf.3 - [[phab:T233851]] *** This week: 1.35.0-wmf.4 - [[phab:T233852]] *** Next week: 1.35.0-wmf.5 - [[phab:T233853]] - last train before two week break === Scoring Platform === * Updates: *** Catalan edit quality now can use Spanish Badwords (cross lingual vandalism is interesting) [[phab:T223794]] *** Complete design assets for Jade Entity UI [[phab:T212370]] *** Jade API review continues. Thanks CPT! [[phab:T199834]] *** (Still to be deployed) Limiting ORES requests to 50 rev_ids (was documented, but not enforced) [[phab:T232005]] *** New docs for Jade API [[Extension:Jade/API]] [[phab:T229968]] *** mwoauth 0.3.7 is out with clean handling of Unicode *** Fixed model info label-ordering issue in revscoring. [[phab:T229445]] *** Starting a spike for OOUIJS for Jade UI. [[phab:T208819]] *** Continued refactoring of revscoring to handle session-based modeling work [[phab:T231214]] === Search Platform === * Blocked by: ** Structured Data: Data dumps for SDC: [[phab:T221917]] * Updates: ** Re-indexed Slovak-language wikis with improved analysis chain: [[phab:T223787]] ** The highlighter will no longer break surrogate pairs - [[phab:T234613]] ** Analysis of new "Did You Mean" suggestion results - [[phab:T232760]] ** Sister search was temporarily broken, and fixed - [[phab:T235778]] === Security === * Updates: ** Review the FileImporter extension's load of config from wiki pages for security concerns, in-progress high priority, [[phab:T202071]] ** Security readiness review for the MachineVision extension, in-progress and nearing completion, [[phab:T227346]] ** Security concept review for newcomer tasks on Special:Homepage, in-progress and nearing completion, [[phab:T235720]] ** Final date for submitting Data Map / GDPR updates will be Nov 30. === Site Reliability Engineering === * Blocked by: ** CPT: SRE Infrastructure foundations Blocked by CPT on service-runner PR, requesting follow-up https://github.com/wikimedia/service-runner/pull/221 * Blocking: ** Release Engineering: logstash-beta.wmflabs.org does not receive any mediawiki events [[phab:T233134]] ** Product Infrastructure needs advice on making requests to third-party APIs from MediaWiki. Please see [[phab:T236797]]

1 0

[MCR] Heads up: testwiki no longer writing to legacy fields in the revision table (rev_text_id, etc)
by Daniel Kinzler 30 Oct '19

30 Oct '19

Hi all! This is a quick heads up that we just switched testwiki (test.wikipedia.org) to $wgMultiContentRevisionSchemaMigrationStage = SCHEMA_COMPAT_NEW [1]. We will do the same for all WMF wikis soon[2], and make this the default for new installes of MW 1.34[3]. In concrete terms, this means that the following fields will no longer be populated: rev_text_id, rev_content_model, rev_content_formt, as well as ar_text_id, ar_content_model, ar_content_formt. All code should now use the slots table to join against the content table to find the relevant information. This should already be the case for all code in core as well as all extensions maintained, deployed or bundled by wmf. The unused fields will be removed eventually. If you notice any oddities on testwiki that might be related to this change, please file a ticket on Phabricator and tag #Core_Platform_Team. Cheers, Daniel [1] https://phabricator.wikimedia.org/T198558 [2] https://phabricator.wikimedia.org/T198312 [3] https://phabricator.wikimedia.org/T231673 -- Daniel Kinzler Principal Software Engineer, Core Platform Wikimedia Foundation

1 0

[TAIM] Wednesday: Technical Advice IRC Meeting
by Leszek Manicki 30 Oct '19

30 Oct '19

Sorry for cross-posting! Reminder: Technical Advice IRC meeting this week **Wednesday 4-5 pm UTC** on #wikimedia-tech. *Note the time change due to Berlin having switched to winter time!* Questions can be asked in English, and Spanish! The Technical Advice IRC Meeting (TAIM) is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about MediaWiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you already know what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! -- Leszek Manicki Engineering Manager Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30 219 158 26-0 http://wikimedia.de Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision! https://spenden.wikimedia.de Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

Outdated dump?
by Bináris 28 Oct '19

28 Oct '19

Hi, I use the latest huwiki-latest-pages-articles.xml.bz2 <https://dumps.wikimedia.org/huwiki/latest/huwiki-latest-pages-articles.xml.…> (21 Oct) from here: https://dumps.wikimedia.org/huwiki/latest/ A few times my bot founds candidates for text replacement in the dump, and then, when it checks the page in the live wiki, it says: No changes were necessary in [[2022-es labdarúgó-világbajnokság]] or other page. But the string "Résztvevő országok", which was found in the dump, was removed from wiki on 7 June: https://hu.wikipedia.org/w/index.php?title=2022-es_labdar%C3%BAg%C3%B3-vil%… This does not happen too often, but not for the first time. So is it possible that the dump contains earlier version? -- Bináris

2 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l October 2019