Hi,
For HTML version see
https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-10-30
Željko
--
= 2019-10-30 =
== Callouts ==
* SRE: Product Infrastructure needs advice on making requests to
third-party APIs from MediaWiki. Please see [[phab:T236797]]
* CPT: SRE Infrastructure foundations Blocked by CPT on service-runner PR,
requesting follow-up https://github.com/wikimedia/service-runner/pull/221
* Release Engineering
** Next week train last train (1.35.0-wmf.5 - [[phab:T233853]]) is the last
train before two week break
** v3 of architecture document for new continuous integration wants review
and feedback [[User:LarsWirzenius/NewCI]]
== Product ==
=== Editing ===
* Updates:
** Developing talk pages prototype v1.0: Replying to specific comments
=== Growth ===
* Updates:
** Mobile summary for suggested edits (task [[phab:T235810]])
** Newcomer tasks: task explanation widget (task [[phab:T235046]])
** Mobile homepage: Don't clone module DOM in overlays
** Homepage: Refactor StartEditing.js to not use global selectors
** Homepage: Refactor SuggestedEditsModule to not use global selectors
** Suggested Edits: Add placeholder image (task [[phab:T232423]])
** Suggested Edits: Implement difficulty filters (task [[phab:T235042]])
** Suggested Edits: Save task types to user preference (task
[[phab:T235042]])
=== iOS native app ===
* Blocked by:
** Core Platform I think? (Need last followup wikidiff2 patch, version++ &
release for section info returned in JSON [[gerrit:546231]])
* Updates:
** 6.4.1 in testing
***3D touch fix in article view
** 6.5 in active development - [[phab:project/view/4245]]
*** History & diffs feature (user testing this week)
*** Blocked by last followup wikidiff2 patch, version++ & release
[[gerrit:546231]]
=== Android native app ===
* Updates:
** Finishing up API provisions work with PI team, in preparation for a
major release with Suggested Edits V3 feature.
**App now supports the red bordered announcement for fundraising.
=== Product Infrastructure ===
* Blocked by:
* SRE: Product Infrastructure needs advice on making requests to
third-party APIs from MediaWiki. Please see [[phab:T236797]]
* Updates:
** Aiming to enable the MachineVision extension in production (Commons and
Test Commons only) ASAP (pending results of security and performance
reviews)
*** Note: For an initial, two-week testing period, the extension
functionality will only be exposed to specific testing users
=== Structured Data ===
* Blocking:
** Search Platform: Data dumps for SDC: [[phab:T221917]]
=== Inuka ===
* Updates:
** KaiOS app search feature: [[phab:T236262]]
** KaiOS app article pagination: [[phab:T234436]]
=== UI Standardization ===
* Updates:
** Design Style Guide
*** “Components” section: Finishing up basic components for official
publication [[phab:T229333]] & [[phab:T217154]]
*** Changing over to scap deployment of Style Guide to enable Git LFS for
large binary files
** OOUI release this week delayed, cause Volker being sick
== Technology ==
=== Fundraising Tech ===
* Blocking:
** Release Engineering: [Low priority] Fundraising Tech: Code review on
[[gerrit:544071]] appreciated to unblock [[phab:T192167]]
* Updates:
** Tweaks to monthly conversion form to ensure donors don't continue seeing
banners [[phab:T235209]]
** Investigating data discrepancies in initial tests of new CentralNotice
data pipeline.
** CentralNotice: Reviewing contractor-written code for sub-national
targeting. [[phab:T226438]]
** CiviCRM: More improvements for contact record de-duplication
=== Core Platform ===
* Blocking:
**iOS - Need last followup wikidiff2 patch, version++ & release for section
info returned in compare endpoint [[gerrit:546231]]
***Will need to pass in those section byte offsets for it to work
** SRE Infrastructure foundations Blocked by CPT on service-runner PR,
requesting follow-up https://github.com/wikimedia/service-runner/pull/221
* Updates:
** Finishing page history API
** Starting minimal client API
** Rolling out new echo notification storage on test wikis
** Supporting rollout of Parsoid/PHP
=== Engineering Productivity ===
==== Release Engineering ====
* Blocked:
** Site Reliability Engineering: logstash-beta.wmflabs.org does not receive
any mediawiki events [[phab:T233134]]
** [Low priority] Fundraising Tech: Code review on [[gerrit:544071]]
appreciated to unblock [[phab:T192167]]
* Updates:
** v3 of architecture document for new continuous integration wants review
and feedback [[User:LarsWirzenius/NewCI]]
** Train Health
*** Last week: 1.35.0-wmf.3 - [[phab:T233851]]
*** This week: 1.35.0-wmf.4 - [[phab:T233852]]
*** Next week: 1.35.0-wmf.5 - [[phab:T233853]] - last train before two week
break
=== Scoring Platform ===
* Updates:
*** Catalan edit quality now can use Spanish Badwords (cross lingual
vandalism is interesting) [[phab:T223794]]
*** Complete design assets for Jade Entity UI [[phab:T212370]]
*** Jade API review continues. Thanks CPT! [[phab:T199834]]
*** (Still to be deployed) Limiting ORES requests to 50 rev_ids (was
documented, but not enforced) [[phab:T232005]]
*** New docs for Jade API [[Extension:Jade/API]] [[phab:T229968]]
*** mwoauth 0.3.7 is out with clean handling of Unicode
*** Fixed model info label-ordering issue in revscoring. [[phab:T229445]]
*** Starting a spike for OOUIJS for Jade UI. [[phab:T208819]]
*** Continued refactoring of revscoring to handle session-based modeling
work [[phab:T231214]]
=== Search Platform ===
* Blocked by:
** Structured Data: Data dumps for SDC: [[phab:T221917]]
* Updates:
** Re-indexed Slovak-language wikis with improved analysis chain:
[[phab:T223787]]
** The highlighter will no longer break surrogate pairs - [[phab:T234613]]
** Analysis of new "Did You Mean" suggestion results - [[phab:T232760]]
** Sister search was temporarily broken, and fixed - [[phab:T235778]]
=== Security ===
* Updates:
** Review the FileImporter extension's load of config from wiki pages for
security concerns, in-progress high priority, [[phab:T202071]]
** Security readiness review for the MachineVision extension, in-progress
and nearing completion, [[phab:T227346]]
** Security concept review for newcomer tasks on Special:Homepage,
in-progress and nearing completion, [[phab:T235720]]
** Final date for submitting Data Map / GDPR updates will be Nov 30.
=== Site Reliability Engineering ===
* Blocked by:
** CPT: SRE Infrastructure foundations Blocked by CPT on service-runner PR,
requesting follow-up https://github.com/wikimedia/service-runner/pull/221
* Blocking:
** Release Engineering: logstash-beta.wmflabs.org does not receive any
mediawiki events [[phab:T233134]]
** Product Infrastructure needs advice on making requests to third-party
APIs from MediaWiki. Please see [[phab:T236797]]
Hi all!
This is a quick heads up that we just switched testwiki (test.wikipedia.org) to
$wgMultiContentRevisionSchemaMigrationStage = SCHEMA_COMPAT_NEW [1]. We will do
the same for all WMF wikis soon[2], and make this the default for new installes
of MW 1.34[3].
In concrete terms, this means that the following fields will no longer be
populated: rev_text_id, rev_content_model, rev_content_formt, as well as
ar_text_id, ar_content_model, ar_content_formt. All code should now use the
slots table to join against the content table to find the relevant information.
This should already be the case for all code in core as well as all extensions
maintained, deployed or bundled by wmf. The unused fields will be removed
eventually.
If you notice any oddities on testwiki that might be related to this change,
please file a ticket on Phabricator and tag #Core_Platform_Team.
Cheers,
Daniel
[1] https://phabricator.wikimedia.org/T198558
[2] https://phabricator.wikimedia.org/T198312
[3] https://phabricator.wikimedia.org/T231673
--
Daniel Kinzler
Principal Software Engineer, Core Platform
Wikimedia Foundation
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting this week **Wednesday 4-5 pm UTC**
on #wikimedia-tech.
*Note the time change due to Berlin having switched to winter time!*
Questions can be asked in English, and Spanish!
The Technical Advice IRC Meeting (TAIM) is a weekly support event for
volunteer developers. Every Wednesday, two full-time developers are
available to help you with all your questions about MediaWiki, gadgets,
tools and more! This can be anything from "how to get started" over "who
would be the best contact for X" to specific questions on your project.
If you already know what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
--
Leszek Manicki
Engineering Manager
Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Phone: +49 (0)30 219 158 26-0
http://wikimedia.de
Imagine a world in which every single human being can freely share in the
sum of all knowledge. Help us to achieve our vision!
https://spenden.wikimedia.de
Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/029/42207.
📘 Read on Phabricator at
https://phabricator.wikimedia.org/phame/post/view/173/
-------
How’d we do in our strive for operational excellence last month? Read on to
find out!
## 📊 Month in numbers
* 5 documented incidents. [1]
* 22 new errors reported. [2]
* 31 error reports closed. [3]
* 213 currently open Wikimedia-prod-error reports in total. [4]
There were five recorded incidents last month, equal to the median for this
and last year. – Explore this data at https://codepen.io/Krinkle/full/wbYMZK
To read more about these incidents, their investigations, and pending
actionables; check
https://wikitech.wikimedia.org/wiki/Incident_documentation#2019
## *️⃣ A Tale of Three Great Upgrades
This month saw three major upgrades across the MediaWiki stack.
*Migrate from HHVM to PHP 7.2*
The client-side switch to toggle between HHVM and PHP 7.2 saw its final
push — from the 50% it was at previously, to 100% of page view sessions on
17 September. The switch further solidified on 24 September when static
MediaWiki traffic followed suit (e.g. API and ResourceLoader). Thanks Effie
and Giuseppe for the final push. – More details at
https://phabricator.wikimedia.org/T219150 and
https://phabricator.wikimedia.org/T176370.
*Drop support for IE6 and IE7*
The RFC to discontinue basic compatibility for the IE6 and IE7 browsers
entered Last Call on 18 September. It was approved on 2 Oct (T232563).
Thanks to Volker Eckl for leading the sprint to optimise our CSS payloads
by removing now-redundant style rules for IE6-7 compat. – More at
https://phabricator.wikimedia.org/T234582.
*Transition from PHPUnit 4/6 to PHPUnit 8*
With HHVM behind us, our Composer configuration no longer needs to be
compatible with a “PHP 5.6 like” run-time. Support for the real PHP 5.6 was
dropped over 2 years ago, and the HHVM engine supports PHP 7 features. But,
the HHVM engine identifies as “PHP 5.6.999-hhvm”. As such, Composer refused
to install PHPUnit 6 (which requires PHP 7.0+). Instead, Composer could
only install PHPUnit 4 under HHVM (as for PHP 5.6). Our unit tests have had
to remain compatible with both PHPUnit 4 and PHPUnit 6 simultaneously.
Now that we’re fully on PHP 7.2+, our Composer configuration effectively
drops PHP 5.6, 7.0 and 7.1 all at once. This means that we no longer run
PHPUnit tests on multiple PHPUnit versions (PHPUnit 6 only). The upgrade to
PHPUnit 8 (PHP 7.2+) is also unlocked! Thanks Max Sem, Jdforrester and
Daimona for leading this transition. –
https://phabricator.wikimedia.org/T192167
-------
## 📉 Outstanding reports
Take a look at the workboard and look for tasks that might need your help.
The workboard lists error reports, grouped by the month in which they were
first observed.
→ https://phabricator.wikimedia.org/tag/wikimedia-production-error/
Or help someone that’s already started with their patch:
→ https://phabricator.wikimedia.org/maniphest/query/pzVPXPeMfRIz/#R
Breakdown of recent months (past two weeks not included):
* February: 1 report was closed. (1 / 5 reports left).
* March: 4 / 10 reports left (unchanged).
* April: 8 / 14 reports left (unchanged). ⚠️
* May: The last 4 reports were resolved. Done!
* June: 9 of 11 reports left (unchanged). ⚠️
* July: 4 reports were fixed! (13 / 18 reports left).
* August: 6 reports were fixed! (8 / 4 reports left).
* September: 12 new reports survived the month of September.
## 🎉 Thanks!
Thank you, to everyone else who helped by reporting, investigating, or
resolving problems in Wikimedia production. Thanks!
Until next time,
– Timo Tijhof
-------
Footnotes:
[1] Incidents. –
https://wikitech.wikimedia.org/wiki/Special:PrefixIndex?prefix=Incident+doc…
[2] Tasks created. –
https://phabricator.wikimedia.org/maniphest/query/XicVcsN1XkVH/#R
[3] Tasks closed. –
https://phabricator.wikimedia.org/maniphest/query/SXjsllmYHwAO/#R
[4] Open tasks. –
https://phabricator.wikimedia.org/maniphest/query/47MGY8BUDvRD/#R
This week Fresnel 0.5.0 was released and deployed to Jenkins.
Highlighted changes:
- Add support for Mann–Whitney U test. [1] –
https://phabricator.wikimedia.org/T223977,
https://en.wikipedia.org/wiki/Mann-Whitney_U_test
- Switch regression detection from diffStdev to diffMannWhitney (for
Paint Timing metrics).
- Update Chromium from 73.0 to 77.0.
- Enable Gzip for static files in web server behind Fresnel and Quibble.
– https://gerrit.wikimedia.org/r/539427
I've written a visual guide for how to open Fresnel's performance report in
your Chrome DevTools locally:
👉 https://wikitech.wikimedia.org/wiki/Performance/Fresnel#DevTools
-- Timo Tijhof
Change log and tracking task for Fresnel 0.5.0:
https://github.com/wikimedia/fresnel/blob/0.5.0/CHANGELOG.mdhttps://phabricator.wikimedia.org/T235195
---------- Forwarded message ---------
From: Timo Tijhof <krinklemail(a)gmail.com>
Subject: Fresnel for MediaWiki (performance testing)
Date: Thu, Mar 7, 2019 at 1:10 AM
You may have noticed something called "mediawiki-fresnel" leaving messages
on Gerrit patches for MediaWiki in the past few days, and wondering what
it's all about. Allow me to introduce Fresnel!
Fresnel is an automation tool for measuring and comparing client-side
performance from web pages. Fresnel was developed over the past two
quarters and is now ready for action. [1] [2] [3]
To learn more about how to use it, what it offers, and how it works, check
out:
https://wikitech.wikimedia.org/wiki/Performance/Fresnel
Some feature highlights:
- ⏱ *Metrics* from Navigation Timing, Paint Timing, and Resource Timing
APIs.
- 📊 DevTools *Timeline* from CI recording can be viewed locally in
Chrome.
- 🖼 Recordings take a *screenshot* available in build artefacts.
- 🔥 Scenarios perform a *warmup* and multiple runs for more stable
metrics.
--
Timo Tijhof
[1] Launch task: https://phabricator.wikimedia.org/T133646
[2] Phabricator project: https://phabricator.wikimedia.org/tag/fresnel/
[3] Task list:
https://phabricator.wikimedia.org/maniphest/query/9w6EAEPPLQ72/#R
Wikimedia-l,
Wikitech-l,
It appears that there is a growing consensus in the discussion area for the Wikiwisdom sister project proposal [1] that some of the ideas which comprise the proposal are also feature requests for the Wikiquote project. These ideas include: those of a structured Wikiquote (e.g. Wikidata integration, individual quotes as structured data items, auto-generated pages from Wikidata queries (e.g. pages listing quotes by author)) as well as social media integration so that users could readily share individual quotes with one another on social media.
I would like to ask how best to get the project proposal information [1] to the Wikiquote project team as well as how best to propose the feature requests to the Wikiquote project.
Thank you,
Adam Sobieski
[1] https://meta.wikimedia.org/wiki/Wikiwisdom
The 1.35.0-wmf.3 version of MediaWiki is no longer blocked[0], and was
deployed to group 0 earlier today at 19:27 UTC, using the American
deploy window.
Thanks to andrewbogott for supplying helpful context in unblocking the
train, as well as hashar, thcipriani, mutante, and paladox for dealing
speedily with Gerrit migration issues.
The train should proceed to group 1 as regularly scheduled, during the
European deploy window.[1]
-- Your unassuming train minion
[0]. <https://phabricator.wikimedia.org/T233851>
[1].
<https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20191023T1300>