https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-29

= *2018-08-29* =

== Callouts == * SRE:

Switchover/Switchback dates reminder. It's in 2 Weeks.

Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC MediaWiki: Wednesday, September 12th 2018: 14:00 UTC

Switchback:

Traffic: Wednesday, October 10th 2018 09:00 UTC MediaWiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC

IMPORTANT: For the duration of the switchover (1 month), please refrain from large db schema changes and please avoid deploying any kind of new feature that requires creation of tables. IMPORTANT: There will be a train freeze in the week of Sept 10th and Oct 8th. * Fundraising campaigns *https://meta.wikimedia.org/wiki/CentralNotice/Calendar* https://meta.wikimedia.org/wiki/CentralNotice/Calendar * From RI: help wanted with https://phabricator.wikimedia.org/T203029 from those who know about Dashiki

- [nuria] Dashiki just uses the files that are now not rendering from meta, it is really a seprate system that consumes those files

* wp10 models in ORES API are renamed to articlequality, if you're using this model, please change * Wikidata would appreciate input/decision on way forward with two patches in MW core, related to testing (thanks to Anotine and Timo for input so far) ** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/455176/ ** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/446543/

== Audiences ==

=== Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: **

==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** Continue work on Partial Blocking (Goal is to have a MVP ready by the end of the sprint) ** Analytics on Harassment cases on A/NI

==== Editing ==== * Blocked by: * Blocking: ** Updates: **Improving event logging for better data analysis **Mobile bug fixes to improve editing experience

==== Growth ==== * Blocked by: * Blocking: * Updates: **

==== Language ==== * Blocked by: None * Blocking: None * Updates: ** Work on ContentTranslation version 2 continues.

=== Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Finished polling Echo notifications (limited to certain types of notifications initially) ** Waiting on user testing of navigation prototypes.

==== Readers Web ==== * Blocked by: * Blocking: * Updates: **

==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** Bernd out rest of week, no PCS updates ** Maps: *** Working on setting up map tile invalidation on resource change (via ChangeProp) *** maps-test cluster to be decommissioned; production maps cluster to be updated to Stretch ** JsonConfig bug affecting Dashiki config pages on meta.wikimedia.org, should be fixed but isn't. Help wanted! https://phabricator.wikimedia.org/T203029 *** https://gerrit.wikimedia.org/r/c/mediawiki/extensions/JsonConfig/+/455868 fixed the issue on zero.wikimedia.org (https://phabricator.wikimedia.org/T203006 ), but not for Dashiki config pages

==== Parsing ==== * Blocked by: None * Blocking: None, coordinating with VE on several updates such as audio/video elements * Updates: Offsite upcoming on 9/10-9/15 Continuing porting TokenTansformers subsystem to PHP as part of overall php port

==== Multimedia ==== * Blocked by: * Blocking: * Updates ** SDoC: multi-lingual captions display and edit on File page ** SDoC: prototyping depicts search almost complete ** SDoC: design artwork

==== UI Standardization ==== * Blocked by: * Blocking: * Updates: **

== Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Updating privacy policy of wikistats2 and other sites like http://analytics.wikimedia.org to the new non-wiki policy per Legal’s request. ** Working with performance on making eventlogging a lot more limber so it can be included in every page: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventLogging/+/45345... ** Changed all random identifiers in mediawiki codebase to have more entropy, from 64 to 80 bits. This benefits eventlogging but also it is used widely on mediawiki client code.: https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/454460/ ** Integrating archiva (java libraries dependency management depot) with LDAP. **Moving all our analytics infrastructure to Debian Stretch. Along the way, we will be moving (superset|turnilo|yarn|hue).wikimedia.org to new VMs and upgrading them.

=== Cloud Services === * Blocked by: * Blocking: * Updates: **

=== Fundraising Tech === * Blocked by: * Blocking: * Updates: ** More testing and bug fixes on main CC processor's new API integration ** CiviCRM UI enhancements ** Donor data export/erase bug fixes ** Testing new pipeline to get banner and landing page impressions into fundraising DBs ** Testing stretch and PHP7 to unblock payments mediawiki LTS upgrade ** Getting started on hiring another fr-tech

=== MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** Platform Evolution: summarizing stakeholder input to cluster themes for Tech Conf ** Requirements gathering and discussion for storage component ** More work on deploying the phan security check (aka phan-taint-check) to more extensions ** Porting poolcounterd tests to Python (gerrit:455385) ** LinksUpdate failure on replag (phab:T201482) ** EU copyright landing page

=== Performance === * Blocked by: ** * Blocking: ** * Updates: ** mcrouter broadcast now live (deletes go to both data centers) ** Thought we had made the world much faster by removing a ResourceLoader round trip, but then realized that we'd accidentally gamed our numbers. Still evaluating the actual improvement. ** Gilles is back from vacation, and cranking through Thumbor bugs ** Testing "hero images" timings.

=== Release Engineering === * Blocked by: ** Noise from https://phabricator.wikimedia.org/T201082 during Train deployment (not really blocked but distracted) ** Block the CI migration to Quibble / off of Nodepool *** MediaWiki team: "[TrustedXFF] on fresh install trusted-xff.cdb is missing and User::getDefaultOptions() cause a fatal" https://phabricator.wikimedia.org/T198120 *** MediaWiki team: "[ReadingLists] No registered builder available for ReadingLists." https://phabricator.wikimedia.org/T196567 *** WMDE or a Qunit/JavaScript guru: ArticlePlaceholder should use MediaWiki qunit runner https://phabricator.wikimedia.org/T180171

* Blocking: ** * Updates: ** Two post mortems this week about recent train problems ** Train: no major problems, 1.32.0-wmf.19 at group 0 https://phabricator.wikimedia.org/T191065 https://tools.wmflabs.org/versions/ ** Log spam: Unknown modifier 'R': [/^page-User:BeneBot.+/RfD-open/text$/] in /srv/mediawiki/php-1.32.0-wmf.16/extensions/Translate/stringmangler/StringMatcher.php https://phabricator.wikimedia.org/T202058

=== Research === * Blocked by: None * Blocking: None * Updates: ** Sent out emails to collect more data (2nd stage of the experiment) for the Elicit new editor interests research: https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work_... ** Will enable collecting data for the CitationUsage schema this Thursday: https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454854/ ** Working towards productionizing the recommendation API. Talking about storage with Services/Analytics: https://phabricator.wikimedia.org/T203039

=== Scoring Platform === * Blocked by: RelEng on these two: https://phabricator.wikimedia.org/T192042 and https://gerrit.wikimedia.org/r/c/All-Projects/+/455629 * Blocking: None * Updates: ** The work for using PoolCounter in ores continues, support for multiple nodes is almost there ** Renaming wp10 models to articlequality, if you're using this model, please change ** Reducing size of ores setup in labs, to reduce the cloud service team maintenance workload ** working on JADE table schemes

=== Search Platform === * Blocked by: * Blocking: * Updates:

- Enabled indexing of all wikidata statements referencing items: https://phabricator.wikimedia.org/T199884 newly edits have it enabled, old items pending reindex

- Added collecting stats for data processing daemons: https://phabricator.wikimedia.org/T201948

- Fixed errors with large offsets on search: https://phabricator.wikimedia.org/T201360

- Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654

- Working on searching for statement values without additional keywords: https://phabricator.wikimedia.org/T163642

- Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960

- Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108

=== Security === * Blocked by: * Blocking: * Updates: ** Starting work into using Content-Security-Policy header ** Security review of *chromimum-render * *https://phabricator.wikimedia.org/T177765* https://phabricator.wikimedia.org/T177765 and EU copyright once ready

=== Services === * Blocked by: * Blocking: * Updates: **

=== Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Switchover/Switchback dates reminder

Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC MediaWiki: Wednesday, September 12th 2018: 14:00 UTC

Switchback:

Traffic: Wednesday, October 10th 2018 09:00 UTC MediaWiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC

IMPORTANT: For the duration of the switchover (1 month), please refrain from large db schema changes and please avoid deploying any kind of new feature that requires creation of tables. IMPORTANT: There will be a train freeze in the week of Sept 10th and Oct 8th.

== Wikidata == * Blocked by: ** Blocked is a big word, but we'd appreciate input/decision on way forward with two patches in MW core, related to testing (thanks to Anotine and Timo for input so far) *** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/455176/ *** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/446543/ * Blocking: * Updates: ** Work in Lexicographical data continues: *** adding senses *** improving the editor workflow *** https://phabricator.wikimedia.org/project/view/2292/ ** Experiment about not using secondary SQL table for formatting item links being gradually deployed *** https://phabricator.wikimedia.org/T201831

== German Technical Wishlist == * Blocked by: * Blocking: * Updates: **

== Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** almost complete phase 2 tasks (today?), planning to finish phase 3 tasks by end of week ** deployment impacted by CI test failures - remediation in progress

== SoS Meeting Bookkeeping == * Updates: **