2018-05-30 Scrum of Scrums meeting notes - Wikitech-l

31 May 2018


      https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-05-30
=2018-05-30=
== Callouts ==
* From last week, all WIndows NT operating systems are under the "Windows"
os family in analytics metrics
* Security: Security review for Wikidata queries data release proposal
https://phabricator.wikimedia.org/T190875
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
** Continuing work on tech debt release, 5.8.2 (
https://phabricator.wikimedia.org/project/view/3358/ )
** Starting work on next major release, 5.9 (
https://phabricator.wikimedia.org/project/view/3238/ )
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
    * Released maintenance update to production (improvements to reading
list syncing / fix no-such-project errors)
    * Finalizing multilingual features based on user testing at Hackathon
-- on track for release in ~1 week.
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
==== Readers Infrastructure ====
* No updates this week.
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
***Reading Infra depends on Parsing, Services
===== Maps =====
* Blocked by:
* Blocking:
* Updates:
==== Multimedia ====
* Blocked by:
* Blocking:
* Updates:
** Looking into OOUI migration for Wikibase per discussions at the
hackathon/elsewhere
** UploadWizard work for multilingual captions pretty much complete
** Indexing wikibase statements (searchable via haswbstatement:XXXX), work
continues on quantities
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare
for launch of the first Structured Data on Commons feature (multilingual
file captions)
***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**  [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- T171252
***Research depends on Multimedia
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
** Working on PageTriage improvements
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
** Working on Blocking Tools
==== Editing ====
* Blocked by:
* Blocking:
* Updates:
    ** None
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
** Tidy -> RemexHtml: final switch planned for June 27th / July 11th
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]]  Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing depends on MediaWiki Platform, Services
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
Increase code sharing of client apps by coalescing and moving more logic to
the server.
*** Reading Infra depends on Parsing, Services
**
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
==== Collaboration ====
* Blocked by:
* Blocking:
* Updates:
** Patches to solve most of Echo's multi-DC incompatibilities now awaiting
review https://phabricator.wikimedia.org/T164860
** Deleted Echo's rspec tests to unbreak CI
==== Language ====
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.1]] Improve and consolidate our unified editing platform so that it's
great on all devices
***Language depends on Editing
=== Audiences Design ===
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
** OOUI – v0.27.1 released yesterday:
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0...
*** 1 deprecation in this release. Additionally 9 style amendments, 9 code
& 2 accessibility improvement. Among those
**** Toolbar: Add a required 'name' property to toolgroup configs;
deprecating change (Ed Sanders)
**** Clarify and align TabSelectWidget focus (Volker E.)
https://phabricator.wikimedia.org/T194863
**** Allow dropdown menus to be larger than their handles (Ed Sanders)
https://phabricator.wikimedia.org/T195257
** Continuing work on Design Style Guide, this week starting 'Resources'
page with all repo resources
** Continuing work on a minor UI/UX issues in AdvancedSearch with WMDE team
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** Updated user agent string parsing regexes in eventlogging and refinery
** Migrated zookeeper to new hardware
** Migrating druid to debian stretch, should be finished this week
** Revision score now available in eventstreams
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** Working on getting Ingenico Connect API campaign ready.
** Still working on backend pipeline for CentralNotice EventLogging stats
** Working on a Donor Deletion tool for Civi in response to GDPR
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
* MCR:
** ar_rev_id deduplication is merged and maintenance script has been run
** API "templated parameters" patch was merged
* TemplateStyles:
** Implemented a feature request.
** An enwiki RFC about enabling it as soon as Remex is enabled there is
passing.
* MediaWiki core master now requires PHP 7.0 or HHVM
* MediaWiki-CodeSniffer 19.0.0 and 20.0.0 released, to allow for safe PHP 7
features to be used
* Bug triage and fixes for MassMessage and GlobalUserPage
* Finished development of "CoverMe": https://tools.wmflabs.org/coverme/ (
https://blog.legoktm.com/2018/05/29/introducing-coverme-find-the-most-called...)
* Deployed postgres in CI, filed T195807 for failures
* Work towards PSR-4 in MediaWiki core, including enabling PSR-4 autoloader
for more directories, and implementing a structure test to validate PSR-4
compliance
* Hackathon projects:
** MySQL client wrapper to replace "sql" shell script:
https://gerrit.wikimedia.org/r/#/c/434188/
** Refactor API parameter validation:
https://gerrit.wikimedia.org/r/q/topic:%2522bug%252FT142080-api-param-valida...)
** Script to import Phabricator task information into a wiki:
https://gerrit.wikimedia.org/r/#/c/433919/
* The usual code review and bug work
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
*** Planning underway for next FY Platform Evolution program
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
*** MCR capabilities in active development
** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer,
[[phab:T174043|T174043]]Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
*** MCR capabilities in active development
=== Performance ===
* Blocked by:
* Blocking: Readers Web (review of CitationUsage) - will be done this week
* Updates:
** performance perception survey live on several wikis
** Trialing mobile performance testing on SauceLabs device lab
** More fixes to ChronologyProtector
** Still pulling jQuery deps out of base javascript modules
** Bunch of resourceloader bug fixes
** mcrouter expected to be ready in prod this week, will test on testwiki
next week
=== Release Engineering ===
* Blocking
**
* Blocked
**
* Updates
** Train status: https://phabricator.wikimedia.org/T191051
** 1.32.0-wmf.5 got held up last week by an incident that happened during
the scheduled Thursday train deployment window.
***
https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
*** We should be back on track this week, wmf.5 is clear of blockers and
wmf.6 should be rolling out as usual
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
=== Research ===
* Blocked by: Performance: https://gerrit.wikimedia.org/r/#/c/432534/
* Blocking: None
* Updates:
** Deploying the gapfinder-tools app and gathering section mappings.
** Have been gathering synonym mappings.
** Analyzed the first incoming labels from WikiLabels citations campaign
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- [[phab:T171252|T171252]]
***Research depends on Multimedia
=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Search Platform ===
* Blocked by: Security:  https://phabricator.wikimedia.org/T190875
* Blocking:
* Updates:
** Wikidata reindexed and now external ID and string properties can be
searched for with haswbstatement keyword
** Deep category search enabled on all wikis except private ones:
https://phabricator.wikimedia.org/T194260
** all: keyword enabled on all wikis:
https://phabricator.wikimedia.org/T165110
** Exploring ideas for applying NLP to search:
https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Potential_Application...
** Looking into fixing regex highlighting that does not time out as
expected: https://phabricator.wikimedia.org/T195491
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
** Working on Polish analyzer: https://phabricator.wikimedia.org/T186046
** Working on fulltext search for Lexemes
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
=== Security ===
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]]: Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
=== Services ===
* Blocked by:
** Parsing on language variants transformation support
** Echo on non JSON-serializable job
https://phabricator.wikimedia.org/T192945
** Who knows who's resonsible for GWToolset extension? It has
non-json-serializable job https://phabricator.wikimedia.org/T192946
* Blocking: none?
* Updates:
** Kafka queue enabled for all jobs everywhere except some exceptions and
cirrus search
** revision-score event exposed via event streams
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server.]]
***Reading Infra/Parsing, Services
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
=== Site Reliability Engineering ===
* Blocked by:
** Collaboration for flow, T172025
* Blocking:
** None
* Updates:
** Had a wikidata outage
https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
** row C move+upgrade went quite well
** mcrouter to be deployed this week
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling
*** Services depends on SRE, Parsing
== Wikidata ==
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer,
[[phab:T174043|T174043]]Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
== SoS Meeting Bookkeeping ==
* Updates: