[Wikitech-l] 2018-02-21 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-02-21 = 2018-02-21 = == Callouts == * Fundraising campaign in Sweden 2018-02-06 - 2018-03-06 and Italy 2018-02-01- 2018-02-27: *https://meta.wikimedia.org/wiki/CentralNotice/Calendar* <https://meta.wikimedia.org/wiki/CentralNotice/Calendar> * GlobalPreferences live on beta labs, please test * Heads up about https://phabricator.wikimedia.org/T157418 (RFC: Make some aspects of Tidy's whitespace stripping behavior part of wikitext parsing "spec") -- please comment there if you have an opinion about the open questions in the description and / or the proposal itself. * Reminder about https://phabricator.wikimedia.org/T51097 (RFC to use figure tags for media in PHP parser) -- patches for these changes are in gerrit right now. == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** Continuing work on 5.8.0 - Synced Reading Lists ( https://phabricator.wikimedia.org/tag/ios-app-v5.8.0-manatee-on-a-skateboar… ) ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Began user testing of synced reading lists, ready to start rolling out to Beta audience for scalability testing. ==== Readers Web ==== * Blocked by: ** The Chromium PDF renderer replacement work is blocked on choosing a deploy server; the Services team has been working very hard to keep progress going but more help is needed ( https://phabricator.wikimedia.org/T187821 ). * Blocking: * Updates: ** Annual planning for technical work on MobileFrontend and MinervaNeue; we'll be publishing notes to MediaWiki.org in about a week. ** Some coordination with Services for the deployment of the new Mobile Content Services Summary v1.3 endpoint. ** Mobile pages are now supported by the Chromium PDF renderer. ** Continued improvements to page previews, MobileFrontend, and MinervaNeue. ** Check out our new quarterly goals column in our sprint board: https://phabricator.wikimedia.org/tag/readers-web-kanbanana-board/ *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** Reading Web/Performance ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** On Tuesday we started the slow rollout of the new /page/summary endpoint version 1.3.0, which is implemented in the Content Service based on Parsoid HTML instead of using TextExtracts. (slow rollout = only recent changes for now, going to speed up transition in the upcoming days or week). It aims to improve the quality of summary extracts (not cutting off text before the end of the first paragraph anymore; stripping of contents in parentheses, ...). It also provides more properties in the output. (Example: https://en.wikipedia.org/api/rest_v1/page/summary/IOS) ===== Maps ===== * Blocked by: None * Blocking: None * Updates: Collab team getting up to speed ==== Multimedia ==== * Blocked by: N/A * Blocking: N/A * Updates ** 3D pushed, announcement coming soon, thanks to all who helped ** MediaInfo work is progressing, thanks to WMDE for helping us work through things, no new dependency stuff ** Search: Cormac is plugging away as usual with exploration of the current state of things and what we need to change, no dependency changes or flags * Quarterly goal dependency update ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** GlobalPreferences live on beta labs, please test ==== Anti-Harassment Tools ==== * Blocked by: Analytics on https://phabricator.wikimedia.org/T187374 * Blocking * Updates ** Completing v1 of Interaction Timeline https://tools.wmflabs.org/interaction-timeline/ ** Next: Blocking Tools ==== Editing ==== * Blocked by: * Blocking: * Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Heads up about https://phabricator.wikimedia.org/T157418 (RFC: Make some aspects of Tidy's whitespace stripping behavior part of wikitext parsing "spec") -- please comment there if you have an opinion about the open questions in the description and / or the proposal itself. ** Reminder about https://phabricator.wikimedia.org/T51097 (RFC to use figure tags for media in PHP parser) *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ==== Language ==== * Blocked by: * Blocking: * Updates: * Dry run for Compact Language Links preference migration script ran successfully. Actual run and deployment for out of Beta scheduled next week. Thanks Jaime for help in: T187880 * CX2 work continue. Santhosh fixed alignment issues in CX2. ===UI Standardization=== * Blocked by: * Blocking: * Updates: * Quarterly goal dependency update: ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Starting to move from analytics-kafka to new jumbo-kafka. Small topic first this week (webrequest-misc), then more next coming weeks * Quarterly goal dependency update: **Improve, adjust, or create features geared at the needs identified in New Editors research project. *** New Editors Experience:Analytics === Cloud Services === * Blocked by: * Blocking: * Updates: === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** CentralNotice: code review on contributed patches ** Upgraded CiviCRM, fixing a few emergent bugs ** PCI paperwork ** upstreaming more Civi extension stuff ** CentralNotice: EventLogging patch ready to merge, could use another glance from Performance === MediaWiki Platform === * Blocked by: * Blocking: * Updates: * code review in progress: Actor table, MCR, External Store de-PHP-serialization * Comment table: ** Follow up schema change is in progress now. ** Enabled WRITE_BOTH on group 0; group 1 soon. ** There's been some movement on the front-end updates. * Uploaded patches to update utfnormal and Scribunto's ustring to support SRE's upgrading of the ICU library. * Working on phan and phan-taint-check-plugin in CI testing *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services * Reduce product and technical debt to modernise our tools and technologies, and to make future changes more effective and efficient *** Parsing/Mediawiki PF **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata === Performance === * Blocked by: N/A * Blocking: N/A * Updates: ** 100% of thumbnail requests are now being handled by Thumbor, including private Wikis ** Seeing an issue with concurrent requests in Thumbor in some circumstances, working on addressing that. Leads to occasional slow thumbnail generation. ** Looking to set up a study on performance perception, in collaboration with an outside researcher. Got solid advice from Jonathan Morgan and Aaron Halfaker on that (thanks!) ** Pushing tons of bug reports upstream for WebPageTest and WebPageReplay. Getting closer to stable metrics on Linux. ** Proved xhprof experimental branch works on PHP7(!) ** Few more NavTiming updates went out *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** Reading Web/Performance === Release Engineering === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: * Continue improving the ways that users can download articles of interest for later consumption ** Reading Web: Tech Ops/RelEng === Research === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia === Scoring Platform === * Blocked by: * Blocking: * Updates: ** ORES has been moved to a dedicated cluster (thanks, Alex!). Just one more step to remove our services from the scb* boxes, probably happening tomorrow. ** Took an audit of wikis where ORES support is ready but not deployed: https://phabricator.wikimedia.org/T187836. This is a coordination issue. ** We now have browser CI to check that Ext:ORES hasn't broken Special:RecentChanges === Search Platform === * Blocked by: * Blocking: * Updates: ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** Working on Serbian analyzer for ES: https://phabricator.wikimedia.org/T183015 ** Looking into improving relevancy of cross-wiki results: https://phabricator.wikimedia.org/T185250 ** Working on Kafka poller for WDQS: https://phabricator.wikimedia.org/T185951 *Quarterly goal dependency update: ** Prepare backend infrastructure for structured data search ** SDC: Search PF/Multimedia/Wikidata === Security === * Blocked by: * Blocking: * Updates: === Services === * Blocked by: none * Blocking: none * Updates: * Summary endpoint switchover to MCS is happening, dumps are running * Working with reading on getting the PDF service deployed * Troubleshooting kafka consumer rebalancing mystery === Site Reliability Engineering === * Blocked by: ** Flow for dumps per usual: https://phabricator.wikimedia.org/T172025 * Blocking: ** None * Updates: ** cache_upload fully migrated to varnish 5 ** Cleanup of scb* hosts from ORES is bound to happen this week == Wikidata == * Blocked by: * Blocking: * Updates: ** Continued work on caching constraint check results: https://phabricator.wikimedia.org/T179839 ** Ongoing investigation on caching derived labels for Lexemes: https://phabricator.wikimedia.org/T187775 ** Released our 300th weekly update: https://www.wikidata.org/wiki/Wikidata:Status_updates/2018_02_19 *Quarterly goal dependency update: **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** Still finetuning Wikidiff2 ** Returning to work on FileImporter