[Wikitech-l] 2018-03-14 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-03-14 = 2018-03-14 = = date = == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01 * [Performance] Editing: Someone familiar with VisualEditor should probably take a look at https://phabricator.wikimedia.org/T189229-- perf issue, but not something that we can easily address * [Language] SRE: DBA to look/review: https://phabricator.wikimedia.org/T187986 * [SRE] Started talking about next Quarter's goals, please DO LET us know if you have dependencies on us, don't just mark them on the wiki. * Tidy has been replaced on another 100 wikis this week. About 300 more to go before the end June deadline. * https://gerrit.wikimedia.org/r/#/c/415770/ is almost ready to go that implements RFC to trim whitespace in headings, lists, and table cells. Very likely to go out next week unless there are objections raised in the last call period (ending today, I think). * Parsing team has been working on the heredocs syntax RFC ( https://phabricator.wikimedia.org/T114432 ) and has a WIP patch @ https://gerrit.wikimedia.org/r/#/c/418198/ if someone wants to test and play with it on your local dev wikis. * Wikistats 2 has now a canary site - https://wikistats-canary.wmflabs.org/ * 1.31.0-wmf.25 going out this week, if you see blockers: https://phabricator.wikimedia.org/T183964 * Scoring platform team is restarting work on the promotional editing model, want to collaborate? == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Continuing rollout of Reading List syncing to Beta audience. Wrapping up next maintenance/bugfix release. ==== Readers Web ==== * Blocked by: Language engineering/core platform(?) - https://gerrit.wikimedia.org/r/#/c/415187/ We'd like to make RTL info of languages available cheaply either via JavaScript/PHP array or API. Guidance needed * Blocking: * Updates: Refreshing some old bugs relating to the Nearby overlay *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** On final stretch. Aiming to launch previews within next 3 weeks. Now we have the new summary endpoint from RI we are addressing some legacy code on client. *** Reading Web/Performance ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** Filter for /page/summary endpoint is enabled, which means all reads should get the latest version. If you find any issues with the summary content please file a task. ** Wikidata overrides will be enabled on beta enwiki today (Wed), testwiki early next week ===== Maps ===== * Blocked by: * Blocking: * Updates: ** ==== Multimedia ==== * Updates ** 3D work closing soon ** Work on file page prototype for structured data is progressing (slowly), may be bothering WMDE soon about some questions ** Search work seems like it's going smoothly, thanks Search for being available and helpful ** UploadWizard prototype changes for multi-lingual captions Quarterly goal dependency update ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata === Contributors === ==== Community Tech ==== * Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal * Blocking: * Updates: ** Working on thanking for log entries and squashing some CodeMirror bugs before promoting it from beta feature. ==== Anti-Harassment Tools ==== * Blocked by: None * Blocking: None * Updates: ** Compmleted Interaction Timeline v1 ** Started work on blocking tools ** Research for reporting system ==== Editing ==== * Blocked by: * Blocking: ** Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** We've fallen behind responding to all the Linter feature requests -- since we don't have sufficient time to handle all of it, but we'll try to address some in the coming couple weeks. ** Tidy has been replaced on another 100 wikis this week. About 300 more to go before the end June deadline. ** https://gerrit.wikimedia.org/r/#/c/415770/ is almost ready to go that implements RFC to trim whitespace in headings, lists, and table cells. Very likely to go out next week unless there are objections raised in the last call period (ending today, I think). ** Arlo has been working on the heredocs syntax RFC ( https://phabricator.wikimedia.org/T114432 ) and has a WIP patch @ https://gerrit.wikimedia.org/r/#/c/418198/ if someone wants to test and play with it on your local dev wikis. ** Scott has been adding language variant conversion support to Parsoid -- a WIP patch in place for Serbian. ** Arlo would appreciate Android app folks taking a look at https://gerrit.wikimedia.org/r/#/c/411493/ -- this is not directly related to Parsing work. *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services *** No new updates or blockers. ==== Collaboration ==== * Blocked by: nobody * Blocking: nobody * Updates: ** Working on a test setup for the maps services (Kartotherian and Tilerator) in beta labs, to replace the maps-test servers ==== Language ==== * Blocked by: See callouts. * Blocking: * Updates: ** CX2 (ie ContentTranslation version 2 with VE) work continue. === Audiences Design === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops ==== UI Standardization ==== * Blocked by: Security review for Style Guide https://phabricator.wikimedia.org/T188698 * Blocking: * Updates: ** OOUI – no release this week, in prep for v0.26.0 breaking change release with (currently planned) *** WikimediaUI theme's new icon set https://gerrit.wikimedia.org/r/#/c/400091/ *** Aligning VE and Special:Pages interface base font-size to each other https://phabricator.wikimedia.org/T97631 *** Switch to grunt-svgmin for SVG opt accomplished ** Style Guide *** Continued work to accomplish v1 goals https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/ == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Eventlogging Analytics migrates to Kafka Jumbo - https://phabricator.wikimedia.org/T183297 ** Eventlogging is now on eventlog1002 and running Debian/systemd ** Deployed sanitization efforts on EventLogging Hive https://phabricator.wikimedia.org/T181064 ** Wikistats 2 has now a canary site - https://wikistats-canary.wmflabs.org/ ** Rolling out responsive site soon * Quarterly goal dependency update: **Improve, adjust, or create features geared at the needs identified in New Editors research project. *** New Editors Experience:Analytics === Cloud Services === * Blocked by: * Blocking: * Updates: ** Wikitech moved to new labweb hardware https://phabricator.wikimedia.org/T168470 ** Updates to Horizon and Toolsadmin coming up on Wednesday, Mar 15 *** Horizon UI will look different - test it out at https://newhorizon.wikimedia.org/ ** Dumps dataset server migration being planned for first week of April *** See https://phabricator.wikimedia.org/T168486#4033572 for timeline === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** CentralNotice: deployed and announced security patches, now deploying EventLogging for impressions. Reviewing a couple of contributed patches. ** CiviCRM: working on anti-fraud tools and custom imports ** More work for main card processor's new API ** Working to also use EventLogging for fundraiser landing page hits === MediaWiki Platform === * Blocked by: * Blocking: * Updates: ** Edit summary display-side truncation https://gerrit.wikimedia.org/r/#/c/417593/ ** Sifting through resumes ** Coordinating with Federal MediaWiki user group and User:Econterms on VPAT *** User:Econterms has started https://www.mediawiki.org/wiki/VPAT_for_MediaWiki ** Published aggregate pingback data at https://pingback.wmflabs.org ** Started working on patches to extensions to use Actor table ** RemexHtml parser tests merged https://gerrit.wikimedia.org/r/#/c/409432/ ** PHP 7.0 MediaWiki unit tests now voting https://gerrit.wikimedia.org/r/#/c/417343/ *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services **** No new updates or blockers *** Parsing/Mediawiki PF **** No new updates or blockers *** SDC: Mediawiki PF/Wikidata **** No new updates or blockers === Performance === * Blocked by: ** n/a * Blocking: ** n/a * Updates: ** Issues with the kafka library that we used for upgrading coal (one of our utilities), need to re-do ** We will start working on safemode for Visual Editor this week ** Attempting to remove a few query-master-on-GET issues ** Updated our MediaWiki profiling to start earlier, will catch more performance issues on startup ** Beginning to work on packaging Dynomite ** Oversampling of performance data in Singapore is live === Release Engineering === * Blocking ** Scoring platform release of scap 3.8 (I think mukunda tagged that, but I'll double check) * Blocked ** SRE: Minikube packaging stuff https://phabricator.wikimedia.org/T184457 * Updates ** 1.31.0-wmf.25 going out this week, if you see blockers: https://phabricator.wikimedia.org/T183964 ** greg is out this week, FYI *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: * === Research === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Update: * === Scoring Platform === * Blocked by: RelEng on release of scap 3.8 and git-lfs * Blocking: * Updates: **Extension:JADE is live on the beta cluster :D ** wp10 model support in ORES ext. is almost finished. Expected to have it enabled in enwiki next week **Restarting work on the promotional editing model, want to collaborate? ***Just about to publish a dataset of paid editors === Search Platform === * Blocked by: * Blocking: * Updates: ** Testing “query explorer” feature of LTR plugin: https://phabricator.wikimedia.org/T187148 ** TermLookup implementation for ElasticSearch ready for review: https://phabricator.wikimedia.org/T143706 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** Serbian analyzer merged, will be enabled after Elastic plugin is deployed: https://phabricator.wikimedia.org/T183015 ** Next is Slovak analysis: https://phabricator.wikimedia.org/T178929 ** Discussing Lexeme search: https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Lexeme_search ** Stability issues with wdqs1004 solved (thanks RobH and all who helped!), WDQS cluster back at full capacity ** Kafka poller has been having problems, had to turn off for now. Will be back when jumbo mirroring is stable - https://phabricator.wikimedia.org/T189458 *Quarterly goal dependency update: ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata **** Working with Cormac on MediaInfo/File indexing patch ****Started design discussions on Lexeme search - https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Lexeme_search ** Update: * === Security === * Blocked by: * Blocking: * Updates: ** === Services === * Blocked by: none * Blocking: none * Updates: ** Summary migration completely complete ** Working on issues with MySQL connection spiking from refreshLinks jobs an d kafka rebalancing issues === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: * Started talking about next Quarter's goals, please DO LET us know if you have dependencies on us, don't just mark them on the wiki. ** *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: No updates * ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops ** Update: No updates on our side, ball is not in our field. == Wikidata == * Blocked by: nothing * Blocking: not aware of any blocks * Updates: re-org happened, we are now 2 teams, so didn't achieve much as far as production in the last week, Team 1 will focus on delivering Lexeme and team 2 are working on Scalaibity issues and data quality at this point ** *Quarterly goal dependency update: **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** Update: * ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * == German Technical Wishlist == * Blocked by: ** Review on https://gerrit.wikimedia.org/r/#/c/404293/ * Blocking: ** no * Updates: ** continue working on FileImporter ** Finished work on Wikidiff2 (Reviewww!!) ** Continue working on AdvancedSearch == SoS Meeting Bookkeeping == * Updates: **