[Wikitech-l] 2018-04-25 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-04-25 ==2018-04-25 == == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01 * RelEng could use some help to get rebuildLocalisationCache.php back up-to-normal speed -- if you have experience with hhvm internals/cli-options: https://phabricator.wikimedia.org/T191921 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: **Released 5.8 with Reading Lists, now working on a point release ( https://phabricator.wikimedia.org/tag/ios-app-v5.8.1-manatee-on-a-scootscoo…) **Joe to return next week (4/30) ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Released Reading list syncing! ==== Readers Web ==== * Blocked by: * Blocking: * Updates: **Page previews enwiki launch **Post-launch page preview bug fixes and clean up https://phabricator.wikimedia.org/T192622 **Starting page issues work https://phabricator.wikimedia.org/T159262 **Planning for MobileFrontend & MinervaNeue frontend architecture improvements https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro… **Fixing mobile watchlist bugs https://phabricator.wikimedia.org/T191454 *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079 *** Reading Web depends on SRE, RelEng, Reading Infra ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** CSS endpoints rolled out ( https://en.wikipedia.org/api/rest_v1/#!/Mobile/get_data_css_mobile_site) ** Added Bosnian Wikipedia to supported wikis for featured article, In-the-news, and On-This-Day ** Working on simplistic browser extension to add the current page to the default reading list (for logged in users) *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079 *** Reading Web depends on SRE, RelEng, Reading Infra **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] ***Reading Infra depends on Parsing, Services ===== Maps ===== * Blocked by: None * Blocking: None * Updates: ** Work being done by collab team ** Paul is out next scrum of scrums *==== Multimedia ====* * Updates **Wikibase patches for file page prototype going through ** Search work continuing for 'depicts' ** File captions - currently working through changing the name of the field for MediaInfo *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) ***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- T171252 ***Research depends on Multimedia === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** Just like last week: GlobalPreferences, CodeMirror, TemplateWizard ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: None * Updates: None ** Updating Block Notices on Mobile https://phabricator.wikimedia.org/T165535 ** Adding Cookie Blocking to IP Users https://phabricator.wikimedia.org/T152462 ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** We are considering removing newline stripping in image captions. See https://gerrit.wikimedia.org/r/#/c/425726/ ** In https://phabricator.wikimedia.org/T192037 we are beginning to make wikitext handling a bit more uniform across extensions and outside extensions, so there are fewer surprises / edge cases. That is yet to be flushed out, but is an advance heads up. ** Tidy removal is going apace -- another 40+ wikis will switch next week. *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing depends on MediaWiki Platform, Services **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] Increase code sharing of client apps by coalescing and moving more logic to the server. *** Reading Infra depends on Parsing, Services [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling phab task ? *** Services depends on SRE, Parsing ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ** Localized maps deployed on testwiki and test2wiki, announcement coming soon *** Test page: https://test2.wikipedia.org/wiki/Map_internationalization_examples ** Going to deploy <mapframe> to English Wikipedia on April 30th https://phabricator.wikimedia.org/T191584 ==== Language ==== * Blocked by: None * Blocking: None * Updates: ** *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.1]] Improve and consolidate our unified editing platform so that it's great on all devices ***Language depends on Editing === Audiences Design === ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** OOUI – v0.26.5 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v… *** 5 style changes, 5 code improvements. Among those **** De-emphasize toolgroup borders in order to visually de-clutter VE toolbar **** PopupTool: Set active state depending on whether popup is open, again a change with visual impact, providing better user-friendliness **** Toolbar: Put all popups (from PopupToolGroup and PopupTool) into an overlay. https://phabricator.wikimedia.org/T192505 ** DateTimeInputWidget has been aligned to other WikimediaUI widgets https://phabricator.wikimedia.org/T189352 ** Style Guide technical and content improvements ongoing with 6 open PRs currently ** Transparency Report now fully conformant to WCAG 2.0 level AA == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Wikistats outage: bad data load led to a couple of days of unstable data, found the problems and rolled back, will update again soon, numbers are good now but missing 2018-03 ** Wikistats is a little more mobile touch friendly, hover interaction a little better in general ** Wikistats titles and meta tags are now more SEO-friendly ** Spark 2 is now the default spark experience on the cluster ** lots of prep work for the Kafka cluster upgrade, already started updating some of the machines, monitoring, etc. ** page preview aggregate data is available now in a Hive table ** fixed wmf.mediawiki_user_history and wmf.mediawiki_page_history tables (they had bad column names which led to null values) ** fixed pagecounts-ez and mediacounts datasets outage problem === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: **DonationInterface: new recurring contribution API for main card processor **CiviCRM: Debugging nasty transaction handling failures ** Working on getting landing page and banner impression EventLogging data into payments cluster DBs === MediaWiki Platform === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) phab task ? ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]] Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE === Performance === * Blocked by: **None * Blocking: **None * Updates: **Good progress consolidating our tools, getting them out of puppet ** Rolling out a tool called PerformanceInspector over the next couple of weeks -- will allow community members to get a bunch of performance data about pages on the wikis ** Doing some optimizations of ResourceLoader ** Making some fixes to MW Core to prep for PHP7 ** Refactoring Varnish logging stuff to use mtail instead of a couple of deprecated varnish tools ** mcrouter is now being used in deployment-prep ** WebPageTest fully migrated over to Linux hosts === Release Engineering === * Blocked by: ** rebuildLocalisationCache.php/localization update rebuilds are taking 40 minutes for full scaps (used to take 8minutes) *** See: https://phabricator.wikimedia.org/T191921 if you have hhvm internals help to give :) * Blocking: ** none? * Updates: ** 1.32.0-wmf.1 is going out this week, wmf.30 was finally completed Monday ** Scap MediaWiki canary changes using service-check (hopefully live Soon™, working in beta) *Quarterly goal dependency update: ** No updates from us (if something specific needed from us, ping us!) [[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079 *** Reading Web depends on SRE, RelEng, Reading Infra === Research === * Blocked by: None * Blocking: None * Updates: *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) phab task ? ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- [[phab:T171252|T171252]] ***Research depends on Multimedia ** Most of the teams is at the Web Conference https://www2018.thewebconf.org/ === Scoring Platform === * Blocked by: * Blocking: * Updates: === Search Platform === * Blocked by: * Blocking: * Updates: ** New analysis plugin deployed: https://phabricator.wikimedia.org/T189239 enabling Serbian and in the future other stemmers ** Solvak stemmer added, deploy & reindexing next: https://phabricator.wikimedia.org/T190815 ** Some fixes for deep category search: https://phabricator.wikimedia.org/T192270, https://phabricator.wikimedia.org/T188350 ** Wikibase Lexeme search patches merged ** Internal WDQS cluster installed, switching traffic to it soon: https://phabricator.wikimedia.org/T192942 ** Working on indexing external IDs and string properties for Wikibase: https://phabricator.wikimedia.org/T99899 ** Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** WDQS GUI automatic build moving along, thanks RelEng: https://phabricator.wikimedia.org/T189811 *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) phab task ? ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia === Security === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]]: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services === Services === * Blocked by: Several job serialization tasks, will talk to owners of the said jobs * Blocking: none * Updates: ** Enabled support for EventBus and kafka job queue for private wikis ** Replaced SSDs on restbase1010, rebootstrapped cassandra there ** CSS endpoint for reading infra deployed *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server.]] ***Reading Infra/Parsing, Services **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling phab task ? *** Services depends on SRE, Parsing === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Have a look at https://blog.wikimedia.org/2018/04/24/new-data-center-singapore/ ** Work on getting proton up (QR goal for Reading Web) and running started https://phabricator.wikimedia.org/T192983 *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079 *** Reading Web depends on SRE, RelEng, Reading Infra **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling phab task ? *** Services depends on SRE, Parsing == Wikidata == * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) phab task ? ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** ICU 57 migration done ** Appservers are being reimaged to Debian Stretch ** == SoS Meeting Bookkeeping == * Updates: **Request from SRE: Please either add phab tasks to all goals so that work can be tracked and updates can be made in a meaningful way even across large and diverse teams, or let's just drop the quarterly goal dependency updates.