[Wikitech-l] 2018-11-07 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-11-07 *=2018-11-07=* == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar * UI Standardization: RelEng, we're in need PHP 7 capable server for public OOUI demos https://phabricator.wikimedia.org/T206046 * Release Engineering: Wikimedia Release Engineering's 1st Annual Developer Satisfaction Survey https://phabricator.wikimedia.org/phame/post/view/126/wikimedia_release_eng… * Readers Web: 14 year old bug T208909 (Thanks Tilman Bayer and Tim Starling) * Readers Web: Alex Hollender's very cool mobile navigation prototype https://en.wikipedia.org/wiki/User:AHollender_(WMF)/sandbox#Advanced_mobile… * Readers Web: SEO A/B test launch for page schemas T208755 * Readers Web: page issues A/B test complete T200792 * Follow progress for edit data lake PUBLIC dataset release on labs, will be available via PRESTO and usable for tools such as quarry: https://phabricator.wikimedia.org/T208752 == Audiences == === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** ==== Growth ==== * Blocked by: Secruity on https://phabricator.wikimedia.org/T207990 and Services (?) https://phabricator.wikimedia.org/T207329 * Blocking: * Updates: **EditorJourney schema is going live on Thursday or Monday ==== Language ==== * Blocked by: * Blocking: * Updates: ** === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: **In bug-fixing mode for 6.1.1 ( https://phabricator.wikimedia.org/tag/ios-app-v6.1.1-narwhal-on-a-magic-pum…), release probably next week. 6.1.1 has fixes for login, event logging and a bunch of UI tweaks. **Next up, we'll work on 6.2 ( https://phabricator.wikimedia.org/tag/ios-app-v6.2/); enabling wikidata description editing on English, user testing wikidata description editing, logging article reading. ==== Android native app ==== * Blocked by: * Blocking: * Updates: **Released bugfix release to production; continuing to refine interface based on user feedback. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** Mobile website (MinervaNeue / MobileFrontend): *** Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro… **** Collapse mobile.search.util into mobile.startup ResourceLoader module T206027 **** Increase test coverage for non-View files with 0% coverage T206698 **** MobileFrontend pre-commit hooks don't work on Windows T208143 **** Add TopicTitleList component T173534 **** Remove unused MW configs loaded on desktop pageviews T186062 *** Page issues https://www.mediawiki.org/wiki/Reading/Web/Projects/Mobile_Page_Issues **** A/B test complete; wrapping up subtasks and performing data analysis T200792 *** Allow users to change their mobile skin preference T173527 *** Collect data on users who are switching from mobile to desktop T208457 *** Maintenance and bug fixes T205359 T193061 T208340 ** SEO: *** Server side split test T206868 *** Enable page schemas on the beta cluster T208763 *** Old page_random values are nonuniformly distributed T208909 (Thanks Tilman and Tim Starling) *** Launch A/B test for sameAs property T208755 ** PDF rendering (Proton) https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality *** Remaining work tracked in T186748 *** Rewrite Queue to Promises T204055 *** Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions **** Design working on navigation prototype: https://en.wikipedia.org/wiki/User:AHollender_(WMF)/sandbox#Advanced_mobile… ** Design working on the community health dashboard project and interviewing QA engineers. ** Management interviewing for apps engineering manager role. ** Post-WMTechConf/Offsite follow-ups. ==== Readers Infrastructure ==== * Waiting on Kartographer/JsonConfig security review (not immediately blocked) ==== Multimedia ==== * Updates ** First release (multi-lingual captions) live on beta commons ... not announcing it yet because we've bugs to work through ** Working on phase 2 (statements) and hiring ==== Parsing ==== * Blocked by: None * Blocking: None * Updates: None ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** == Technology == === Analytics === * Updates: ** ** Met with security and SRE to plan best architecture to put edit data lake data on labs via presto cluster. This is adataset that quarry can use to answer questions that are just to hard for labs replicas, see conversations: https://phabricator.wikimedia.org/T207321 ** Will produce design document and cloud team can also take a look ** We are about to update cloudera distro in cluster to 5.15 ** Research and analytics collaborating as time permits in classifier to better identify bots in pageview data ** Reactive: When communication works: we had an issue that “looked” like data loss but was actually request for WebP assets being double logged. We were able to figure out the connection via updates on SRE meeting. See ticket: https://phabricator.wikimedia.org/T208752 kudos to everyone for fast responses. === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: **Still tightening up some stuff in CentralNotice **CiviCRM UI fixes **Dealing with PayPal inconsistencies **Fixing authentication for internal dashboard === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** Session Management Service RFC is available ** Team is beginning the process of extracting actionables from TechConf ** PHP7 work ongoing ** Automating the process of creating the MediaWiki tarball === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: * Blocking: ** Train Health: *** Last week: 1.33.0-wmf.2 deployment blockers https://phabricator.wikimedia.org/T206656 **** wmf.2 was late last week due to an odd HHVM issue: https://phabricator.wikimedia.org/T208549 *** This week: 1.33.0-wmf.3 deployment blockers https://phabricator.wikimedia.org/T206657 **** All systems nominal. *** Thanks James_F and Roan for wmf.2 work! (and for deploys this morning) * Updates: ** Wikimedia Release Engineering's 1st Annual Developer Satisfaction Survey https://phabricator.wikimedia.org/phame/post/view/126/wikimedia_release_eng… *** Please take it! :) === Research === * Blocked by: None * Blocking: None * Updates: ** Team is at CSCW 2018. ** Offsite in the second part of the week. === Scoring Platform === * Blocked by: * Blocking: * Updates: **Amir pushed out big changes to ORES -- CODFW is having poolcounter slowness -- Implementing a better poolcounter restart strategy withtimeouts (deployed on 11/5) **Celery 4 shows a huge reduction latency for precached (single revision scoring, 300% faster), but increase in latency for multi-revision scoring *** Celery4 is now able to recover from redis outages === Search Platform === * Blocked by: None * Blocking: None * Updates: ** Added syntax for searching Wikidata for any qualifier value: https://phabricator.wikimedia.org/T207016 ** Made code to calculate autocomplete examination probabilities for Wikidata: https://phabricator.wikimedia.org/T205348 ** Made some updates to WDQS network and logging configurations to improve stability under load: https://phabricator.wikimedia.org/T206105 https://phabricator.wikimedia.org/T207834 https://phabricator.wikimedia.org/T207843related to https://wikitech.wikimedia.org/wiki/Incident_documentation/20181024-WDQS ** Changed throttling setting for WDQS internal cluster: https://phabricator.wikimedia.org/T206648 ** Added support for millisecond timestamps to WDQS Kafka poller: https://phabricator.wikimedia.org/T207873 ** Working on ES 6 upgrade: https://phabricator.wikimedia.org/T183282 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by:None * Blocking:https://phabricator.wikimedia.org/T144467#3932037 **T200279 Security review for WikibaseMediaInfo **T207798 Security review for GrowthExperiments extension * Updates:T207798 is complete **T200279 and T144467 are in process === Services === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: * Blocking: * Updates: ** == Wikidata == * Blocked by: * Blocking: * Updates: **Thanks to people helping out with WDQS stability issues! **Working on exciting new things in the UI -> will request a service from SRE at some point in the near future **Several collegues from the team got deployment access rights -> thanks for support to SRE and RelEng! == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** Enabled “read new” on all wikis ** Approved RFC: Spec for representing multiple content objects per revision (MCR) in XML dumps ** Working on backend support for editing slots other than main slot