[Wikitech-l] 2018-09-26 Scrum of Scrums meeting notes

*https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-09-26 <https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-09-26>* *= 2018-09-26 =* == Callouts == Release Engineering: * *Deployments of MediaWiki with scap cause a spam of "web request took longer than 60 seconds and timed out"* ** https://phabricator.wikimedia.org/T204871 ** Scap is checking canary servers in dormant instead of active-dc* ** Switchover process needs an update. Long term the list of canaries should be in conftool. ** https://phabricator.wikimedia.org/T204907 * ComTech: ** We're starting to work on showing SVGs in page language - https://phabricator.wikimedia.org/T205040 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: **Planning to be feature complete for 6.1 ( https://phabricator.wikimedia.org/tag/ios-app-v6.1-narwhal-on-a-bumper-car/) by the end of this week ** Apps offsite next week, ==== Android native app ==== * Blocked by: * Blocking: * Updates: **Working on productionising new navigation **Apps offsite next week. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** Mobile website (MinervaNeue / MobileFrontend): *** SkinMinerva.php file logs "Undefined variable: returntoquery` error T205449 *** Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro… **** Continue Webpack and test transition of mobile.startup T203817 **** Add more tests to mobile.startup files T203818 **** Simplify CategoryOverlay T191987 **** Add Sinon.JS configuration T204885 **** Update test file naming T197884 **** Bundle Hogan.js T205128 T205129 **** Enable client side error reporting T167699 *** Page issues https://www.mediawiki.org/wiki/Reading/Web/Projects/Mobile_Page_Issues **** Limited A/B test in progress T204609 **** ReadingDepth logging sometimes initializes before PageIssues T204144 **** Add new treatment opt-in query parameter override T204746 **** Don't cache config flag with HTML T205355 **** What % of pages feature issues? T201123 **** Increase sampling ratio for ReadingDepth T205176 *** Working with editing *** Add share icon to beta T181195 *** Lighten default theme color T204691 *** Maintenance and bug fixes T199066 T204584 T197105 T198018 T205321 *** Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions **** Generate list of most used special pages T198218 **** Design and product continuing special pages work in Minerva *** Data working on "better use of data" requirements ** PDF rendering (Proton) https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality *** Remaining work tracked in T186748 *** Working with Services on a Grafana dashboard T201158 T204055 *** Chromium-render doesn't handle browser connection abort well T181623 *** Miscellaneous maintenance and bug fixes ** Supporting Multimedia/Test hiring processes ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** PCS: Continue work on mobile-html endpoint. ** Maps *** maps1004 migrated to stretch successfully **** It will now receive OSM data load to start generating tiles T205462 *** Investigation of tilerator crash in eqiad has an workaround but still need permanent fix T204047 ==== Parsing ==== * Blocked by: None * Blocking: None * Updates: All code review requests from last week have been handled, thanks ** Will pass along: (Parsing) T205497 [Regression pre-wmf.23] REST API on Beta cluster returns content of different pages than requested (breaks VE) ==== Multimedia ==== * Blocked by: * Blocking: * Updates ** === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** We're starting to work on showing SVGs in page language - https://phabricator.wikimedia.org/T205040 *Ping Parsing and SRE* ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** Removed dedicated annotation operation types in the VE data model and instead model annotation transactions using replacements ** Improved mobile dialogs in the visual editor ** Completed move of MobileFrontend's VisualEditor styles back to MobileFrontend from Minerva ==== Growth ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: * Blocking: * Updates: ** Preparing for ContentTranslation v2 continue. === Audiences Design === * Blocked by: * Blocking: * Updates: ** ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** Special:Preferences OOUI rollout ** Resolving remaining typography/imagery quests on Design Style Guide ** Accessibility work on wikimediafoundation.org website == Technology == === Analytics === * Blocked by: * Blocking: * Updates: - Analytics team off-site - Replacement of hadoop cluster node managers without issues - 2 new metrics for Wikistats2: pages to date (total article count) and top contributors, deploy before end of quarter - Final work on Wikistats2 graph annotations (tricky UI), also deploy before end of quarter - Modern Event Data Platform internal discussions, tickets and naming reworked for a clearer picture of what we will be working on === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Thanks to the people who are helping out with the MessageCache issue affecting CentralNotice (Ian Marlier, Jaime Crespo, Daniel Kinzler, Niklas Laxström et al) ** Got a patch out to support Amazon Alexa donations, just in time for their announcement ** Working on distinguishing endowment gifts throughout the whole donation pipeline ** Fixing a couple of issues in spreadsheet imports ** Interviewing for engineer position === Core Platform === * Blocked by: * Blocking: * Updates: ** Session management service design and implementation is being moved up to this quarter to get to unblock multi-DC *** Preparing for moving to production early Q3 ** MediaWIki tarball release script updated ** Work starting on Excimer - New profiler for PHP to replace XHProf https://phabricator.wikimedia.org/T205059 === Performance === * Blocked by: * Blocking: * Updates: ** === Release Engineering === * Blocked by: ** 1.32.0-wmf.23 deployment blockers *** (Readers Web) T205449 SkinMinerva.php file logs "Undefined variable: returntoquery` error **** Done *** (Core Platform) T205469 Fatal error from LinkRenderer on special pages ("Object of class HtmlArmor could not be converted") **** Done *** (Search Platform) T205473 Fatal error "Invalid operand type" from CirrusSearch LinksUpdate **** Done *** (Parsing) T205497 [Regression pre-wmf.23] REST API on Beta cluster returns content of different pages than requested (breaks VE) **** Done * Blocking: ** * Updates: ** Train Health: *** Scap is checking canary servers in dormant instead of active-dc - Switchover process needs an update. Long term the list of canaries should be in conftool - https://phabricator.wikimedia.org/T204907 ** Log Health: *** We are seing a lot of T204871 "web request took longer than 60 seconds and timed out" in `fatalmonitor` ** Code Health: *** Creating communication channels (Phabricator https://phabricator.wikimedia.org/tag/code-health-metrics/, IRC channel, mailing list) === Research === * Blocked by: None * Blocking: None * Updates: ** Data collection for CitationUsagePageLoad at 33.3% (was 10% previously) ** Retaining de-identified CitationUsage data beyond 90 days ** Recommendation API service to MySQL connection: https://phabricator.wikimedia.org/T205452 === Scoring Platform === * Blocked by: * Blocking: * Updates: ** PoolCounter is deployed everywhere, now the limit of parallel connections is being enforced ** Started to work on improving logs in ores, specially sending them to logstash ** Building javascript library in mediawiki to make requesting scores to ores easier: https://phabricator.wikimedia.org/T201691 === Search Platform === * Blocked by: * Blocking: * Updates: **Made sanetizer process to constantly reindex the wikis: https://phabricator.wikimedia.org/T203622 **Implemented support for Lexemes in RDF (not enabled yet, waiting for dumps): https://phabricator.wikimedia.org/T202459 **Finished evaluation of image quality as query-independent ranking signal: https://phabricator.wikimedia.org/T202339 ***Conclusion: positive, image quality is a good signal, will plan implementation ** Upgraded ElasticSearch plugins for 6.3: https://phabricator.wikimedia.org/T197960 ** Added ntriples RDF dump for Wikidata: https://phabricator.wikimedia.org/T144103 ** Reindexing Wikidata to enable several newly deployed features ** Reindexed Esperanto wiki after new analysis enabled: https://phabricator.wikimedia.org/T203005 ** Working on calculating examination probabilities for completion queries: https://phabricator.wikimedia.org/T205348 ** Working on improving Korean analyzers: https://phabricator.wikimedia.org/T178925 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on searching for statement values without additional keywords for Wikidata: https://phabricator.wikimedia.org/T163642 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Preparing for the switchback ** Finishing goals == Wikidata == * Blocked by: * Blocking: * Updates: ** == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** "read new" enabled on testwiki ** "read new" being enabled on mediawiki.org this week ** waiting for DC switch back to enable "read new" on Commons and other wikis ** reactive minor bug fixes == SoS Meeting Bookkeeping == * Updates: **