[Wikitech-l] 2017-11-22 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-11-22 = 2017-11-22 = == Callouts == * If you use and process Parsoid HTML, please test your code with Parsoid master (merged patches for section tag addition + use of figure-inline tag) * It looks like Remex got turned off on the cluster on Oct 26 as part of https://phabricator.wikimedia.org/T178632 .. I didn't know about this till last week (because of some gaps in Phab notifications). When you switch off a feature in production, please make sure the responsible folks know about it. :-) * [Performance] Seeing some performance regressions being reported under Firefox 57; working with Mozilla to understand whether these are real or if they're due to a bug in FF57 NavTiming. * node service-runner provides node GC metrics to statsd from v2.4.3 so all node services can have it out of the box * Biggest fundraising campaign of the year starts Tuesday - please double-check with fr-tech if you're about to do anything that might affect CentralNotice or donatewiki. == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: still working on 5.8 https://phabricator.wikimedia.org/project/view/2913/ ==== Android native app ==== * Blocked by: * Blocking: * Updates: ==== Reading Web ==== * Blocked by: * Blocking: * Updates: ** A print button was added to the mobile site ** We made progress with working out how to deploy Chromium inside puppeteer and are continuing to work with services to get the pdf render service up and running ==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** working on Reading Lists performance improvements, hoping to deploy next week ** work continues on summary and media endpoints ==== Multimedia ==== * Blocked by: * Blocking: * Updates: WMDE is moving on some work for MediaInfo, in the meantime Multimedia is focusing on 3D, which should be ready to move out in early December. ==== Discovery ==== * Blocked by: * Blocking: * Updates: ** Deployed SVGs on www.wikipedia.org portal ===== Maps ===== * Blocked by: None * Blocking: None * Updates: ** Paul attended training at PGConf Seattle and intends to put together a learning session ** Ops person out this week === Community Tech === * Blocked by: * Blocking: * Updates: ** we were mostly conducting our survey. === Contributors === ==== Editing ==== * Blocked by: * Blocking: * Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Next big Parsoid deploy *** section-tag and figure-inline-tag patches merged; YET to bump HTML version number to 1.6.0 *** html5 ids patch in WIP; depending on how that goes, we may bundle that with the next deploy with a HTML version bump from 1.5.0 -> 1.6.0; *** If you use and process Parsoid HTML, please test your code with Parsoid master *** Parsoid should be backward compatible for the html -> wikitext direction; we should be able to process v1.5.0 or the newer HTML (or some combination of the two as well :)). Please report bugs if you see any problems. *** If testing early next week goes okay and we get a green from everyone, we will deploy next Thursday. If not, will push to the following week ** Tidy replacement *** It looks like Remex got turned off on the cluster on Oct 26 as part of https://phabricator.wikimedia.org/T178632 -- for whatever reason, Phab didn't notify me when James added me to the ticket, and Tim may not have known either. I've added both of us to the RemexHTML project .. so hopefully will receive project notifications in the future. But, when you switch off a feature in production, please make sure the responsible folks know about it. :-) *** Tim has fixed the problem and the fix will go out next week. ** Linter *** Over the last week, I finished running a script to re-generate linter issues for all pages on all (active) wikis. This should hopefully have initialized linter issues for all wikis (and removed false positives based on Parsoid fixes). ==== Global Collaboration ==== * Blocked by: nobody * Blocking: ops on dumps, Roan STILL hasn't talked to Ariel, apologies again, talking to Ariel as we speak * Updates: ** Translate extension's RC filters are now converted to the new system, that means almost all WMF wikis are fully converted except super edge cases like incubator ** Live update on RC will probably be deployed next week, stay tuned for announcement ==== Contributors Design ==== * Blocked by: * Blocking: * Updates: == Technology == === Analytics === * Blocked by: * Blocking: * Updates: === Cloud Services === * Blocked by: * Blocking: * Updates: ** Annual Toolforge survey kicked off on Monday; will run for 2 weeks -- https://phabricator.wikimedia.org/T177126 ** After much load testing we think Labvirt1015 is fit for duty. ** Andrew back from vacation ** Cloud VPS instances were switched to use Puppet's future parser on Monday === MediaWiki Platform === * Blocked by: * Blocking: * Updates: === Performance === * Blocked by: * Blocking: * Updates: ** Seeing some performance regressions being reported under Firefox 57; working with Mozilla to understand whether these are real or if they're due to a bug in FF57 NavTiming. === Release Engineering === * Blocked by: ** ops: [https://phabricator.wikimedia.org/T180524 Upgrade latest docker-registry.wikimedia.org/nodejs-devel to stretch] * Blocking: * Updates: * [Team vacations] Mukunda is out all week. Dan is only working on Monday. And of course Thurs/Fri for all US staff. * [MediaWiki Train] Catching up after last week’s delay due to the wikidata database crash. No MW train this week. Played catchup yesterday. All on wmf.8 * [Offsite] More team offsite logistics. Will be doing some cross team gathering with Reading (who we’re sharing a hotel/couple days overlap with). * A lot of Gerrit repository and Github mirror administration this past week. * [Phabricator] Caused and fixed a degradation of Phabricator’s search functionality last Wednesday night/Thursday morning (15th and 16th). We apologize if you were affected by this. [wiki] [email] === Research === * Blocked by: * Blocking: * Updates: === Scoring Platform === * Blocked by: * Blocking: * Updates: ** https://mediawiki.org/wiki/ORES/FAQ & https://wikitech.wikimedia.org/wiki/SIGDOCS ** draft_quality data coming to English Wikipedia, doing small DB key things. ** wp10 (article quality) data is going to be available for English Wikipedia ** Nov 20 outage on ruwiki and frwiki, Special:RecentChanges and Special:W atchList caused by ORES. We're drafting an incident report by the end of the day. ** We'd love to work with Global Collaboration to improve robustness on the pages that rely on ORES, to provide graceful degradation. ** Perhaps Global Collaboration wants to share QA resources? *** Roan: Happy to, on both. === Search Platform === * Blocked by: none * Blocking: none * Updates: ** Working on improvements to LTR training https://phabricator.wikimedia.org/T177520 ** Improving completion suggester interaction with namespaced prefix search https://phabricator.wikimedia.org/T178474 ** Preparing for next relevancy survey https://phabricator.wikimedia.org/T176428 ** Reviewing Serbian morphological libraries https://phabricator.wikimedia.org/T178926 ** Working on porting Selenium tests from Ruby to JS ** Working on upgrade to Elastic 5.5 - search clusters upgraded, logstash next ** Working on indexing Wikidata descriptions and adding them to fulltext search === Security === * Blocked by: * Blocking: * Updates: ** Reviews: *** mediawiki-services-chromium-render *** Ex:WikipediaExtracts === Services === * Blocked by: none * Blocking: none * Updates: ** Continuing to reshape cassandra cluster and moving more nodes to Cassandra 3 cluster ** service-runner provides node GC metric now to statsd *** After a deploy you will be able to make a GC graph this for your service *** https://grafana.wikimedia.org/dashboard/db/jobqueue-eventbus?panelId=13&… === Technical Operations === * Blocked by: * Blocking: * Updates: == Wikidata == * We are aware of review requests for description indexing for Search, as well as the request by the Structured Commons team. * RDF exports support foreign repository now, needed for Structured Data on Commons: https://phabricator.wikimedia.org/T161592 * Worked on making statements on Forms editable and persistent: https://phabricator.wikimedia.org/T163724 * Worked on fine-grained usage tracking in Wikibase' Lua library: https://phabricator.wikimedia.org/T172914 * Worked on caching constraint check results: https://phabricator.wikimedia.org/T179849 == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ==== Fundraising Tech ==== * CentralNotice: ** Aware that the Selenium tests are still on Ruby, would like to put off the nodejs update till January. ** Deployed a little bit of debugging code for the large banner switch campaign mixin * Payments forms: deployed little style fixes to buttons, putting off deploying validation changes till January * CiviCRM: contact de-duplication improvements for large dollar amount donors, de-duplicating organization records * More refinements to stats reported to Prometheus