[Wikitech-l] 2018-03-07 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-03-07 = 2018-03-07 = == Callouts == * Fundraising campaigns *https://meta.wikimedia.org/wiki/CentralNotice/Calendar* <https://meta.wikimedia.org/wiki/CentralNotice/Calendar>* - next up: Netherlands *2018-04-03 through 2018-05-01 * Collaboration is planning to move maps server testing from prod (on out-of-warranty hardware) into labs, tell us if that's a bad idea or if there's a catch * Performance: WebPageTest migration to Linux complete, dashboards need to be updated if they haven't been already. Reach out to Peter Hedenskog if you need help. * Performance: FOUC issue when autofocus is used on Firefox has been addressed, but fix won't be released until FF60 (expected on 8 May). (Has been reported to affect some Special pages, Roan also reported it.) ==Blockers== ==== iOS native app ==== ** No Joe :( Velocity is going to be reduced for a bit. ==== Readers Infrastructure ==== * Blocked by: Wikidata on code review for description overrides https://phabricator.wikimedia.org/T184000 ==== Community Tech ==== * Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal ==== Collaboration ==== * Blocked by: SRE on reviewing Flow dumps patch ==== UI Standardization ==== * Blocked by: RelEng on repos for Design subdomain https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests & https://phabricator.wikimedia.org/T185282 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: ** No Joe :( Velocity is going to be reduced for a bit. * Blocking: * Updates: ** Bug fixing iOS reading list sync / finishing remaining sync UI bits ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Rolled out Reading List syncing to 10% of beta audience (~25000 users); Will continue to roll out to 50% then 100% in the next few days, assuming scalability looks good. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** Bug fixing to mobile web and page previews (in preparation for release to all wikis) *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** Reading Web/Performance ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ==== Readers Infrastructure ==== * Blocked by: Wikidata on code review for description overrides https://phabricator.wikimedia.org/T184000 * Blocking: * Updates: ** ===== Maps ===== * Blocked by: * Blocking: * Updates: ** ==== Multimedia ==== * Updates ** 3D work nearly all complete - some cleanup and optimization that could be done later ** Search: Draft patch up, looking for feedback but not urgently ** Other SDC: Progressing, complicated code structure slightly impeding work, but nothing new and hopefully not for long Quarterly goal dependency update ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata === Contributors === ==== Community Tech ==== * Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal * Blocking: * Updates: ** Lots of discussions with community around long edit summaries rollout, seems like drastic measures will be avoided. ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Tidy will be replaced on a bunch of wikis (~100 overall) next week - sent out an announcement on ambassadors and wikitech-l ** Last week's RFC hearing about https://phabricator.wikimedia.org/T157418 has been approved and will be announced for last call soon. WIP patches for both the PHP parser and Parsoid have been uploaded to gerrit. I have to update tests and verify they all pass before I take it out of WIP. But, I expect this to be ready for final review before the last call period ends. *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services ** No new updates on these dependencies since last week's update ==== Collaboration ==== * Blocked by: SRE on reviewing Flow dumps patch * Blocking: nobody * Updates: ** "Flow on your talk page" beta feature re-enabled after Roan fixed MCR bug ** Patch up for review that should fix Flow dumps, Ariel will review next week ** Planning to move maps server testing from prod into labs, tell us if that's a bad idea or if there's a catch ** IRC meeting today about change tags RFC ==== Language ==== * Blocked by: * Blocking: * Updates: ** === Audiences Design === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops ==== UI Standardization ==== * Blocked by: RelEng on repos for Design subdomain https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests & https://phabricator.wikimedia.org/T185282 * Blocking: * Updates: ** OOUI v0.25.3 released with 3 new features, 2 style improvements and 12 code fixes/amendments, among those: *** Toolbar items' focus is now aligned to widgets elsewhere https://phabricator.wikimedia.org/T188031 (Volker E.) *** demos: Use individual oojs-ui-* JS files for sourcemap support (Moriel Schottlender) *** Also preparation for v0.26.0 with currently aimed for unification of base font-size of OOUI's WikimediaUI theme in VE and MW core https://phabricator.wikimedia.org/T97631 *** And refine icon set https://phabricator.wikimedia.org/T177432 ** Style Guide *** Fixing technical debt, *** Bringing proper SVG implementation to it *** Overhauling imagery == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: **Improve, adjust, or create features geared at the needs identified in New Editors research project. *** New Editors Experience:Analytics === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** More work on new API for main card processor ** blocking more PayPal fraud ** CentralNotice: ready to deploy EventLogging update ** Processing batch refunds for donors affected by confusing recurring toggle === MediaWiki Platform === * Blocked by: * Blocking: * Updates: * StripState improvements to address out of memory errors in production (T187833), and general cleanup * Working to address memcached timeout errors (T187980) * A few bugs showed up related to the Actor table patch and were fixed. * MCR: ** Lots of code review ** Lots of design discussion * Comment table: ** WRITE_BOTH enabled everywhere! ** WRITE_NEW blocked on the follow up schema change (T187089) and on T181650. ** There was some displeasure on enwiki over longer edit summaries resulting in T188798 "Decreasing length of the edit summary (until UI issues are resolved)". * Progress on running tests with PHP 7.0 in CI (T144962) * utfnormal update and other ICU upgrade related patches (T188480) * SPDX 3.0 license identifier updates * LuaSandbox: fixed test failure in 32-bit mode, released new version (T188467) * Published aggregated pingback statistics using reportupdater and dashiki: https://pingback.wmflabs.org ** Will be announced after final tweaks ** Thanks, Analytics! * Preparing for EMWCon * FYI: Daren Welsh from NASA posted https://www.mediawiki.org/wiki/5_Year_NASA_Wikiversary *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services * Reduce product and technical debt to modernise our tools and technologies, and to make future changes more effective and efficient *** Parsing/Mediawiki PF **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** no new updates on quarterly goal dependencies since last week === Performance === * Blocked by: **N/A * Blocking: **N/A * Updates: ** SRE raised concerns about mcrouter project, going back to the drawing board with an alternative called Dynomite. This puts our quarterly goal to have WANCache replicated between data centers at risk ** Enabling oversampling of performance metrics from Singapore this week, to support the new cache center there. ** Thumbor private wiki support being improved further ** WPT migration to Linux complete, dashboards need to be updated if they haven't been already ** FOUC issue when autofocus is used on Firefox has been addressed, but fix won't be released until FF60 (expected on 8 May). (Has been reported to affect some Special pages, Roan also reported it.) ** Coal update from last week was carried over to address some CR issues, should go out this week instead. === Release Engineering === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: * === Research === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Update: * === Scoring Platform === * Blocked by: * Blocking: * Updates: === Search Platform === * Blocked by: * Blocking: * Updates: **Kafka poller for WDQS is in production: https://phabricator.wikimedia.org/T185951 ** Wikidata items appear in completion searches faster - merged: https://phabricator.wikimedia.org/T183053 ** Started testing “query explorer” feature of LTR plugin: https://phabricator.wikimedia.org/T187148 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** Working on Serbian analyzer for ES: https://phabricator.wikimedia.org/T183015 ** Discussing Lexeme search implementation: https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Lexeme_search *Quarterly goal dependency update: ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * === Security === * Blocked by: * Blocking: * Updates: ** === Services === * Blocked by: none * Blocking: none * Updates: ** All refreshLinks jobs processed on kafka queue *** Some backlogw created by the switch is being cleared now ** All cdnPurge jobs processed on kafka ** Next - switch cirrusSearch jobs === Site Reliability Engineering === * Blocked by: ** Collab on Flow dumps https://phabricator.wikimedia.org/T172025 *** Roan: not any more, we're blocked on you now * Blocking: ** None that we know of * Updates: ** All traffic cluster are now upgraded to Varnish 5 ** hardware refreshing ongoing ** A long standing ICMP issue traffic from Google was fixed finally last week. https://phabricator.wikimedia.org/T165651#4017007 ** The Readings lists schema change has been completed by the Data Persistence SRE (sub)team *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: It will not happen this quarter due to lack of time from Services and SRE teams per https://phabricator.wikimedia.org/T187821#4018885 * ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops This is https://phabricator.wikimedia.org/T185282 ** Update: This is not in SRE field currently, we are waiting for the code to be live in gerrit/phab repos * == Wikidata == * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** Update: * ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: **please add links to Phab tickets that relate to quarterly goals