[Wikitech-l] 2018-06-27 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-06-27 = 2018-06-27 = == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar : ** 2018-07 es, 2018-07-09 to 2018-11-11 de, 2018-07-01 to 2018-11-31 en, 2018-07-10 to 2018-12-31 de, no, he, fr, nl, da, pl, ru, uk, pt, lv, ru, ro, sk, hu, en, fr, de, zh, es * Multi-Content Revisions: revision storage / page update rewrite (T174024, T174038) goes live this week, RfC on further page update changes today (T198075) == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Multi-language support now in production ==== Readers Web ==== * Blocked by: **Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710 * Blocking: * Updates: **Mobile website (MinervaNeue / MobileFrontend): ***Improvements to diff T197491 T197581 ***Improvements to page issues T197728 T191303 ***Investigating parser cache pollution T173949 ***Miscellaneous fixes and improvements T196947 T156186 T197273 T192725 T190549 T193517 ***Mobile navigation for advanced contributors is in planning and design https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions **Desktop website (Popups): ***Miscellaneous fixes and improvements T192928 T193792 T196952 T193519 **PDF rendering (Proton): ***Miscellaneous fixes and improvements to concurrency and queue management T186748 T186748 T186748 ***Investigating grave kerning and spacing issues T178665 *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra ==== Readers Infrastructure ==== * Blocked by: Ping RelEng for CI patch review: https://gerrit.wikimedia.org/r/#/c/integration/config/+/442126/ * Blocking: * Updates: ** Wikipedia Reading Lists extension for Safari is ready for release ** Integration of Wikimedia Page Library in the Page Content Service is in progress — see https://gerrit.wikimedia.org/r/#/q/topic:page-lib2+(status:open+OR+status:m… ** Maps infrastructure handoff updates: *** Validated loading documentation on Wikidata for new map styles (though that work is on hold) *** TODO: Validate loading docs for existing styles on Stretch in preparation to upgrade the maps servers to Stretch (currently running Jessie); pending https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/442258/ *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] ***Reading Infra depends on Parsing, Services ===== Maps ===== * Blocked by: * Blocking: * Updates: ** Planning on reimaging test servers to see if there are any issues running on stretch ==== Multimedia ==== * Updates ** Work is progressing but tied up in administrative stuff to some extent ** Search interface prototyping currently so users can search by Wikibase properties/values ** Also continuing work on search backend *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) ***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- T171252 ***Research depends on Multimedia === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** Nothing new to report ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Language variants endpoint in production -- selectively exposed for some languages by the REST API on the RESTBase end. ** Tidy -> RemexHtml on track for July 5th completion *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing depends on MediaWiki Platform, Services **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] Increase code sharing of client apps by coalescing and moving more logic to the server. *** Reading Infra depends on Parsing, Services ** [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: Editing: https://phabricator.wikimedia.org/T196136 (and T191011) * Blocking: * Updates: ** Continue work on ContentTranslation v2. ** CX draft purge dry-run this week, actual run next week (Monday) *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.1]] Improve and consolidate our unified editing platform so that it's great on all devices ***Language depends on Editing === Audiences Design === ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** OOUI – v0.27.4 special release last Thu https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v… *** 3 style, 16 code and 2 accessibility improvements. Highlights: **** Refactor how we apply `display: none` to unused icons and indicators (Bartosz Dziewoński) **** FieldLayout: Add `for` attribute to inline help label (Prateek Saxena) **** PopupWidget: Listen to 'click' for 'mousedown' events in iOS (Moriel Schottlender) **** styles: Remove proprietary IE 8 & 9 `-ms-filter` properties (Volker E.) ** Continuing work on Design Style Guide == Technology == === Analytics === * Blocked by: * Blocking: * Updates: **New UI work on wikistats. Bookmarks for graphs are deployed, see for example new registered users for Arabic wikipedia: https://stats.wikimedia.org/v2/#/ar.wikipedia.org/contributing/new-register… |bar|2-Year~2016050100~2018061900|~total ** Looks like we might be able to move forward in the outstanding privacy conversation of what to do with AppInstallID (the token that identifies wikipedia app install on a phone) ** We will be working with security to do a threat model of analytics infrastructure next quarter ** JSONSchema vs Avro RFC submitted for Modern Event Platform program: https://phabricator.wikimedia.org/T198256 === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Off-site this week with the advancement teams === MediaWiki Platform === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE === Performance === * Blocked by: **None * Blocking: **SRE (Aaron has work to do to finish the mcrouter rollout, everyone is aware) * Updates: ** Offsite last week ** Nifty blog post: https://phabricator.wikimedia.org/phame/live/7/post/109/mobile_web_performa… ** Updating some dashboards to tighten down alerts ** Perf perception survey continues ** Continuing to split out mediawiki base to push jQuery load back, expect that to land this week sometime === Release Engineering === * Blocked by: * Blocking: ** readers web ** will review https://gerrit.wikimedia.org/r/c/integration/config/+/442126 * Updates: ** FYI: Release Engineering will start including Europeans in our train rotation meaning that the MW Train will now include European appropriate windows for those weeks. Exact schedule TBA to wikitech-l@, ops@, engineering@, and @wikitech-ambassadors@ *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra === Research === * Blocked by: * Blocking: * Updates: ** Added Arabic and RLT support to the Gapfinder tools project.: http://gapfinder-tools.wmflabs.org/ ** Done with training models for translation recommendation: https://github.com/wikimedia/research-translation-recommendation-models/ ** Collecting data for Schema:CitationUsage starting tomorrow. *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- [[phab:T171252|T171252]] ***Research depends on Multimedia === Scoring Platform === * Blocked by: * Blocking: * Updates: === Search Platform === * Blocked by: * Blocking: * Updates: ** Added analysis chain for Mirandese: https://phabricator.wikimedia.org/T197890 ** Finished analysis chain for Esperanto: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Esperanto_Stemmer_An… ** Added Lexeme to instant indexing setup: https://phabricator.wikimedia.org/T196896 ** Fixed a number of bugs in WDQS MWAPI: https://phabricator.wikimedia.org/T197495 https://phabricator.wikimedia.org/T197496 ** Started preparation to upgrade to ElasticSearch 6.3: https://phabricator.wikimedia.org/T198067 ** Working on Lexeme fulltext search: https://phabricator.wikimedia.org/T196188 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia === Security === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]]: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services === Services === Not attending in person today * Blocked by: none * Blocking: none as we know * Updates: **JobQueue migration completed. No need for Redis queue any more, so far so good ** Language variants support in REST API is coming soon, working with clients to *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server.]] ***Reading Infra/Parsing, Services **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** Readers web on proton. Should be unblocked this week. * Updates: ** Back from SRE offsite, no updates *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra *** The service is after some changes done this and last week seems in a better shape to withstand the monitoring load. Next step is to pool it in LVS and make it available. **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing == Wikidata == * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** page update / revision storage refactoring goes live this week: *** https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015 *** https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595 *** https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465 ** RfC on future steps of page update refactoring today: https://phabricator.wikimedia.org/T198075 ** new revision schema will be enabled on beta soon (this week or next): https://phabricator.wikimedia.org/T197818 == SoS Meeting Bookkeeping == * Updates: **