[Wikitech-l] 2016-08-17 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-08-17

= 2016-08-17 =

== Product ==

=== Reading ===

==== Reading Web ==== * Current sprint: https://phabricator.wikimedia.org/project/view/2126/ * Next sprint: https://phabricator.wikimedia.org/project/view/2158/ * Lazy loading images on mobile web is going live very soon * Heads up, we're looking to release Related Articles on mobile web potentially in 6-10 weeks. More api.php calls. * Any ideas on "Various browser tests failing due to login error" ( https://phabricator.wikimedia.org/T142600 )?

==== Mobile Content Service (MCS) ==== Not stripping title attributes from links anymore. https://gerrit.wikimedia.org/r/#/c/304785/

==== Android native app ==== * Current sprint: https://phabricator.wikimedia.org/project/view/2142/ * Next sprint: * Beta release this week with minor feed updates (tab icon update, access to tabs from the feed, persistent dismissal of cards) * Nav overhaul work continues apace * Working with Discovery to get Nearby search going

==== iOS native app ==== * 5.0.6 shipped this week: https://phabricator.wikimedia.org/tag/ios-app-v5.0.6-hotfix/

* Current release board: https://phabricator.wikimedia.org/project/board/1736/ ** Major features are iPad and Find in Page ** Feature Complete and in beta ** Still wrapping up minor tweaks and bug fixes

* Next release board: https://phabricator.wikimedia.org/project/view/2150/ ** Started development this week week ** Adding iOS 10 support ** Dropping iOS 8 support ** Major features are Widgets and Feed improvements ** Expected to go to beta in early september

==== Reading Infrastructure ==== *

=== Security === * MediaWiki 1.27.1 release delayed to this week * Security reviews this week: Html5Depurate, GlobalGroupPermisions, PerformanceInspector * Planning for captcha improvements continues ** https://phabricator.wikimedia.org/T125132 ** https://phabricator.wikimedia.org/T141490 ** First step will be re-generating images using current script

=== Editing ===

=== Collaboration === * Blocked: * Blocking: * Updates:

=== Language === * Blocked: * Blocking: * Updates: ** Security review for Youdao needed: https://phabricator.wikimedia.org/T143185 ** Apertium->Jessie packaging work almost done; Few packages left to upload. ** Improvements in Content Translation continue: MT card, templates, DB errors.

=== Multimedia === * Blocked: ** Is there an update on thumbor production status? (Performance?) It's still blocking ImageTweaks deployment. * Blocking: ** None of which we're aware. * Updates: ** Continuing our work on FileAnnotations; currently pending on a decision on whether we're waiting for structured data or will go early and re-write content after the fact when it goes live.

=== Parsing === * Blocked: * Blocking: * Updates:

=== VisualEditor === * Blocked: ** We (and other teams depending on Phlogiston) remain blocked with Ops/Labs on server issues, with the system either completely broken or impaired continuously since mid-June; this week it's T142742, before that T141796, T142165, T137736 and others from related issues. Is there a better mechanism for getting these kinds of issues fixed more rapdily? * Blocking: ** Parsing team are still waiting for our response on "native" Parsoid <gallery> implementation. Thalia and Ed will look at it more. * Updates: ** Major work this week on client-side DOM diffing (for smaller save bandwidth demands), re-orderable transactions (for enhanced IME support and maybe offline editing), and the new wikitext editor (now merged in a feature-flagged state; Beta Feature expected in a month or so).

== Technology ==

=== Release engineering === * '''Blocked''' ** ops - need a set of eyes on https://gerrit.wikimedia.org/r/#/c/302601/ so we can easily put logs for Java-based applications into Logstash * '''Blocking''' ** Security - security release of 1.27.1 & co. This week. * Updates: ** New SWAT window schedule starting Aug 22nd *** See: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd *** And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team *** https://phabricator.wikimedia.org/T137970

=== Analytics === * loading of new AQS (pageview API) cluster ongoing, will switch over to it when done * new event bus logging from mw hooks merged, will start being available on event bus soon * re-ran massive sqoop of all mediawiki databases, parallelizing most of the small wikis together, and dbstore1002 doesn't seem impacted * re-worked some dataset documentation to help people transition from the old pagecounts-raw: https://wikitech.wikimedia.org/wiki/Analytics/Data * Joseph and Luca are on vacation for two and one week respectively

=== Services === * Blockers: none * Kafka upgraded to 0.9, now working on replacing the driver in Change-Prop * Parsoid move to scap3 is in progress * Puppetisation of the PDF render electron service

=== Research === * Substantial update to ORES is live ** CPU usage down by 66% ** Memory usage down by 26% ** Some minor regressions that will be handled in incoming patches.

=== Community Tech === * Updating affected abuse filters as the wikis receive the new code for norm and ccnorm function https://phabricator.wikimedia.org/T29987 * Working on acceptance tests for InternetArchiveBot ( https://phabricator.wikimedia.org/T140386) and releasing some code as a composer package (https://phabricator.wikimedia.org/T140135) * Migrations to centralauth database for cross-wiki watchlist https://phabricator.wikimedia.org/T141951 ** Semi-blocker: update on when the watchlist IDs will be added by the TCB team * Testing numeric sorting on Swedish Wikipedia https://phabricator.wikimedia.org/T142113 * Helping out with Education Program’s Dashboard tool * Nearing completion of feature releases for CopyPatrol

=== Discovery === * No blockers * Working on BM25 implementation * Working on multi-wiki indexes * Working on integrating Polestar (http://vega.github.io/polestar/) and WDQS GUI to allow create graphs visually from WDQS results * Improved suggestions with typos in first characters: https://phabricator.wikimedia.org/T107006 * Analysis of ASCII folding/stemming on enwiki: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Re-Ordering_Stemming_... ** TLDR: results positive, we should do it * Summary of Portal changes published: https://lists.wikimedia.org/pipermail/wikitech-l/2016-August/086312.html

=== Interactive Team === * Working on deploying <mapframe> and <maplink> to all non-Wikipedia sites * Working on replacing GeoHack with <maplink> + info screen on all Wikipedias * Working on deploying Tabular data on Commons. Already synced up with Wikidata. * In progress of deploying eqiad maps cluster

=== Technical Operations === * '''Blocked''' ** None * '''Blocking''' ** None * Updates: ** apertium packages for LE reviews ongoing ** thumbor service getting installed this week, no definite ETA yet, but ongoing ** Work ongoing on puppetDB, xkey, varnish4

== Wikidata == * Blockers: None. * Implemented user feedback on ArticlePlaceholder. * Series of small fixes to make error messages in the UI more actionable. * Need Ops input on https://phabricator.wikimedia.org/T142944. Performance and caching considerations when we make ArticlePlaceholder pages visible to search engines. * Today: ArchCom meeting about proposals for content model storage. First step towards allowing multiple content objects. https://phabricator.wikimedia.org/E261

== Fundraising Tech == * More queue work * Running CiviCRM batch de-duplication, fixing issues as they arise

== Architecture == https://www.mediawiki.org/wiki/Architecture_committee/Status 2016W33: 2016-08-17 (Wednesday)

* ArchCom Planning meeting: [https://phabricator.wikimedia.org/E260 Phab:E260] 20 UTC (1pm PDT) ** Notes: [https://www.mediawiki.org/wiki/Architecture_committee/2016-08-17 Architecture committee/2016-08-17] * ArchCom-RFC office hour: [https://phabricator.wikimedia.org/E261 Phab:E261] 21 UTC (2pm PDT) ** Agenda: [https://phabricator.wikimedia.org/T105652 Revisiting T105652 (content model storage)]