2016-08-17 Scrum of Scrums meeting notes - Wikitech-l

17 Aug 2016


      https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-08-17
= 2016-08-17 =
== Product ==
=== Reading ===
==== Reading Web ====
* Current sprint: https://phabricator.wikimedia.org/project/view/2126/
* Next sprint: https://phabricator.wikimedia.org/project/view/2158/
* Lazy loading images on mobile web is going live very soon
* Heads up, we're looking to release Related Articles on mobile web
potentially in 6-10 weeks. More api.php calls.
* Any ideas on "Various browser tests failing due to login error" (
https://phabricator.wikimedia.org/T142600 )?
==== Mobile Content Service (MCS) ====
Not stripping title attributes from links anymore.
https://gerrit.wikimedia.org/r/#/c/304785/
==== Android native app ====
* Current sprint: https://phabricator.wikimedia.org/project/view/2142/
* Next sprint:
* Beta release this week with minor feed updates (tab icon update, access
to tabs from the feed, persistent dismissal of cards)
* Nav overhaul work continues apace
* Working with Discovery to get Nearby search going
==== iOS native app ====
* 5.0.6 shipped this week:
https://phabricator.wikimedia.org/tag/ios-app-v5.0.6-hotfix/
* Current release board:
https://phabricator.wikimedia.org/project/board/1736/
** Major features are iPad and Find in Page
** Feature Complete and in beta
** Still wrapping up minor tweaks and bug fixes
* Next release board: https://phabricator.wikimedia.org/project/view/2150/
** Started development this week week
** Adding iOS 10 support
** Dropping iOS 8 support
** Major features are Widgets and Feed improvements
** Expected to go to beta in early september
==== Reading Infrastructure ====
*
=== Security ===
* MediaWiki 1.27.1 release delayed to this week
* Security reviews this week: Html5Depurate, GlobalGroupPermisions,
PerformanceInspector
* Planning for captcha improvements continues
** https://phabricator.wikimedia.org/T125132
** https://phabricator.wikimedia.org/T141490
** First step will be re-generating images using current script
=== Editing ===
=== Collaboration ===
* Blocked:
* Blocking:
* Updates:
=== Language ===
* Blocked:
* Blocking:
* Updates:
** Security review for Youdao needed:
https://phabricator.wikimedia.org/T143185
** Apertium->Jessie packaging work almost done; Few packages left to upload.
** Improvements in Content Translation continue: MT card, templates, DB
errors.
=== Multimedia ===
* Blocked:
** Is there an update on thumbor production status? (Performance?) It's
still blocking ImageTweaks deployment.
* Blocking:
** None of which we're aware.
* Updates:
** Continuing our work on FileAnnotations; currently pending on a decision
on whether we're waiting for structured data or will go early and re-write
content after the fact when it goes live.
=== Parsing ===
* Blocked:
* Blocking:
* Updates:
=== VisualEditor ===
* Blocked:
** We (and other teams depending on Phlogiston) remain blocked with
Ops/Labs on server issues, with the system either completely broken or
impaired continuously since mid-June; this week it's T142742, before that
T141796, T142165, T137736 and others from related issues. Is there a better
mechanism for getting these kinds of issues fixed more rapdily?
* Blocking:
** Parsing team are still waiting for our response on "native" Parsoid
<gallery> implementation. Thalia and Ed will look at it more.
* Updates:
** Major work this week on client-side DOM diffing (for smaller save
bandwidth demands), re-orderable transactions (for enhanced IME support and
maybe offline editing), and the new wikitext editor (now merged in a
feature-flagged state; Beta Feature expected in a month or so).
== Technology ==
=== Release engineering ===
* '''Blocked'''
** ops - need a set of eyes on https://gerrit.wikimedia.org/r/#/c/302601/ so
we can easily put logs for Java-based applications into Logstash
* '''Blocking'''
** Security - security release of 1.27.1 & co. This week.
* Updates:
** New SWAT window schedule starting Aug 22nd
*** See: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd
*** And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team
*** https://phabricator.wikimedia.org/T137970
=== Analytics ===
* loading of new AQS (pageview API) cluster ongoing, will switch over to it
when done
* new event bus logging from mw hooks merged, will start being available on
event bus soon
* re-ran massive sqoop of all mediawiki databases, parallelizing most of
the small wikis together, and dbstore1002 doesn't seem impacted
* re-worked some dataset documentation to help people transition from the
old pagecounts-raw: https://wikitech.wikimedia.org/wiki/Analytics/Data
* Joseph and Luca are on vacation for two and one week respectively
=== Services ===
* Blockers: none
* Kafka upgraded to 0.9, now working on replacing the driver in Change-Prop
* Parsoid move to scap3 is in progress
* Puppetisation of the PDF render electron service
=== Research ===
* Substantial update to ORES is live
** CPU usage down by 66%
** Memory usage down by 26%
** Some minor regressions that will be handled in incoming patches.
=== Community Tech ===
* Updating affected abuse filters as the wikis receive the new code for
norm and ccnorm function https://phabricator.wikimedia.org/T29987
* Working on acceptance tests for InternetArchiveBot (
https://phabricator.wikimedia.org/T140386) and releasing some code as a
composer package (https://phabricator.wikimedia.org/T140135)
* Migrations to centralauth database for cross-wiki watchlist
https://phabricator.wikimedia.org/T141951
** Semi-blocker: update on when the watchlist IDs will be added by the TCB
team
* Testing numeric sorting on Swedish Wikipedia
https://phabricator.wikimedia.org/T142113
* Helping out with Education Program’s Dashboard tool
* Nearing completion of feature releases for CopyPatrol
=== Discovery ===
* No blockers
* Working on BM25 implementation
* Working on multi-wiki indexes
* Working on integrating Polestar (http://vega.github.io/polestar/) and
WDQS GUI to allow create graphs visually from WDQS results
* Improved suggestions with typos in first characters:
https://phabricator.wikimedia.org/T107006
* Analysis of ASCII folding/stemming on enwiki:
https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Re-Ordering_Stemming_...
** TLDR: results positive, we should do it
* Summary of Portal changes published:
https://lists.wikimedia.org/pipermail/wikitech-l/2016-August/086312.html
=== Interactive Team ===
* Working on deploying <mapframe> and <maplink> to all non-Wikipedia sites
* Working on replacing GeoHack with <maplink> + info screen on all
Wikipedias
* Working on deploying Tabular data on Commons.  Already synced up with
Wikidata.
* In progress of deploying eqiad maps cluster
=== Technical Operations ===
* '''Blocked'''
** None
* '''Blocking'''
** None
* Updates:
** apertium packages for LE reviews ongoing
** thumbor service getting installed this week, no definite ETA yet, but
ongoing
** Work ongoing on puppetDB, xkey, varnish4
== Wikidata ==
* Blockers: None.
* Implemented user feedback on ArticlePlaceholder.
* Series of small fixes to make error messages in the UI more actionable.
* Need Ops input on https://phabricator.wikimedia.org/T142944. Performance
and caching considerations when we make ArticlePlaceholder pages visible to
search engines.
* Today: ArchCom meeting about proposals for content model storage. First
step towards allowing multiple content objects.
https://phabricator.wikimedia.org/E261
== Fundraising Tech ==
* More queue work
* Running CiviCRM batch de-duplication, fixing issues as they arise
== Architecture ==
https://www.mediawiki.org/wiki/Architecture_committee/Status
2016W33: 2016-08-17 (Wednesday)
* ArchCom Planning meeting: [https://phabricator.wikimedia.org/E260 Phab:E260]
20 UTC (1pm PDT)
** Notes: [https://www.mediawiki.org/wiki/Architecture_committee/2016-08-17
Architecture
committee/2016-08-17]
* ArchCom-RFC office hour: [https://phabricator.wikimedia.org/E261 Phab:E261]
21 UTC (2pm PDT)
** Agenda: [https://phabricator.wikimedia.org/T105652 Revisiting T105652
(content model storage)]