[Wikitech-l] Scrum of scrums/2019-11-20

Hi, for HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-11-20 Željko -- = 2019-11-20 = == Callouts == ** SRE: *** DBAS [general update] Upcoming s1 (enwiki) database master switch 14 Nov: [[phab:T234800]] [will imply a small read only window] *** Requesting follow-up from Scoring team [[phab:T233448#5638765]] *** Requesting follow-up from Releng team [[gerrit:479139]] ** Release Engineering: no train because of team offsite == Product == === iOS native app === * Blocked by: **Core Platform ***release wikidiff2 to get section titles from compare endpoint ***counts endpoint limit increases ***minor count endpoint failing ( https://en.wikipedia.org/w/rest.php/v1/page/Barack_Obama/history/counts/min… ) * Updates: **6.5 wrapping up bugs/development - [[phab:project/view/4245]] ***aiming to be in public beta Friday (11/22) === Android native app === * Updates: ** Our major release is all set to go out the door.: [[phab:project/view/4123]] *** Fundraising banner is ready and in review. *** We have re-started work on integration with mobile-html endpoint. === Product Infrastructure === * Updates: * Patches for client-side error logging and EventLogging client improvements * Security review followups for MachineVision * Reviewing MCS overhaul patches * Wikifeeds ** Removed frwiki from supported TFA wikis due to [[phab:T237790]] ** Patch in review for upgrading to Node 10 -- just need confirmation from CPT that this won’t cause any problems === Structured Data === * Blocked by: ** WMDE/Wikidata: review of [[gerrit:548734]] ([[phab:T222497]]) * Blocking: ** Search Platform: Data dumps for SDC: [[phab:T221917]] === Parsing === * Blocked by: ** deployment recipe issues need resolving before we do additional live traffic deploys ([[phab:T238685]] and [[phab:T238748]]) ** (soft blocker) still working to get all parsoid clients tested against parsoid/php (Content translation and flow) * Updates: ** parsoid/php is on testwiki -- see wikitech-l mail from y'day === Inuka === * Updates: ** PageViews instrumentation: [[phab:T238029]] == Technology == === Fundraising Tech === * Updates: ** CiviCRM *** More tweaks to how we import data from our bulk mailing provider *** Changes to our custom drupal code to accommodate using a read-only database connection for some requests. *** Still working on button to send end-of-year summary receipt on demand [[phab:T221271]] ** CentralNotice *** Trying to understand a few more oddities in the new EventLogging data pipeline. For example, how are we getting client-side FundraiserLandingPage events without corresponding server-log pageviews? [[phab:T236835#5670862]] ...see the section "Explaining orphaned events in new logs" *** Finishing up initally-contractor-written feature to extend geotargeting to regions smaller than countries. [[phab:T226438]] === Core Platform === * Blocking: ** Potentially Wikidata/WMDE: Mentioned 2 times in SoS already with no result: In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: [[phab:T128486]]. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get [[phab:T128486]] unstuck. **iOS ***release wikidiff2 to get section titles from compare endpoint ***counts endpoint limit increases ***minor count endpoint failing ( https://en.wikipedia.org/w/rest.php/v1/page/Barack_Obama/history/counts/min… ) * Updates: ** REST API extension interface documentation [[API:REST_API/Extensions]] === Engineering Productivity === ==== Release Engineering ==== * Blocking: ** SRE: Requesting follow-up from Releng team [[gerrit:479139]] * Updates: ** Train Health *** Last week: no train because of Wikimedia Technical Conference *** This week: no train because of team offsite *** Next week: 1.35.0-wmf.8 [[phab:T233856]] === Scoring Platform === * Blocking: ** SRE: Requesting follow-up from Scoring team [[phab:T233448#5638765]] * Updates: ** Team back from offsite in Austin ** We got a laptop to Uganda via DHL in a reasonable amount of time. === Search Platform === * Blocked by: ** Structured Data: Data dumps for SDC: [[phab:T221917]] * Blocking: ** WMDE/Wikidata: Not critically blocked by, but pinging the team to have a look at [[phab:T234431]]. * Updates: ** New elasticsearch servers configured and in production (elastic10[53-67].eqiad.wmnet) - [[phab:T230746]] ** Refactor Puppet WDQS module to make it usable for WDQS and CQS [[phab:T232297]] ** Metrics from the WDQS updater are no longer collected [[phab:T238408]] === Site Reliability Engineering === * Blocked by: ** Scoring Platform team: *** Requesting follow-up from Scoring team [[phab:T233448#5638765]] ** Releng: *** Requesting follow-up from Releng team [[gerrit:479139]] * Updates: ** [general update] Upcoming s1 (enwiki) database master switch 14 Nov: [[phab:T234800]] [will imply a small read only window] == Wikimedia DE == === Wikidata === * Blocked by: ** Search Platform: Not critically blocked by, but pinging the team to have a look at [[phab:T234431]]. ** Not sure who, Core Platform? Mentioned 2 times in SoS already with no result: In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: [[phab:T128486]]. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get [[phab:T128486]] unstuck. * Blocking: ** Structured Data: review of [[gerrit:548734]] ([[phab:T222497]])