*https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-11-29 https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-11-29*

*= 2017-11-29=* == Callouts == * Reminder! This is your last few weeks of deployments for the year/quarter! Deployment freeze starts the week of December 18th. * Reminder! This is also the first week of the big fundraising campaign. Please be extra careful not to break CentralNotice (js/skin changes, resourceloader changes) or donate.wikimedia.org. * s8 replica set of servers for wikidata (T177208) to be live on 9th January- check scripts/config that assume wikidata is on s5!). We will have a small period of read only that day. * databases no longer guaranteed to be on port 3306 only (T178359)- check also scripts that assume default/no port (should be transparent for most people) * Your performance metrics (esp first paint) may have changed on Nov 2nd. This is due to a bug in our performance monitoring that we fixed on that day. * Please provide feedback on WikimediaUI (OOUI) icon overhaul at https://phabricator.wikimedia.org/M229 – plan to settle on set by next week * Last name of thiemowmde changed, can I get an LDAP update? https://phabricator.wikimedia.org/T181130 * Special:Preferences was migrated to OOjs UI in wmf.10 (this week's train), this changes the prefs UI substantially

== Audiences == === Readers ===

==== iOS native app ==== * Blocked by: * Blocking: * Updates: still working on 5.8 https://phabricator.wikimedia.org/project/view/2913/

==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** working on Reading Lists performance ** continuing work on media, summary, and references endpoints ** considering undeploying trending-edits service https://phabricator.wikimedia.org/T180384

==== Web ==== * Blocked by: * Blocking: * Updates: ** Business as usual (Chromium-based PDF service)! Next up: Performance https://phabricator.wikimedia.org/T178278 ** Started work on updating/tidying the design of special pages on mobile: https://phabricator.wikimedia.org/T169162

==== Multimedia ==== * Blocked by: N/A * Blocking: N/A * Updates ** MP3 uploads enabled Soon™ on Commons ** 3D product nearly ship-ready, heads-up for deploy coming at some point ** Wikibase/MediaInfo work for SDoC is progressing slowly

===== Maps ===== * Blocked by: None * Blocking: None * Updates: ** Ops person back this week

===== Discovery ===== * Blocked by: None * Blocking: None * Updates: ** automated Jenkins build for wikipedia.org portal working well ** updating documentation

=== Contributors ===

==== Global Collaboration ==== * Blocked by: nobody * Blocking: ops for Flow dumps (talked to Ariel and came to an agreement, but didn't have time to work on it last week with the holidays) * Updates: ** RCFilters "live update" graduating out of beta in this week's train ** On behalf of Editing: Special:Preferences migration to OOjs UI in this week's train, UI of Special:Preferences will change substantially

==== Parsing ==== * <section> tag code being tested. ** Code in beta cluster. ** Some fixes in progress based on tests. Unlikely to be deployed this week, unless we get everything merged and tested today.

=== Community Tech === * Blocked by TechCom on global preferences * Not blocking * Our wishlist survey is in voting stage

==== UI Standardization ==== * Blocked: icons overhaul, pls see below. New iteration got out end of second-last week, plan to settle by end of week – pls provide feedback ** OOUI v0.24.3 released https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0...; among changes: 7 new features, among those: *** Allow adding virtual viewport spacing (Bartosz Dziewoński) *** DropdownInputWidget: Generate a hidden `<select>` in JS (Bartosz Dziewoński), *** MenuSelectWidget, PopupWidget: Automatically change popup direction if there is no space (Bartosz Dziewoński) 4 design fixes and removing Opera < 15 special treatment * Ongoing: ** OOUI & based products: *** icons: Work on icon set to be more harmonious and align to WikimediaUI Style Guide https://phabricator.wikimedia.org/T177432

- Provide specific feedback at https://phabricator.wikimedia.org/M229

*** Make Special:Preferences use OOUI – related UI/UX amendments https://phabricator.wikimedia.org/T180538 ** Unify SVG markup across Foundation products https://phabricator.wikimedia.org/T178867

== Technology ==

==== Analytics ==== * Blocked by: * Blocking: * Updates: ** Wikistats vetting almost complete, announcing next week ** Prometheus driven metrics on druid - https://grafana.wikimedia.org/dashboard/db/prometheus-druid?orgId=1 ** Working on jsonrefine on eventlogging so eventlogging data that was up to now only available on MYSQL is available on Hadoop ** Productionising Superset ** Data on eventlogging slave back in compliance with privacy policy, master data still being worked on.

==== Services ==== * Not attending personally * Blockers: none * Updates: ** Still reshaping cassandra cluster to migrate to Cassandra 3 ** wikibase-addUsagesForPage job switched to kafka queue

=== Performance === * Blocking * Blocked * Updates ** Callout above re: performance metrics changing on Nov 2nd. ** Working with Mozilla on some perf regressions related to FF57 ** Working on identifying some issues related to Chrome 62

=== Release Engineering === * Blocking ** * Blocked ** [SSD] blocked on ops updating nodejs-devel base image: < https://phabricator.wikimedia.org/T180524%3E * Updates ** [MW Train] Reminder! This is your last few weeks of deployments for the year/quarter! No non-emergency deploys starts the week of December 18th. ** [MW Train] The post mortem for T181006 (Watchlist and RecentChanges failure due to ORES on frwiki and ruwiki) is scheduled for December 7th. ** [nodejs browser tests] CirrusSearch and Mobile are active with migrations. ** [nodejs browser tests] Investigation of using mwbot instead of nodemw (javascript api interfaces to MW). CirrusSearch uses mwbot. We use nodemw (maintained by a Wikia engineer). ** [ruby] We will upgrade rubocop (Ruby linter/static analyzer) across the corpus of extensions due to a security issue (pointed out by the new Github security issue notification service). We (WMF production and CI) are not affected by the issue AND we have officially deprecated our ruby browser test stack (where 99% of all rubocup uses/dependencies are) BUT we’ll do it :) ** [techdebt] Wider conversations regarding SLAs/stewardship of components/software: *https://www.mediawiki.org/wiki/Talk:Development_policy/Code_Stewardship* https://www.mediawiki.org/wiki/Talk:Development_policy/Code_Stewardship ** [techdebt] 2nd of the 3 tech debt series of blog posts (after the 0th introduction one on Code Health) is in drafting. ** [CI] We’ve migrated almost all of the tox (python) jobs to the new container based CI infra.

=== Scoring Platform === * Blocked by: ** scap and network issues preventing us from continuing to test new ORES cluster. *** https://phabricator.wikimedia.org/T181552 *** https://phabricator.wikimedia.org/T181661 * Blocking: * Updates: ** We've been having fun with heavy outages for the last day, seems to have been stabilized a few hours ago. *** https://phabricator.wikimedia.org/T181538

=== Search Platform === * Blocked by: none * Blocking: none * Updates: * Merged WIkidata description indexing, starting reindex after deploy * Finished review of Serbian morphological libraries, some promise but needs bugfixes https://phabricator.wikimedia.org/T178926#3790458 * Working on improvements to LTR training https://phabricator.wikimedia.org/T177520 * Improving completion suggester interaction with namespaced prefix search https://phabricator.wikimedia.org/T178474 * Working on porting Selenium tests from Ruby to JS * Working on upgrade to Elastic 5.5 * Working on Wikidata fulltext search

=== Technical Operations === * Blocking ** [Releng] blocked on ops updating nodejs-devel base image: < https://phabricator.wikimedia.org/T180524%3E * Blocked ** * Updates ** s8 replica set of servers for wikidata ( https://phabricator.wikimedia.org/T177208 ) to be live on 9th January- check scripts/config that assume wikidata is on s5!). We will have a small period of read only that day. ** databases no longer guaranteed to be on port 3306 only ( https://phabricator.wikimedia.org/T178359 )- check also scripts that assume default/no port (should be transparent for most people) ** service-running was spamming statsd, incident report https://wikitech.wikimedia.org/wiki/Incident_documentation/20171125-statsd

== Wikidata == * Fiddling with the concept of "sub-entities" in the Wikibase storage layer: https://phabricator.wikimedia.org/T163724 * We are aware of the blocker for the MediaInfo team, planning to tackle it this week: https://phabricator.wikimedia.org/T177022 * Last name of thiemowmde changed, can I get an LDAP update? https://phabricator.wikimedia.org/T181130

=== Fundraising Tech === * Banners are up! Watching the money roll in * Mostly working on visualizations - our funky internal dashboard and more data for grafana * Helping fr-not-tech get good info, debugging campaign configuration * Deployed one low-level CiviCRM thing to deal better with database contention

=== MediaWiki Platform === * Continuing on schema changes for MCR, etc...