https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-04-25
==2018-04-25 ==
== Callouts ==
* Fundraising campaigns
https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up:
Netherlands 2018-04-03 through 2018-05-01
* RelEng could use some help to get rebuildLocalisationCache.php back
up-to-normal speed -- if you have experience with hhvm
internals/cli-options:
https://phabricator.wikimedia.org/T191921
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
**Released 5.8 with Reading Lists, now working on a point release (
https://phabricator.wikimedia.org/tag/ios-app-v5.8.1-manatee-on-a-scootscoo…)
**Joe to return next week (4/30)
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Released Reading list syncing!
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
**Page previews enwiki launch
**Post-launch page preview bug fixes and clean up
https://phabricator.wikimedia.org/T192622
**Starting page issues work
https://phabricator.wikimedia.org/T159262
**Planning for MobileFrontend & MinervaNeue frontend architecture
improvements
https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro…
**Fixing mobile watchlist bugs
https://phabricator.wikimedia.org/T191454
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
https://phabricator.wikimedia.org/T181079
*** Reading Web depends on SRE, RelEng, Reading Infra
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** CSS endpoints rolled out (
https://en.wikipedia.org/api/rest_v1/#!/Mobile/get_data_css_mobile_site)
** Added Bosnian Wikipedia to supported wikis for featured article,
In-the-news, and On-This-Day
** Working on simplistic browser extension to add the current page to the
default reading list (for logged in users)
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
https://phabricator.wikimedia.org/T181079
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
***Reading Infra depends on Parsing, Services
===== Maps =====
* Blocked by: None
* Blocking: None
* Updates:
** Work being done by collab team
** Paul is out next scrum of scrums
*==== Multimedia ====*
* Updates
**Wikibase patches for file page prototype going through
** Search work continuing for 'depicts'
** File captions - currently working through changing the name of the field
for MediaInfo
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare
for launch of the first Structured Data on Commons feature (multilingual
file captions)
***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- T171252
***Research depends on Multimedia
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
** Just like last week: GlobalPreferences, CodeMirror, TemplateWizard
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking: None
* Updates: None
** Updating Block Notices on Mobile
https://phabricator.wikimedia.org/T165535
** Adding Cookie Blocking to IP Users
https://phabricator.wikimedia.org/T152462
==== Editing ====
* Blocked by:
* Blocking:
** Updates:
**
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
** We are considering removing newline stripping in image captions. See
https://gerrit.wikimedia.org/r/#/c/425726/
** In
https://phabricator.wikimedia.org/T192037 we are beginning to make
wikitext handling a bit more uniform across extensions and outside
extensions, so there are fewer surprises / edge cases. That is yet to be
flushed out, but is an advance heads up.
** Tidy removal is going apace -- another 40+ wikis will switch next week.
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing depends on MediaWiki Platform, Services
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server]]
Increase code sharing of client apps by coalescing and moving more logic to
the server.
*** Reading Infra depends on Parsing, Services
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling phab task ?
*** Services depends on SRE, Parsing
==== Collaboration ====
* Blocked by:
* Blocking:
* Updates:
** Localized maps deployed on testwiki and test2wiki, announcement coming
soon
*** Test page:
https://test2.wikipedia.org/wiki/Map_internationalization_examples
** Going to deploy <mapframe> to English Wikipedia on April 30th
https://phabricator.wikimedia.org/T191584
==== Language ====
* Blocked by: None
* Blocking: None
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.1]] Improve and consolidate our unified editing platform so that it's
great on all devices
***Language depends on Editing
=== Audiences Design ===
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
** OOUI – v0.26.5 released:
https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v…
*** 5 style changes, 5 code improvements. Among those
**** De-emphasize toolgroup borders in order to visually de-clutter VE
toolbar
**** PopupTool: Set active state depending on whether popup is open, again
a change with visual impact, providing better user-friendliness
**** Toolbar: Put all popups (from PopupToolGroup and PopupTool) into an
overlay.
https://phabricator.wikimedia.org/T192505
** DateTimeInputWidget has been aligned to other WikimediaUI widgets
https://phabricator.wikimedia.org/T189352
** Style Guide technical and content improvements ongoing with 6 open PRs
currently
** Transparency Report now fully conformant to WCAG 2.0 level AA
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** Wikistats outage: bad data load led to a couple of days of unstable
data, found the problems and rolled back, will update again soon, numbers
are good now but missing 2018-03
** Wikistats is a little more mobile touch friendly, hover interaction a
little better in general
** Wikistats titles and meta tags are now more SEO-friendly
** Spark 2 is now the default spark experience on the cluster
** lots of prep work for the Kafka cluster upgrade, already started
updating some of the machines, monitoring, etc.
** page preview aggregate data is available now in a Hive table
** fixed wmf.mediawiki_user_history and wmf.mediawiki_page_history tables
(they had bad column names which led to null values)
** fixed pagecounts-ez and mediacounts datasets outage problem
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
**DonationInterface: new recurring contribution API for main card processor
**CiviCRM: Debugging nasty transaction handling failures
** Working on getting landing page and banner impression EventLogging data
into payments cluster DBs
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions) phab
task ?
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]
Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
=== Performance ===
* Blocked by:
**None
* Blocking:
**None
* Updates:
**Good progress consolidating our tools, getting them out of puppet
** Rolling out a tool called PerformanceInspector over the next couple of
weeks -- will allow community members to get a bunch of performance data
about pages on the wikis
** Doing some optimizations of ResourceLoader
** Making some fixes to MW Core to prep for PHP7
** Refactoring Varnish logging stuff to use mtail instead of a couple of
deprecated varnish tools
** mcrouter is now being used in deployment-prep
** WebPageTest fully migrated over to Linux hosts
=== Release Engineering ===
* Blocked by:
** rebuildLocalisationCache.php/localization update rebuilds are taking 40
minutes for full scaps (used to take 8minutes)
*** See:
https://phabricator.wikimedia.org/T191921 if you have hhvm
internals help to give :)
* Blocking:
** none?
* Updates:
** 1.32.0-wmf.1 is going out this week, wmf.30 was finally completed Monday
** Scap MediaWiki canary changes using service-check (hopefully live Soon™,
working in beta)
*Quarterly goal dependency update:
** No updates from us (if something specific needed from us, ping us!)
[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
https://phabricator.wikimedia.org/T181079
*** Reading Web depends on SRE, RelEng, Reading Infra
=== Research ===
* Blocked by: None
* Blocking: None
* Updates:
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions) phab
task ?
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment
4, Outcome 2]]: Develop a better understanding of existing needs for
Structured Commons- [[phab:T171252|T171252]]
***Research depends on Multimedia
** Most of the teams is at the Web Conference
https://www2018.thewebconf.org/
=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
** New analysis plugin deployed:
https://phabricator.wikimedia.org/T189239 enabling
Serbian and in the future other stemmers
** Solvak stemmer added, deploy & reindexing next:
https://phabricator.wikimedia.org/T190815
** Some fixes for deep category search:
https://phabricator.wikimedia.org/T192270,
https://phabricator.wikimedia.org/T188350
** Wikibase Lexeme search patches merged
** Internal WDQS cluster installed, switching traffic to it soon:
https://phabricator.wikimedia.org/T192942
** Working on indexing external IDs and string properties for Wikibase:
https://phabricator.wikimedia.org/T99899
** Evaluating feature generation by `query_explorer` functionality of LTR
plugin:
https://phabricator.wikimedia.org/T187148
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
** WDQS GUI automatic build moving along, thanks RelEng:
https://phabricator.wikimedia.org/T189811
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions) phab
task ?
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]]
Integrate structured file captions into search
*** SDC depends on Search Platform, Multimedia
=== Security ===
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]]: Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
=== Services ===
* Blocked by: Several job serialization tasks, will talk to owners of the
said jobs
* Blocking: none
* Updates:
** Enabled support for EventBus and kafka job queue for private wikis
** Replaced SSDs on restbase1010, rebootstrapped cassandra there
** CSS endpoint for reading infra deployed
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of
client apps by coalescing and moving more logic to the server.]]
***Reading Infra/Parsing, Services
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal
3.6]] Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
***Parsing depends on MediaWiki Platform, Services
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling phab task ?
*** Services depends on SRE, Parsing
=== Site Reliability Engineering ===
* Blocked by:
** None
* Blocking:
** None
* Updates:
** Have a look at
https://blog.wikimedia.org/2018/04/24/new-data-center-singapore/
** Work on getting proton up (QR goal for Reading Web) and running started
https://phabricator.wikimedia.org/T192983
*Quarterly goal dependency update:
**[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome
1, Objective 4]]: Continue improving the ways that users can download
articles of interest for later consumption
https://phabricator.wikimedia.org/T181079
*** Reading Web depends on SRE, RelEng, Reading Infra
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions)
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
[[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better
data|Outcome 2: Objective 1]]: Revision storage scaling phab task ?
*** Services depends on SRE, Parsing
== Wikidata ==
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the
first Structured Data on Commons feature]] (multilingual file captions) phab
task ?
***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki
Platform, Research
**[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist
with deploying MultiContent Revisions on Commons
[[phab:T174022|T174022]] Implement multi-content revisions,
[[phab:T174023|T174023]] Implement MCR storage layer,
[[phab:T174045|T174045]] DB schema migration for MCR,
[[phab:T174044|T174044]] Deploy MCR storage layer,
[[phab:T174043|T174043]]Deploy Multi-Content Revisions
***SDC depends on MediaWiki Platform, WMDE
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
** ICU 57 migration done
** Appservers are being reimaged to Debian Stretch
**
== SoS Meeting Bookkeeping ==
* Updates:
**Request from SRE: Please either add phab tasks to all goals so that work
can be tracked and updates can be made in a meaningful way even across
large and diverse teams, or let's just drop the quarterly goal dependency
updates.