https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-01
= 2018-08-01=
== Callouts ==
* SREs say FYI:
** Switchover tentative timeline announced. Please take a look and voice
concerns if any
Switchover:
Services: Tuesday, September 11th 2018 14:30 UTC
Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC
Traffic: Tuesday, September 11th 2018 19:00 UTC
Mediawiki: Wednesday, September 12th 2018: 14:00 UTC
Switchback:
Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on
Monday)
Mediawiki: Wednesday, October 10th 2018: 14:00 UTC
Services: Thursday, October 11th 2018 14:30 UTC
Media storage/Swift: Thursday, October 11th 2018 15:00 UTC
* MCR Schema migrations are happening
** Beta is set to write both / read new with no problems identified
** Production set to write both / read old this week
** Starting with migration scripts to copy data from old schema to new one
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by: -
* Blocking: -
* Updates:
**6.0 in beta (
https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/),
expected to push another beta this week
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Maintenance update released to Beta, will go to production tomorrow
(Thurs)
** User testing of navigation design prototypes will commence shortly.
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
** RFC: Modernise our JavaScript with the goal that the startup module and
mediawiki object should not depend on jQuery
https://phabricator.wikimedia.org/T200868
** Mobile website (MinervaNeue / MobileFrontend):
*** Page issues UI and instrumentation: T191532 T191303 T197932 T197931
T200867
*** Invest in the MobileFrontend & MinervaNeue frontend architecture:
T188261 T197133 T197639
*** Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066
T197110 T198151
** Product and design are collating research and interviews from Wikimania
and working on advanced contributions
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** mobile-html exposed but needs fixes for CSP header and a URL to CSS.
Won't run CollapseTable transform on server for the time being.
** Maps:
*** New tile regeneration cron job for low-zoom vector tiles
https://phabricator.wikimedia.org/T194787
*** Snapshot low DPI bug is waiting for a pull request review from upstream
on third party library https://phabricator.wikimedia.org/T152196
*** Working on migrating test servers to Cloud VPS
*** Working with SRE (Gehel) on migrating all servers to Debian Stretch
==== Multimedia ====
* No representative today - two team members on vacation and Mark has a
conflicting meeting
* Updates
** Breaking change in MediaWiki Core OOUI widget nearly caught us out -
luckily something else broke in the meantime so the related fatal never
occurred because of another fatal. Both fixed now.
** Search for SDC coming along slowly with various people on vacation.
** Next up: OOUI rendering for SDC first feature (captions), coming down
the pipeline soon™
** MCR rollout plan basically set, we'll need some time to sort out our
integration, but should all work out well.
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
**
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
**
==== Editing ====
* Blocked by: None
* Blocking: None
** Updates:
**Unblocked languages on previous issues.
**
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
==== Growth ====
* Blocked by:
* Blocking:
* Updates:
**
==== Language ====
* Blocked by:
** CX patches still blocked from merging due to test failures occuring in
Wikibase Lexeme
** Thanks to everyone who helped/are helping to solve issues (4 separate
ones) that prevent merging patches to CX&Translate
* Blocking:
** Providing guidance on https://phabricator.wikimedia.org/T195910 (ios app
language selection related issue)
* Updates:
** Grant Metrics enabled for translation in translatewiki.net
** Niklas will work on https://phabricator.wikimedia.org/T195293 (follow-ups
to an issue causing an outage a while ago)
=== Audiences Design ===
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
** Preparation of OOUI v0.27.6
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
** Outage in Eventlogging
* Updates:
** Added data quality checks in mediawiki history and mediawiki history
reduced datasets
** Cleaning of user directories in hadoop
** Improved data sanitization in Eventlogging (salt creation/rotation)
** Improved partition cleaning in hive
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** Making our exchange rates available on a WMF-visible spreadsheet for
travel reimbursement
** Work continues on the ingress scripts for EventLogging data from banner
and landing page impressions
** Experimenting with different ways to let donors from certain countries
opt in to emails
** CiviCRM: new search filters, looking at mailing house data import bug
and data erasure requests
** Reviewing CiviCRM core team code for contact view editor
** More error-handling work prompted by full-scale tests of card
processor's new API
=== MediaWiki Core Platform ===
* Blocked by:
* Blocking:
* Updates:
** Cherry-picked API statsd improvement into production. Updated API
dashboard in Grafana.
***
https://grafana.wikimedia.org/dashboard/db/api-backend-summary?refresh=5m&o…
** Platform Evolution kick-offs and TechConf prep are ongoing
** Language variants for summary REST API deployed - Page Previews will now
show your preferred variant
*** Only serbian language is supported now, but more will be added as
Parsoid supports more conversions
** Memory issues with EventStreams service in codfw affected other
services, now resolved.
== Multi-Content Revisions ==
* Blocked by:
* Blocking:
* Updates:
** MCR Schema migrations are happening
*** Beta is set to write both / read new with no problems identified
*** Production set to write both / read old this week
*** Starting with migration scripts to copy data from old schema to new one
** Discussion on-going on whether a production test wiki is necessary in
addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616
*** Requires Wikibase change propagation
** Development and code review continues
=== Performance ===
* Blocked by:
**
* Blocking:
**
* Updates:
**
=== Release Engineering ===
* Blocked by:
** Related to 1.32.0-wmf.14 train
https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#A…
*** Feedback needed from Wikidata team on how T200340
(*Wikibase\DataModel\Entity\EntityIdParsingException
$serialization must not be an empty string*) could be prevented.
*** Feedback needed from Readers/Performance team(s) on how T200346 (*wmf.14
failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run:
HTTP request failure"*) could be prevented.
*** Feedback needed from ORES/Wikidata team(s) on how T200412 (*PageTriage
requires ORES to be installed*) could be prevented.
*** Feedback needed from Wikidata team on how T200420 (*Wikidata
dispatching stuck (not releasing lockmanager locks)*) could be prevented.
*** Feedback needed from Readers team on how T200456 (*MapCacheLRU::has
called with invalid key. Must be string or integer*) could be prevented.
* Blocking:
* Updates:
** Moved the beta deployment server to deployment-deploy01, yell if
anything seems amiss there
=== Research ===
* Blocked by: None
* Blocking: None
* Updates:
** We've been analyzing the Citation usage data and improving the schema.
- https://phabricator.wikimedia.org/T199457
** Working on recommending missing articles based on translation pageview
predictions.
** Have been interviewing candidates for a research position.
=== Scoring Platform ===
* Blocked by:
** Waiting for a TechCom review of JADE proposal for deployment.
*** Trying to get Global Collaboration's attention about this.
*** "Everything is a wiki page", yet we're not allowed to deploy an
extension that might increase the number of wiki pages... Who will be
blocked next?
* Blocking:
* Updates:
** GSoC project by Saurabh Batra to identify donations fraud has resulted
in a successful model! We're beginning integration work now.
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
** Lexeme fulltext search merged: https://phabricator.wikimedia.org/T196188
** Started collecting click stats for Wikidata completion search:
https://phabricator.wikimedia.org/T196186
** Quality constraints violations are now in WDQS:
https://phabricator.wikimedia.org/T172380
** Fixed intitle search not matching stopwords:
https://phabricator.wikimedia.org/T68969
** Fixed problems in completion search on shard failure:
https://phabricator.wikimedia.org/T180807
** Added task to purge query click data according to privacy policy:
https://phabricator.wikimedia.org/T189845
** Working on running multiple Elastic instances on the same hardware:
https://phabricator.wikimedia.org/T193654
** Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960
** Working on Esperanto analyzer: https://phabricator.wikimedia.org/T200099
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
=== Security ===
* Blocked by:
* Blocking:
* Updates:
**
=== Site Reliability Engineering ===
* Blocked by:
** None
* Blocking:
** None
* Updates:
** eqiad row B and C upgrades went quite fine with some minor hiccups
** work on the switchover preparation ongoing. Tentative timeline posted.
Take a look at calls out section
== Wikidata ==
* Blocked by:
* Blocking:
** ContentTranslation CI red because of failing Wikidata-related tests:
https://phabricator.wikimedia.org/T200693
*** working on understanding and fixing failures
* Updates:
** Work in Lexicographical data continues:
*** adding senses
*** improving the editor workflow
*** https://phabricator.wikimedia.org/project/view/2292/
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
**
== SoS Meeting Bookkeeping ==
* Updates:
** move the meeting to 2 hours earlier as soon as week of 2018-08-06- look
for new invite!
** some changes to the notes template
** keep the meeting as is- a forum for teams to share updates and ask for
help and keep the notes as useful as possible
** decision to handle goals dependencies outside this meeting
why is it that the excellent player is available on the standard wikipedia
view, and not on mobile view? is this just my configuration? as eyample:
* https://en.wikipedia.org/wiki/Polar_orbit
* https://en.m.wikipedia.org/wiki/Polar_orbit
the effect is that my mobile can play the standard view video, but not the
mobile view video.
rupert
Hi All!
There are new deployment servers in beta cluster: deployment-deploy01
and deployment-deploy02.
These servers replace deployment-tin and deployment-mira (which I just
shut down today).
If you had a home directory on either deployment-tin or deployment-mira
I've moved it to the new machines at:
deployment-deploy01:~/deployment-tin-home
deployment-deploy02:~/deployment-mira-home
If you see anything amiss that you feel may be a result of this move,
please file a task on phab or find me on IRC.
Thanks to Daniel Zahn and Alex Monk for all their work on this task!
Thanks!
-- Tyler
Hi,
today, I noticed that I was getting API warnings in WPCleaner for each call
to API query/revisions :
revisions - Because "rvslots" was not specified, a legacy format has been
used for the output. This format is deprecated, and in the future the new
format will always be used.
This rvslots is not documented on API:Revisions and I don't find an email
mentionning a compatibility problem on this subject.
I tried the API Sandbox, but the documentation for rvslots is cryptic for
me : " Which revision slots to return data for, when slot-related
properties are included in rvprops. If omitted, data from the main slot
will be returned in a backwards-compatible format."
Any understandable explanation on this parameter and what value should I
put, and what difference should I expect in the result ?
Thanks
Nico
*# Vocarnival*
The Vocabulary Carnival (Vocarnival) at SEMANTiCS 2018 is a unique
opportunity for vocabulary publishers to showcase and share their work,
meet the growing community of vocabulary publishers and users, and build
useful semantic, technical and social links. The Vocarnival forms part
of the SEMANTiCS programme with the Carnival Minute Madness and the
marketplace.
*Which are the expected vocabulary types? *
All types! A very wide vocabulary definition applies to this
competition, including ontologies, classifications, thesauri, concept
and metadata schemes, independently of their format, be it RDF or not.
*When is the submission deadline?*
The submission deadline is set for September 3, 2018, 23:30 CET time.
Get familiar with the technical requirements and the presentation format
for your vocabulary submission. Afterwards, follow the steps below and
get honored by a special prize if you have one of the best three
posters. The winners will be announced during the respective Vocarnival
Session at SEMANTiCS 2018. Please find all information here:
_https://2018.semantics.cc/vocabulary-carnival_
*How to submit your Vocabulary to the Carnival? *
*Step 1:*Make sure your vocabulary is accessible on the Web via a public
URI.
*Step 2:*Submit your vocabulary here:
_https://2018.semantics.cc/submit-vocabulary-vocarnival_
*Step 3:*Register to SEMANTiCS 2018: _https://2018.semantics.cc/prices_
*Step 4:*Every poster will be presented in our exhibition area. The
organising committee will select the best vocabulary poster and
presentation for the awards.
*# DBpedia Day - Call for Participation*
At the beginning of SEMANTiCS 2018, the DBpedia Community will get
together on the**10th of September for the DBpedia Day. Besides the
following highlights, we want you to be a part of the day by telling us
what cool things you do with DBpedia. Submit your proposal in our form:
_https://goo.gl/forms/ngRWCjgH9ocDCrEb2_!
*Highlights*
- Keynote #1: Dealing with Open Domain Data by Mathieu d’Aquin (NUI Galway)
- Keynote #2: Linked Open Data cloud - act now before it’s too late by
Javier Fernández García (WU Wien)
- DBpedia Association hour
- DBpedia Chapter Session
*Important Facts*
- Web URL: _http://wiki.dbpedia.org/meetings/Vienna2018_
- When: September 10th, 2018
- Where: Gußhaus Campus of Vienna's Technical University, Gußhausstraße
27-29, 1040 Vienna, Austria
- Call for Contribution: Submit your proposal in our form
_https://goo.gl/forms/ngRWCjgH9ocDCrEb2_
- Attending the DBpedia Community Meeting costs €50 (excl. registration
fee and VAT). DBpedia members get free admission, please contact your
nearest DBpedia chapter or the _DBpedia Association_
<mailto:holze@infai.org>for a promotion code.
/We are looking forward to your contributions and to seeing you at the
SEMANTiCS in Vienna! /
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Hi,
MediaWiki core patches will now need to pass tests on postgres and
sqlite (in addition to mysql of course) to be merged. For speed, CI
won't run postgres/sqlite tests until after the patch has been +2'd
(gate-and-submit queue). If you want to run them manually to debug a
failure, you can comment "check sqlite" or "check postgres".
Note that not all tests are passing under postgres/sqlite yet, we just
disabled the remaining failing ones temporarily so these jobs could be
enabled to prevent regressions. [1] tracks SQLite failures, and [2]
for Postgres. [3] should find both :) Help definitely appreciated from
people familiar with either DBMS to help fix the remaining test failures
!
[1] https://phabricator.wikimedia.org/T191035
[2] https://phabricator.wikimedia.org/T195807
[3]
https://codesearch.wmflabs.org/core/?q=fails%20under%20(postgres%7Csqlit
e)&i=nope&files=tests%2Fphpunit&repos=
- -- Legoktm
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAltiRfYACgkQUvyOe+23
/KLbxQ/+Nb+7WvF89Q5aIegYZhwIppG6cJAoEwU0zHtKSaUl4nOfCDnC7FnBnuni
pgeixj9bF2T+pcR0nXZ1mchLtihWo8yercD5uDcRXjrPxaFduKRQonGLMDrzZsY7
18HRxeZ/QwjNDCnW6I+ITUbEkLwGT/4OtSqPfkUjOmAprePWXgu5hj2W6X91HMnm
Lh0qeab/avAe1aEktoNJd96Xhwo1imr7xbeefHXZcrD3CICRFGKkwK/FCdIBHrtR
lzxgmPS+C1VAV3Hy4w+/QUZHCXrJ7v0i696TblC+bg+EWQ/2m4g1C3PbgzLPhJ0J
LPQkrOk5fmuftBbkIIDvBh+12a0c3ImUVPi9g4oqZ643+qIw3uAHlBl+FwoN7Tat
By+UAlCUMyEm8uUj40cpIWkktP+D1tBOA2Ogb4XdYDcuoLvzw/Oh5JY3twp9Vj3A
Y2Fc3uuJEemJc4vRt4Xb4mGw7ZvoxXH7G90ZYAostUmS2ubv4IAy0suWDU87WyQK
4jf4vohPQkaASJr5AazZGyhsFbvJDiA3PXahguFPdXnF4NTJDB+oSmZKzz7yh0qv
Gij08lx2wH/DTP+qRuYaocdHygojU8hXMhyp2DK3HbWZGPVQdNhzOp/KS2uNpimB
KK8nb2BzNUFU0cE9tIOowzZdQSjAc3eQX5GM+LVnSDDsew50SFU=
=BEXH
-----END PGP SIGNATURE-----
Hi Community Metrics team,
This is your automatic monthly Phabricator statistics mail.
Accounts created in (2018-07): 293
Active Maniphest users (any activity) in (2018-07): 912
Task authors in (2018-07): 473
Users who have closed tasks in (2018-07): 325
Projects which had at least one task moved from one column to another on
their workboard in (2018-07): 294
Tasks created in (2018-07): 2315
Tasks closed in (2018-07): 4020
Open and stalled tasks in total: 38936
Median age in days of open tasks by priority:
Unbreak now: 6
Needs Triage: 420
High: 738
Normal: 965
Low: 1261
Lowest: 1222
(How long tasks have been open, not how long they have had that priority)
Active Differential users (any activity) in (2018-07): 21
TODO: Numbers which refer to closed tasks might not be correct, as
described in https://phabricator.wikimedia.org/T1003 .
Yours sincerely,
Fab Rick Aytor
(via community_metrics.sh on phab1001 at Wed Aug 1 09:39:50 UTC 2018)
Hi Community Metrics team,
This is your automatic monthly Phabricator statistics mail.
Accounts created in (2018-07):
Active Maniphest users (any activity) in (2018-07):
Task authors in (2018-07):
Users who have closed tasks in (2018-07):
Projects which had at least one task moved from one column to another on
their workboard in (2018-07):
Tasks created in (2018-07):
Tasks closed in (2018-07):
Open and stalled tasks in total:
Median age in days of open tasks by priority:
Unbreak now: 0
Needs Triage: 17744
High: 17744
Normal: 17744
Low: 17744
Lowest: 17744
(How long tasks have been open, not how long they have had that priority)
Active Differential users (any activity) in (2018-07):
TODO: Numbers which refer to closed tasks might not be correct, as
described in https://phabricator.wikimedia.org/T1003 .
Yours sincerely,
Fab Rick Aytor
(via community_metrics.sh on phab1001 at Wed Aug 1 00:00:01 UTC 2018)
In the TechCom committee meeting yesterday, it was decided that next
week's RFC meeting will discuss T198256 "Modern Event Platform -
Choose Schema Tech"
https://phabricator.wikimedia.org/T198256
This relates to the choice between Avro and JSONSchema for the next
iteration of EventLogging.
The meeting will be at 1pm Wednesday PST in #wikimedia-office.
-- Tim Starling