https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-29
= *2018-08-29* =
== Callouts ==
* SRE:
Switchover/Switchback dates reminder. It's in 2 Weeks.
Services: Tuesday, September 11th 2018 14:30 UTC
Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC
Traffic: Tuesday, September 11th 2018 19:00 UTC
MediaWiki: Wednesday, September 12th 2018: 14:00 UTC
Switchback:
Traffic: Wednesday, October 10th 2018 09:00 UTC
MediaWiki: Wednesday, October 10th 2018: 14:00 UTC
Services: Thursday, October 11th 2018 14:30 UTC
Media storage/Swift: Thursday, October 11th 2018 15:00 UTC
IMPORTANT: For the duration of the switchover (1 month), please refrain
from large db schema changes and please avoid deploying any kind of new
feature that requires creation of tables.
IMPORTANT: There will be a train freeze in the week of Sept 10th and Oct
8th.
* Fundraising campaigns
*https://meta.wikimedia.org/wiki/CentralNotice/Calendar*
<https://meta.wikimedia.org/wiki/CentralNotice/Calendar>
* From RI: help wanted with https://phabricator.wikimedia.org/T203029 from
those who know about Dashiki
- [nuria] Dashiki just uses the files that are now not rendering from
meta, it is really a seprate system that consumes those files
* wp10 models in ORES API are renamed to articlequality, if you're using
this model, please change
* Wikidata would appreciate input/decision on way forward with two patches
in MW core, related to testing (thanks to Anotine and Timo for input so far)
** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/455176/
** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/446543/
== Audiences ==
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
**
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
** Continue work on Partial Blocking (Goal is to have a MVP ready by the
end of the sprint)
** Analytics on Harassment cases on A/NI
==== Editing ====
* Blocked by:
* Blocking:
** Updates:
**Improving event logging for better data analysis
**Mobile bug fixes to improve editing experience
==== Growth ====
* Blocked by:
* Blocking:
* Updates:
**
==== Language ====
* Blocked by: None
* Blocking: None
* Updates:
** Work on ContentTranslation version 2 continues.
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
**
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Finished polling Echo notifications (limited to certain types of
notifications initially)
** Waiting on user testing of navigation prototypes.
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
**
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** Bernd out rest of week, no PCS updates
** Maps:
*** Working on setting up map tile invalidation on resource change (via
ChangeProp)
*** maps-test cluster to be decommissioned; production maps cluster to be
updated to Stretch
** JsonConfig bug affecting Dashiki config pages on meta.wikimedia.org,
should be fixed but isn't. Help wanted!
https://phabricator.wikimedia.org/T203029
***
https://gerrit.wikimedia.org/r/c/mediawiki/extensions/JsonConfig/+/455868 fixed
the issue on zero.wikimedia.org (https://phabricator.wikimedia.org/T203006 ),
but not for Dashiki config pages
==== Parsing ====
* Blocked by: None
* Blocking: None, coordinating with VE on several updates such as
audio/video elements
* Updates: Offsite upcoming on 9/10-9/15
Continuing porting TokenTansformers subsystem to PHP as part of overall php
port
==== Multimedia ====
* Blocked by:
* Blocking:
* Updates
** SDoC: multi-lingual captions display and edit on File page
** SDoC: prototyping depicts search almost complete
** SDoC: design artwork
==== UI Standardization ====
* Blocked by:
* Blocking:
* Updates:
**
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** Updating privacy policy of wikistats2 and other sites like
http://analytics.wikimedia.org to the new non-wiki policy per Legal’s
request.
** Working with performance on making eventlogging a lot more limber so it
can be included in every page:
https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventLogging/+/4534…
** Changed all random identifiers in mediawiki codebase to have more
entropy, from 64 to 80 bits. This benefits eventlogging but also it is used
widely on mediawiki client code.:
https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/454460/
** Integrating archiva (java libraries dependency management depot) with
LDAP.
**Moving all our analytics infrastructure to Debian Stretch. Along the
way, we will be moving (superset|turnilo|yarn|hue).wikimedia.org to new VMs
and upgrading them.
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** More testing and bug fixes on main CC processor's new API integration
** CiviCRM UI enhancements
** Donor data export/erase bug fixes
** Testing new pipeline to get banner and landing page impressions into
fundraising DBs
** Testing stretch and PHP7 to unblock payments mediawiki LTS upgrade
** Getting started on hiring another fr-tech
=== MediaWiki Core Platform ===
* Blocked by:
* Blocking:
* Updates:
** Platform Evolution: summarizing stakeholder input to cluster themes for
Tech Conf
** Requirements gathering and discussion for storage component
** More work on deploying the phan security check (aka phan-taint-check) to
more extensions
** Porting poolcounterd tests to Python (gerrit:455385)
** LinksUpdate failure on replag (phab:T201482)
** EU copyright landing page
=== Performance ===
* Blocked by:
**
* Blocking:
**
* Updates:
** mcrouter broadcast now live (deletes go to both data centers)
** Thought we had made the world much faster by removing a ResourceLoader
round trip, but then realized that we'd accidentally gamed our numbers.
Still evaluating the actual improvement.
** Gilles is back from vacation, and cranking through Thumbor bugs
** Testing "hero images" timings.
=== Release Engineering ===
* Blocked by:
** Noise from https://phabricator.wikimedia.org/T201082 during Train
deployment (not really blocked but distracted)
** Block the CI migration to Quibble / off of Nodepool
*** MediaWiki team: "[TrustedXFF] on fresh install trusted-xff.cdb is
missing and User::getDefaultOptions() cause a fatal"
https://phabricator.wikimedia.org/T198120
*** MediaWiki team: "[ReadingLists] No registered builder available for
ReadingLists." https://phabricator.wikimedia.org/T196567
*** WMDE or a Qunit/JavaScript guru: ArticlePlaceholder should use
MediaWiki qunit runner https://phabricator.wikimedia.org/T180171
* Blocking:
**
* Updates:
** Two post mortems this week about recent train problems
** Train: no major problems, 1.32.0-wmf.19 at group 0
https://phabricator.wikimedia.org/T191065https://tools.wmflabs.org/versions/
** Log spam: Unknown modifier 'R':
[/^page\-User\:BeneBot.+/RfD\-open/text$/] in
/srv/mediawiki/php-1.32.0-wmf.16/extensions/Translate/stringmangler/StringMatcher.php
https://phabricator.wikimedia.org/T202058
=== Research ===
* Blocked by: None
* Blocking: None
* Updates:
** Sent out emails to collect more data (2nd stage of the experiment) for
the Elicit new editor interests research:
https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work…
** Will enable collecting data for the CitationUsage schema this Thursday:
https://gerrit.wikimedia.org/r/#/c/operations/mediawiki-config/+/454854/
** Working towards productionizing the recommendation API. Talking about
storage with Services/Analytics: https://phabricator.wikimedia.org/T203039
=== Scoring Platform ===
* Blocked by: RelEng on these two: https://phabricator.wikimedia.org/T192042
and https://gerrit.wikimedia.org/r/c/All-Projects/+/455629
* Blocking: None
* Updates:
** The work for using PoolCounter in ores continues, support for multiple
nodes is almost there
** Renaming wp10 models to articlequality, if you're using this model,
please change
** Reducing size of ores setup in labs, to reduce the cloud service team
maintenance workload
** working on JADE table schemes
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
- Enabled indexing of all wikidata statements referencing items:
https://phabricator.wikimedia.org/T199884 newly edits have it enabled,
old items pending reindex
- Added collecting stats for data processing daemons:
https://phabricator.wikimedia.org/T201948
- Fixed errors with large offsets on search:
https://phabricator.wikimedia.org/T201360
- Working on running multiple Elastic instances on the same hardware:
https://phabricator.wikimedia.org/T193654
- Working on searching for statement values without additional keywords:
https://phabricator.wikimedia.org/T163642
- Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960
- Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
=== Security ===
* Blocked by:
* Blocking:
* Updates:
** Starting work into using Content-Security-Policy header
** Security review of *chromimum-render *
*https://phabricator.wikimedia.org/T177765*
<https://phabricator.wikimedia.org/T177765> and EU copyright once ready
=== Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Site Reliability Engineering ===
* Blocked by:
** None
* Blocking:
** None
* Updates:
**
Switchover/Switchback dates reminder
Services: Tuesday, September 11th 2018 14:30 UTC
Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC
Traffic: Tuesday, September 11th 2018 19:00 UTC
MediaWiki: Wednesday, September 12th 2018: 14:00 UTC
Switchback:
Traffic: Wednesday, October 10th 2018 09:00 UTC
MediaWiki: Wednesday, October 10th 2018: 14:00 UTC
Services: Thursday, October 11th 2018 14:30 UTC
Media storage/Swift: Thursday, October 11th 2018 15:00 UTC
IMPORTANT: For the duration of the switchover (1 month), please refrain
from large db schema changes and please avoid deploying any kind of new
feature that requires creation of tables.
IMPORTANT: There will be a train freeze in the week of Sept 10th and Oct
8th.
== Wikidata ==
* Blocked by:
** Blocked is a big word, but we'd appreciate input/decision on way forward
with two patches in MW core, related to testing (thanks to Anotine and Timo
for input so far)
*** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/455176/
*** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/446543/
* Blocking:
* Updates:
** Work in Lexicographical data continues:
*** adding senses
*** improving the editor workflow
*** https://phabricator.wikimedia.org/project/view/2292/
** Experiment about not using secondary SQL table for formatting item links
being gradually deployed
*** https://phabricator.wikimedia.org/T201831
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
**
== Multi-Content Revisions ==
* Blocked by:
* Blocking:
* Updates:
** almost complete phase 2 tasks (today?), planning to finish phase 3 tasks
by end of week
** deployment impacted by CI test failures - remediation in progress
== SoS Meeting Bookkeeping ==
* Updates:
**
Hi,
As you may know, the team Technical Wishes of Wikimedia Deutschland has
worked on improving the wikitext diff view for over a year in order to fix
a technical limitation: Whenever a paragraph was moved to another position
on the page, it was displayed as a removed and added paragraph and users
had to manually check if the text in the paragraph was altered or not.
With the improvements in the diff code, the algorithm now recognizes
paragraphs as moved, displays moved paragraphs as such and highlights
changes within them. The desktop version of this was already deployed to
most wikis end of May. Since today it’s available on all wikis. More
details and before/after screenshots can be found here:
https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes/Show_text_changes_whe…
As of today, moved paragraphs are also shown correctly on mobile. The
Wikimedia Foundation’s Readers Web team developed styles for the mobile
diff view, based on the recent improvements in the wikidiff code.
A big thanks to everyone involved, especially to the Readers Web team for
bringing the feature to mobile devices!
Michi
for the Technical Wishes team
PS: Diffs are cached for up to 7 days, so it might take a few days until
diffs of previous changes are generated with the new version.
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Forwarding.
Pine
( https://meta.wikimedia.org/wiki/User:Pine )
---------- Forwarded message ---------
From: John Bennett <jbennett(a)wikimedia.org>
Date: Wed, Aug 29, 2018 at 5:56 PM
Subject: [Wikimedia-l] Updates for failed logins and OurMine
To: wikimedia-l(a)lists.wikimedia.org <wikimedia-l(a)lists.wikimedia.org>
Hello,
The Security team will be putting together a brief summary of events
for both of these incidents and plan on sharing an overview by Sept
7th.
Thanks
John Bennett
_______________________________________________
Wikimedia-l mailing list, guidelines at:
https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and
https://meta.wikimedia.org/wiki/Wikimedia-l
New messages to: Wikimedia-l(a)lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l,
<mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>
Hi All,
A reminder that tomorrow TechCom is hosting a IRC discussion on: RFC:
Modern Event Platform: Schema Registry / Metadata Service
<https://phabricator.wikimedia.org/T201643>
This RFC is part of a series of RFC as part of the Modern Event Platform
program. This RFC outlines the current state of our event schemas and
repositories and some possible ways forward. It outlines 3 possible
options and recommends developing a new schema registry/metadata service.
The meeting is scheduled for 29 August at 2pm PST(21:00 UTC, 23:00 CET)
in #wikimedia-office
If you haven't joined a #wikimediaoffice meeting before more information
can be found here:
<https://meta.wikimedia.org/wiki/IRC_office_hours#How_to_participate>
More information regarding the TechCom RFC process is available here:
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Processes#RFC_…>
Thanks,
Kate
--
Kate Chapman TechCom Facilitator (Contractor)
Anti-vandalism functionality has now been deployed in Phabricator for a
while. After adjusting the parameters in response to a few initial issues
and letting it run over the weekend, I'm now fairly confident in the
algorithm. It should reliably detect and disable accounts which are doing
automated edits (except for the bots that we have white-listed ). In
addition, it should be unlikely to affect users due to normal user activity
like task submission / editing / commenting, etc. When a user account is
disabled due to antivandalism, a notification is posted into the
phabricator event feed[1]. If any account is disabled due to a false
positive, then any phabricator admin may re-enable the account in the usual
way within phabricator's 'manage user' UI.
If anyone has any questions, or notices a problem, please let me know!
[1] https://phabricator.wikimedia.org/feed/query/all/
Reminder: Technical Advice IRC meeting again **Wednesday 3-4 pm UTC** on
#wikimedia-tech.
Question can be asked in English, German, Hungarian.
The Technical Advice IRC Meeting (TAIM) is a weekly support event for
volunteer developers. Every Wednesday, two full-time developers are
available to help you with all your questions about Mediawiki, gadgets,
tools and more! This can be anything from "how to get started" over "who
would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for the Technical Advice IRC Meeting crew)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.