Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 4-5 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting: https://www.mediawiki.org/wiki/Technical_
Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
(Hello, I am trying something new this week by writing in Spanish. I am
hoping to encourage people to contribute to this conversation in their
preferred languages.)
Hola, estoy intentando algo nuevo esta semana escribiendo en español. Espero
animar a las personas a contribuir a esta conversación en sus idiomas
preferidos.
Algo que me hace feliz esta semana es la disponibilidad de "diffs visuales"
como se describe en el Blog de la Fundación Wikimedia:
https://blog.wikimedia.org/2018/02/20/visual-diffs/.
¿Qué te hace feliz esta semana?
Pine
( https://meta.wikimedia.org/wiki/User:Pine )
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512
Hello!
MediaWiki-CodeSniffer 16.0.0 is now available for use in your
MediaWiki extensions and other projects. This release features some
new sniffs and bug fixes.
The full changelog since 15.0.0:
* Add sniff to find tests without @covers tags (Kunal Mehta)
* Add sniff to use namespaced PHPUnit\Framework\TestCase (Kunal Mehta)
* Avoid assignment in return statements (Umherirrender)
* Be aware of extension MediaWiki compatibility (Kunal Mehta)
* Detect variadic arguments in function comments (Umherirrender)
* Disallow PHP 7.2+ `object` type-hint (Kunal Mehta)
* Downgrade "Missing parameter comment" to warning (Reedy)
* Expand sniff to replace some php aliases with main function
(Umherirrender)
* Fix SpaceyParenthesisSniff comment detection for ignore statements
(Umherirrender)
* Fix Undefined index: scope_opener in IfElseStructureSniff
(Umherirrender)
* Forbid parse_str() without a second argument (Umherirrender)
* Remove direction from @param (Umherirrender)
* Remove unneeded closing declaration comments (Umherirrender)
* Remove unneeded @codingStandardsIgnoreLine from test (Umherirrender)
* Skip __construct on checking for @return tags (Umherirrender)
* Use SPDX 3.0 license identifier (Kunal Mehta)
* Warn on usage of each() (Kunal Mehta)
- -- Legoktm
-----BEGIN PGP SIGNATURE-----
iQJLBAEBCgA1FiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlqFNA4XHGxlZ29rdG1A
bWVtYmVyLmZzZi5vcmcACgkQUvyOe+23/KIbdQ//d4eo6OxBukBLM2mqSIKQg7B5
44J/GLgezgtA1WIDOTbnWAxaPWjFKLuvSKJHWiIodk4GC0M3Zez/gLBJB9mrdCka
vvsF/P0QRPYpBwJCeKNVJAhggIi6sP+ZBemj85P3qzLAweTkwm+Bh4zqxscYYZMl
zJCieaLd5pOPDHdOPJQDeLrJVXmA5LgqIXCvjOAUokEtm+x8vH7jiGdy75fFhP1u
MeKDYAV0iY97ZbISKjzUSKD0HLEP3fM6X/TvZL4Aesuh+gc6JgLy1OYI9desLWBk
k20EkfyvhkjfZ68JtVehJjsgvVq2W7h4q3GnYFEd1m+MPG1BocOAf3t2YYSkiU7U
BVKghgmuoW2/oZ3WrTp8vQV8ZD2qvLn0VWAJ5GO7YxpDGWDQ8kUcU7JMtg9DyJ+U
zr1zi1hKHK0aUmGzDQfAIlZsdi1mrd6Kw5pHMxteHN6Fig6SEa38Y2USEH2PS/D/
/DJ5IL5tOUTVfHg+xqiFTWcm6cG69GpPdEEwL2dFv9UPW5niR8OhYlwvPlhMiPp0
QkUhw3LgVJJS/6b3ObU7lPd0nkG26xDPawl0Aw23V9eG1o8xmKqRghKlF75LRtgi
oo4OFDGNWBseFI1keieBT7aPfQNqgUwEgV/YFO2j7aLqJn58BGu5rVOz6FRVYnwv
QQrUUMsNcKdspGfua2o=
=VHTl
-----END PGP SIGNATURE-----
The deployment of 1.31.0-wmf.22 revealed a critical bug[1] immediately
after I pushed the new branch to group1 wikis. Group1 was rolled back to
wmf.21 pending the resolution of T187942. Refer to Phabricator for details
and discussion. I will attempt to resume the train later today, assuming
blockers[2] have been resolved.
1. Replication lag detection broken in wmf.22
https://phabricator.wikimedia.org/T187942
2. 1.31.0-wmf.22 deployment blockers
https://phabricator.wikimedia.org/T183961
Hello everyone,
This is to inform you that on Monday Feb 22nd 2018 ~10:00 UTC, the
infrastructure powering irc.wikimedia.org will be rebooted for
security upgrades. This is expected to only impact bots that are using
irc.wikimedia.org AND are not able to automatically reconnect on
connection failure. From recent experience (the equipment was rebooted
210 ago last time, with no fallout) those are very limited in number
these days.
Regards,
--
Alexandros Kosiaris <akosiaris(a)wikimedia.org>
https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-02-21
= 2018-02-21 =
== Callouts ==
* Fundraising campaign in Sweden 2018-02-06 - 2018-03-06 and Italy
2018-02-01- 2018-02-27:
*https://meta.wikimedia.org/wiki/CentralNotice/Calendar*
<https://meta.wikimedia.org/wiki/CentralNotice/Calendar>
* GlobalPreferences live on beta labs, please test
* Heads up about https://phabricator.wikimedia.org/T157418 (RFC: Make some
aspects of Tidy's whitespace stripping behavior part of wikitext parsing
"spec") -- please comment there if you have an opinion about the open
questions in the description and / or the proposal itself.
* Reminder about https://phabricator.wikimedia.org/T51097 (RFC to use
figure tags for media in PHP parser) -- patches for these changes are in
gerrit right now.
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
* Blocking:
* Updates:
** Continuing work on 5.8.0 - Synced Reading Lists (
https://phabricator.wikimedia.org/tag/ios-app-v5.8.0-manatee-on-a-skateboar…
)
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Began user testing of synced reading lists, ready to start rolling out
to Beta audience for scalability testing.
==== Readers Web ====
* Blocked by:
** The Chromium PDF renderer replacement work is blocked on choosing a
deploy server; the Services team has been working very hard to keep
progress going but more help is needed (
https://phabricator.wikimedia.org/T187821 ).
* Blocking:
* Updates:
** Annual planning for technical work on MobileFrontend and MinervaNeue;
we'll be publishing notes to MediaWiki.org in about a week.
** Some coordination with Services for the deployment of the new Mobile
Content Services Summary v1.3 endpoint.
** Mobile pages are now supported by the Chromium PDF renderer.
** Continued improvements to page previews, MobileFrontend, and MinervaNeue.
** Check out our new quarterly goals column in our sprint board:
https://phabricator.wikimedia.org/tag/readers-web-kanbanana-board/
*Quarterly goal dependency update:
** Increase learning by lowering the cost of exploration
*** Reading Web/Performance
** Continue improving the ways that users can download articles of interest
for later consumption
*** Reading Web: Tech Ops/RelEng
==== Readers Infrastructure ====
* Blocked by:
* Blocking:
* Updates:
** On Tuesday we started the slow rollout of the new /page/summary endpoint
version 1.3.0, which is implemented in the Content Service based on Parsoid
HTML instead of using TextExtracts. (slow rollout = only recent changes for
now, going to speed up transition in the upcoming days or week). It aims to
improve the quality of summary extracts (not cutting off text before the
end of the first paragraph anymore; stripping of contents in parentheses,
...). It also provides more properties in the output. (Example:
https://en.wikipedia.org/api/rest_v1/page/summary/IOS)
===== Maps =====
* Blocked by: None
* Blocking: None
* Updates: Collab team getting up to speed
==== Multimedia ====
* Blocked by: N/A
* Blocking: N/A
* Updates
** 3D pushed, announcement coming soon, thanks to all who helped
** MediaInfo work is progressing, thanks to WMDE for helping us work
through things, no new dependency stuff
** Search: Cormac is plugging away as usual with exploration of the current
state of things and what we need to change, no dependency changes or flags
* Quarterly goal dependency update
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and
exposure
*** SDC: Research/Multimedia
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
=== Contributors ===
==== Community Tech ====
* Blocked by:
* Blocking:
* Updates:
** GlobalPreferences live on beta labs, please test
==== Anti-Harassment Tools ====
* Blocked by: Analytics on https://phabricator.wikimedia.org/T187374
* Blocking
* Updates
** Completing v1 of Interaction Timeline
https://tools.wmflabs.org/interaction-timeline/
** Next: Blocking Tools
==== Editing ====
* Blocked by:
* Blocking:
* Updates:
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
** Heads up about https://phabricator.wikimedia.org/T157418 (RFC: Make some
aspects of Tidy's whitespace stripping behavior part of wikitext parsing
"spec") -- please comment there if you have an opinion about the open
questions in the description and / or the proposal itself.
** Reminder about https://phabricator.wikimedia.org/T51097 (RFC to use
figure tags for media in PHP parser)
*Quarterly goal dependency update:
** Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing:Mediawiki PF/Services
==== Collaboration ====
* Blocked by:
* Blocking:
* Updates:
==== Language ====
* Blocked by:
* Blocking:
* Updates:
* Dry run for Compact Language Links preference migration script ran
successfully. Actual run and deployment for out of Beta scheduled next
week. Thanks Jaime for help in: T187880
* CX2 work continue. Santhosh fixed alignment issues in CX2.
===UI Standardization===
* Blocked by:
* Blocking:
* Updates:
* Quarterly goal dependency update:
** Audiences DesignStandardise our user interfaces to match user
expectation of quality from our products
*** Audiences Design: Ops
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** Starting to move from analytics-kafka to new jumbo-kafka. Small topic
first this week (webrequest-misc), then more next coming weeks
* Quarterly goal dependency update:
**Improve, adjust, or create features geared at the needs identified in New
Editors research project.
*** New Editors Experience:Analytics
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** CentralNotice: code review on contributed patches
** Upgraded CiviCRM, fixing a few emergent bugs
** PCI paperwork
** upstreaming more Civi extension stuff
** CentralNotice: EventLogging patch ready to merge, could use another
glance from Performance
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
* code review in progress: Actor table, MCR, External Store
de-PHP-serialization
* Comment table:
** Follow up schema change is in progress now.
** Enabled WRITE_BOTH on group 0; group 1 soon.
** There's been some movement on the front-end updates.
* Uploaded patches to update utfnormal and Scribunto's ustring to support
SRE's upgrading of the ICU library.
* Working on phan and phan-taint-check-plugin in CI testing
*Quarterly goal dependency update:
** Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing:Mediawiki PF/Services
* Reduce product and technical debt to modernise our tools and
technologies, and to make future changes more effective and efficient
*** Parsing/Mediawiki PF
**1.1 It is possible to store structured data within wiki pages, in
particular on media file pages on Commons. We will enable the MediaWiki
storage layer to correctly store and process structured data elements
within wiki pages.
*** SDC: Mediawiki PF/Wikidata
=== Performance ===
* Blocked by: N/A
* Blocking: N/A
* Updates:
** 100% of thumbnail requests are now being handled by Thumbor,
including private Wikis
** Seeing an issue with concurrent requests in Thumbor in some
circumstances, working on addressing that. Leads to occasional slow
thumbnail generation.
** Looking to set up a study on performance perception, in
collaboration with an outside researcher. Got solid advice from Jonathan
Morgan and Aaron Halfaker on that (thanks!)
** Pushing tons of bug reports upstream for WebPageTest and
WebPageReplay. Getting closer to stable metrics on Linux.
** Proved xhprof experimental branch works on PHP7(!)
** Few more NavTiming updates went out
*Quarterly goal dependency update:
** Increase learning by lowering the cost of exploration
*** Reading Web/Performance
=== Release Engineering ===
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
* Continue improving the ways that users can download articles of interest
for later consumption
** Reading Web: Tech Ops/RelEng
=== Research ===
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and
exposure
*** SDC: Research/Multimedia
=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:
** ORES has been moved to a dedicated cluster (thanks, Alex!). Just one
more step to remove our services from the scb* boxes, probably happening
tomorrow.
** Took an audit of wikis where ORES support is ready but not deployed:
https://phabricator.wikimedia.org/T187836. This is a coordination issue.
** We now have browser CI to check that Ext:ORES hasn't broken
Special:RecentChanges
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
** Working on Serbian analyzer for ES:
https://phabricator.wikimedia.org/T183015
** Looking into improving relevancy of cross-wiki results:
https://phabricator.wikimedia.org/T185250
** Working on Kafka poller for WDQS:
https://phabricator.wikimedia.org/T185951
*Quarterly goal dependency update:
** Prepare backend infrastructure for structured data search
** SDC: Search PF/Multimedia/Wikidata
=== Security ===
* Blocked by:
* Blocking:
* Updates:
=== Services ===
* Blocked by: none
* Blocking: none
* Updates:
* Summary endpoint switchover to MCS is happening, dumps are running
* Working with reading on getting the PDF service deployed
* Troubleshooting kafka consumer rebalancing mystery
=== Site Reliability Engineering ===
* Blocked by:
** Flow for dumps per usual: https://phabricator.wikimedia.org/T172025
* Blocking:
** None
* Updates:
** cache_upload fully migrated to varnish 5
** Cleanup of scb* hosts from ORES is bound to happen this week
== Wikidata ==
* Blocked by:
* Blocking:
* Updates:
** Continued work on caching constraint check results:
https://phabricator.wikimedia.org/T179839
** Ongoing investigation on caching derived labels for Lexemes:
https://phabricator.wikimedia.org/T187775
** Released our 300th weekly update:
https://www.wikidata.org/wiki/Wikidata:Status_updates/2018_02_19
*Quarterly goal dependency update:
**1.1 It is possible to store structured data within wiki pages, in
particular on media file pages on Commons. We will enable the MediaWiki
storage layer to correctly store and process structured data elements
within wiki pages.
*** SDC: Mediawiki PF/Wikidata
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
** Still finetuning Wikidiff2
** Returning to work on FileImporter