Hello,
The last blocker for 1.36.0-wmf.29 is:
* MemcachedPeclBagOStuff: Serialization of 'Closure' is not allowed
- https://phabricator.wikimedia.org/T273242
It comes from the extension FeaturedFeeds which attempt to serialize
some User objects in the cache. An issue we already identified in a
previous train when we marked User as not being serializable:
https://phabricator.wikimedia.org/T264391
This time it is unknown what caused the regression (most probably it is
due to a change in mediawiki/core). Anyway there is a patch up for
review to stop serializing those objects but instead drop usage of User
objets and cache an array of properties instead of the object itself:
https://gerrit.wikimedia.org/r/c/mediawiki/extensions/FeaturedFeeds/+/66135…
Without this fixed, the train can not progress further.
cheers,
--
Antoine "hashar" Musso
https://www.mediawiki.org/wiki/Scrum_of_scrums/2021-02-03#2021-02-03
= 2021-02-03 =
== Callouts ==
* [RelEng] After several failed attempts to rollout wmf.28, we abandoned
the release and moved on to wmf.29. This was done because (1) wmf.29 is a
superset of code in wmf.28 (2) we need a stable base to rollback to and
there was not enough time to determine wmf.28's stability.
* [Performance] New synthetic testing user journey dashboard:
https://grafana.wikimedia.org/d/d-pdqGBGdse/wikipedia-login-user-journey?or…
* [Performance] FOSDEM happening this weekend online. We're running a
devroom: https://fosdem.org/2021/schedule/track/web_performance/
=== No updates ===
CommTech, Editing,
=== '''No notes provided''' ===
Web, Product Infrastructure, Parsing, Language, Inuka, Analytics, Cloud
Services, Fundraising Tech, Platform, Security
== SoS Meeting Bookkeeping ==
* Updates:
** For 2021-02-10 meeting, please list the recommendations from the
retrospective that you would like to adopt:
https://docs.google.com/spreadsheets/d/1EQzjJrAW5RFN7YnrAXPpeaxOB7pQ_2jrpeL…
== Product ==
=== Community Tech ===
* Blocked by:
* Blocking:
* Updates:
** No Updates
=== Anti-Harassment Tools ===
* Blocked by:
* Blocking:
* Updates:
** 3rd new engineer started - thanks to Dayllan Maza for helping with code
review while new engineers onboard
** Thanks to DBAs and Amir Sarabadani for helping with SecurePoll tables
** Thanks to Martin Urbanec and James Forrester for setting up beta
environment for votewiki
=== Editing ===
* Blocked by:
* Blocking:
* Updates:
** No updates
=== Growth ===
* Blocked by:
* Blocking:
* Updates:
** Working on link recommendations and on making the mwaddlink service
production-ready. [[phab:T252822]]
=== iOS native app ===
* Blocked by:
* Blocking:
* Updates:
** New version out yesterday! Investigated OAuth - endpoints aren't
currently adaptable for a variety of reasons.
=== Android native app ===
* Blocked by:
* Blocking:
* Updates:
** New version out yesterday with watchlists and native talk pages!
=== Structured Data ===
* Blocked by:
* Blocking:
* Updates:
** MediaSearch: more feature work and bug fixes, discussing approach for
making MediaSearch the default search interface on Commons
** Image recommendations: investigating how to compare and evaluate search
algorithm results
** Working with the Architecture team on plans for implementing
infrastructure changes related to the Structured Data Across Wikimedia
program
=== Abstract Wikipedia ===
* Blocked by:
* Blocking:
* Updates:
** Moving on to phase gamma, finally!
** Working on getting the back-end executor service runnable.
** Huge thanks to Daniel and others from the Platform team for sharing
their plans for how the core of MediaWiki's Content hierarchy is going, and
advice on our code on how to be more testable.
** Community suggestions for the logo concept for Wikifunctions continues.
=== Library ===
* Blocked by:
* Blocking:
* Updates:
** Set up hosted versions of GlitchTip for Wikilink and The Wikipedia
Library
** Bug fixes for The Wikipedia Library
** Onboarding new designer
=== Vue.js ===
* Blocked by:
* Blocking:
* Updates:
** Developing processes and timelines
** Discussing Vue, the new component library, and related infrastructure
with various stakeholders (other Product teams, WMDE, RelEng, Community
Relations...)
** Adapting MediaWiki's ES5 minifier to work with ES6
** Experimenting with alternatives to webpack (namely Vite, which uses
Rollup)
** Reviewing existing Vue components within MediaWiki projects and starting
to form a plan for building out components in WVUI
== Technology ==
=== Engineering Productivity ===
==== Performance ====
* Blocked by:
* Blocking:
* Updates:
** RUM (field) performance data for the past couple of weeks is tainted due
to partial outages during the Event Platform migration
==== Quality and Test Engineering ====
* Blocked by:
* Blocking:
* Updates:
** Blog post by Elena Tonkovidova: Testing search in MediaSearch
https://phabricator.wikimedia.org/phame/live/21/post/226
==== Release Engineering ====
* Blocked by:
** [https://phabricator.wikimedia.org/T273242 MemcachedPeclBagOStuff:
Serialization of 'Closure' is not allowed]
*** Listed as PET, has a patch
* Blocking:
** ???
* Updates:
** [All] Deployments/Covid-19
https://wikitech.wikimedia.org/wiki/Deployments/Covid-19
** Train Health
*** Last week: 1.36.0-wmf.28 [[phab:T271342]] <!--
https://phabricator.wikimedia.org/T271342 -->
*** This week: 1.36.0-wmf.29 [[phab:T271343]] <!--
https://phabricator.wikimedia.org/T271343 -->
*** Next week: 1.36.0-wmf.30 [[phab:T271344]] <!--
https://phabricator.wikimedia.org/T271344 -->
** Just starting to think about npm 7, now that's released.
=== Search Platform ===
* Blocked by:
** (DCOps) Memory issue on elastic1063 caused elasticsearch to be killed -
https://phabricator.wikimedia.org/T265113
* Blocking:
* Updates:
** Include gsrprop & gsrsinfo data in search api generator response -
https://phabricator.wikimedia.org/T270381
** Implement 50kb limit on file text indexing for to reduce increasing
commonswiki_file on-disk size -https://phabricator.wikimedia.org/T271493
** Add swift plugin to Flink k8s - https://phabricator.wikimedia.org/T269876
** Create Helm Chart (for Flink) - https://phabricator.wikimedia.org/T265526
=== Site Reliability Engineering ===
* Blocked by:
** None
* Blocking:
** Search Platform on Memory issue on elastic1063 caused elasticsearch to
be killed -https://phabricator.wikimedia.org/T265113
* Updates:
** Working on kubernetes logging for mediawiki with observability.
== Cross-cutting ==
* Blocked by:
* Blocking:
* Updates:
** No major progress on PHP 8.0 work.
** CI tools upgrades' status:
https://libraryupgrader2.wmcloud.org/status?branch=master
*** Upgrade of mediawiki-codesniffer to 35.0.0 is 93% complete.
*** Upgrade of eslint-config-wikimedia to 0.18.1 is 87% complete.
Hi all,
A note that after a difficult end of last week and some further
complications today, we're abandoning the 1.36.0-wmf.28 train[0],
rolling all wikis back to wmf.27, and proceeding with wmf.29[1] once
unblocked during this week's usual train windows.
This is a somewhat unusual step, but hopefully it will simplify the
process this week.
We're treating the following outstanding issues as blockers for wmf.29:
* ApiEchoUnreadNotificationPages.php PHP Notice: Undefined index: query
- https://phabricator.wikimedia.org/T273479
* MemcachedPeclBagOStuff: Serialization of 'Closure' is not allowed
- https://phabricator.wikimedia.org/T273242
* Accessing WikiPage that cannot exist as a page: w:Help:Books/Book
creator text. [Called from WikiPage::exists]
- https://phabricator.wikimedia.org/T273101
* MimeAnalyzer::improveTypeFromExtension() must be of the type string,
null given
- https://phabricator.wikimedia.org/T273249
Thanks in advance for any help resolving these issues. Also thanks to
Urbanecm and Pchelolo for work over the weekend clearing some obstacles
for the wmf.28 version, and all who helped out late last week.
-- Brennen, on behalf of your faithful train crew
[0]. <https://phabricator.wikimedia.org/T271342>
[1]. <https://phabricator.wikimedia.org/T271343>
Hello,
we are planning to change how Cloud VPS instances and Toolforge tools contact
WMF-hosted wikis, in particular the source IP address for the network connection.
The new IP address that wikis will see is 185.15.56.1.
The change is scheduled to go live on 2021-02-08.
More detailed information in wikitech:
https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_wikis
If you are a Cloud VPS user or Toolforge developer, check your tools after that
date to make sure they are properly running. If you detect a block, a rate-limit
or similar, please let us know.
If you are a WMF SRE or engineer involved with the wikis, be informed that this
address could generate a significant traffic volume, perhaps about 30%-40% total
wiki edits. We are trying to smooth the change as much as possible, so please
send your feedback if you think there is something we didn't account for yet.
Thanks, best regards.
--
Arturo Borrero Gonzalez
SRE / Wikimedia Cloud Services
Wikimedia Foundation
Hello,
I have upgraded our Gerrit instances from v3.2.5 to v3.2.7 today at
10:00 UTC. There should be barely any user facing changes.
The upgrade addresses a memory leak I have found on Christmas which was
forcing us to restart our Gerrit on a monthly basis. For reference:
https://phabricator.wikimedia.org/T263008
If you find a regression please do file a new task in Phabricator
against #gerrit
Thank you!
--
Antoine "hashar" Musso
The Search Platform Team
<https://www.mediawiki.org/wiki/Wikimedia_Search_Platform> usually holds
office hours the first Wednesday of each month. Come talk to us about
anything related to Wikimedia search, Wikidata Query Service, Wikimedia
Commons Query Service, etc.!
Feel free to add your items to the Etherpad Agenda for the next meeting.
Details for our next meeting:
Date: Wednesday, February 3rd, 2021
Time: 16:00-17:00 GMT / 08:00-09:00 PST / 11:00-12:00 EST / 17:00-18:00 CET
Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours
Google Meet link: https://meet.google.com/vyc-jvgq-dww
Join by phone in the US: +1 786-701-6904 PIN: 262 122 849#
Hope to talk to you Wednesday!
—Trey
Trey Jones
Sr. Computational Linguist, Search Platform
Wikimedia Foundation
UTC-5 / EST
Hey folks, this is an occasional reminder about how to spread basic
information about technical changes to the Wikimedia communities. There are
enough new people coming into the Wikimedia technical spaces that I send
this out every now and then. If it's not relevant to you, or you know
everything about Tech News, you can stop reading now.
Tech News is the technical newsletter for the Wikimedia wikis. It’s not the
only way to reach our communities, and major projects will reach out in
many ways, but it is our main way of keeping them informed of changes big
and small.
Here is the latest issue of the newsletter:
https://meta.wikimedia.org/wiki/Tech/News/2021/05
ABOUT TECH NEWS
a) What is Tech News?
https://meta.wikimedia.org/wiki/Tech/News
Tech News is a newsletter for reaching out with technical updates to the
general Wikimedia editor communities, to make sure they can keep track of
what’s happening. Most items talk about changes from the Foundation, but
many items are about work done by volunteer developers or Wikimedia
Deutschland staff. It’s typically distributed in 18–24 languages, reaching
roughly 100 community pages (Village Pumps etc) in addition to those who
read it on Meta, see it included in the Signpost, get it in their email
inbox, or are among the 850 individual subscribers. Typically, this is how
we tell our editors we are changing or planning to change something.
b) How is Tech News written?
Simplification is key. Technical news for non-technical readers. Should be
easy to translate as well as be written with en-1 and en-2 readers in mind.
A couple of sentences per item, then a link to a Phabricator task, wiki
page or email if they need more information. Too long and we put an
unreasonable burden on the translators. This doesn’t mean you should avoid
adding things because all of this seems difficult – we’ll edit it, if
necessary. It’s a wiki, after all.
c) I’ve done something technical. The communities should know. How do I add
it?
Just add it. This is the best and simplest way.
https://meta.wikimedia.org/wiki/Tech/News/Next will take you to the
relevant issue. Remember to link to a relevant Phabricator task, wiki page
or archived mailing list email.
(You can also add the “user-notice” tag in Phabricator together with a
simple 1–3 sentence explanation of what this is and how it affects editors.
Don’t worry about polish; we’ll take care of that. Or if you’re not sure if
it fits the newsletter – we’ll take a look, and if it doesn’t, we’ll just
remove the tag.)
d) When is it distributed?
Weekly, each Monday afternoon/evening UTC. The deadlines for additions are
several days prior to that to give the translators time to do their work.
See
https://meta.wikimedia.org/wiki/Tech/News/For_contributors#When_is_the_work…
for when to add things to have them included in the next newsletter.
This is typically earlier than people tend to assume.
e) What is Tech News not?
* A general Wikimedia newsletter. Everything in the Wikimedia world is at
most one step removed from being technical. This doesn’t mean Tech News is
the best place. Typical items are new or upcoming features or potential
breaking changes.
* The way to reach the Wikimedia technical community. If you want to reach
Wikimedia developers, an email to wikitech-l is usually better than an item
in Tech News. Tech News is a way to keep Wikimedia contributors up-to-date
with technical changes.
* A way to talk about all the important things that happen in the
background. They’re often awesome and we should talk more about them, but
if they don’t affect how contributors interact with the sites, then this is
not the place.
* A place for updates about one wiki. If it’s just relevant for English or
German Wikipedia, you should inform English or German Wikipedia, not the
entire Wikimedia community. Exceptions to this rule are Commons and
Wikidata, because they’re used by so many other Wikimedia wikis.
More:
https://meta.wikimedia.org/wiki/Tech/News/For_contributors#What_is_typicall…
The best time to do this for minor things is typically the week they go
out, i.e. you add it by Thursday the week before the change we’re talking
about, which means it’s in the newsletter delivered on the Monday before
the train goes out Tuesday through Thursday, but anything major should
probably be flagged under “future news” much earlier – preferably while
it's still possible to act on relevant community feedback.
//Johan Jönsson
--
Hello,
1.36.0-wmf.28 had to be rolled back entirely on Friday due to a faulty
hard deprecation of some of MediaWiki interfaces.
Backport patches have/are being merged right now. I will push the train
to group 0 as soon as that has completed.
I will push to group 1 13:00 UTC / 14:00 CET
(just after the backport window).
The rest of wikis will be done later tonight, at 20:00 UTC which is the
usual American train slot.
Train blocker task: https://phabricator.wikimedia.org/T271342
--
Antoine "hashar" Musso
Hi Community Metrics team,
This is your automatic monthly Phabricator statistics mail.
Accounts created in (2021-01): 322
Active Maniphest users (any activity) in (2021-01): 1043
Task authors in (2021-01): 540
Users who have closed tasks in (2021-01): 288
Projects which had at least one task moved from one column to another on
their workboard in (2021-01): 301
Tasks created in (2021-01): 2416
Tasks closed in (2021-01): 2180
Open and stalled tasks in total: 46706
* Only open tasks in total: 45856
* Only stalled tasks in total: 850
Median age in days of open tasks by priority:
Unbreak now: 11
Needs Triage: 625
High: 975
Normal: 1364
Low: 1945
Lowest: 2006
(How long tasks have been open, not how long they have had that priority)
Active Differential users (any activity) in (2021-01): 3
To see the names of the most active task authors:
* Go to https://wikimedia.biterg.io/
* Choose "Phabricator > Overview" from the top bar
* Adjust the time frame in the upper right corner to your needs
* See the author names in the "Submitters" panel
TODO: Numbers which refer to closed tasks might not be correct, as
described in https://phabricator.wikimedia.org/T1003 .
Yours sincerely,
Fab Rick Aytor
(via community_metrics.sh on phab1001 at Mon 01 Feb 2021 12:00:17 AM UTC)