The 1.35.0-wmf.8 version of MediaWiki is blocked[0].
The train was tentatively unblocked on Friday. Details can be read
here:
* After deploy of 1.35.0-wmf.8 to group1, surge of "Cannot access the
database: Unknown error"
- https://phabricator.wikimedia.org/T239877
The new version can't proceed to group2 [1] until this (new) issue is
resolved:
* "PHP Notice: Undefined index: key" and similar in Cite.php and
ReferenceStack.php
- https://phabricator.wikimedia.org/T240248
If this issues is resolved, we will attempt to roll wmf.8 forward to all
wikis today, in order that wmf.10 can proceed as usual on Tuesday.
Thank you for your help with this issue!
-- Your frazzled train drudge
[0]. <https://phabricator.wikimedia.org/T233856>
[1]. <https://tools.wmflabs.org/versions/>
Hello everyone,
On Monday this week, we enabled Parsoid/PHP everywhere for all products
(Visual Editor, Mobile Content Service, Structured Discussions aka Flow,
Content Translation) but two (Wikitext Linter, Language Variant support).
Those last two were being supported by Parsoid/JS.
However, about 30 minutes back, we disabled database updates for wikitext
lints by turning off Parsoid/JS for the wikitext linter. You can read the
details in https://phabricator.wikimedia.org/T240057 but we took the
decision in order to help mitigate cluster load issues (
https://phabricator.wikimedia.org/T239983 if you have access to the phab
task ).
This is a temporary measure and we expect to be able to enable wikitext
linter updates something in the coming week (optimistically) assuming the
mediawiki train can roll out this week.
Not to bury the lede or anything (late on a Friday evening in the US
timezones), but we have now effectively switched over from Parsoid/JS to
Parsoid/PHP on the Wikimedia cluster. Once we have moved over language
variant support from Parsoid/JS to Parsoid/PHP and wrapped up any other
loose ends and tied a neat bow around it all, we'll be publishing a blog
post about the Parsoid/PHP porting and rollout process.
Subbu (on behalf of the Parsing team).
Hi All,
On* 5, December 2019, 8 PM UTC*, we'll welcome Camille Fournier for a
special edition of Wikimedia Tech talks! Camille will share insights from
her career and discuss her book, “The Manager’s Path: A Guide for Tech
Leaders Navigating Growth and Change
<https://www.amazon.com/Managers-Path-Leaders-Navigating-Growth-ebook/dp/B06…>
.”
Camille Fournier is the head of Platform Engineering at Two Sigma, a
financial company in New York City. Prior to joining Two Sigma, she was
the Chief Technology Officer of Rent the Runway
<https://www.renttherunway.com/>, a transformative brand that offers
unprecedented access to designer fashion, disrupting the way millions of
women get dressed.
She is an Open Source contributor and project committee member for both
Apache ZooKeeper and the Dropwizard web framework. Prior to working for
Rent the Runway, Camille served as a software engineer at Microsoft, and
most recently, spent several years as a technical specialist at Goldman
Sachs, creating distributed systems for managing risk analysis and firmwide
infrastructure.
She has a BS in Computer Science from Carnegie Mellon University and an MS
in Computer Science from the University of Wisconsin-Madison. Camille is a
well-respected voice within the tech community, speaking on a variety of
topics such as engineering leadership, distributed systems, scaling teams,
and technical architecture.
You can view the talk live and ask questions here:
https://www.youtube.com/watch?v=mNtFUt0vR58
Questions will also be taken through #wikimedia-office IRC
*Feel free to share this announcement! *
Kindly,
Sarah R. Rodlund
Technical Writer, Developer Advocacy
<https://meta.wikimedia.org/wiki/Developer_Advocacy>
srodlund(a)wikimedia.org
Hello,
CI has jobs to build Debian packages, I have moved them from Jessie to
Buster instances.
Building the package is made in a build environment matching the target
distribution (using cowbuilder), but some operations are executed on the
host. There might be side effect as a result of the upgrade.
For the utilities I can think of:
pbuilder 0.215 > 0.230.4
* which notably cause the building user to have a home directory set to
a non existent path /nonexistent
pristine-tar 1.33 > 1.46
* add support for delta version 3
git-buildpackage 0.6.22 > 0.9.14
If you see any oddity in the debian-glue* CI jobs, please fill a task in
Phabricator against #continuous-integration-infrastructure.
The migration task was:
Migrate debian-glue jobs to Buster instances
https://phabricator.wikimedia.org/T224943
--
Antoine "hashar" Musso
Next Wednesday, December 4th, at 00:00 UTC (4pm San Francisco) there will be
a Phabricator upgrade window that might last up to 2 hours.
While we expect downtime to be much shorter than that Phabricator might be
unreachable in that time frame.
We are switching the production Phabricator server to a buster (Debian
stable) machine.
https://phabricator.wikimedia.org/T238956
--
Daniel Zahn <dzahn(a)wikimedia.org>
Operations Engineer
Hi all,
Here are the minutes from this week's TechCom meeting:
* Discussed: RFC OpenGraph descriptions in wiki pages <
https://phabricator.wikimedia.org/T213505>.
This RFC discusses possible approaches for adding and maintaining OpenGraph
metadata for wiki
pages, allowing for rich link previews.
* Last call for comments: RFC Where to implement Desktop Improvements
project
<https://phabricator.wikimedia.org/T234907>. This RFC proposes implementing
broad UI changes
to the desktop interface of Wikimedia projects by modifying the existing
Vector skin. This RFC will
be approved as proposed if no concerns remain unaddressed by December 11.
* Last call for comments: MediaWiki database policy and/or guidelines
<https://phabricator.wikimedia.org/T220056>. This RFC proposes
re-implementing the 2015
MediaWiki schema change policy. This RFC will be approved as proposed if no
concerns remain
unaddressed following the last call period.
* No IRC discussion next week.
You can also find our meeting minutes at
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes>
See also the TechCom RFC board
<https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>.
If you prefer you can subscribe to our newsletter here
<https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar>
Thanks!
- Alex
--
Alex Paskulin
Technical Writer
Wikimedia Foundation
The Cite extension implements an API `action=query&prop=references`[1],
which was written to support a reference lazy-loading feature for mobile
clients but never used. This was a beta feature and the API was never
enabled on Wikimedia sites.[2] If you query it, you'll see nothing but an
error response.
My team is currently refactoring the Cite extension, and we would prefer to
remove the API rather than continue maintaining dead code. Please respond
by the end of the week if you know of any non-Wikimedia sites where the API
is enabled and in use, otherwise we'll continue with the plan to remove it
without a deprecation period.
Thank you,
Adam
[1]
https://en.wikipedia.org/w/api.php?action=help&modules=query%2Breferences
[2] https://phabricator.wikimedia.org/T222373
--
Adam Wight - Developer - Wikimedia Deutschland e.V. - https://wikimedia.de
Hello everyone,
Change 554602 [1] proposes the removal without deprecation of the old extension schema update globals. Those globals ($wgExtNewTables, $wgExtNewFields, $wgExtNewIndexes, $wgExtPGNewFields, $wgExtPGAlteredFields and $wgExtModifiedFields) became obsolete with 1.17 and were replaced with the LoadExtensionSchema hook that passed a DatabaseUpdater instance.
The phabricator task [2] lists all extensions that still reference those globals, but these are already migrated to the hook and only use the globals for backwards compatibility. The task also has a link to the code search query that lists all extensions still referencing the globals.
[1] https://gerrit.wikimedia.org/r/c/mediawiki/core/+/554602
[2] https://phabricator.wikimedia.org/T237873
Mainframe98
Hi,
for HTML version see
https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-12-04
Željko
--
= 2019-12-04 =
== Callouts ==
* Release Engineering - unusual train schedule:
** This week: 1.35.0-wmf.8 - group1 + group2
** Next week: 1.35.0-wmf.10
** December 23-January 3rd - No deploys (including train), Holiday break
== Product ==
=== Editing ===
* Updates:
** Finalizing work on high fidelity prototype for replies on talk pages
=== Growth ===
* Updates:
** Cleaning up remaining bugs from v1.0 release of newcomer tasks
=== iOS native app ===
* Updates:
**Released 6.5 on 12/2 - [[phab:project/view/4245]]
***Fundraising announcement on article
***History & Diffs screens
**Beginning exploratory work on 6.6 [[phab:project/view/4273]]
***Mobile-html
***Bug fixes
=== Android native app ===
* Updates:
** Suggested Edits v3 is live, as well as fundraising announcement (article
banner in newest app version, and in the Feed in older versions)
** Continuing integration with mobile-html, and continuing to test the
latest Parsoid / content service with language variant support.
=== Readers Web ===
* Updates:
** Summary: planning for desktop improvements and tapering off of advanced
mode.
** [[[Reading/Web/Desktop_Improvements]] Desktop Improvements Project
(Vector / DIP)]:
*** Planning, research, and task creation
*** [[[phab:T239248]] <nowiki>Divide VectorTemplate into
components</nowiki>]
** Responsive website (MinervaNeue / MobileFrontend / Portals):
*** [[[Reading/Web/Advanced_mobile_contributions]] Advanced mode]:
**** [[[phab:T232652]] <nowiki>Add History to article toolbar for all
logged-in users</nowiki>]
**** [[[phab:T232594]] <nowiki>Add article and discussion tabs to all
logged-in users on mobile</nowiki>]
*** Miscellaneous:
**** [[[phab:T232734]] <nowiki>Mobile logout should not involve an
interstitial</nowiki>]
**** [[[phab:T225213]] <nowiki>Main Menu should work without JavaScript to
be more accessible and a better user experience</nowiki>]
**** [[[phab:T214045]] <nowiki> Drawers should be removed from DOM after
close</nowiki>]
=== Product Infrastructure ===
* Updates:
** Computer-Aided Tagging will launch soon (TM), after the go-ahead from
Performance
** mobileapps flapping is under investigation ([[phab:T239344]])
*** seems related to increased request rate associated with the Parsoid/PHP
rollout ([[phab:T238832#5708029]])
*** There are also some unexplained MW API request timeouts for which I'm
adding more logging for further investigation
=== Structured Data ===
* Updates:
** rdfDumps now unblocked
** getting recentchanges by slot merged, so unblocking search
** work continues on new input types for structured data
** tech talk on Structured Data on Commons 1 week from today
=== Parsing ===
* Updates:
** Parsoid/PHP deployed to all wikis and all products except (a) linter (b)
language converter. These 2 products are served by Parsoid/JS
=== Language ===
* Updates:
** Team is back from Offsite.
** More Apertium MT updates coming up.
** Exploring MarianMT at: [[phab:T234194]]
=== Inuka ===
* Updates:
** KaiOS better pagination [[phab:T234436]]
=== UI Standardization ===
* Updates:
** Design Style Guide https://design.wikimedia.org/style-guide/
*** Polishing tasks
*** Improving responsive layout
*** Adding further components, like recently Comboboxes
** OOUI release v0.35.2 in preparation
== Technology ==
=== Fundraising Tech ===
* Updates:
** Monitoring fundraiser, tuning parameters to keep receipts and stats
flowing smoothly
** Yesterday donors gave us more money by far than any other single day in
the foundation's history
*** For publicly available stats (as CSVs), see https://frdata.wikimedia.org
** Seeing lower-than-expected CentralNotice banner impressions for US, AU,
and IE but that may be all because of bots: [[phab:T239748]]
** Small tweaks to Civi custom code to reduce logspam and cache a few more
db lookups.
=== Core Platform ===
* Blocking:
** Product Infrastructure - mobileapps flapping is under investigation
([[phab:T239344]]), seems related to increased request rate associated with
the Parsoid/PHP rollout
* Updates:
** Next round of Core REST API work
** Virtual offsite next week (Dec 10-12)
=== Engineering Productivity ===
==== Release Engineering ====
* Blocking:
** Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for
wikibase/vuejs-components repository: [[gerrit:551829]]
* Updates:
** Train Health
*** Last week: 1.35.0-wmf.8 - [[phab:T233856]] - group0 only because of
Thanksgiving
*** This week: 1.35.0-wmf.8 - [[phab:T233856]] - group1 + group2
*** Next week: 1.35.0-wmf.10 - [[phab:T233858]]
=== Scoring Platform ===
* Blocking:
*** Ack that we're blocking [[phab:T233448#5638765]]
* Updates:
*** Jade API code is ready for review again - [[phab:T199834]]
*** Model improvements coming for euwiki and cawiki - [[phab:T238839]]
*** Model improvements coming for nowiki - [[phab:T130291]]
*** Looking at SpaCy and other "industrial strength" NLP to boost ORES
models fitness and performance.
*** Extending our documentation around deployment prep:
[[wikitech:ORES/Prepare_deployment]]
*** Developing improved topic taxonomies. See
https://github.com/halfak/wikitax
=== Security ===
* Updates:
** Password Reset Update: Security Proposal - [[phab:T237755]] - complete
** Security Review For Page Content Service route /page/mobile-html -
[[phab:T227114]] - nearly complete
** A Large-scale Study of Wikipedia Users' Quality of Experience: data
release - [[phab:T217318]] - nearly complete
** Security Review for whichbrowser/parser - [[phab:T239259]] - in progress
** Data Map (GDPR) update period closes 12/6
== Wikimedia DE ==
=== Wikidata ===
* Blocked by:
** Release Engineering: Setting up Pipeline CI job for
wikibase/vuejs-components repository: [[gerrit:551829]]