Hi All,
On* 5, December 2019, 8 PM UTC*, we'll welcome Camille Fournier for a
special edition of Wikimedia Tech talks! Camille will share insights from
her career and discuss her book, “The Manager’s Path: A Guide for Tech
Leaders Navigating Growth and Change
<https://www.amazon.com/Managers-Path-Leaders-Navigating-Growth-ebook/dp/B06…>
.”
Camille Fournier is the head of Platform Engineering at Two Sigma, a
financial company in New York City. Prior to joining Two Sigma, she was
the Chief Technology Officer of Rent the Runway
<https://www.renttherunway.com/>, a transformative brand that offers
unprecedented access to designer fashion, disrupting the way millions of
women get dressed.
She is an Open Source contributor and project committee member for both
Apache ZooKeeper and the Dropwizard web framework. Prior to working for
Rent the Runway, Camille served as a software engineer at Microsoft, and
most recently, spent several years as a technical specialist at Goldman
Sachs, creating distributed systems for managing risk analysis and firmwide
infrastructure.
She has a BS in Computer Science from Carnegie Mellon University and an MS
in Computer Science from the University of Wisconsin-Madison. Camille is a
well-respected voice within the tech community, speaking on a variety of
topics such as engineering leadership, distributed systems, scaling teams,
and technical architecture.
You can view the talk live and ask questions here:
https://www.youtube.com/watch?v=mNtFUt0vR58
Questions will also be taken through #wikimedia-office IRC
*Feel free to share this announcement! *
Kindly,
Sarah R. Rodlund
Technical Writer, Developer Advocacy
<https://meta.wikimedia.org/wiki/Developer_Advocacy>
srodlund(a)wikimedia.org
Hello,
CI has jobs to build Debian packages, I have moved them from Jessie to
Buster instances.
Building the package is made in a build environment matching the target
distribution (using cowbuilder), but some operations are executed on the
host. There might be side effect as a result of the upgrade.
For the utilities I can think of:
pbuilder 0.215 > 0.230.4
* which notably cause the building user to have a home directory set to
a non existent path /nonexistent
pristine-tar 1.33 > 1.46
* add support for delta version 3
git-buildpackage 0.6.22 > 0.9.14
If you see any oddity in the debian-glue* CI jobs, please fill a task in
Phabricator against #continuous-integration-infrastructure.
The migration task was:
Migrate debian-glue jobs to Buster instances
https://phabricator.wikimedia.org/T224943
--
Antoine "hashar" Musso
Next Wednesday, December 4th, at 00:00 UTC (4pm San Francisco) there will be
a Phabricator upgrade window that might last up to 2 hours.
While we expect downtime to be much shorter than that Phabricator might be
unreachable in that time frame.
We are switching the production Phabricator server to a buster (Debian
stable) machine.
https://phabricator.wikimedia.org/T238956
--
Daniel Zahn <dzahn(a)wikimedia.org>
Operations Engineer
Hi all,
Here are the minutes from this week's TechCom meeting:
* Discussed: RFC OpenGraph descriptions in wiki pages <
https://phabricator.wikimedia.org/T213505>.
This RFC discusses possible approaches for adding and maintaining OpenGraph
metadata for wiki
pages, allowing for rich link previews.
* Last call for comments: RFC Where to implement Desktop Improvements
project
<https://phabricator.wikimedia.org/T234907>. This RFC proposes implementing
broad UI changes
to the desktop interface of Wikimedia projects by modifying the existing
Vector skin. This RFC will
be approved as proposed if no concerns remain unaddressed by December 11.
* Last call for comments: MediaWiki database policy and/or guidelines
<https://phabricator.wikimedia.org/T220056>. This RFC proposes
re-implementing the 2015
MediaWiki schema change policy. This RFC will be approved as proposed if no
concerns remain
unaddressed following the last call period.
* No IRC discussion next week.
You can also find our meeting minutes at
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes>
See also the TechCom RFC board
<https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>.
If you prefer you can subscribe to our newsletter here
<https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar>
Thanks!
- Alex
--
Alex Paskulin
Technical Writer
Wikimedia Foundation
The Cite extension implements an API `action=query&prop=references`[1],
which was written to support a reference lazy-loading feature for mobile
clients but never used. This was a beta feature and the API was never
enabled on Wikimedia sites.[2] If you query it, you'll see nothing but an
error response.
My team is currently refactoring the Cite extension, and we would prefer to
remove the API rather than continue maintaining dead code. Please respond
by the end of the week if you know of any non-Wikimedia sites where the API
is enabled and in use, otherwise we'll continue with the plan to remove it
without a deprecation period.
Thank you,
Adam
[1]
https://en.wikipedia.org/w/api.php?action=help&modules=query%2Breferences
[2] https://phabricator.wikimedia.org/T222373
--
Adam Wight - Developer - Wikimedia Deutschland e.V. - https://wikimedia.de
Hello everyone,
Change 554602 [1] proposes the removal without deprecation of the old extension schema update globals. Those globals ($wgExtNewTables, $wgExtNewFields, $wgExtNewIndexes, $wgExtPGNewFields, $wgExtPGAlteredFields and $wgExtModifiedFields) became obsolete with 1.17 and were replaced with the LoadExtensionSchema hook that passed a DatabaseUpdater instance.
The phabricator task [2] lists all extensions that still reference those globals, but these are already migrated to the hook and only use the globals for backwards compatibility. The task also has a link to the code search query that lists all extensions still referencing the globals.
[1] https://gerrit.wikimedia.org/r/c/mediawiki/core/+/554602
[2] https://phabricator.wikimedia.org/T237873
Mainframe98
Hi,
for HTML version see
https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-12-04
Željko
--
= 2019-12-04 =
== Callouts ==
* Release Engineering - unusual train schedule:
** This week: 1.35.0-wmf.8 - group1 + group2
** Next week: 1.35.0-wmf.10
** December 23-January 3rd - No deploys (including train), Holiday break
== Product ==
=== Editing ===
* Updates:
** Finalizing work on high fidelity prototype for replies on talk pages
=== Growth ===
* Updates:
** Cleaning up remaining bugs from v1.0 release of newcomer tasks
=== iOS native app ===
* Updates:
**Released 6.5 on 12/2 - [[phab:project/view/4245]]
***Fundraising announcement on article
***History & Diffs screens
**Beginning exploratory work on 6.6 [[phab:project/view/4273]]
***Mobile-html
***Bug fixes
=== Android native app ===
* Updates:
** Suggested Edits v3 is live, as well as fundraising announcement (article
banner in newest app version, and in the Feed in older versions)
** Continuing integration with mobile-html, and continuing to test the
latest Parsoid / content service with language variant support.
=== Readers Web ===
* Updates:
** Summary: planning for desktop improvements and tapering off of advanced
mode.
** [[[Reading/Web/Desktop_Improvements]] Desktop Improvements Project
(Vector / DIP)]:
*** Planning, research, and task creation
*** [[[phab:T239248]] <nowiki>Divide VectorTemplate into
components</nowiki>]
** Responsive website (MinervaNeue / MobileFrontend / Portals):
*** [[[Reading/Web/Advanced_mobile_contributions]] Advanced mode]:
**** [[[phab:T232652]] <nowiki>Add History to article toolbar for all
logged-in users</nowiki>]
**** [[[phab:T232594]] <nowiki>Add article and discussion tabs to all
logged-in users on mobile</nowiki>]
*** Miscellaneous:
**** [[[phab:T232734]] <nowiki>Mobile logout should not involve an
interstitial</nowiki>]
**** [[[phab:T225213]] <nowiki>Main Menu should work without JavaScript to
be more accessible and a better user experience</nowiki>]
**** [[[phab:T214045]] <nowiki> Drawers should be removed from DOM after
close</nowiki>]
=== Product Infrastructure ===
* Updates:
** Computer-Aided Tagging will launch soon (TM), after the go-ahead from
Performance
** mobileapps flapping is under investigation ([[phab:T239344]])
*** seems related to increased request rate associated with the Parsoid/PHP
rollout ([[phab:T238832#5708029]])
*** There are also some unexplained MW API request timeouts for which I'm
adding more logging for further investigation
=== Structured Data ===
* Updates:
** rdfDumps now unblocked
** getting recentchanges by slot merged, so unblocking search
** work continues on new input types for structured data
** tech talk on Structured Data on Commons 1 week from today
=== Parsing ===
* Updates:
** Parsoid/PHP deployed to all wikis and all products except (a) linter (b)
language converter. These 2 products are served by Parsoid/JS
=== Language ===
* Updates:
** Team is back from Offsite.
** More Apertium MT updates coming up.
** Exploring MarianMT at: [[phab:T234194]]
=== Inuka ===
* Updates:
** KaiOS better pagination [[phab:T234436]]
=== UI Standardization ===
* Updates:
** Design Style Guide https://design.wikimedia.org/style-guide/
*** Polishing tasks
*** Improving responsive layout
*** Adding further components, like recently Comboboxes
** OOUI release v0.35.2 in preparation
== Technology ==
=== Fundraising Tech ===
* Updates:
** Monitoring fundraiser, tuning parameters to keep receipts and stats
flowing smoothly
** Yesterday donors gave us more money by far than any other single day in
the foundation's history
*** For publicly available stats (as CSVs), see https://frdata.wikimedia.org
** Seeing lower-than-expected CentralNotice banner impressions for US, AU,
and IE but that may be all because of bots: [[phab:T239748]]
** Small tweaks to Civi custom code to reduce logspam and cache a few more
db lookups.
=== Core Platform ===
* Blocking:
** Product Infrastructure - mobileapps flapping is under investigation
([[phab:T239344]]), seems related to increased request rate associated with
the Parsoid/PHP rollout
* Updates:
** Next round of Core REST API work
** Virtual offsite next week (Dec 10-12)
=== Engineering Productivity ===
==== Release Engineering ====
* Blocking:
** Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for
wikibase/vuejs-components repository: [[gerrit:551829]]
* Updates:
** Train Health
*** Last week: 1.35.0-wmf.8 - [[phab:T233856]] - group0 only because of
Thanksgiving
*** This week: 1.35.0-wmf.8 - [[phab:T233856]] - group1 + group2
*** Next week: 1.35.0-wmf.10 - [[phab:T233858]]
=== Scoring Platform ===
* Blocking:
*** Ack that we're blocking [[phab:T233448#5638765]]
* Updates:
*** Jade API code is ready for review again - [[phab:T199834]]
*** Model improvements coming for euwiki and cawiki - [[phab:T238839]]
*** Model improvements coming for nowiki - [[phab:T130291]]
*** Looking at SpaCy and other "industrial strength" NLP to boost ORES
models fitness and performance.
*** Extending our documentation around deployment prep:
[[wikitech:ORES/Prepare_deployment]]
*** Developing improved topic taxonomies. See
https://github.com/halfak/wikitax
=== Security ===
* Updates:
** Password Reset Update: Security Proposal - [[phab:T237755]] - complete
** Security Review For Page Content Service route /page/mobile-html -
[[phab:T227114]] - nearly complete
** A Large-scale Study of Wikipedia Users' Quality of Experience: data
release - [[phab:T217318]] - nearly complete
** Security Review for whichbrowser/parser - [[phab:T239259]] - in progress
** Data Map (GDPR) update period closes 12/6
== Wikimedia DE ==
=== Wikidata ===
* Blocked by:
** Release Engineering: Setting up Pipeline CI job for
wikibase/vuejs-components repository: [[gerrit:551829]]
Forwarding in case this is of interest to people on other mailing lists.
Pine
( https://meta.wikimedia.org/wiki/User:Pine )
---------- Forwarded message ---------
From: Jaqen <nataliofosco(a)gmail.com>
Date: Tue, Dec 3, 2019 at 11:52 AM
Subject: [Wiki-research-l] Survey on data visualization for Wikipedia
To: Research into Wikimedia content and communities <
wiki-research-l(a)lists.wikimedia.org>, <glam(a)lists.wikimedia.org>
Hi!
As a part of my job at OBC Transeuropa <https://www.balcanicaucaso.org/eng>
among the other things I contribute to Wikipedia and Commons with graphs
and text coming from EDJNet <https://www.europeandatajournalism.eu/>, a
data journalism network we promote that is publishing its content with a
free license.
In the attempt of inserting graphs using MediaWiki instead of svg images I
realised the tool now available are cumbersome and there is the
possibilities for improvement.
Thus we are making a survey to understand if Wikipedia users are interested
in having better tools, allowing to publish better graphs more easily. So
I ask you to please spend a few minutes of your time to let us now what you
think :)
https://surveys.europeandatajournalism.eu/quiz/data-visualization-for-wikip…
The survey is anonymous. You will be given the opportunity to leave your
e-mail address to receive updates on developments, but this is optional.
The results of the survey will be published on EDJNet and on Meta, and I
will also link them here.
Let me know if you have any questions! Thank you!
Niccolò "Jaqen" Caranti
_______________________________________________
Wiki-research-l mailing list
Wiki-research-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
Hi all,
We're having terrible trouble with the Cirrus search maintenance script
for initialising the elastic indexes:
forceSearchIndex.php --skipLinks --indexOnSkip...
It's happening with MW 1.31 .. 1.33, we're using redis job queue and a
single instance of Elastic on the same host (these are low traffic
wikis). Debian 10.2, PHP 7.3.
No matter what parameters we use (--queue or not, different --maxJobs,
or --fromId/--toId, --batchSize etc etc) we're always finding that
hundreds of elastic docs are not being created.
There's nothing about the articles themselves that are preventing it, if
we run the maintenance script on just a single missing one afterwards it
gets created no problem, and also each time this problem happens, there
are many differences in the missing docs.
Please if anyone has heard of this kind of things and could point us in
the right direction here that would be awesome!
Thanks a lot,
Aran