Wikitech-l March 2018

wikitech-l@lists.wikimedia.org

68 participants
76 discussions

Masaryk University mirrors of Wikipedia XML dumps
by defanor 14 Mar '18

14 Mar '18

Hello, <https://dumps.wikimedia.org/mirrors.html> currently lists Masaryk University mirrors, which are inactive (mirroring there was intentionally stopped several years ago, it's not a temporary issue). It would be nice to update the list.

2 1

Tomorrow: Technical Advice IRC Meeting
by Michael Schönitzer 14 Mar '18

14 Mar '18

Sorry for cross-posting! Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 4-5 pm UTC** on #wikimedia-tech. The Technical Advice IRC meeting is open for all volunteer developers, topics and questions. This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! Michi (for WMDE’s tech team) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 0

Discovery Weekly Update for the week starting 2018-03-05
by Chris Koerner 13 Mar '18

13 Mar '18

Hear ye, hear ye! This is the weekly update from the Search Platform team for the week starting 2018-03-05. If you have feedback or questions, please let me know. == Discussions == === Search === * Trey (with a *lot* of help from Guillaume and David) finished wrapping an open-source stemmer for Serbian into an Elasticsearch plugin[0] for use on Serbian wikis. It will also support cross-script searching! It will still be a few weeks before the Serbian language projects are re-indexed, but we are moving toward that goal. We're also planning to investigate using the same stemmer on Bosnian, Croatian, and Serbo-Croatian wikis. [1] * Stas fixed a minor issue with using Blazegraph for deep category searching / returning of results [2] * Stas implemented quicker indexing for newly created Wikidata items [3] == Did you know? == * The sound associated with the letter <s> in English is called a "voiceless alveolar sibilant" by linguists, and appears in many languages. It also comes in at least three varieties, which sound more or less the same, but are articulated differently. You can see the Wikipedia page for technical details, [4] but the most obvious difference is that some people have the tip of their tongue behind their *lower* front teeth when they say /s/, while others have the tip of their tongue behind their *upper* front teeth or even a little further back along the roof of their mouth. * Another sound with multiple articulations—which isn't found in any language but *is* found in many cultures—is an "unvoiced linguolabial trill", also called a "raspberry". [5] Some people vibrate their lower lip against their tongue, others use their upper lip. Trying to do it the other way around can be very difficult, and a bit messy. Also of note, the name "raspberry" comes from Cockney rhyming slang [6]—see the Wikipedia page on "blowing a raspberry" for the full etymology. [0] https://phabricator.wikimedia.org/T183015 [1] https://en.wikipedia.org/wiki/Serbo-Croatian [2] https://phabricator.wikimedia.org/T165982 [3] https://phabricator.wikimedia.org/T183053 [4] https://en.wikipedia.org/wiki/Voiceless_alveolar_fricative#Features [5] https://en.wikipedia.org/wiki/Blowing_a_raspberry [6] https://en.wikipedia.org/wiki/Rhyming_slang --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

1 0

Fwd: ¿Qué te hace feliz esta semana? / What's making you happy this week? (Week of 11 March 2018)
by Pine W 12 Mar '18

12 Mar '18

I apologize for forgetting to include Wikitech-l in my original post. Pine ( https://meta.wikimedia.org/wiki/User:Pine ) ---------- Forwarded message ---------- What's making me happy this week: 1. A recent entry in the Mozilla Blog discussed the possible value of anonymity in decreasing bias in code review processes: https://blog.mozilla.org/blog/2018/03/08/gender-bias-code-reviews/ 2. The opt-in "pingback" telemetry from MediaWiki installations, which is available since March 2017, suggests that there are more than 40,000 unique installations. See: https://pingback.wmflabs.org, https://www.mediawiki.org/wiki/Manual:$wgPingback and https://wikimediafoundation.org/wiki/MediaWiki_Pingback_Privacy_Statement. There is also some news which is a little older and I am now getting around to sharing here: 3. A research project has been started which aims to test whether vandal activity can be detected in (near) real time, which may open opportunities for interventions earlier in the process of publishing edits. See https://lists.wikimedia.org/pipermail/ai/2018-January/000221.html. What's making you happy this week? You are welcome to write in any language. Pine ( https://meta.wikimedia.org/wiki/User:Pine )

2 1

Any way to find the used template from the template itself?
by Strainu 11 Mar '18

11 Mar '18

Say we have an article which includes {{Infobox A}}, which redirects to {{Infobox B}}, which in turn transcludes {{Infobox}}, which is implemented using [[Module:Infobox]]. Is there a way to know from the module (or the {{Infobox}} template) which infobox was actually used in the article? Thanks, Strainu

3 4

Wikitech move this Friday, 2018-03-09 at 16:00 UTC
by Andrew Bogott 10 Mar '18

10 Mar '18

On Friday morning my time (10:00 CST, 8:00 PST, 16:00 UTC) I'll be switching the dns record for wikitech.wikimedia.org to point to a new server. This change should be largely invisible to users, but there are a few things to be ready for: - Most importantly, YOU WILL BE LOGGED OUT of Wikitech. So if you've been relying on a persistent session to avoid having to keep track of your 2FA tokens, today is the day to reset 2FA and record the new information. - The new Wikitech build uses a lot of updated software (Debian Stretch, HHVM, etc.). Although we've done some spot-checks, there may be new issues that appear for your particular use case. We'll evaluate these as they crop up, and decide whether or not to revert to the old server. -Andrew

1 2

Upcoming CI changes for PHP 7
by Kunal Mehta 09 Mar '18

09 Mar '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, We're planning to enable tests against PHP 7.0 as a voting job for MediaWiki core, and all MediaWiki extensions and skins that currently have one for PHP 5.5 and HHVM. Tests have run in non-voting mode against nearly all extensions, most of which are passing[1]. There is currently 1 group of test failures, and 3 more extensions that are failing: * Tidy change[2] (being replaced with RemexHtml) * PhpTags test failures[3] * Mpdf is failing PHP 7.0 lint[4] * PHPExcel is failing PHP 7.0 lint[5] We're currently planning to land the tidy change Tuesday afternoon (following the branch cut). If someone wants to look into the three extension failures that would be appreciated :) After that sits for a few days, I plan on enabling PHP 7.0 voting tests on Thursday or Friday. I don't expect many problems given that most people have already been running MediaWiki with PHP 7.0 for quite a while now. The master task tracking all of this is [6]. [1] https://tools.wmflabs.org/ci/last_run.html [2] https://phabricator.wikimedia.org/T188167 [3] https://phabricator.wikimedia.org/T188585 [4] https://phabricator.wikimedia.org/T188523 [5] https://phabricator.wikimedia.org/T188586 [6] https://phabricator.wikimedia.org/T144962 Thanks, - -- Kunal / Legoktm -----BEGIN PGP SIGNATURE----- iQJLBAEBCgA1FiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlqeOwUXHGxlZ29rdG1A bWVtYmVyLmZzZi5vcmcACgkQUvyOe+23/KK3Aw/9Hq5jZ1Mp9tejdLU+fGqSYH5s uD7Hc8lvoZf1qr6WBsO9GmIdtdftOClLuYoEp3yvPiJTRBuYVAucKd37GYGKBS2K Iw6FRV/MHmWnjythpK0O4vbjfxYSNGNrPZ6GHTSlJYpjTNPbKaGLIerDmxsrBfrg 0I+ce9xhxaPHjp/qLmXM/9e8Fvwm4MhAAxzQjVqm3z0QBT5Remudsk8C+/vFHe0K 4GT/DLd/m6M4fpqZG3C0oLKMkeTgzsHBUVvcX9SLjwLlhQH1/AB57XtHM5RV/i/I 4mIYoHPws8jv4gRf16fSNVuYbAtKaPaIK26jaqqxc/zzZnR5PGcykEAPI6SYN+6E WiZs3V7U/GXAis+9zeWqiLbU5FTboXCoIjjr6FEmXVCwSQSn89Ne04MWiugclJ3h XLkbVDxRWDNEZ2oWl7z/1xUoitUgl2dknT+SZAQrLfomFYsdGksRr6rIAD5uPsUq m94qJx9LiENL4tOb2ztTWFtlWwACwjj/MTsZqoKw75XwKZrqNSQpcFLMr63NTdrZ n5MOaGKodt0vPhtvHpwxwJhQfT/5ECzEWkxXjL+346zznIV5bV8Gx+jM2mYkNY+r UqiN86b71wSZ+gQn7mbSRSrIEk3X4W/hqBNgTY0t7kCM/1duJwSS+NH9JmFapPpu /W2B/ul30MD4DbGw7/Q= =kRAF -----END PGP SIGNATURE-----

1 1

TechCom Radar, 2018-03-07
by Kate Chapman 09 Mar '18

09 Mar '18

Hi All, Here are the minutes from this week's TechCom meeting: * RFC Put on Last Call (closing on 2018-03-14 at 3pm PST (21:00 UTC, 22:00 CET)): Make some aspects of Tidy's whitespace stripping behavior part of wikitext parsing "spec" <https://phabricator.wikimedia.org/T157418> * RFC Put on Last Call (closing on 2018-03-21 at 3pm PST (21:00 UTC, 22:00 CET)): Normalize change tag schema <https://phabricator.wikimedia.org/T185355> * No RFC IRC Meeting on March 14 * Redis based refreshLinks jobs are switched to EventBus and now running exclusively from Kafka * Global preferences moving along, community tech waiting for change to table names You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. -- Kate Chapman TechCom Facilitator (Contractor)

1 0

2018-03-07 Scrum of Scrums meeting notes
by Grace Gellerman 09 Mar '18

09 Mar '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-03-07 = 2018-03-07 = == Callouts == * Fundraising campaigns *https://meta.wikimedia.org/wiki/CentralNotice/Calendar* <https://meta.wikimedia.org/wiki/CentralNotice/Calendar>* - next up: Netherlands *2018-04-03 through 2018-05-01 * Collaboration is planning to move maps server testing from prod (on out-of-warranty hardware) into labs, tell us if that's a bad idea or if there's a catch * Performance: WebPageTest migration to Linux complete, dashboards need to be updated if they haven't been already. Reach out to Peter Hedenskog if you need help. * Performance: FOUC issue when autofocus is used on Firefox has been addressed, but fix won't be released until FF60 (expected on 8 May). (Has been reported to affect some Special pages, Roan also reported it.) ==Blockers== ==== iOS native app ==== ** No Joe :( Velocity is going to be reduced for a bit. ==== Readers Infrastructure ==== * Blocked by: Wikidata on code review for description overrides https://phabricator.wikimedia.org/T184000 ==== Community Tech ==== * Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal ==== Collaboration ==== * Blocked by: SRE on reviewing Flow dumps patch ==== UI Standardization ==== * Blocked by: RelEng on repos for Design subdomain https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests & https://phabricator.wikimedia.org/T185282 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: ** No Joe :( Velocity is going to be reduced for a bit. * Blocking: * Updates: ** Bug fixing iOS reading list sync / finishing remaining sync UI bits ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Rolled out Reading List syncing to 10% of beta audience (~25000 users); Will continue to roll out to 50% then 100% in the next few days, assuming scalability looks good. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** Bug fixing to mobile web and page previews (in preparation for release to all wikis) *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** Reading Web/Performance ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ==== Readers Infrastructure ==== * Blocked by: Wikidata on code review for description overrides https://phabricator.wikimedia.org/T184000 * Blocking: * Updates: ** ===== Maps ===== * Blocked by: * Blocking: * Updates: ** ==== Multimedia ==== * Updates ** 3D work nearly all complete - some cleanup and optimization that could be done later ** Search: Draft patch up, looking for feedback but not urgently ** Other SDC: Progressing, complicated code structure slightly impeding work, but nothing new and hopefully not for long Quarterly goal dependency update ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata === Contributors === ==== Community Tech ==== * Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal * Blocking: * Updates: ** Lots of discussions with community around long edit summaries rollout, seems like drastic measures will be avoided. ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Tidy will be replaced on a bunch of wikis (~100 overall) next week - sent out an announcement on ambassadors and wikitech-l ** Last week's RFC hearing about https://phabricator.wikimedia.org/T157418 has been approved and will be announced for last call soon. WIP patches for both the PHP parser and Parsoid have been uploaded to gerrit. I have to update tests and verify they all pass before I take it out of WIP. But, I expect this to be ready for final review before the last call period ends. *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services ** No new updates on these dependencies since last week's update ==== Collaboration ==== * Blocked by: SRE on reviewing Flow dumps patch * Blocking: nobody * Updates: ** "Flow on your talk page" beta feature re-enabled after Roan fixed MCR bug ** Patch up for review that should fix Flow dumps, Ariel will review next week ** Planning to move maps server testing from prod into labs, tell us if that's a bad idea or if there's a catch ** IRC meeting today about change tags RFC ==== Language ==== * Blocked by: * Blocking: * Updates: ** === Audiences Design === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops ==== UI Standardization ==== * Blocked by: RelEng on repos for Design subdomain https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests & https://phabricator.wikimedia.org/T185282 * Blocking: * Updates: ** OOUI v0.25.3 released with 3 new features, 2 style improvements and 12 code fixes/amendments, among those: *** Toolbar items' focus is now aligned to widgets elsewhere https://phabricator.wikimedia.org/T188031 (Volker E.) *** demos: Use individual oojs-ui-* JS files for sourcemap support (Moriel Schottlender) *** Also preparation for v0.26.0 with currently aimed for unification of base font-size of OOUI's WikimediaUI theme in VE and MW core https://phabricator.wikimedia.org/T97631 *** And refine icon set https://phabricator.wikimedia.org/T177432 ** Style Guide *** Fixing technical debt, *** Bringing proper SVG implementation to it *** Overhauling imagery == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: **Improve, adjust, or create features geared at the needs identified in New Editors research project. *** New Editors Experience:Analytics === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** More work on new API for main card processor ** blocking more PayPal fraud ** CentralNotice: ready to deploy EventLogging update ** Processing batch refunds for donors affected by confusing recurring toggle === MediaWiki Platform === * Blocked by: * Blocking: * Updates: * StripState improvements to address out of memory errors in production (T187833), and general cleanup * Working to address memcached timeout errors (T187980) * A few bugs showed up related to the Actor table patch and were fixed. * MCR: ** Lots of code review ** Lots of design discussion * Comment table: ** WRITE_BOTH enabled everywhere! ** WRITE_NEW blocked on the follow up schema change (T187089) and on T181650. ** There was some displeasure on enwiki over longer edit summaries resulting in T188798 "Decreasing length of the edit summary (until UI issues are resolved)". * Progress on running tests with PHP 7.0 in CI (T144962) * utfnormal update and other ICU upgrade related patches (T188480) * SPDX 3.0 license identifier updates * LuaSandbox: fixed test failure in 32-bit mode, released new version (T188467) * Published aggregated pingback statistics using reportupdater and dashiki: https://pingback.wmflabs.org ** Will be announced after final tweaks ** Thanks, Analytics! * Preparing for EMWCon * FYI: Daren Welsh from NASA posted https://www.mediawiki.org/wiki/5_Year_NASA_Wikiversary *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services * Reduce product and technical debt to modernise our tools and technologies, and to make future changes more effective and efficient *** Parsing/Mediawiki PF **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** no new updates on quarterly goal dependencies since last week === Performance === * Blocked by: **N/A * Blocking: **N/A * Updates: ** SRE raised concerns about mcrouter project, going back to the drawing board with an alternative called Dynomite. This puts our quarterly goal to have WANCache replicated between data centers at risk ** Enabling oversampling of performance metrics from Singapore this week, to support the new cache center there. ** Thumbor private wiki support being improved further ** WPT migration to Linux complete, dashboards need to be updated if they haven't been already ** FOUC issue when autofocus is used on Firefox has been addressed, but fix won't be released until FF60 (expected on 8 May). (Has been reported to affect some Special pages, Roan also reported it.) ** Coal update from last week was carried over to address some CR issues, should go out this week instead. === Release Engineering === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: * === Research === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Update: * === Scoring Platform === * Blocked by: * Blocking: * Updates: === Search Platform === * Blocked by: * Blocking: * Updates: **Kafka poller for WDQS is in production: https://phabricator.wikimedia.org/T185951 ** Wikidata items appear in completion searches faster - merged: https://phabricator.wikimedia.org/T183053 ** Started testing “query explorer” feature of LTR plugin: https://phabricator.wikimedia.org/T187148 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** Working on Serbian analyzer for ES: https://phabricator.wikimedia.org/T183015 ** Discussing Lexeme search implementation: https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Lexeme_search *Quarterly goal dependency update: ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * === Security === * Blocked by: * Blocking: * Updates: ** === Services === * Blocked by: none * Blocking: none * Updates: ** All refreshLinks jobs processed on kafka queue *** Some backlogw created by the switch is being cleared now ** All cdnPurge jobs processed on kafka ** Next - switch cirrusSearch jobs === Site Reliability Engineering === * Blocked by: ** Collab on Flow dumps https://phabricator.wikimedia.org/T172025 *** Roan: not any more, we're blocked on you now * Blocking: ** None that we know of * Updates: ** All traffic cluster are now upgraded to Varnish 5 ** hardware refreshing ongoing ** A long standing ICMP issue traffic from Google was fixed finally last week. https://phabricator.wikimedia.org/T165651#4017007 ** The Readings lists schema change has been completed by the Data Persistence SRE (sub)team *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: It will not happen this quarter due to lack of time from Services and SRE teams per https://phabricator.wikimedia.org/T187821#4018885 * ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops This is https://phabricator.wikimedia.org/T185282 ** Update: This is not in SRE field currently, we are waiting for the code to be live in gerrit/phab repos * == Wikidata == * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** Update: * ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: **please add links to Phab tickets that relate to quarterly goals

1 0

LAST REMINDER: Wikimedia Hackathon 2018 Barcelona - 14 March
by Toni Hermoso Pulido 08 Mar '18

08 Mar '18

Hello everyone, We are getting close to maximum capacity for the Wikimedia Hackathon in Barcelona. This is the last week that we will be accepting registrations from anyone needing accommodation support (registration is already closed for Wikimedia Foundation staff and those requesting scholarships). The deadline for any additional registrations is Wednesday, 14 March. https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018/Register_and_Attend Please do not hesitate to mail hackathon(a)wikimedia.cat for any question!

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l March 2018