Wikitech-l March 2018

wikitech-l@lists.wikimedia.org

68 participants
76 discussions

Database dumps
by Byrial Jensen 17 Apr '25

17 Apr '25

Until some weeks ago http://dumps.wikimedia.org/backup-index.html used to show 4 dumps in progress at the same time. That meant that new database dumps normally was available within about 3 weeks for all databases except for enwiki and maybe dewiki where the dump process due to size took longer time. However the 4 dumps processes at one time become 3 some weeks ago. And after massive failures at June 4, only one dump has been in progress at the same time. So at the current speed it will take several months to come thru all dumps. Is it possible to speed up the process again using several dump processes at the same time? Thank you, Byrial

3 2

User-Agent:
by Domas Mituzas 17 Apr '25

17 Apr '25

Hi! from now on specific per-bot/per-software/per-client User-Agent header is mandatory for contacting Wikimedia sites. Domas

19 61

Acquiring list of templates including external links
by Takashi OTA 17 Apr '25

17 Apr '25

Hoi, This is an inquiry from my friend in academia, researching about Wikipedia. He would like to know whether there's a way to acquire a list of templates including external links. Here are some examples including external links. https://ja.wikipedia.org/wiki/Template:JOI/doc https://ja.wikipedia.org/wiki/Template:Twitter/doc Such links are stored in externallinks.sql.gz, in an expanded form. When you want to check increase/decrease of linked domains in chronological order through edit history, you have to check pages-meta-history1.xml etc. In a such case, traditional links and links by templates are mixed, Therefore, the latter ones (links by templates) should be expanded to traditional link forms. Sorry if what I am saying does not make sense. Thanks in advance, --Takashi Ota [[U:Takot]]

13 24

EBNF grammar project status?
by Steve Bennett 01 Apr '25

01 Apr '25

What's the status of the project to create a grammar for Wikitext in EBNF? There are two pages: http://meta.wikimedia.org/wiki/Wikitext_Metasyntax http://www.mediawiki.org/wiki/Markup_spec Nothing seems to have happened since January this year. Also the comments on the latter page seem to indicate a lack of clear goal: is this just a fun project, is it to improve the existing parser, or is it to facilititate a new parser? It's obviously a lot of work, so it needs to be of clear benefit. Brion requested the grammar IIRC (and there's a comment to that effect at http://bugzilla.wikimedia.org/show_bug.cgi?id=7 ), so I'm wondering what became of it. Is there still a goal of replacing the parser? Or is there some alternative plan? Steve

26 217

Missing Section Headings
by Marc Riddell 13 Sep '24

13 Sep '24

Hello, I have been a WP editor since 2006. I hope you can help me. For some reason I no longer have Section Heading titles showing in the Articles. This is true of all Headings including the one that carries the Article subject's name. When there is a Table of Contents, it appears fine and, when I click on a particular Section, it goes to that Section, but all that is there is a straight line separating the Sections. There is also no button to edit a Section. If I edit the page and remove the "== ==" markers from the Section Titles, the Title then shows up, but not as a Section Heading. Also, I don't have any Date separators on my Want List. This started 2 days ago. Any thoughts? Thanks, Marc Riddell [[User:Michael David]]

10 11

How to make commits from mirrored Wikimedia repos show up on your GitHub profile
by Bartosz Dziewoński 28 Jun '24

28 Jun '24

I know it has been annoying a couple of people other than me, so now that I've learned how to make it work I'll share the knowledge here. tl;dr: Star the repositories. No, seriously. (And yes, you need to star each extension repo separately.) (Is there a place on mw.org to put this tidbit on?) ------- Forwarded message ------- From: "Brian Levine" <support(a)github.com> (GitHub Staff) To: matma.rex(a)gmail.com Cc: Subject: Re: Commits in mirrored repositories not showing up on my profile Date: Tue, 09 Jul 2013 06:47:19 +0200 Hi Bartosz In order to link your commits to your GitHub account, you need to have some association with the repository other than authoring the commit. Usually, having push access gives you that connection. In this case, you don't have push permission, so we don't link you to the commit. The easy solution here is for you to star the repository. If you star it - along with the other repositories that are giving you this problem - we'll see that you're connected to the repository and you'll get contribution credit for those commits. Cheers Brian -- Matma Rex

3 3

Research FAQ gets a facelift
by Dario Taraborelli 25 Jun '24

25 Jun '24

We just released a new version of Research:FAQ on Meta [1], significantly expanded and updated, to make our processes at WMF more transparent and to meet an explicit FDC request to clarify the role and responsibilities of individual teams involved in research across the organization. The previous version – written from the perspective of the (now inactive) Research:Committee, and mostly obsolete since the release of WMF's open access policy [2] – can still be found here [3]. Comments and bold edits to the new version of the document are welcome. For any question or concern, you can drop me a line or ping my username on-wiki. Thanks, Dario [1] https://meta.wikimedia.org/wiki/Research:FAQ [2] https://wikimediafoundation.org/wiki/Open_access_policy [3] https://meta.wikimedia.org/w/index.php?title=Research:FAQ&oldid=15176953 *Dario Taraborelli *Head of Research, Wikimedia Foundation wikimediafoundation.org • nitens.org • @readermeter <http://twitter.com/readermeter>

2 1

bluejeans
by Jeremy Baron 22 Feb '23

22 Feb '23

Hi, On Tue, Mar 1, 2016 at 3:36 PM, David Strine <dstrine(a)wikimedia.org> wrote: > We will be holding this brownbag in 25 minutes. The Bluejeans link has > changed: > > https://bluejeans.com/396234560 I'm not familiar with bluejeans and maybe have missed a transition because I wasn't paying enough attention. is this some kind of experiment? have all meetings transitioned to this service? anyway, my immediate question at the moment is how do you join without sharing your microphone and camera? am I correct thinking that this is an entirely proprietary stack that's neither gratis nor libre and has no on-premise (not cloud) hosting option? are we paying for this? -Jeremy

9 16

New DB_REPLICA constant; DB_SLAVE deprecated
by Aaron Schulz 04 Jul '20

04 Jul '20

As of 950cf6016c, the mediawiki/core repo was updated to use DB_REPLICA instead of DB_SLAVE, with the old constant left as an alias. This is part of a string of commits that cleaned up the mixed use of "replica" and "slave" by sticking to the former. Extensions have not been mass converted. Please use the new constant in any new code. The word "replica" is a bit more indicative of a broader range of DB setups*, is used by a range of large companies**, and is more neutral in connotations. Drupal and Django made similar updates (even replacing the word "master"): * https://www.drupal.org/node/2275877 * https://github.com/django/django/pull/2692/files & https://github.com/django/django/commit/beec05686ccc3bee8461f9a5a02c607a023… I don't plan on doing anything to DB_MASTER, since it seems fine by itself, like "master copy", "master tape" or "master key". This is analogous to a master RDBMs database. Even multi-master RDBMs systems tend to have a stronger consistency than classic RDBMs slave servers, and present themselves as one logical "master" or "authoritative" copy. Even in it's personified form, a "master" database can readily be thought of as analogous to "controller", "governer", "ruler", lead "officer", or such.** * clusters using two-phase commit, galera using certification-based replication, multi-master circular replication, ect... ** https://en.wikipedia.org/wiki/Master/slave_(technology)#Appropriateness_of_… *** http://www.merriam-webster.com/dictionary/master?utm_campaign=sd&utm_medium… -- -Aaron

4 3

Life hack: Working with production content in your local wiki
by Jon Robson 13 Dec '18

13 Dec '18

I've been meaning to document this for a while. If you're finding yourself visiting Special:Export/Import often for the purpose of MediaWiki development there is a much better way to get content into your local wiki for testing purposes. This short video explains how MobileFrontend extension provides tooling to help you debug live on-wiki content via $wgMFContentProviderClass [1] https://youtu.be/uRQzjN0hBlY Hope it saves someone lots of time! [1] https://github.com/wikimedia/mediawiki-extensions-MobileFrontend/blob/maste… -- Jon Robson Senior Software Engineer

1 1

Roadmap for CX?
by Strainu 06 Sep '18

06 Sep '18

Following the recent outage, we've had a new series of complaints about the lack of improvements in CX, especially related to server-side activities like saving/publishing pages. Now, I know the team is involved in a long-term effort to merge the editor with the VE, but is there an end in sight for that effort? Can I tell people who ask "look, 6 more months then we'll have a much better translation tool"? Is there a publicly available roadmap for this project and more generally, for CX? Thanks, Strainu

5 8

Re: [Wikitech-l] Wikistats 2.0 - Now with Maps!
by יגאל חיטרון 17 Apr '18

17 Apr '18

Hello and thank you. What do you mean in country named "--"? Igal (User:IKhitron) On Feb 15, 2018 00:15, "Nuria Ruiz" <nuria(a)wikimedia.org> wrote: Hello from Analytics team: Just a brief note to announce that Wikistats 2.0 includes data about pageviews per project per country for the current month. Take a look, pageviews for Spanish Wikipedia this current month: https://stats.wikimedia.org/v2/#/es.wikipedia.org/reading/ pageviews-by-country Data is also available programatically vi APIs: https://wikitech.wikimedia.org/wiki/Analytics/AQS/ Pageviews#Pageviews_split_by_country We will be deploying small UI tweaks during this week but please explore and let us know what you think. Thanks, Nuria _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

6 12

changes coming to large dumps
by Ariel Glenn WMF 10 Apr '18

10 Apr '18

Please forward wherever you think appropriate. For some time we have provided multiple numbered pages-articles bz2 file for large wikis, as well as a single file with all of the contents combined into one. This is consuming enough time for Wikidata that it is no longer sustainable. For wikis where the sizes of these files to recombine is "too large", we will skip this recombine step. This means that downloader scripts relying on this file will need to check its existence, and if it's not there, fall back to downloading the multiple numbered files. I expect to get this done and deployed by the March 20th dumps run. You can follow along here: https://phabricator.wikimedia.org/T179059 Thanks! Ariel

3 6

Unblocking 79 IPs blocked as open proxies 12 years ago (T189840)
by Brad Jorsch (Anomie) 08 Apr '18

08 Apr '18

In 2005–2006 a sysadmin blocked 79 IP addresses on all wikis as being automatically-detected open proxies, without recording them in the block log or attributing the block to any user account. These incomplete records are now causing errors when MediaWiki tries to access them in various places, see https://phabricator.wikimedia.org/T189840. Since these are all over 12 years old, it seems reasonably likely that many of these are no longer open proxies. Rather than trying to fix the incomplete records, I'm just going to remove them. Any existing blocks of these IPs that are not causing errors will not be removed. At first glance this seems relevant mainly to enwiki, where only 5 of the IPs have incomplete records. 21 are currently blocked there with complete records (19 since 2005 or earlier), and the other 53 are not currently blocked there. The list of IPs is at https://phabricator.wikimedia.org/P6876 in case anyone wants to review them for potential reblocking. -- Brad Jorsch (Anomie) Senior Software Engineer Wikimedia Foundation

7 8

Better Support for Mobile in Wikistats2
by Nuria Ruiz 30 Mar '18

30 Mar '18

Hello! Analytics is working on better support for mobile in wikistats2: http://stats.wikimedia.org/v2 Do take a look at latest changes and if there are issues that prevent you from using this site in mobile let us know. A phabricator ticket (http://phabricator.wikimedia.org) with a screenshot will be great. Site should be usable in: * last two versions of any major desktop browser (chrome, FF, edge and safari) * any newish iOS device (iphone4 and up) that has been kept up to date * android 4.4 and up We are still working on improving our mobile support and happy to take requests on higher levels of support for browsers we might have not considered. This is the work we have planned for next quarter: - Persistent links for metrics. Bookmarks. task T179444 <https://phabricator.wikimedia.org/T179444> - Support annotations task T178015 <https://phabricator.wikimedia.org/T178015> - Label non obvious concepts task T177950 <https://phabricator.wikimedia.org/T177950> - Improvements on pageview data per country task T188928 <https://phabricator.wikimedia.org/T188928> Thanks, Nuria

1 0

MediaWiki train rolled back to wmf.26
by Greg Grossmeier 30 Mar '18

30 Mar '18

The new MediaWiki weekly branch has some issues that are preventing us from deploying as planned. The specific issue: https://phabricator.wikimedia.org/T190960 The tracking task for the train: https://phabricator.wikimedia.org/T183966 Reminder that you can use the "Wikimedia MediaWiki versions"[0] tool on ToolForge to to know which wikis have which version at any time. Greg [0] https://tools.wmflabs.org/versions/ -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | Release Team Manager A18D 1138 8E47 FAC8 1C7D |

1 1

Code of conduct committee call for new members
by Amir Ladsgroup 30 Mar '18

30 Mar '18

Hello all, It's coming close to time for annual appointments of community members to serve on the Code of Conduct (CoC) committee. The Code of Conduct Committee is a team of five trusted individuals plus five auxiliary members with diverse affiliations responsible for general enforcement of the Code of conduct for Wikimedia technical spaces. Committee members are in charge of processing complaints, discussing with the parties affected, agreeing on resolutions, and following up on their enforcement. For more on their duties and roles, see https://www.mediawiki.org/wiki/Code_of_Conduct/Committee <http://meta.wikimedia.org/wiki/Ombudsman_commission> This is a call for community members interested in volunteering for appointment to this committee. Volunteers serving in this role should be experienced Wikimedians or have had experience serving in a similar position before. The current committee is doing the selection and will research and discuss candidates. Six weeks before the beginning of the next Committee term, meaning 8th of April 2018, they will publish their candidate slate (a list of candidates) on-wiki. The community can provide feedback on these candidates, via private email to the group choosing the next Committee. The feedback period will be two weeks. The current Committee will then either finalize the slate, or update the candidate slate in response to concerns raised. If the candidate slate changes, there will be another two week feedback period covering the newly proposed members. After the selections are finalized, there will be a training period, after which the new Committee is appointed. The current Committee continues to serve until the feedback, selection, and training process is complete. If you are interested in serving on this committee or like to nominate a candidate, please write an email to techconductcandidates AT wikimedia.org with details of your experience on the projects, your thoughts on the code of conduct and the committee and what you hope to bring to the role and whether you have a preference in being auxiliary or constant member of the committee. The committee consists of five members plus five auxiliary members and they will serve for six months; all applications are appreciated and will be carefully considered. The deadline for applications is end of day on 5th of April, 2018. Please feel free to pass this invitation along to any users who you think may be qualified and interested. Best, Amir on behalf of the CoC committee

1 0

TechCom Radar, 2018-03-28
by Kate Chapman 29 Mar '18

29 Mar '18

Hi All, Here are the minutes from this week's TechCom meeting: * This week’s IRC Meeting: Tracking dependencies for multiple Content objects per page (MCR) <https://phabricator.wikimedia.org/T190063> Meeting log: <https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.20…> (summary still to be posted in Phabricator ticket) * RFC Declined (topic can be picked up again when resourced): Define an official thumb API <https://phabricator.wikimedia.org/T66214> * Ops has turned on some services in Eqsin data center, showing improvement for readers in Singapore. Still experimental, but initial results positive. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. -- Kate Chapman TechCom Facilitator (Contractor)

1 0

Turn mapframe for English Wikipedia? We’re ready if you are
by Joe Matazzoni 29 Mar '18

29 Mar '18

In October 2017, English Wikipedia community members approved an RfC requesting implementation of mapframe <https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_15…> [1]—a feature that enables contributors to easily display dynamic maps on article pages. At the time, there was some question about whether technical support for the maps service would be available long term, and the Foundation asked that the community stand by. I’m writing now to say that those questions have been answered, and a small team will be assigned for routine maps maintenance. So, unless we hear from the English Wikipedia community that the consensus on adding mapframe has changed since last year’s RfC, we plan to move forward in April 2018. You can read more about this plan and leave comments on Village Pump [2]. If you foresee any issues, let us hear from you. Otherwise, happy mapping! [1] https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_15… <https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_15…>? [2] https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Turn_on_ma… <https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Turn_on_ma…> Joe Matazzoni Product Manager, Collaboration Wikimedia Foundation

1 0

Re: [Wikitech-l] [Ops] new deployment server (tin -> deploy)
by Mukunda Modell 29 Mar '18

29 Mar '18

Update: deployments are moving back to tin temporarily while we work out what to do about php7 (or rather, the lack of php5 in stretch) See https://phabricator.wikimedia.org/T190909 On Wed, Mar 28, 2018 at 4:32 AM, Chad Horohoe <chorohoe(a)wikimedia.org> wrote: > Indeed. There was nobody aiming for making php -l or l10nupdate or anything > else *faster*....it was a planned move to stretch and HHVM has been > unacceptably > slow in this area. The decision earlier today to use PHP7 was to avoid the > huge > penalty if we fell back to HHVM instead of using PHP5. > > In any case: we've reverted back to tin for now: > https://gerrit.wikimedia.org/r/#/c/422376/ > > -Chad > > > On Wed, Mar 28, 2018 at 2:25 AM Mukunda Modell <mmodell(a)wikimedia.org> > wrote: > >> This isn't really motivated by any enthusiasm for php7. The issue is that >> php5 has been dropped from stretch and updating the os is a blocker for a >> bunch of other things. So we have to deal with the php7 issue to unblock a >> bunch of other stuff which is not available on jessie. >> >> On Wed, Mar 28, 2018 at 3:19 AM, Antoine Musso <hashar(a)free.fr> wrote: >> >>> On 28/03/2018 00:24, Daniel Zahn wrote: >>> > Hi, >>> > >>> > good old tin.eqiad.wmnet was out of warranty and running jessie, >>> > so as part of our hardware refresh goal it had to be replaced by >>> > something new. >>> > >>> > We now have deploy1001.eqiad.wmnet and it's running on stretch with >>> PHP7 >>> > and we just switched deployment servers and Mukunda is running the >>> first >>> > deploy from it as we speak. >>> > >>> > <+logmsgbot> !log twentyafterfour@deploy1001 Started scap: Deploy >>> > 1.31.0-wmf.27 to test wikis >>> > >>> > >>> > Here are the related puppet changes that switched it and added stretch >>> > support: >>> > >>> > https://gerrit.wikimedia.org/r/#/q/project:operations/ >>> puppet+branch:production+topic:deploy1001 >>> > >>> > >>> > Additionally mwscript needed a way to detect php5 or php7, for that >>> see: >>> > https://gerrit.wikimedia.org/r/#/c/422348/ >>> > >>> > There are also more details on today's SAL and on: >>> > https://phabricator.wikimedia.org/T175288 >>> >>> Hello, >>> >>> I am not sure it is a good idea to switch to PHP7 right now, specially >>> in production. I understand the incentive to get l10nupdate , scap php >>> -l etc faster, but really switching mwscript to php7 is too early. >>> >>> There are a few reasons: >>> >>> - Although CI runs PHP7 tests, the jobs run on Jessie with different >>> libraries than Stretch and we use community made Debian packages ( >>> https://deb.sury.org/ ). >>> >>> - The beta cluster is on HHVM, with the equivalent of tin using php5.6. >>> That is where we catch a lot of low hanging fruits. >>> >>> - We all know our test coverage is far from the production reality. >>> >>> - worker machines such as terbium/wasat do rely on mwscript for >>> production critical jobs. I guarantee they will magically explode the >>> minute they are switched to PHP7. >>> >>> - application servers SHELL OUT to mwscript to get other wikis >>> configuration (see SiteConfiguration::getConfig() ). >>> >>> >>> - of course various PHP7 objects/functions would have a slightly >>> different behavior compared to PHP5/HHVM. That has hit us hard >>> previously when we switched. >>> >>> I appreciate all the enthusiasms toward migration to PHP7. But can we >>> please do it professionally with stages and proper testing? I would >>> rather avoid having the whole site down and making the news front page. >>> >>> cheers, >>> >>> -- >>> Antoine "hashar" Musso >>> >>> >>> _______________________________________________ >>> Ops mailing list >>> Ops(a)lists.wikimedia.org >>> https://lists.wikimedia.org/mailman/listinfo/ops >>> >> >> _______________________________________________ >> Ops mailing list >> Ops(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/ops >> >

2 2

MediaWiki-CodeSniffer 17.0.0 released
by Kunal Mehta 29 Mar '18

29 Mar '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hello! MediaWiki-CodeSniffer 17.0.0 is now available for use in your MediaWiki extensions and other projects. This release features new sniffs, performance improvements, and other bug fixes. Notably, the "MissingParamComment" warning was removed - it often led to people adding documentation like "@param User $user User object" where the comment was not useful, and just a duplicate of the name or type. The full changelog since 16.0.1: * Allow globals to start with numbers (Umherirrender) * Check for close parenthesis first and shorten out earlier (Thiemo Kreu z) * Check for use statement with non-compound name (Umherirrender) * Don't require @covers from abstract tests (Max Semenik) * Forbid usage of assert() (Kunal Mehta) * Improve ClassMatchesFilenameSniff::isMaintenanceScript (Umherirrender) * Improve performance of PrefixedGlobalFunctionsSniff (Umherirrender) * Optimize ClassMatchesFilename sniff for performance (Thiemo Kreuz) * Optimize DirUsage sniff for performance (Thiemo Kreuz) * Optimize MultipleEmptyLines sniff for performance (Thiemo Kreuz) * Remove warning about "missing" @param comments (Thiemo Kreuz) * Simplify UnusedGlobalVariables sniff (Thiemo Kreuz) * Skip closing parentheses in "( )" and "[ ]" instead of rechecking (Thiemo Kreuz) * Skip empty () and [], not processing closing token a second time (Thiemo Kreuz) * Update squizlabs/php_codesniffer to 3.2.3 (Kunal Mehta) * Use faster array_key_exists instead of in_array in 2 sniffs (Thiemo Kreuz) * Use faster strcasecmp() instead of strtolower() for comparisons (Thiemo Kreuz) * Use File::findExtendedClassName to get extends name (Umherirrender) * Use File::getDeclarationName to get the function name (Umherirrender) * Use File::getMethodProperties to get visibility (Umherirrender) * Validate @license against SPDX (Umherirrender) * Validate phpunit annotations (Umherirrender) - -- Legoktm -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlq8BRYACgkQUvyOe+23 /KJbvg//c9C8YCRm7GSahC5swIlOMaBlTFDT85ZKHsRML1FGWAv2N1SKMTBNkTn/ Az6qfo8DriqOwApgIxA9TXMI3JareBWQzphuXGWz7OMGQD029rolTQ5T5urPNcu+ nEgcPEvLiwC1Mflj3abfVhr4FTncAI9zpjBoSwIF5EOfJRsx79lEuX6Gz9gVBxU+ 4zsvQ0kx0zf6wLinK5i8WsIaV5nJN218vr4/wkI1g85zCVdqoebVrYGfF5sI7FAt P1ZYpzSd0eY5EYxkiBkjd6ZmzjIY8hnwKOl80lDBNPzH6+K0tOP0nj8p9nIeJVyS X0/shWSJsdjgr3rpD6zdzFi69ow9zwffIsT+tlWUIuFsv/fXfEZkXwPLQECSSBTv sHfKPQgUWgmdPEvHaGp7SyN7xExIbPm+kxPwsOEYufsDPU/c0M2BOC+FF5d7eFa2 luVItCnCaou6fwT4CdI0XQX2eVjTk0D1P32gs0P6pDcKjG8Elg4k5UEmQUnP4Iyy HalGL8bjzlLcdwJTOWgWyH7JUHcv1v0gVvja35SUHpgdMCwINvnZFpKc8BMFj6MG b6f8LrL2bbdmxWhJxdp0Oqk0J7jzaGMYahtb+hPk9ENV0mi5TUGDHUW2msBLvWwa ZriHPMbOnalCiZq+Sn6vomKM+hs9aXyyJiVXyNdSH0JhhPke9Jo= =Lgpe -----END PGP SIGNATURE-----

1 0

Re: [Wikitech-l] Example .spec file for packaging Mediawiki with RPM
by Hogan, Michael C 29 Mar '18

29 Mar '18

Kunal, thank you for the reference to the Fedora .spec files. Anyone know if there's a technical / policy reason for the Fedora EPEL package to be stuck at mediawiki123? https://mirror.umd.edu/fedora/epel/7/x86_64/Packages/m/ -Michael -----Original Message----- From: Wikitech-l [mailto:wikitech-l-bounces@lists.wikimedia.org] On Behalf Of wikitech-l-request(a)lists.wikimedia.org Sent: Tuesday, March 27, 2018 5:00 AM To: wikitech-l(a)lists.wikimedia.org Subject: Wikitech-l Digest, Vol 176, Issue 34 Send Wikitech-l mailing list submissions to wikitech-l(a)lists.wikimedia.org To subscribe or unsubscribe via the World Wide Web, visit https://lists.wikimedia.org/mailman/listinfo/wikitech-l or, via email, send a message with subject or body 'help' to wikitech-l-request(a)lists.wikimedia.org You can reach the person managing the list at wikitech-l-owner(a)lists.wikimedia.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Wikitech-l digest..." Today's Topics: 1. Replacing Tidy on Wikimedia wikis: Next round (Subramanya Sastry) 2. Example .spec file for packaging Mediawiki with RPM? (Hogan, Michael C) 3. Re: Example .spec file for packaging Mediawiki with RPM? (Kunal Mehta) ---------------------------------------------------------------------- Message: 1 Date: Mon, 26 Mar 2018 14:53:27 -0700 From: Subramanya Sastry <ssastry(a)wikimedia.org> To: wikitech-l(a)lists.wikimedia.org Subject: [Wikitech-l] Replacing Tidy on Wikimedia wikis: Next round Message-ID: <d8a9b509-251f-a92f-9bbf-73b3f620248a(a)wikimedia.org> Content-Type: text/plain; charset=utf-8; format=flowed Hello everyone, On behalf of the Parsing Team @ the WMF, I am announcing our plans to replace Tidy with Remex on the next set of wikis. On April 4th, we plan to turn off Tidy on all wikiquotes (except frwikiquote) [1] and wikimedia wikis [2]. 23 wikis will have Tidy replaced. On April 11th, we plan to turn off Tidy on all wikis with < 50 entries in all high priority linter categories [3]. About 60 wikis will have Tidy replaced. Please follow T175706 [4] to monitor progress of Tidy replacement. Currently about 600 wikis have had Tidy replaced and we have another 300 wikis to go. We plan to finish this transition from Tidy to RemexHtml by end of June 2018. If you have any questions or concerns, please leave a comment on the associated phabricator tickets or leave a message on mw.org [5]. Thanks, Subbu. [1] https://phabricator.wikimedia.org/T188881 [2] https://phabricator.wikimedia.org/T190726 [3] https://phabricator.wikimedia.org/T190731 [4] https://phabricator.wikimedia.org/T175706 [5] https://www.mediawiki.org/wiki/Help_talk:Extension:Linter ------------------------------ Message: 2 Date: Mon, 26 Mar 2018 22:02:49 +0000 From: "Hogan, Michael C" <Michael.C.Hogan2(a)boeing.com> To: "wikitech-l(a)lists.wikimedia.org" <wikitech-l(a)lists.wikimedia.org> Subject: [Wikitech-l] Example .spec file for packaging Mediawiki with RPM? Message-ID: <522be458713a415bb5e2cb933f77362d(a)XCH15-04-08.nw.nos.boeing.com> Content-Type: text/plain; charset="us-ascii" Anyone know of a Mediawiki RPM .spec file posted online? I've only been able to find pre-packaged RPMs. Thank you! ------------------------------ Message: 3 Date: Mon, 26 Mar 2018 17:00:20 -0700 From: Kunal Mehta <legoktm(a)member.fsf.org> To: wikitech-l(a)lists.wikimedia.org Subject: Re: [Wikitech-l] Example .spec file for packaging Mediawiki with RPM? Message-ID: <109bc4b8-78ce-37cb-abc3-a6f746a4e295(a)member.fsf.org> Content-Type: text/plain; charset=utf-8 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, On 03/26/2018 03:02 PM, Hogan, Michael C wrote: > Anyone know of a Mediawiki RPM .spec file posted online? I've only > been able to find pre-packaged RPMs. Thank you! The .spec files that Fedora uses are available at <https://src.fedoraproject.org/rpms/mediawiki/tree/master>. - -- Legoktm -----BEGIN PGP SIGNATURE----- iQJLBAEBCgA1FiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlq5iZIXHGxlZ29rdG1A bWVtYmVyLmZzZi5vcmcACgkQUvyOe+23/KLvtw//VRq2kgLTUO9Iaj+lUHBZKHo7 svXF2XN9sOiJL/gUahLyWBn69wSAky8vmuGRWSqttrJ6baqHuV0bjZf7wx8ba7PJ j0nb6q6swlNS5yUAp9shk7c4MuPnByqoet3iFjfDjxocQH8XNFiDPpAxO2W09YoH dPZ1yQRQZCRj8ZeJSSfr+LY0wXaPB/h9m8IX8dDemvG3Cw3D5AGaA/wLUH1Mif/Y Yibrynh9b+NpQeBg6UG4MrpkNS6c54TW+SCkQS6ljLzeSZkuPfHCfqv/VcAQm2QT clA50xnl31XSCIRwFjKV/F/xFmlUXaC1iwJsqYJZnXmTe/GXrP5n2s8xVgnws7hp LAqr8Pcws0wHtSrPmaXBrrngFazUvf2VIVP6sP13cIoc2j3HXaUjAFTo4oDpx0BD CXQXFXfpAgXT7Te60OgvtNQp3Zg3CZcev7WcpzjZfl3/m+M70wQLzGy5HS7hBdXY LfEmpfc7QyKl0W8CdwsX+h58okFsxSdKu6wS9kstUotw5EMX62YYvmmSTqJck8r+ jzagCQF++Ler/TAeCK3LqICpwnZ3w9CZWO8fL12iOnxHnGya2YMsGsFBR4SBEgZ0 AghqVRFQEaSl1WxnEIMtSdFqLf3fGRYWl+1l0a3u7xuQ3DQXbYKtjXmemDaEeYfZ NafRDhU0jFvKbNrhzj8= =O2z6 -----END PGP SIGNATURE----- ------------------------------ Subject: Digest Footer _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l ------------------------------ End of Wikitech-l Digest, Vol 176, Issue 34 *******************************************

2 1

Discovery Weekly Update for the week starting 2018-03-19
by Chris Koerner 29 Mar '18

29 Mar '18

Hi, Below you'll find the weekly update from the Search Platform team for the week starting 2018-03-19. As always, feedback and questions welcome. == Discussions == === Search === * Trey has finished his initial review of a Slovak stemmer, and so far it looks like like the less aggressive version of the stemmer performs well. [0] Next steps may include more testing and packaging a version of the stemmer into an Elasticsearch plugin. == Did you know? == * The English word ''nice'' has undergone many big swings in meaning, including “foolish”, “painstaking”, “strict”, “subtle”, and “risky”. See the obsolete and dated senses in English Wiktionary [1] or the etymological information at Etymonline [2]. [0] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Slovak_Stemmer_Analy… [1] https://en.wiktionary.org/wiki/nice#English [2] https://www.etymonline.com/word/nice --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

1 0

2018-03-28 Scrum of Scrums meeting notes
by Grace Gellerman 29 Mar '18

29 Mar '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-03-28 = 2018-03-28 = == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01 * Language blocked on Research: Recommendation API fails with internal error if the optional seed_article param is missing (T190266) * English Wikipedia is rolling out local Wikidata description overrides, which are available via a different API. All on-wiki functionality should be updated to use prop=description instead of prop=pageterms. Affected teams will be contacted by Lani over the coming week; if we forget about you, please reach out. (T184000) * OOUI's default font size has changed from 12.8px to 14px https://phabricator.wikimedia.org/T97631 , and the icons were resized and redesigned https://phabricator.wikimedia.org/T177432 . If you have code using OOUI, you may need to update it after these changes. == Audiences == === Readers === ==== iOS native app ==== * Blocked by: - * Blocking: - * Updates: ** Stil working on Reading Lists (current release board: https://phabricator.wikimedia.org/tag/ios-app-v5.8.0-manatee-on-a-skateboar…), planning to do user testing early this week (details about what we'll be covering: https://phabricator.wikimedia.org/T188962) ** Senior iOS Software Engineer job ad posted ( https://boards.greenhouse.io/wikimedia/jobs/1072152?gh_src=q87rx4bt1#.Wrjw-…), we're preparing hiring materials (tech questions, tech task) ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Reading list syncing rolled out to 100% of Beta audience (~250K users) ** Will start rolling out to production in ~1-2 more weeks, while we gather feedback from beta users. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: ** Increase learning by lowering the cost of exploration *** Reading Web/Performance ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** enabled Wikidata description override for enwiki on Wednesday (T184000) ** enabled TemplateStyles for wikivoyages on Wednesday (T189834) ===== Maps ===== * Blocked by: Ops creating a schema on maps test server ( https://phabricator.wikimedia.org/T190238) * Blocking: * Updates: *Working with collab * Making progress towards new style deployment ==== Multimedia ==== * Updates ** Search for MediaInfo: Patch merged, follow-up work progressing - thanks to the Search and WMDE teams for being helpful there ** Multi-lingual captions in UploadWizard: Work progressing, thanks to WMDE for being helpful there ** File page display/editing of MediaInfo data: Patch up, working now, thanks especially to Thiemo (WMDE) for walking through stuff when needed Quarterly goal dependency update ** Prepare backend infrastructure for structured data search: Nearly done *** SDC: Search PF/Multimedia/Wikidata ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure: Nearly done *** SDC: Research/Multimedia ** Prepare backend infrastructure for structured data search: Nearly done *** SDC: Search PF/Multimedia/Wikidata === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** Resolving issues uncovered by GlobalPreferences test deployment last week ==== Anti-Harassment Tools ==== * Blocked by: None * Blocking: None that we know of * Updates: ** Bug Fixes completed for Interaction Timeline ** Continue work on Blocking Tool improvlements ** Continue research on Reporting Tool ==== Editing ==== * Blocked by: None * Blocking: None ** Updates: OOUI font size fixes ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ** OOUI font size update on the train this week, lots of tweaks to deal with that ** Got maps service working in labs and pointed beta wikis to it. Need to migrate to a new VM though, due to OpenStack issues ** Localized maps labels expected in beta labs end of this week / early next ==== Language ==== * Blocked by: ** Research: Recommendation API fails with internal error if the optional seed_article param is missing (T190266) * Blocking: * Updates: ** Work on CX2 continue, except tools column. === Audiences Design === * Blocked by: * Blocking: * Updates: ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** OOUI – v0.26.1 released https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v… *** In-time release before MW core cut to address findings from icons/font-size rollout in v0.26.0 on two main tasks below *** WikimediaUI theme's new icon set in place https://phabricator.wikimedia.org/T177432 ! *** Unified VE in Vector/WikimediaUI interface base font-size to usage of OOUI in core/extensions elsewhere https://phabricator.wikimedia.org/T97631 ! ** Style Guide *** Continued work on v1 goals https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/ == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Jupyter notebooks hardware has been refreshed and updated software. ** Working with audiences on rolling out the popups feature (desktop previews of pages) to all wikipedias. Not yet enabled on enwiki or dewiki ** responsive Wikistats work is ongoing ** Geowiki dashboard from hadoop data should be finished this week ** Google Summer of Code (improvements to Wikistats 2 UI) - We are currently in the process of chosing among two participants * Quarterly goal dependency update: **Improve, adjust, or create features geared at the needs identified in New Editors research project. *** New Editors Experience:Analytics === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Drupal security release dropping today. ** More work on recurring charges with our new payment processor integration. ** Second round of unintended recurring charge cancelations and refunds. ** More work on using EventLogging to get banner impression and fundraiser landing page stats === MediaWiki Platform === * Blocked by: * Blocking: * Updates: ** Announced April 16 as the "pencils down" date for MW 1.31 ** Met with SRE to discuss multi-DC planning ** Actively participated in Enterprise MediaWiki Conference (EMWCon) ( https://www.mediawiki.org/wiki/EMWCon_Spring_2018) *** Cindy presented "Toward a MediaWiki Roadmap" and was a panelist on "MediaWiki Best Practices" panel *** Celebrated MediaWiki's 15th birthday ( https://twitter.com/CindyCicalese/status/976862020925566976) *** Toured NASA Johnson Space Center to get first-hand view of the use of their wikis (https://twitter.com/CindyCicalese/status/976517916488323072) ** Finished extension updates related to Actor table ** MCR code review and development for API updates for query modules ** Comment table follow up schema change still in progress ** Improving test coverage for API modules ** Usual code review and bug fixes *Quarterly goal dependency update: ** Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing:Mediawiki PF/Services *** Platform Evolution CDP planning in progress * Reduce product and technical debt to modernise our tools and technologies, and to make future changes more effective and efficient *** Parsing/Mediawiki PF *** Platform Evolution CDP planning in progress **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata *** MCR development in progress === Performance === * Blocked by: ** None * Blocking: ** None * Updates: ** eqsin live, working with Traffic to monitor/evaluate performance impact. (So far: really good!) ** Continuing to have issues with coal, hoping that a new version that went out just now will work ** Prepping a survey-based study on performance perception, using the QuickSurveys extension ** Patch expected today for the ResourceLoader parts of getting Safe Mode working with VisualEditor ** Dynomite option didn't work for multi-DC WANObjectCache, going back to mcrouter. Got some traction with the team at Facebook that maintains that code base, so that's good. (Thanks to Giuseppe from SRE) === Release Engineering === * Blocked by: * Blocking: * Updates: ** * Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: * === Research === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: ** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure *** SDC: Research/Multimedia ** Update: * === Scoring Platform === * Blocked by: RelEng on git lfs * Blocking: None * Updates: ** ores-support-checklist is almost ready. It's live: http://tools.wmflabs.org/ores-support-checklist ** Will announce it soon === Search Platform === * Blocked by: * Blocking: * Updates: ** *Quarterly goal dependency update: ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata- Lexeme in progress ** Update: *** Wikidata fulltext search - new code enabled with today's train *** Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148 *** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 *** Working Slovak analysis: https://phabricator.wikimedia.org/T178929 *** Working on Lexeme completion search: https://phabricator.wikimedia.org/T189745 === Security === * Blocked by: * Blocking: * Updates: ** === Services === * Blocked by: none * Blocking: none * Updates: ** New REST endpoints with Reading Infrastructure *** Page Metadata https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_metadata_titl… *** Page References https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_references_ti… ** Fixed the issue with jobqueue -> mysql connection spikiness ** Cirrus search jobs transfer started. Switched to kafka for test wikis === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Singapore is already serving live traffic, enabling more countries every week ** Backups goal completed successfully ** PuppetDB upgraded, puppetmasters upgraded, debian stretch upgrades (goal) completed successfully ** hardware refreshing last steps being finished (goal) ** Mathoid 100% served from the kubernetes cluster, migration successful ** *Quarterly goal dependency update: ** Continue improving the ways that users can download articles of interest for later consumption *** Reading Web: Tech Ops/RelEng ** Update: Postponed for early next quarter * ** Audiences DesignStandardise our user interfaces to match user expectation of quality from our products *** Audiences Design: Ops ** Update: AFAIK this is done * == Wikidata == * Blocked by: ** None * Blocking: * Updates: ** Continuing to work on better Lua functions ** Continue work on release for Lexeme, probably at the end of April *Quarterly goal dependency update: **1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages. *** SDC: Mediawiki PF/Wikidata ** Update: * ** Prepare backend infrastructure for structured data search *** SDC: Search PF/Multimedia/Wikidata ** Update: * == German Technical Wishlist == * Blocked by: ** Wikidiff2 review (still the same as the weeks before): https://gerrit.wikimedia.org/r/404293 * Blocking: * Updates: ** Shaping AdvancedSearch extension for Beta phase: https://phabricator.wikimedia.org/T187436 ** Making sure FileImporter works with AbuseFilter as expected: https://phabricator.wikimedia.org/T160540 ** Documenting technical control and data flow of FileImporter before deployment: https://phabricator.wikimedia.org/T190716

1 0

[x-post] Wikimedia Language team online meeting on March 28 instead of March 21 [was Re: [x-post] Wikimedia Language team office hour and online meeting on March 21, 2018 (Wednesday) at 1300 UTC]
by Runa Bhattacharjee 28 Mar '18

28 Mar '18

Hello, Due to unavoidable reasons, we have had to move this online session to next week, on 28th March 2018. The time will be same i.e. 1300 UTC. I will send a reminder ahead of the session. Meanwhile, please see the original announcement below for other details. Thanks, and apologies for this last minute change. regards Runa On Thu, Mar 15, 2018 at 11:17 AM, Runa Bhattacharjee < rbhattacharjee(a)wikimedia.org> wrote: > [x-posted announcement] > > Hello, > > Wikimedia Foundation’s Language team would like to invite you for an > online office hour session scheduled for Wednesday, March 21st, 2018 at > 13:00 UTC. This will be an open session to talk about our work, and in > particular the changes to interlanguage links, which were recently > rolled-out on the English Wikipedia. > > The new option shows a list of up to 9 languages instead of a long list > that can have more than 200 items, and a panel with all the links that can > be looked up in any language using a search box. The purpose of this > feature is to make articles in all languages easier to find. We recently > published a blog post about this feature and the thoughts behind the > development: > > https://blog.wikimedia.org/2018/03/08/compact-language-links-launch. > > This session is going to be an online discussion over Google > Hangouts/Youtube with a simultaneous IRC conversation. Due to the > limitation of Google Hangouts, only a limited number of participation slots > are available. Hence, do please let us know in advance if you would like to > join in the Hangout. The IRC channel will be open for interactions during > the session. > > Please read below for the event details, including local time, youtube > session links and do let us know if you have any questions. > > Thank you > Runa > > == Details == > > # Event: Wikimedia Foundation Language office hour session > > # When: March 21st, 2018 (Wednesday) at 13:00 UTC (check local time > http://www.timeanddate.com/worldclock/fixedtime.html?iso=20180321T1300) > > # Where: and on IRC #wikimedia-office (Freenode) and > https://www.youtube.com/watch?v=RmZcL6zVcTA > > > # Agenda: > Discussion about Compact Language Links, and Q & A. > > > -- > Engineering Manager, Language (Contributors) > Wikimedia Foundation > > -- Engineering Manager, Language (Contributors) Wikimedia Foundation

1 1

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l March 2018