Wikitech-l October 2016

wikitech-l@lists.wikimedia.org

81 participants
93 discussions

MediaWiki and extensions .gitreview now uses track=1
by Tyler Cipriani 01 Nov '16

01 Nov '16

Hi all! Last week .gitreview for MediaWiki branches and extensions switched from targeting a specific branch to using track=1[0]. This is a change that, going forward, should make it easier to do weekly branching and releases without being too disruptive for developer workflows. The git-review version that allows for this change is 1.25.0. I have updated the docs to reflect the use of this version[1]. It is also important to note that to use git-review with track=1 you must be on a local branch that tracks an upstream – detached-head states and branches that do no track upstream will cause strange errors. -- Tyler [0]. <https://phabricator.wikimedia.org/T146293> [1]. <https://www.mediawiki.org/wiki/Gerrit/git-review>

1 0

CREDIT Showcase in two days - 2-Nov-2016 - call for demos
by Adam Baso 31 Oct '16

31 Oct '16

Hi! The next CREDIT showcase is in two days - Wednesday, 2-November-2016 at 1800 UTC (1100 San Francisco). https://www.mediawiki.org/wiki/CREDIT_showcase Got a demo? Add it here: https://etherpad.wikimedia.org/p/CREDIT Last month (WebM <https://commons.wikimedia.org/wiki/File:CREDIT_-_October_2016.webm>, YouTube <https://www.youtube.com/watch?v=PCn-oeHQnpU&feature=youtu.be&t=6>) we saw great demos of a Raspberry Pi based network conditioner, Wikidata credits for maps, extended OCR support for Indic Wikisource projects, an intro to EventBus and ChangePropagation, data visualizations on maps, and an alternative table of contents approach. We're excited to see what's next! Whether you've just launched a new feature or are just getting started with an idea, we welcome demos from Wikimedia community members and staff alike. See you soon. And if you would like to invite anyone to CREDIT, feel free to use this template. *Hi <FNAME>* *I hope all is well with you! I wanted to let you know about CREDIT, a monthly demo series that we’re running to showcase open source tech projects from Wikimedia Community, Reading, Editing, Discovery, Infrastructure and Technology.* *CREDIT is open to the public, and we welcome questions and discussion. The next CREDIT will be held on November 2nd at 11am PT / 2pm ET / 18:00 UTC. * *Here’s a link to the YouTube live stream <https://www.youtube.com/watch?v=NmfqtP3pr2Y>, which will be available shortly before the event starts. There’s more info on MediaWiki.org <https://www.mediawiki.org/wiki/CREDIT_showcase>, and on Etherpad <https://etherpad.wikimedia.org/p/CREDIT>, which is where we take notes and ask questions. You can also ask questions on IRC in the Freenode chatroom #wikimedia-office (web-based access here <https://webchat.freenode.net/?channels=%23wikimedia-office>). * *Please feel free to pass this information along to any interested folks. Our projects tend to focus on areas that might be of interest to folks working across the open source tech community: language detection, numerical sort, large data visualizations, maps, and all sorts of other things.* *Thanks, and I hope to see you at CREDIT.* - *YOURNAME*

1 0

Adding custom parameters to Elastica back-end
by Aran 31 Oct '16

31 Oct '16

Hi Guys, I'm using CirrusSearch on mw1.27 and wondering if there's a way to add custom parameters to the Elastica back-end such as for example, "sort": ["namespace_text": "asc"] Thanks, Aran

1 0

Automatic gerrit authentication and retrieval of reviews
by Strainu 30 Oct '16

30 Oct '16

Hi everyone, I'm organizing a contest for people in Romania willing to contribute to Wikimedia code. [1] In order to automatically grade the contributions, we're using a tool already developed be our partners, ROSEdu, which reviews changes made on github [2][3]. The current (github-based) workflow is: 1. The admins add a number of repositories that qualify for the contest 2. The paticipants login with their github account (using oauth) 3. The software retrieves all the pull requests they made to the relevant projects. 4. A number of points is assigned for each pull request using a predefined formula (based on the number of touched lines, if the change was merged etc.; can by customized) I need some guidance on how to replicate this workflow to Wikimedia's gerrit. I've read the API docs [4] and looked at the gerrit uploader [5] and it seems that retrieving the reviews is fairly straightforward, since all the reviews seem to be available through unauthenticated access. The real issue is how to match the user in the tool with the reviews without user intervention. Any ideas or advice are appreciated, but here are my thoughts on the issue: 1. Gerrit does not seem to support oauth authentication. I vaguely remember that the gerrit account used to be linked to the mw.org account. Is there any way I could use the mw.org auth to retrieve the gerrit account and/or authenticate to gerrit with it? The gerrit uploader seems to only use the mw account to put the username in the committer field and then uploads the change as itself. 2. The simplest (although not so secure) solution would be to ask people to submit their changes using the same email address used for their github account. This will only work if the user is willing to make their github address public (I'm not doing that, for instance). 3. Another idea would be to match the gerrit account with the github account. This sounds even less reliable. 4. Give up and ask the users to submit the email/user used for gerrit and check for cheaters manually (this should work as long as the number of contributors is small) Thanks, Strainu [1] https://www.mediawiki.org/wiki/Wikimedia_Challenge_powered_by_ROSEdu [2] http://challenge.rosedu.org/ [3] https://github.com/rosedu/challenge [4] https://gerrit.wikimedia.org/r/Documentation/rest-api.html [5] https://github.com/valhallasw/gerrit-patch-uploader

5 12

ORES scores is injected to js configs
by Amir Ladsgroup 30 Oct '16

30 Oct '16

Hey, With deployment of I42300f9 [1] in wmf.23 which happened several days ago (depending on your wiki), ORES scores are injected to mediawiki javascript config variables. You can access ores data in Special:RecentChanges/Watchlist/Contributions using mw.config.get('oresData'). It opens up a whole new level of functionality for gadgets. For example, I re-wrote a huge script called ScoredRevisions [2] into several lines [3]. Also, without needing to connect to ores.wikimedia.org, it's much faster than the original gadget. You can also write scripts to sort rows in recent changes based on their ORES scores, etc. As a fun task I made my recent changes look like a rainbow :D [4] [5] The next level is to inject ORES thresholds as mediawiki config variables so we can write up wiki-agnostic gadgets. I would really appreciate comments or ideas :) [1]: https://gerrit.wikimedia.org/r/#/c/314449/ [2]: https://github.com/he7d3r/mw-gadget-ScoredRevisions/blob/master/src/ScoredR… [3]: https://gist.github.com/Ladsgroup/e67e40500b64dd99dc7ab5c2fa34f261 [4]: https://phabricator.wikimedia.org/T144922#2736504 [5]: https://phab.wmfusercontent.org/file/data/hoibxop7mn4s2cooz4lz/PHID-FILE-w7… Best

1 0

Discovery Weekly Update for the week starting 2016-10-24
by Chris Koerner 29 Oct '16

29 Oct '16

Hello, Here is the Discovery status update for the week starting 24 October. Feedback and questions are welcome. == Discussions == * Show globe icon 🌐 next to all <maplinks> links [0] * Request for Comment - All map location names should be shown in the user's language [1] * Merge Kartographer with commons-on-osm [2] * Discussion and recommendations for the overall usability of the new search engine results page with the Design team [3] == Search == * Don't show the "results from other projects" box if empty [4] * Check to see if popularity_score is wrong in a lot of articles [5] * Disable highlighting on insource queries if experimental highlighter in not turned on [6] * Reindex search cluster for BM25 test [7] * Search works incorrectly when the query contains words used as namespace names and a colon (:) [8] * ask for translations for 'showing results from' (Polish, Dutch, Arabic and Chinese) [9] * Configure varnish to include wdqs nodes in codfw [10] * Started second BM25 A/B test (ja, zh, th) [11] * Turn on second BM25 test [12] * Fix in_array() expects parameter 2 to be an array or collection in /srv/mediawiki/php-1.28.0-wmf.22/extensions/CirrusSearch/includes/Search/RescoreBuilders.php on line 160 [13] * Communicate to community the upcoming BM25 release [14] * [Recurring task] CirrusSearch: what is updated during re-indexing [15] * Review and fix the description of autocomplete profiles (completion suggester) in the Search preference tab [16] * Enable cross-wiki backend search functionality on it.wikipedia - we made it faster [17] * Enable GC (garbage collection) logs on Elasticsearch JVM [18] * Argument 2 passed to SearchEngine::processCompletionResults() must be an instance of SearchSuggestionSet, Elastica\Response in SearchEngine class [19] * [bug] cirrussearch fatal in 1.28.0-wmf.23 - [20] == Analysis == * Compare ZRR for query features across other search engines [21] * Investigate what we'd need to do to ignore double quotes in search queries [22] * Maps Dashboard: fix and update [23] * Analyze the variance of user-agent's, country, and other useful metrics of google referred traffic with and without a search query available in referrer [24] * Add a PaulScore approximation to discovery.wmflabs.org [25] == Portal == '''''Portal updates that got code reviews after rebasing - thanks! ''''' * update logo for new branding guidelines [26] * add information for Wikipedia / Wikimedia apps availability [27] == Interactive == * Deprecate <slippymap> provided by MapSources in favor of Kartographer's <mapframe> [28] * Illegal and unheralded removal of MapSourcesHooks::wfgeoLink function hook on dewikivoyage [29] * More details button should appear when map is loaded [30] * maps1002 does not run latest kartotherian [31] * Snapshot service not working with empty groups param [32] * Kartographer no longer displays external data credits [33] * Graph behaves differently on PHP7 - was fixed automagically [34] * <mapframe>/<maplink>: Invalid GeoJSON code in wgKartographerLiveData prevents drawing of maps at Wikivoyage [35] * Don't pollute history with map hashes [36] * Fix Governor's demo - party affiliations (needed a fix with WDQS SPARQL query - thanks, Stas!) [37] * Show wikidata query results as map markers [38] * Support geomask externaldata in Kartotherian [39] * Geoshape service should return map mask polygon with holes [40] '''''Interactive tickets completed this week, but awaiting next train in order to be deployed: Nov 1, 2016:''''' * Use maps snapshot service until user interacts (click/mouseover?) [41] * Geoshape service should return map mask polygon with holes [42] * Show preview with static maps is broken [43] * [Bug] GeoData\Searcher fatal error in 1.28-wmf.23 [44] * Support data.get() with optional language param [45] * Remove static background from mapframes after going dynamic [46] == Interactive Ops Tasks == * WV layers dropdown bug on vem.wmflabs.org [47] * Maps - move traffic to eqiad instead of codfw [48] * Configure new maps servers in eqiad [49] * Unmet dependencies around postgis apt packages on maps* servers [50] * increase replication factor for system_auth keyspace on maps / cassandra [51] * Upgrade PostGIS on maps servers to version 2.2+ [52] * Maps-test was created with incorrect initial encoding [53] * Update Node on Maps to v4.6.0 [54] * elastic2020 is powered off and does not want to restart [55] * Maps - error when doing initial tiles generation: "Error: could not create converter for SQL_ASCII"" [56] [0] https://phabricator.wikimedia.org/T145176 [1] https://phabricator.wikimedia.org/T112948 [2] https://phabricator.wikimedia.org/T149280 [3] https://phabricator.wikimedia.org/T139310#2748175 [4] https://phabricator.wikimedia.org/T96881 [5] https://phabricator.wikimedia.org/T148136 [6] https://phabricator.wikimedia.org/T148107 [7] https://phabricator.wikimedia.org/T147498 [8] https://phabricator.wikimedia.org/T148344 [9] https://phabricator.wikimedia.org/T143354 [10] https://phabricator.wikimedia.org/T146158 [11] https://phabricator.wikimedia.org/T147495 [12] https://phabricator.wikimedia.org/T147497 [13] https://phabricator.wikimedia.org/T148840 [14] https://phabricator.wikimedia.org/T147509 [15] https://phabricator.wikimedia.org/T147505: [16] https://phabricator.wikimedia.org/T148010 [17] https://phabricator.wikimedia.org/T146179 [18] https://phabricator.wikimedia.org/T134853 [19] https://phabricator.wikimedia.org/T148978 [20] https://phabricator.wikimedia.org/T149254 [21] https://phabricator.wikimedia.org/T136377 [22] https://phabricator.wikimedia.org/T149143 [23] https://phabricator.wikimedia.org/T149127 [24] https://phabricator.wikimedia.org/T128146 [25] https://phabricator.wikimedia.org/T144424 [26] https://phabricator.wikimedia.org/T144834 [27] https://phabricator.wikimedia.org/T137495 [28] https://phabricator.wikimedia.org/T136768 [29] https://phabricator.wikimedia.org/T149288 [30] https://phabricator.wikimedia.org/T148882 [31] https://phabricator.wikimedia.org/T148881 [32] https://phabricator.wikimedia.org/T149145 [33] https://phabricator.wikimedia.org/T149154 [34] https://phabricator.wikimedia.org/T148250 [35] https://phabricator.wikimedia.org/T148971 [36] https://phabricator.wikimedia.org/T144880 [37] https://phabricator.wikimedia.org/T149281 [38] https://phabricator.wikimedia.org/T134816 [39] https://phabricator.wikimedia.org/T149151 [40] https://phabricator.wikimedia.org/T146582 [41] https://phabricator.wikimedia.org/T148070 [42] https://phabricator.wikimedia.org/T146582 [43] https://phabricator.wikimedia.org/T149070 [44] https://phabricator.wikimedia.org/T149159 [45] https://phabricator.wikimedia.org/T149149 [46] https://phabricator.wikimedia.org/T149155 [47] https://phabricator.wikimedia.org/T148865 [48] https://phabricator.wikimedia.org/T145758 [49] https://phabricator.wikimedia.org/T138092 [50] https://phabricator.wikimedia.org/T147780 [51] https://phabricator.wikimedia.org/T149074: [52] https://phabricator.wikimedia.org/T144763 [53] https://phabricator.wikimedia.org/T148114 [54] https://phabricator.wikimedia.org/T148661 [55] https://phabricator.wikimedia.org/T149006 [56] https://phabricator.wikimedia.org/T148031 ---- The full update, and archive of past updates, can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as Easy or Volunteer needed in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation 57 links‽ That has to be some kind of record.

1 0

MediaWiki Language Extension Bundle 2016.10 release
by Kartik Mistry 28 Oct '16

28 Oct '16

Hello all, I would like to announce the release of MediaWiki Language Extension Bundle 2016.10. This bundle is The bundle is compatible with MediaWiki 1.26 and 1.27 or above and requires PHP 5.5.9 or above. Next MLEB is expected to be released in 3 months. If there are major changes or important bug fixes, we will do intermediate release. Please give us your feedback at [[Talk:MLEB|https://www.mediawiki.org/wiki/Talk:MLEB]]. * Download: https://translatewiki.net/mleb/MediaWikiLanguageExtensionBundle-2016.10.tar… * sha256sum: f82ac16b1a71433d68066c684c2e67379d3c435d1938044a9f0f0582cb6549b3 Quick links: * Installation instructions are at: https://www.mediawiki.org/wiki/MLEB * Announcements of new releases will be posted to a mailing list: https://lists.wikimedia.org/mailman/listinfo/mediawiki-i18n * Report bugs to: https://phabricator.wikimedia.org/ * Talk with us at: #mediawiki-i18n @ Freenode Release notes for each extension are below. -- Kartik Mistry == Highlights and upgrade notes == * Easy way to access wikitext editor from Special:Translate. T48955 * Special:Translate now works with MobileFrontend. T102922 * Special:Translate now works better in mobile devices. T146134 * WebAPI module to query user's babel languages. * The style of ULS's dialogs have been updated and polished to be more streamlined (for real this time, was incorrectly claimed to be included in 2016.08). == Babel == * Kunal Mehta made is possible to store babel languages in the database for efficient querying if a configuration option is enabled. * Kunal Mehta added an WebAPI module to query user's babel languages. * Kunal Mehta made it possible to read user's babel languages from a central wiki if a configuration option is enabled. T95877 * Ricordisamoa added a configuration option that can be used to set namespace limits to restrict for which pages are automatically categorized to babel categories. T69334 * Niklas Laxström removed references to non-existing configuration option BabelPreferISO639_3. * Kunal Mehta made the new babel database table to start populating automatically if it exists. * Kunal Mehta changed the main babel category no longer include users who set the skill level to zero. T146909 == CLDR and LocalisationUpdate == * Maintenance and localisation updates only. == CleanChanges == * Niklas Laxström fixed a minor issue causing unnecessary code to load on certain configurations. T146476 == Translate == * Glaisher improved how Translate checks and enforces restrictions for non-translatable languages. * C0nnex taught Translate to support new authentication method for Microsoft Translate API. T46679 * Niklas Laxström removed the broken new line handling from Microsoft Translate API support. T60121 * Jon Robson and Niklas Laxström made Special:Translate work with Mobile Frontend. T102922 * Niklas Laxström polished Special:Translate to work better in mobile devices. T146134 * Glaisher added way to access wikitext editor from Special:Translate. T48955 * Federico Leva and Niklas Laxström made "hide own translations" button in Special:Translate only appear when relevant. T50972 * Erik Moeller added support for explicitly chosen namespace constant in wfAddNamespace. * Niklas Laxström fixed an issue causing email confirmation emails to be sent twice for sandbox users. T147570 * Erik Moeller added support for CLDR-style plural keywords to JSON file format support. == UniversalLanguageSelector == * Amir Aharoni changed "Language search" to "Search for a language". T138235 * New design implemented by Niklas Laxström was imported from jquery.uls. * Niklas Laxström improved language change tooltip positioning. T145483 * Amir Aharoni documented available hooks and added one new hook. T145755 * Fomafix improved and simplified the way the CSS is loaded for ULS triggers to avoid flash. * Ed Sanders updated beta feature image to use proper layout and colours. T144428 * Niklas Laxström fixed an issue that caused unparsed plural syntax appear in the compact language links. T148117 -- Kartik Mistry/કાર્તિક મિસ્ત્રી | IRC: kart_ {kartikm, 0x1f1f}.wordpress.com

1 0

Labs and Wikitech outages Friday, 2016-10-28 at 15:00 UTC
by Andrew Bogott 28 Oct '16

28 Oct '16

In order to address a security issue, we are patching and rebooting many physical Labs hosts. The next round of this will begin at 15:00 UTC on Friday, which is 8:00AM San Francisco time. Interruptions will include: - A labs-wide network outage - Wikitech downtime - Horizon downtime - Possible failures in new instance creation None of the above should last more than a few minutes. For the most part Labs instances will be unaware of the outages, and no action is required from users. Apologies for any inconvenience caused! -Andrew

1 2

2016W43 ArchCom-RFC meeting: Allow HTML in SVG?
by Rob Lanphier 28 Oct '16

28 Oct '16

Hi everyone, For [this week's ArchCom-RFC meeting][E325], let's talk about SVG. As you probably know, MediaWiki optionally allows for SVG uploads, which is allowed on many Wikimedia wikis (e.g. on Commons). However, in order to make this preference safe to use, we need to validate the SVG. One thing that's allowed in the SVG spec is to embed fragments of XHTML inside the SVG. This isn't just a obscure spec feature; this is understood to be the best way to embed a caption for a diagram that allows for word wrap when the image is scaled. Having XHTML support also would allow for greater compatibility between MediaWiki and real-world SVG editing tools (e.g. like draw.io) matmarex made a suggestion in [the bug for this][T138783]: > We have a HTML validation library (the Sanitizer class) and it could > probably be hooked up to validating HTML in SVG file uploads. But it > would definitely require some work. It's not officially an RFC, but I suggested it as a discussion topic in [last week's ArchCom planning meeting][3], and no one objected. Let's see if we can answer a couple of questions: 1. Is this a good idea in theory? i.e. is it possible/likely that an experienced developer could implement something that can pass security review, or is it conceptually flawed? 2. Is matmarex's suggested approach a good one? 3. Should we turn our SVG validation code into a proper library? 4. (if there's time) Let's step through the [brion's June 30 comment][4] This week it will be the usual time (Wednesday 21 UTC, 14 PDT, 23 CEST) and place (#wikimedia-office). Next week, things get complicated because of the end of [Summer Time in Europe][5]; an announcement about next week's meeting will hopefully find its way to the [ArchComStatus page][6]. Rob [E325]: <https://phabricator.wikimedia.org/E325> [T138783]: <https://phabricator.wikimedia.org/T138783> [3]: <https://www.mediawiki.org/wiki/Architecture_committee/2016-10-19> [4]: <https://phabricator.wikimedia.org/T138783#2419210> [5]: <https://en.wikipedia.org/wiki/Summer_Time_in_Europe> [6]: <https://www.mediawiki.org/wiki/ArchComStatus>

6 8

8 am UTC Oct 29, maintenance for dataset1001 (dumps.wikimedia.org)
by Ariel Glenn WMF 28 Oct '16

28 Oct '16

On Saturday Oct 29, at 8 am UTC, the web server for the dumps and other datasets will be unavailable due to maintenance. This should take no longer than 10 minutes. Thanks for your understanding. Ariel

1 0

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l October 2016