Wikitech-l April 2019

wikitech-l@lists.wikimedia.org

69 participants
80 discussions

Re: [Wikitech-l] [Wikidata] URL shortener for the Wikimedia projects will be available on April 11th
by Amir Sarabadani 11 Apr '19

11 Apr '19

Hey, This is live now, you can use it in https://meta.wikimedia.org/wiki/Special:UrlShortener Best On Wed, Apr 3, 2019 at 2:14 PM Léa Lacroix <lea.lacroix(a)wikimedia.de> wrote: > *(apologies for crost-posting - feel free to share this announcement in > your communities)* > > Hello all, > > Having a service providing short links exclusively for the Wikimedia > projects is a community request that came up regularly on Phabricator > <https://phabricator.wikimedia.org/T44085> or in community discussions > <https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019/Reading/Crea…>. > > > After a common work of developers from the Wikimedia Foundation and > Wikimedia Germany, we are now able to provide such a feature, it will be > enabled on April 11th on Meta. > *What is the URL Shortener doing?* > > The Wikimedia URL Shortener is a feature that allows you to create short > URLs for any page on projects hosted by the Wikimedia Foundation, in order > to reuse them elsewhere, for example on social networks or on wikis. > > The feature can be accessed from Meta wiki on the special page > m:Special:URLShortener > <https://meta.wikimedia.org/wiki/Special:URLShortener> (will be enabled > on April 11th). On this page, you will be able to enter any web address > from a service hosted by the Wikimedia Foundation, to generate a short URL, > and to copy it and reuse it anywhere. > > The format of the URL is w.wiki/ followed by a string of letters and > numbers. You can already test an example: w.wiki/3 redirects to > wikimedia.org. > *What are the limitations and security measures?* > > In order to assure the security of the links, and to avoid shortlinks > pointing to external or dangerous websites, the URL shortener is restricted > to services hosted by the Wikimedia Foundation. This includes for example: > all Wikimedia projects, Meta, Mediawiki, the Wikidata Query Service, > Phabricator. (see the full list here > <https://meta.wikimedia.org/wiki/Wikimedia_URL_Shortener>) > > In order to avoid abuse of the tool, there is a rate limit: logged-in > users can create up to 50 links every 2 minutes, and the IPs are limited to > 10 creations per 2 minutes. > *Where will this feature be available?* > > In order to enforce the rate limit described above, the page > Special:URLShortener will only be enabled on Meta. You can of course create > links or redirects to this page from your home wiki. > > The next step we’re working on is to integrate the feature directly in the > interface of the Wikidata Query Service, where bit.ly is currently used > to generate short links for the results of the queries. For now, you will > have to copy and paste the link of your query in the Meta page. > *Documentation and requests* > > - If you have any question or requests, feel free to leave a comment > under this Phabricator task <https://phabricator.wikimedia.org/T44085> > - The user documentation is available here > <https://meta.wikimedia.org/wiki/Special:MyLanguage/Wikimedia_URL_Shortener>: > please help us to translate it in your language! > - See also the technical documentation of the extension > <https://www.mediawiki.org/wiki/Extension:UrlShortener> > > Thanks a lot to all the developers and volunteers who helped moving > forward with this feature, and making it available today for everyone in > the Wikimedia projects! > -- > Léa Lacroix > Project Manager Community Communication for Wikidata > > Wikimedia Deutschland e.V. > Tempelhofer Ufer 23-24 > 10963 Berlin > www.wikimedia.de > > Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. > > Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg > unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt > für Körperschaften I Berlin, Steuernummer 27/029/42207. > _______________________________________________ > Wikidata mailing list > Wikidata(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikidata > -- Amir

1 0

s3 primary db master failover on Thursday 10th April 05:00AM UTC
by Manuel Arostegui 11 Apr '19

11 Apr '19

Hello, Due to hardware malfunction on the current s3 database primary master (T219115) we need to failover it to a different host. We are going to do this on Thursday 10th at 05:00 AM UTC, and we have requested a 30 minutes window (T220080) as we have to go read only for all the wikis living on s3 (P7994). Impact: Writes will be blocked, reads will remain unaffected. Time: 05:00AM UTC - 05:30 AM UTC (we do not expect to use the full 30 minutes window). Communication will happen at #wikimedia-operations If you are around at that time and want to help with the monitoring, please join us! Thanks

2 4

MediaWiki 1.33 branch announcement
by Greg Grossmeier 11 Apr '19

11 Apr '19

Hello! We are beginning the process of working on the 1.33.0 release of MediaWiki. The release is currently scheduled for May 2019. We created the REL1_33 branch this week (aligned with the final Wikimedia alpha, 1.33.0-wmf.25), and will be generating the first release candidate soon, so this means it's now "pencils down". If you have any open Phabricator tasks tagged with mw-1.33-release [0], please check to see if they are indeed blockers for the release. If not, please remove the tag from them. Conversely, if there are any blockers that are not tagged with mw-1.33.release, please tag them. Please feel free to reach out to me if you have any questions about this. We will be in the normal patch master + backport process from now until the release in May. Thanks, Greg [0] https://phabricator.wikimedia.org/tag/mw-1.33-release/ -- Greg Grossmeier Release Team Manager

1 0

Uploading new versions of other people's patches to gerrit
by Isarra Yos 10 Apr '19

10 Apr '19

This seems to be broken, or something. It's causing problems for collaboration. Please fix. -I

7 13

Discovery Weekly Update for the week starting 2019-03-25
by Chris Koerner 09 Apr '19

09 Apr '19

Greetings, This is the weekly update from the Search Platform team for the week starting 2019-03-25 and 2019-04-01. As always, feedback and questions are welcome. == Discussions == === Search === * ElasticSearch upgrade to v6: ** incident [0] *Trey finished a deep dive into the performance of language identification for cross-wiki searching [1] (example [2]) and punctuation-related problems, and discovered things are working pretty well overall, but the Chinese language model is a bit off. * Erik noticed that the inlabel / incaption keywords should highlight the label/caption but were not [3] * David worked on fixing an error code that Elasticsearch 6 nested_path and nested_filter are deprecated [4] and _retry_on_conflict was deprecated [5] * We worked on migrating mjolnir to stdout/syslog/cee logging output [6] * The team worked on upgrade to elasticsearch 6.5.4 for cirrus / codfw (specifically) [7] and for eqiad [8] * Erik worked on the implementation and testing of glent m0 integration with wmf infrastructure [9] * David did a lot of work to update the mw-config to use the psi&omega elastic clusters [10] * David found that the auto_generate_phrase_queries is deprecated and ineffective [11] * The team fixed an old bug where we were getting fatal errors - "cannot perform this operation with arrays" from CirrusSearch/ElasticaWrite (using JobQueueDB) [12] * Gehel worked to make spicerack more robust when unfreezing writes to elasticsearch / cirrus [13] as well as creating a cookbook to reset frozen write state on elasticsearch / cirrus [14] * Stas moved WikibaseLexeme search code to WikibaseLexemeCirrusSearch extension [15] * We noticed that Elasticsearch indices went read-only, causing a huge lag [16] * We also saw where search exceptions handling was printing response information on the screen [17] * The team fixed an issue where mwgrep was not working [18] * We also fixed an issue where Elasticsearch 6 needed to silence deprecation warnings to avoid logspam [19] * We needed to create an extra elasticsearch clusters in the beta cluster [20] * We also needed some alerts so we know if mjolnir starts misbehaving [21] * We also converted check_elasticsearch.py icinga plugin to py3 [22] * We needed to start using local nginx reverse proxy for connections reuse [23] * The version of curator that we currently use (5.2.0) isn't compatible with elasticsearch 6. Which causes issues in a few cron on logtash servers (see blelow). Version 5.6.0 supports both elasticsearch 5 and 6.....so...we updated it [24] * We also did some cleanup of the reprepro configuration for elasticsearch-curator [25] * Getting a centralized way to inspect the content of the search profiles might be helpful when investigating search behaviors. In the same vein as other dump debug APIs (mapping/settings/cirrusdoc) David suggested that we should add a new simple API to dump the profiles (cirrus-profiles-dump) [26] * David also found that a call to a member function toArray() on a non-object (null) in vendor/ruflin/elastica/lib/Elastica/Client.php:736 and fixed it [27] [0] https://wikitech.wikimedia.org/wiki/Incident_documentation/20190327-elastic… report [1] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Review_of_Language_I… [2] https://en.wikipedia.org/w/index.php?search=%D0%93%D0%B0%D1%80%D1%80%D0%B8+… [3] https://phabricator.wikimedia.org/T217809 [4] https://phabricator.wikimedia.org/T219266 [5] https://phabricator.wikimedia.org/T219265 [6] https://phabricator.wikimedia.org/T218833 [7] https://phabricator.wikimedia.org/T218878 [8] https://phabricator.wikimedia.org/T218879 [9] https://phabricator.wikimedia.org/T218164 [10] https://phabricator.wikimedia.org/T210381 [11] https://phabricator.wikimedia.org/T219267 [12] https://phabricator.wikimedia.org/T124196 [13] https://phabricator.wikimedia.org/T219640 [14] https://phabricator.wikimedia.org/T219638 [15] https://phabricator.wikimedia.org/T216206 [16] https://phabricator.wikimedia.org/T219364 [17] https://phabricator.wikimedia.org/T216959 [18] https://phabricator.wikimedia.org/T219162 [19] https://phabricator.wikimedia.org/T219269 [20] https://phabricator.wikimedia.org/T213940 [21] https://phabricator.wikimedia.org/T214494 [22] https://phabricator.wikimedia.org/T215439 [23] https://phabricator.wikimedia.org/T215491 [24] https://phabricator.wikimedia.org/T218991 [25] https://phabricator.wikimedia.org/T216235 [26] https://phabricator.wikimedia.org/T218682 [27] https://phabricator.wikimedia.org/T217402 ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner (he/him) Community Relations Specialist Wikimedia Foundation

1 0

Save the date! Wikimedia Technical Conference 2019: November 12-15, 2019
by Rachel Farrand 09 Apr '19

09 Apr '19

Hello everyone! Please save the dates of November 12-15 for the Wikimedia Technical Conference 2019 which will be held in Atlanta, Georgia, USA. We are in the initial stages of forming the program committee and clearly defining the scope and content for the event. We will update our event’s MediaWiki page <https://www.mediawiki.org/wiki/Wikimedia_Technical_Conference/2019> as everything develops — announcing when the theme has been defined and again when the event registration opens. For now, please add the dates to your calendar and watch our event page if you are interested. Any comments, suggestions, or discussion that you would like the program committee to take into consideration, answer, or discuss can be added to the talk page or are welcome on this phabricator task. <https://phabricator.wikimedia.org/T220212> Thank you! -- Rachel Farrand Events Program Manager Technical Collaboration Team Wikimedia Foundation

1 0

mwoauth.errors.OAuthException in Flask
by Egbe Eugene 09 Apr '19

09 Apr '19

Hello All, i am not sure this is the right channel to send this. Nevertheless, I am trying to login using OAuth from a flask application and I am getting an error which says *MediaWiki response lacks token information: {b'Consumer is owner-only, <a class': [b'"external" href="https://www.mediawiki.org/wiki/Help:OAuth/Errors#E010 <https://www.mediawiki.org/wiki/Help:OAuth/Errors#E010>">E010</a>']}* I am not sure why i got no response token. Please i need some help on this. Thanks. <Eugene233>

3 3

Re: [Wikitech-l] GSOC 2019 Project Summary
by Houcemeddine A. Turki 08 Apr '19

08 Apr '19

Dear Ms., I thank you for your answer. I am already a member of Africa Wikimedia Developers Project. I contacted Mr. Felix Nartey and Mr. Alangi Derick about creating a user group for Wikimedia Developers in Tunisia. However, we could not do that because we lacked time. As I said in the previous email, I am a medical student and I just code for fun. I have several skills of HTML, Pascal and Python. But, I am not a computer scientist. I am as well interested since 2009 in contributing to Wikipedia, Wikimedia Incubator and Wikimedia Commons... I do not contribute to Mediawiki... As I saw, all contributors to Africa Wikimedia Developers Project work on Mediawiki. However, I work on enriching Wikidata using Python. My project is to use PubMed to enrich Wikidata with Biomedical information. If there are members of Africa Wikimedia Developers Project who like to join my project and support me, I will be honoured to work with them. Yours Sincerely, Houcemeddine Turki (he/him) Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia Undergraduate Researcher, UR12SP36 GLAM and Education Coordinator, Wikimedia TN User Group Member, WikiResearch Tunisia Member, Wiki Project Med Member, WikiIndaba Steering Committee Member, Wikimedia and Library User Group Steering Committee Co-Founder, WikiLingua Maghreb Founder, TunSci ____________________ +21629499418 -------- Message d'origine -------- De : Rosalie Perside <rosalieperside(a)gmail.com> Date : 2019/04/08 23:08 (GMT+01:00) À : Wikimedia developers <wikitech-l(a)lists.wikimedia.org> Cc : Richa <richakinjal4(a)gmail.com> Objet : Re: [Wikitech-l] GSOC 2019 Project Summary Hello Dine, I am assuming you have seen Srishti reply to Richa as it applies in your case as well. The time left to prepare a good proposal for this round is very small and you may consider preparing for next round instead. In that case, I suggest you join the Africa Wikimedia Developer program. There you will have a lot of other motivated volunteers who contribute code to Wikimedia projects around Africa and later if eligible apply for outreach programs in Wikimedia. Check it out : https://www.mediawiki.org/wiki/Africa_Wikimedia_Developers_Project For environment setting up, check this: https://www.mediawiki.org/wiki/Gerrit/Tutorial Rosalie On Mon, Apr 8, 2019 at 6:50 PM Houcemeddine A. Turki < turkiabdelwaheb(a)hotmail.fr> wrote: > Dear all, > I thank you for your efforts. I am Houcemeddine Turki from Tunisia. I am a > medical student. But, I work on projects related to Biomedical Informatics, > NLP and Scientometrics. I have several skills of HTML, Pascal and Python. I > will be honoured to contribute to GSoC 2019 if possible. > Yours Sincerely, > Houcemeddine Turki (he/him) > Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia > Undergraduate Researcher, UR12SP36 > GLAM and Education Coordinator, Wikimedia TN User Group > Member, WikiResearch Tunisia > Member, Wiki Project Med > Member, WikiIndaba Steering Committee > Member, Wikimedia and Library User Group Steering Committee > Co-Founder, WikiLingua Maghreb > Founder, TunSci > ____________________ > +21629499418 > > > -------- Message d'origine -------- > De : Richa <richakinjal4(a)gmail.com> > Date : 2019/04/08 17:01 (GMT+01:00) > À : wikitech-l(a)lists.wikimedia.org > Objet : [Wikitech-l] GSOC 2019 Project Summary > > Respected Sir/Madam, > Im Richa Shah from V.V.P Engineering College,Rajkot. I’m studying Computer > Engineering in 6th Semester. I had Knowledge about > C,C++,JAVA,PHP,JavaScript,CSS,HTML... > I would like to contribute in project of wikimedia of “Update count > without reload the page”. > > I’ll give my maximum hours in working for this project. I had also > participated in India Hackathon 2018. I had good coding skills so that i > can use my skills in this project so that it is usefull for the users. > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

Re: [Wikitech-l] GSOC 2019 Project Summary
by Houcemeddine A. Turki 08 Apr '19

08 Apr '19

Dear all, I thank you for your efforts. I am Houcemeddine Turki from Tunisia. I am a medical student. But, I work on projects related to Biomedical Informatics, NLP and Scientometrics. I have several skills of HTML, Pascal and Python. I will be honoured to contribute to GSoC 2019 if possible. Yours Sincerely, Houcemeddine Turki (he/him) Medical Student, Faculty of Medicine of Sfax, University of Sfax, Tunisia Undergraduate Researcher, UR12SP36 GLAM and Education Coordinator, Wikimedia TN User Group Member, WikiResearch Tunisia Member, Wiki Project Med Member, WikiIndaba Steering Committee Member, Wikimedia and Library User Group Steering Committee Co-Founder, WikiLingua Maghreb Founder, TunSci ____________________ +21629499418 -------- Message d'origine -------- De : Richa <richakinjal4(a)gmail.com> Date : 2019/04/08 17:01 (GMT+01:00) À : wikitech-l(a)lists.wikimedia.org Objet : [Wikitech-l] GSOC 2019 Project Summary Respected Sir/Madam, Im Richa Shah from V.V.P Engineering College,Rajkot. I’m studying Computer Engineering in 6th Semester. I had Knowledge about C,C++,JAVA,PHP,JavaScript,CSS,HTML... I would like to contribute in project of wikimedia of “Update count without reload the page”. I’ll give my maximum hours in working for this project. I had also participated in India Hackathon 2018. I had good coding skills so that i can use my skills in this project so that it is usefull for the users. _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

2 1

[Train] 1.33.0-wmf.24 status update
by Dan Duvall 08 Apr '19

08 Apr '19

The 1.33.0-wmf.24 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * Citoid should only usurp "<ref" / ctrl+shift+k shortcuts if full configured - https://phabricator.wikimedia.org/T219510 * RefreshLinksJob::runForTitle: transaction round 'RefreshLinksJob::run' already started on commons - https://phabricator.wikimedia.org/T220037 The first issue was deemed noncritical for group1 but the second caused a large spike in DBTransactionError rates. The second issue already has a proposed fix but had not yet merged at the closing of the train deployment window. If both issues are resolved by tomorrow's train window, group1 and group2 will be promoted in succession at that time (barring further issues). Thank you for your help resolving these issues! Your humble train toiler, Dan [0]. https://phabricator.wikimedia.org/T206678 [1]. <https://tools.wmflabs.org/versions/> -- Dan Duvall Software Engineer, Release Engineering Wikimedia Foundation <http://wikimediafoundation.org>

1 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l April 2019