Wikitech-l February 2019

wikitech-l@lists.wikimedia.org

56 participants
63 discussions

Wednesday: Technical Advice IRC Meeting
by Michael Schönitzer 19 Feb '19

19 Feb '19

Reminder: Technical Advice IRC meeting this week **(Wednesday) 4-5 pm UTC** on #wikimedia-tech. Question can be asked in English, Bulgarian & Hungarian. The Technical Advice IRC Meeting is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about Mediawiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! Michi (for the Technical Advice IRC Meeting crew) -- Michael F. Schönitzer Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 https://wikimedia.de Unsere Vision ist eine Welt, in der alle Menschen am Wissens der Menschheit teilhaben, es nutzen und mehren können. Helfen Sie uns dabei! https://spenden.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

Announcing zuul-status plugin for gerrit
by Paladox 19 Feb '19

19 Feb '19

Hi, i am pleased to announce that the zuul-status plugin is now available for gerrit 2.16+. This plugin integrates the zuul status json response into gerrit displaying the jobs lined up and running. It's similar to how you would see it on https://integration.wikimedia.org/zuul/ apart from it will only show for your change only. This will improve the experience as you won't need to leave your change to get a live feed of your change as it progresses through checks. You can see the demo at https://imgur.com/a/uBk2oxQ Plugin at https://gerrit-review.googlesource.com/admin/repos/plugins/zuul-status First commit: https://gerrit-review.googlesource.com/c/plugins/zuul-status/+/212103 The plugin uses PolyGerrit's ui rather then GWTUI as GWTUI has been removed upstream (from gerrit 3.0) and because PolyGerrit provides XSS protection.

3 4

Thank you Tuesday
by MusikAnimal 19 Feb '19

19 Feb '19

I'd like to offer a big thank you to the Cloud Services team for resolving issues with VPS and toolsdb. It would take several weeks of "Thank You Tuesdays" to adequately express my gratitude for your hard work during this ordeal. Thank you Brooke, Andrew, Bryan, Arturo, Giovanni, our fine DBAs, and everyone else involved! As I said on IRC, I think the toolsdb outage is in a way indicative of success. Maybe increased usage wasn't the true culprit, but the fallout of the outage clearly shows how much we rely on Cloud Services. Also, tools that I maintain running on VPS have had some 99% uptime since they were launched (XTools going back 1.5 years), evidenced by a monitoring service that I use. That's phenomenal. All things considered, a week or so of partial downtime related to VPS hardware and toolsdb is not that significant. Your prompt, tireless efforts to restore stability over the weekend has not gone unnoticed. Y'all are amazing. ~ MusikAnimal

2 1

question about wikidata entity dumps usage (please forward to interested parties)
by Ariel Glenn WMF 19 Feb '19

19 Feb '19

Hey folks, We've had a request to reschedule the way the various wikidata entity dumps are run. Right now they go once a week on set days of the week; we've been asked about pegging them to specific days of the month, rather as the xml/sql dumps are run. See https://phabricator.wikimedia.org/T216160 for more info. Is this going to cause problems for anyone? Do you ingest these dumps on a schedule, and what works for you? Please weigh in here or on the phabricator task; thanks! Ariel

2 1

TechCom Radar 2019-02-13
by Kate Chapman 15 Feb '19

15 Feb '19

Hi All, Here are the minutes from this week's TechCom meeting: * Last Call ending 11pm PST (February 14 07:00 UTC, 08:00 CET) on 27 February 2019 RFC: Update to Gerrit privilege policy <https://phabricator.wikimedia.org/T216295> * Last Call ending 20 February 1pm PST(21:00 UTC, 22:00 CET) Wikibase Front-End Architecture <https://phabricator.wikimedia.org/T213318> with the caveat that this is an opportunity for Wikidata to experiment with this approach while TechCom discusses out to do Front End Architecture in a more universal/organized way. Also noting this introduces a circular dependency that should be resolved at some point. * Last Call ending 20 February 1pm PST(21:00 UTC, 22:00 CET) RFC: Re-establish the development policies <https://phabricator.wikimedia.org/T190379> * Hosted IRC discussion on: Use Github login for mediawiki.org - <https://phabricator.wikimedia.org/T215046> * Log: <https://tools.wmflabs.org/meetbot/wikimedia-office/2019/wikimedia-office.20…> * Minutes: <https://tools.wmflabs.org/meetbot/wikimedia-office/2019/wikimedia-office.20…> You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org

1 0

REST API /page/summary: proposed change to content_urls and api_urls
by Michael Holloway 15 Feb '19

15 Feb '19

The Wikimedia REST API's /page/summary response contains content_urls and api_urls keys that provide convenience lists of various URLs of potential interest to the consumer. These lists appear in other endpoint responses as well, as the page summary response is transcluded in various places throughout the REST API. Currently, these URL strings are constructed erroneously using unencoded page title strings. A proposed patch ( https://gerrit.wikimedia.org/r/#/c/mediawiki/services/mobileapps/+/489329/) applies encodeURIComponent to encode these before including them in URLs. Since this endpoint is advertised as stable[1], I'm announcing the change here in advance. Barring any objections, the change will be deployed late next week. [1] https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_summary_title -- Michael Holloway Software Engineer, Reading Infrastructure

1 0

Announcing the Docker Special Interest Group
by Greg Grossmeier 14 Feb '19

14 Feb '19

Hello, At this year's WMF All Hands there was an unconference session about MediaWiki and Docker; what people currently are doing/using and what plans are for the future. One of the identified needs during the session was a single forum for those working with this tooling to collaborate more efficiently. To that end it was proposed to create a Special Interest Group[0] (a "SIG"). I'd like to announce that we now have the basics of such a group: * Wiki: https://www.mediawiki.org/wiki/Docker/SIG * Mailing list: https://lists.wikimedia.org/mailman/listinfo/docker-sig * IRC: #wikimedia-pipeline (reusing an already in use topical channel for efficiency) Please join! I will be setting up a first meeting Soon (TM) and will announce on the SIG's mailing list (and probably cross-post it here the first time). Best, Greg [0] https://www.mediawiki.org/wiki/Special_Interest_Groups -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | Release Team Manager A18D 1138 8E47 FAC8 1C7D |

2 1

A potential new way to deal with spambots
by Pine W 14 Feb '19

14 Feb '19

This sounds like an interesting potential approach to deal with spambots, and hopefully to deter the people who make them. https://techcrunch.com/2019/02/05/kasada-bots/ I don't know how practical it would be to implement an approach like this in the Wikiverse, and whether licensing proprietary technology would be required. I would be interested in decreasing the quantity and effectiveness of spambots that misuse WMF infrastructure, damage the quality of Wikimedia content, and drain significant cumulative time from the limited supply of good faith contributors. Pine ( https://meta.wikimedia.org/wiki/User:Pine )

8 17

GSoC' 19 project idea ( proposal)
by K. Kaushik Reddy 13 Feb '19

13 Feb '19

Hi team, This is Kaushik Reddy. After a long work, I would like to introduce you to my idea proposal for the (Wikimedia) GSoC '19. Here is it: 1) Building an animation to dynamically create popups overlapped on a geographical map using a real-time API from Wikimedia. I had found the root of this in here( I have gone through it a bit): https://meta.m.wikimedia.org/wiki/Research:Data I would like to work on this idea, this summer. Hope any mentor would join to guide me . Also, feel free to comment on this. With regards, Kaushik.

3 2

Discovery Weekly Update for the week starting 2019-02-04
by Chris Koerner 13 Feb '19

13 Feb '19

Hello, This is the weekly update from the Search Platform team for the week starting 2019-02-04. As always, feedback and questions welcome. == Discussions == === Search === * Based on feedback received during a conversation at All Hands, Erik wrote up a page documenting how to utilize dependencies inside pyspark with a custom setup at the start of a notebook. [0] * Julia (NLP contractor) is working on various things and will use glent in part of that research. :) [1] * Nuria is reading / watching all sorts of documentation regarding search, here's a video that is interesting. [2] * Erik finished up more documenting debt with adding the search sort options that are available in the API [3] * David worked on using subphrase matching for autocomplete by default on specific sites [4] * Erik worked on starting a new browser bot instance running elastic 6 to help get ready for the upcoming es6 upgrade [5] * Erik noticed that once the elasticsearch cluster split is complete we will need to be ready to start deploying the archive index split, and went ahead and dropped the "archive" from generic index on testwiki [6] * Trey reviewed David's port of all of our internal and external language analyzers to Elasticsearch 6. There are some unexpected upgrades, and there were a few problems, which David immediately fixed (and added new tests to cover). [7] [0] https://wikitech.wikimedia.org/wiki/User:EBernhardson/pyspark_on_SWAP [1] https://en.wiktionary.org/wiki/glent [2] https://commons.wikimedia.org/wiki/File:BareBonesSearch.webm [3] https://phabricator.wikimedia.org/T215198 [4] https://phabricator.wikimedia.org/T212788 [5] https://phabricator.wikimedia.org/T214422 [6] https://phabricator.wikimedia.org/T213851 [7] https://phabricator.wikimedia.org/T194849 ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner (he/him) Community Relations Specialist Wikimedia Foundation

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l February 2019