Wikitech-l November 2019

wikitech-l@lists.wikimedia.org

53 participants
71 discussions

Wikibase: security fix available for the Query Service GUI
by Léa Lacroix 07 Nov '19

07 Nov '19

Hello all, -and sorry for cross-posting- This message is important to everyone running an instance of Wikibase including the Query Service GUI. We just released a new version of the Wikidata Query Service GUI. This release is primarily to fix a security issue described in T233213 <https://phabricator.wikimedia.org/T233213> (hidden task, will be made public soon). The fix has been successfully deployed for the Wikidata Query Service. In order to keep your instance safe, please make sure to update your Query Service GUI! Git repositories, releases and currently active version docker images also include the latest fixed code (see links below). If you have a local test setup using the docker-compose example then see: https://gist.github.com/addshore/36f8d6fe2331d28ca8f70df5abda20fd Gerrit repositories: - wikidata/query/gui after commit d9f964b88c01748e278ca8c4b8929a8ef0ef0267 - wikidata/query/gui-deploy after commit 7445472ab0ec61890b42e4d524416fbc6a18aa8a - wikidata/query/deploy after 094d9cda98f3fb706cf9c25aefa3eb33f9f6999a Docker images: - wdqs:0.3.6 (all versions of this tag) - wdqs:latest from digest sha256:04237b42d0b904a2c49ecb7059c82ace8265ba0b7f690ee2d4b3004ad39517ee - wdqs-frontend:latest from digest sha256:1308a7d6622b1e141783336fb52cd6993973321077f58359fbf907b77e105ca3 - wdqs-frontend:legacy from digest sha256:f830abd53fe5e79299011211a2aab7ad947181e56785c06eed6e9bd6b430d4ce Downloadable releases: - https://archiva.wikimedia.org/repository/snapshots/org/wikidata/query/rdf/s… If you have any questions or issues updating your code, please let us know (you can write me an email, or ask in the Wikibase Telegram group <https://t.me/joinchat/HGjGexZ9NE7BwpXzMsoDLA>) Thanks for your understanding, Cheers, -- Léa Lacroix Project Manager Community Communication for Wikidata Wikimedia Deutschland e.V. Tempelhofer Ufer 23-24 10963 Berlin www.wikimedia.de Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 Nz. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

TechCom Radar 2019-11-06
by Alexandra Paskulin 06 Nov '19

06 Nov '19

Hi all, Here are the minutes from this week's TechCom meeting: * Discussed: RFC: Where to implement Desktop Improvements project <https://phabricator.wikimedia.org/T234907>. This RFC discusses the approach for implementing broad UI changes to the desktop interface of Wikimedia projects. * Discussed: Schema change procedure documentation blanked, no alternative given for 8 months <https://phabricator.wikimedia.org/T237229>. This task proposes re-adding the procedure for schema changes to the Wikimedia development policy. * Last call: RFC: ParallelMaintenance helper class for multi-process maintenance scripts <https://phabricator.wikimedia.org/T201970>. This RFC was placed on last call on 2019-10-23 with the intent to approve on 2019-11-13. Comments in support of or in opposition to this RFC are welcome during the last call period. * TechCom will not meet next week due to the 2019 Wikimedia Technical Conference. * No IRC meeting next week or on 2019-11-20. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes>. See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar>. Thanks, - Alex -- Alex Paskulin Technical Writer Wikimedia Foundation

1 0

Scrum of scrums/2019-11-06
by Željko Filipin 06 Nov '19

06 Nov '19

Hi, for HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-11-06 Željko -- = 2019-11-06 = == Callouts == * Parsoid-PHP is about ready to be rolled out in the coming weeks for all live traffic and will serve client requests (VE, CX, Flow, MCS for Android app) instead of the current Parsoid/JS service. See Parsing team section of this etherpad for more notes about testing requests. ( [[phab:T229015]] is the tracking task ) * Product Infrastructure ** blocked by RelEng: Ensure all PI engineers have +2 rights in operations/deployment-charts [[phab:T232794]] ** Product Infrastructure blocked by SRE: Configure Google Cloud Vision credentials in production [[phab:T236426]] ** MachineVision extension is being enabled today, please let us know if anyone sees any new errors on Commons * Release Engineering ** This week train last train (1.35.0-wmf.5 - [[phab:T233853]]) is the last train before two week break ** v3 of architecture document for new continuous integration wants review and feedback [[User:LarsWirzenius/NewCI]] * Language ** Blocked by Core: Preemptive refresh in getMultiWithSetCallback() and getMultiWithUnionSetCallback() pollutes cache: [[phab:T235188]] == Product == === Editing === * Blocking: ** Parsing: [[phab:T229074]] -- Prepare VE for Parsoid-PHP switch ( Editing team ) === Growth === * Blocking: ** Parsing: [[phab:T229078]] -- Prepare Flow for Parsoid-PHP switch ( which team? but, heads up Roan ) === iOS native app === * Updates: ** 6.4.1 in beta/testing ***3D touch fix in article view ***Seeing crashes in beta so may wait on this until 6.5 ** 6.5 in active development - [[phab:project/view/4245]] ***Wrapping up history & diffs feature - integrating live endpoints this week === Android native app === * Updates: ** Had a minor release with an important bug fix related to 2FA login. ** Wrapped up our server side changes for Suggested Edits V3 feature and all set to integrate with it for a major release **Picking back momentum on mobile-html related work:[[phab:project/view/4318]] === Product Infrastructure === * Blocked by: ** RelEng: Ensure all PI engineers have +2 rights in operations/deployment-charts [[phab:T232794]] ** SRE: Configure Google Cloud Vision credentials in production [[phab:T236426]] * Blocking: ** Parsing: [[phab:T229077]] -- Prepare MCS for Parsoid-PHP switch ( Product Infrastructure team ) * Updates: ** MachineVision extension is being enabled today, please let us know if anyone sees any new errors on Commons === Structured Data === * Blocking: ** Search Platform: Data dumps for SDC: [[phab:T221917]] * Updates: ** machine vision released on testcommonswiki ** can now access MediaInfo items via Lua === Parsing === * Blocked by: ** [[phab:T236930]] needs resolution for using VE with Parsoid/PHP on non-RESTBase wikis (ex: officewiki, wikitech). Need Core Platform Team to take a look at it ** These next 4 testing / QA tasks aren't strictly a blocker yet, but will quickly become blockers as we are aiming to roll out Parsoid/PHP for all live traffic in the coming weeks (before Thanksgiving). Some teams are already working on them, but just flagging them all here for completeness' sake - thanks to you all for addressing them. *** [[phab:T229078]] -- Prepare Flow for Parsoid-PHP switch ( which team? but, heads up Roan ) *** [[phab:T229074]] -- Prepare VE for Parsoid-PHP switch ( Editing team ) *** [[phab:T229075]] -- Prepare CX for Parsoid-PHP switch ( Language team ) *** [[phab:T229077]] -- Prepare MCS for Parsoid-PHP switch ( Product Infrastructure team ) * Updates: ** As of Nov 4, Parsoid/PHP cluster is receiving 100% of Parsoid/JS change prop reparse traffic (which makes up > 90% of all traffic that Parsoid handles). Performance, error rates are all looking good. ( [[phab:T235902]] ) ** So, we are getting ready to roll this out everywhere in the coming weeks in a phased manner (wiki-by-wiki for *all* services). Appreciate testing against Parsoid/PHP in the beta cluster. See description of [[phab:T229074]] for how to test against Parsoid/PHP. === Language === * Blocked by: ** Core: [[phab:T235188]] * Blocking: ** Parsing: [[phab:T229075]] -- Prepare CX for Parsoid-PHP switch ( Language team ) * Updates: ** Testing Parsoid-PHP switch: [[phab:T229075]] === Inuka === * Updates: ** KaiOS app Quick Facts feature: [[phab:T234619]] == Technology == === Fundraising Tech === * Updates: ** CiviCRM: *** Moving more contact deduplication features from local custom hooks to a community-installable extension *** adding new data conflict resolution rules *** Adding contact locking mechanism to avoid trying to deduplicate the same contact from two different jobs ** Investigating payment processor iframe load issues ** CentralNotice: Puzzling out differences between stats from old vs new data pipelines ** CentralNotice: reviewing sub-national targeting ** End of year summary receipt changes === Core Platform === * Blocking: ** Parsing: [[phab:T236930]] needs resolution for using VE with Parsoid/PHP on non-RESTBase wikis (ex: officewiki, wikitech). Need Core Platform Team to take a look at it ** Language: [[phab:T235188]] === Engineering Productivity === ==== Performance ==== * Updates: ** Rolled out the new synthetic testing setup ready with a new Graphite instance. WebPageReplay tests has moved and WebPageTest is the next thing. All old WebPageTest dashboard will work as before but with more metrics and data. ** Gilles presenting at Velocity Berlin today: How to make sense of real user performance metrics ==== Release Engineering ==== * Blocking: ** Product Infrastructure: Ensure all PI engineers have +2 rights in operations/deployment-charts [[phab:T232794]] * Updates: ** v3 of architecture document for new continuous integration wants review and feedback [[User:LarsWirzenius/NewCI]] ** Train Health *** Last week: 1.35.0-wmf.4 - [[phab:T233852]] *** This week: 1.35.0-wmf.5 - [[phab:T233853]] - last train before two week break *** Next week: no train because of [[Wikimedia Technical Conference/2019]] === Search Platform === * Blocked by: ** Structured Data: Data dumps for SDC: [[phab:T221917]] === Site Reliability Engineering === * Blocking: ** Product Infrastructure: Configure Google Cloud Vision credentials in production [[phab:T236426]]

1 0

[TAIM] Wednesday: Technical Advice IRC Meeting
by Leszek Manicki 06 Nov '19

06 Nov '19

Sorry for cross-posting! Reminder: Technical Advice IRC meeting this week **Wednesday 4-5 pm UTC** on #wikimedia-tech. *Note the time change due to Berlin having switched to winter time!* Questions can be asked in English. The Technical Advice IRC Meeting (TAIM) is a weekly support event for volunteer developers. This week we have a special theme, related to the upcoming Wikimedia Technical Conference focusing on Developer Productivity. In particular we're interested in hearing about your experiences with developer productivity in the context of your work with on-wiki tools (gadgets, templates, modules, etc). Your input is going to be useful for the "Developer Productivity & onwiki tooling" ( https://phabricator.wikimedia.org/T234661) session held at the Conference next week. Hope to see you there! -- Leszek Manicki Engineering Manager Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30 219 158 26-0 http://wikimedia.de Imagine a world in which every single human being can freely share in the sum of all knowledge. Help us to achieve our vision! https://spenden.wikimedia.de Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

Developer Productivity and onwiki tooling: Your input is welcome :-)
by Birgit Mueller 05 Nov '19

05 Nov '19

(sorry for cross-posting!) Hello all, We’re running a session at next week’s Wikimedia Technical Conference <https://www.mediawiki.org/wiki/Wikimedia_Technical_Conference/2019> around the topic: Developer Productivity and onwiki tooling - userscripts, gadgets, templates, modules <https://phabricator.wikimedia.org/T234661>. For this we’re looking for more input from folks who won’t be at the conference. The goal of the conference is to identify changes to tooling and processes to support Wikimedia developers in working more efficiently. One aspect of that is to explore what makes it currently difficult for technical contributors working with templates, modules, userscripts and gadgets, and to discuss what could be improved or done differently. It would be wonderful if you could share your experience and comment on the following 2 questions in the phabricator ticket for the session <https://phabricator.wikimedia.org/T234661> (or send me an email, and we’ll add it to the phabricator ticket): 1. What is your background, what do you do as a technical contributor? 2. In what way your productivity as a technical contributor is affected in the context of on-wiki tooling (what slows you down, what makes your life complicated, what helps you …)? To give you two examples (made-up): 1. I am a volunteer developer and have developed several user scripts for frwiki. 2. When I’ve developed a userscript, I don’t know how many people are copying the code to use my script. When I make changes to the script, others often still have older versions. When people report bugs, I need to first find out which version they are using which is very time-consuming. 1. I am a developer of Wikibase extension, WMDE staff member 2. When I develop a new feature in Wikibase, I am often informed AFTER the feature has been released that Wikidata gadgets had been broken. Then I need to stop my current tasks, go back to my previous work and change the feature. This makes the process of my work on new features longer. Many thanks for your support! The developer productivity and onwiki tooling session crew -- Birgit Müller (she/her) Director of Technical Engagement Wikimedia Foundation <https://wikimediafoundation.org/>

1 0

MediaWiki 1.34.0-rc.1 is ready for testing
by Sam Reed 05 Nov '19

05 Nov '19

I'm pleased to announce the immediate availability of MediaWiki 1.34.0-rc.1, the first second candidate for 1.34.x. Download links at the end of the e-mail. The tag has been signed and pushed to Git. Please note that MediaWiki 1.34 no longer supports HHVM, and also the PHP version requirement has been raised from 7.0.13 in MediaWiki 1.33, to 7.2.9. This is not a final release and should not be used for production websites. Known issues are tracked in Phabricator on the release workboard [1]. As always please do try out the release candidate in a test environment and report any issues that you discover. Please use the #MW-1.34-Release [2] tag in Phabricator when reporting issues specific to this release. MediaWiki 1.34.0-rc.1 reverts some deprecations in the Parser code that were reported for not properly following our deprecation policy. There is a known and intermittent issue that surfaces itself as "Circular dependency when creating service!", see T231866 [3] for more information. If you experience this issue, please let us know (on the ticket) to get an idea of how prevalent it is. It is intended to get this resolved for 1.34.0. It is expected that MediaWiki 1.34 will become final in the second half of November 2019. Preliminary release notes: https://phabricator.wikimedia.org/source/mediawiki/browse/REL1_34/RELEASE-N… https://www.mediawiki.org/wiki/Release_notes/1.34 MediaWiki core with bundled extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.1.tar.gz Core only, no extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.1.ta… GPG signatures: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.1.ta… https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.1.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html Open Bugs: [1] https://phabricator.wikimedia.org/project/board/3386/ Bug report form: [2] https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?tags=MW-1.34-… [3] https://phabricator.wikimedia.org/T231866 ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.1.tar.gz Download without bundled extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.1.ta… GPG signatures: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.1.ta… https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.1.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html

1 0

Upcoming Search Platform Office Hours—November 6th
by Trey Jones 05 Nov '19

05 Nov '19

*Note that the time is different for this session because of Daylight Savings time and a scheduling conflict.* The Search Platform Team <https://www.mediawiki.org/wiki/Wikimedia_Search_Platform> usually holds office hours the first Wednesday of each month. Come talk to us about anything related to Wikimedia search! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, Nov 6th, 2019 Time: 17:00-18:00 GMT / 09:00-10:00 PST / 12:00-13:00 EST / 18:00-19:00 CST Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vyc-jvgq-dww Hope to talk to you in a week! —Trey Trey Jones Sr. Software Engineer, Search Platform Wikimedia Foundation UTC-4 / EDT

1 1

Getting Error When Trying to Save Changes to Page Using Visual Editor
by Egbe Eugene 04 Nov '19

04 Nov '19

Hi All, After installing the VisualEditor extension and trying to edit pages I get an error message saying 'Error contacting the Parsoid/RESTBase server: (curl error: 7) Couldn't connect to server' Is there anything I am missing in the configuration? -- Eugene

2 1

This Week in Logspam
by Brennen Bearnes 01 Nov '19

01 Nov '19

Hi all, >From recent discussion with colleagues while deploying the train, it's come up that there used to be a recurring e-mail along these lines, and it seems like it may be useful to resume on a regular basis. A high volume of error messages in production logs makes it hard to glance at error logs after a deployment and reason about the deployment's impact.[0] This can be especially problematic at times when our visibility into logs is impaired for unrelated reasons, as it has been in recent weeks.[1] It's my good fortune to be resuming this tradition during a week in which the logspam situation seems to have improved. I'm aware of two currently tracked issues which are producing a noticeable amount of noise: * T226751: PHP error "non well formed numeric value encountered" from FormatMetadata->formatCoords[2] * T233349: A data update callback triggered a fail-safe exception in DataUpdateAdapter[3] Help in eliminating these errors from production logs is greatly appreciated, and I want to extend my thanks to everyone who has spent time this week fixing similar issues. I'd also like to thank everyone who's been working on getting logstash back into usable shape. [0]. https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Logspam [1]. https://phabricator.wikimedia.org/T234283 [2]. https://phabricator.wikimedia.org/T226751 [3]. https://phabricator.wikimedia.org/T233349 -- Brennen Bearnes (he/him) Release Engineering Wikimedia Foundation

1 0

URL parameter fetching (mediawiki)
by John Shepherd 31 Oct '19

31 Oct '19

Is there a “special” way in mediawiki to get parameters passed by URL or do you just use the conventional PHP way ($_GET)? I am trying to check if “Special:CreateAccount?reason=“ is set/has a value (and what that value is). Thank you for your assistance, trying to be convention compliant. -TheSandDoctor

3 2

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2019