Wikitech-l August 2017

wikitech-l@lists.wikimedia.org

63 participants
67 discussions

TechCom Radar, 2017-08-09 and 2017-08-16
by Daniel Kinzler 18 Aug '17

18 Aug '17

Hi all! So, Wikimania happened! Yay! It was a busy time, lots of things were discussed and revived. My appologies for not writing a Radar mail for so long - it's so hard to concentrate when there is so much going on at the conference. So, here are the minutes from the last TWO weeks' TechCom meeting. You can also find the minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes/2017-0…> and <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes/2017-0…>. See also the TechCom activity page on the RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. On August 9th, we had our first public TechCom meeting during the Wikimania Hackathon. Thanks to everyone who participated! Here is what we talked about: * New RFC: Attribute anonymous contributions to the first IP address used in a session <https://phabricator.wikimedia.org/T172477> * Did NOT approve after last call, more discussion needed: HTML5 section ids <https://phabricator.wikimedia.org/T152540> * Input wanted: Allow anonymous recent changes to be filtered by IP range <https://phabricator.wikimedia.org/T172376> (not resourced) * Media format switching to webm for video (Brion) * ContentTranslation to use VE, server-side adaptation logic (Roan) * Progress on raising minimum PHP version for MediaWiki to 5.6/7 <https://phabricator.wikimedia.org/T172165> * Input wanted: use-cases for delayed job execution <https://phabricator.wikimedia.org/T172832> * Active discussion: moving most of MediaWiki within a /core folder <https://phabricator.wikimedia.org/T167038> * TechCom to think about QA strategies/guidelines over the coming weeks (code review, test coverage, etc). I did not personally attend the Meeting on August 16, since I had an off-site to attend. Here is what I gathered from the notes: * LAST CALL for Comments: PostgreSQL schema change for consistency with MySQL <https://phabricator.wikimedia.org/T164898>. Should no pertinent objections remain unaddressed by August 30th, this RFC will be approved for implementation. Please comment on the ticket. * Discussion (Roan): want to work on filtering edits by “revertedness”. Could use change tags, maybe. * Work started on making MediaWiki core PSR4 compatible. Involves renaming every class in core! <https://phabricator.wikimedia.org/T166010> (Tim) * Ongoing work on migrating Job Queue to EventBus/Kafka (Gabriel) * Discussion on how <section> tags may be used in the context of HTML5 section ID migration (T152540) <https://phabricator.wikimedia.org/T114072> (Timo) * Active discussion: JSON schema validation: <https://phabricator.wikimedia.org/T147137> * Active discussion: load multi-file packages via ResourceLoader <https://phabricator.wikimedia.org/T133462> PS: Goats are the new kittens <https://phabricator.wikimedia.org/tag/goatification/> -- Daniel Kinzler Principal Platform Engineer Wikimedia Deutschland Gesellschaft zur Förderung Freien Wissens e.V.

1 0

Technical Debt SIG...
by Jean-Rene Branaa 18 Aug '17

18 Aug '17

Hello All, I'm reaching out to invite you to an ongoing discussion regarding MediaWiki Technical Debt. The topic of technical debt has been discussed in a number of forums, and there's even been some work towards reducing it. This SIG's purpose is to get better alignment on what technical debt is, how to approach reducing it, and what are things we can do to avoid it moving forward. If you'd like to attend, please register here by August 22nd: https://goo.gl/forms/6sFWuBxfgGfwNUZ93 I'm trying to get a sense of those that are interested in attending and their timezone. I look to schedule sessions that are timezone friendly. Thanks and look forward to some good discussion. Cheers, JR Jean-Rene Branaa (irc: jrbranaa) RelEng Team

3 2

Last Call: PostgreSQL schema change for consistency with MySQL
by Tim Starling 17 Aug '17

17 Aug '17

The Wikimedia Technical Committee is hereby issuing a last call for comments on the RFC "PostgreSQL schema change for consistency with MySQL". https://phabricator.wikimedia.org/T164898 If no new objections are raised, this RFC will be approved on August 30. This RFC proposes to resolve differences between the PostgreSQL and MySQL support in MediaWiki by reducing the use of PostgreSQL-specific features. Note that I'm not planning implement this RFC in the current quarter. I would welcome volunteer implementors. -- Tim Starling

5 5

Orphan unbreak now
by Eran Rosenthal 17 Aug '17

17 Aug '17

There are thousands of pages generating lua errors when accessing wikidata with Lua (T170039 <https://phabricator.wikimedia.org/T170039>) and it affects on most/all wikis. The issue is lasting for few weeks since first reported. It seems to have no root cause, but the best current guess (AFAIK) is due to Lua-sandbox (T171166 <https://phabricator.wikimedia.org/T171166>). [Please don't take it personally!] 1. What is the ETA for getting it deployed to production? 2. IMO It looks like there is a little bit miscommunication (between WMF & WMDE?) in handling this case. For future cases, it would be nice if who can better communicate urgency of blocker tasks, especially if it involves other organizations. Thanks, Eran

1 0

MediaWiki and extensions 1.30.0-wmf.14 group1 deployment blocked
by Tyler Cipriani 16 Aug '17

16 Aug '17

The deployment of MediaWiki and extensions version 1.30.0-wmf.14 is blocked as a message in the error log gradually worsened following the roll out 1.30.0-wmf.14 to group1 wikis. The error: Cannot flush pre-lock snapshot because writes are pending is detailed on phabricator[0]. As of right now, group0 wikis are on php-1.30.0-wmf.14, group1 wikis are on php-1.30.0-wmf.13 (excluding wikidatawiki which is on php-1.30.0-wmf.11), the remaining wikis are on php-1.30.0-wmf.13. The types of issues that will halt the train and the process and procedures for when the train is halted are detailed on Wikitech[1]. The current version deployed per wiki is available on the wikiversions toollabs page[2]. -- Tyler [0]. <https://phabricator.wikimedia.org/T173462> [1]. <https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train> [2]. <https://tools.wmflabs.org/versions/>

1 0

2017-08-16 Scrum of Scrums meeting notes
by Grace Gellerman 16 Aug '17

16 Aug '17

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-08-16 = 2017-08-16 = contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering == Callouts == * Releng: Trebuchet's days are numbered. If you care about these projects please get in touch with #RelEng ** These are the last remaining trebuchet projects: *** iegreview *** scholarships *** ocg *** dropwizard * Wikidata: * For weeks we see thousands of hard to track user-facing Lua errors, see https://phabricator.wikimedia.org/T170039. We believe https://phabricator.wikimedia.org/T171166 might fix it, but need help by devs willing to touch LuaSandbox build. == Wikidata == * Callout: For weeks we see thousands of hard to track user-facing Lua errors, see https://phabricator.wikimedia.org/T170039. We believe https://phabricator.wikimedia.org/T171166 might fix it, but need help by devs willing to touch LuaSandbox build. === Readers === ==== Web ==== * Completing roll out of Page previews to all projects but enwiki and dewiki (likely to be stalled until post Wikimania) * RelatedArticles now renders articles in footer rather than side bar. ( https://phabricator.wikimedia.org/T165991) ==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** MCS gets geo coordinates from action API instead of Parsoid. ** Got rid of action=mobilview API calls for regular pages. === Reading Discovery ==== * Updates ** Working on search thumbnail AB test https://phabricator.wikimedia.org/T149811 === Contributors === ==== Collaboration ==== * Most of our team was at Wikimania. * However, we continued work on RC Filters and Echo * Echo: Merged a "Mark all as read" patch from community member and worked on additional patches (e.g. edit-user notification) * RCFilters: Small fixes * Flow: In-progress work on a feature to allow you to add inline Flow discussion linked to specific text. == Technology == === Analytics === *2 team members in wikimania, 2 on family leave, 1 of our team members coming back next week from parental leave. Not a lot happened. *We figured out issue with timeouts in varnishkafka, there was one host running too new of a version of kafka API *Still working on purging eventlogging data, moving to cluster some data out of MySQL (will make DBAs happy). Couple tables that are about 0.5 tb. *Ordering new hosts to replace eventlogging MYSQL hosts using some budget we will not need for the new Kafka cluster. *Edit History Reconstruction, made a snapshoot custom for Neil (editing data analysts) to calculate metrics on. *Wikimetrics had stop working due to some recent changes to labs db connection limits, fixed that. === Services === * Blockers: none * Updates: ** Wiped out Parsoid HTML cache in preparation for Cassandra 3 upgrade *** Elevated VE latencies for a while while new storage is populated === Technical Operations === * '''Blocked''': ** by noone * '''Blocking''': ** none * '''Updates''': ** Wikimania + Debconf week, not much happened. === Community Tech === *Updates: CodeMirror and LoginNotify are still coming! === Fundraising Tech === * looking into db replication lag - it'll get up to like 5000 sec behind, but restarting mysql on the replicated copy will make it catch up in less than a minute * continuing new API work with main credit card processor * updating our interrupted-donation-resolver to work generically so we can use it for PayPal express checkout * refinements to CiviCRM<->bulk mailer data flows * CentralNotice clone campaign feature almost ready for CR === Scoring platform === *Blocked **Feeling the pain of no git-fat in labs deployments (our git repos are huge!) ***https://phabricator.wikimedia.org/T171758 ***Releng, can this be prioritized? *Updates **New ORES model information available at https://ores-misc.wmflabs.org. Demo coming soon. ***Mostly an FYI for Collab Team === Release Engineering === * Last projects moving to scap3 **These have patches but deployment window scheduled: *** [https://phabricator.wikimedia.org/T129154 iegreview] *** [https://phabricator.wikimedia.org/T129134 scholarships] ** No idea about: *** [https://phabricator.wikimedia.org/T129142 ocg] *** [https://phabricator.wikimedia.org/T170839 dropwizard metrics(???)] - Speak up now or forever hold your peace (we'll delete it)

1 0

MW Function for parsing and modifying template arguments on a page
by Daren Welsh 15 Aug '17

15 Aug '17

I'm working on a server-side script that will periodically revise wiki pages that all use the same template. Is there a function I can use that will parse a page and then find and replace template arguments with values I determine within my script? For example, let's say I have Template:Beer like the following: {{Beer |Name= |Brewery= |Style= |ABV= |IBU= }} So if I had a page Rocket Fuel: {{Beer |Name=Rocket Fuel |Brewery=8th Wonder |Style=Vietnamese Coffee Porter |ABV=4.6 |IBU=18 }} Let's say my script "discovered" an error in one of the arguments and needed to update the page. For example, let's say the IBU was actually 28. Is there a function that will find and replace the value for IBU in the page? I'm currently using regex, but I'm wondering if there's a more trustworthy method. Thanks, Daren

4 5

Timeless skin now available on mw.org
by Isarra Yos 15 Aug '17

15 Aug '17

The Timeless skin has been deployed to test, test2, and mw.org. Anyone interested, please go ahead an enable it and find everything wrong and swear at me about it. Note that the current design is not the final design and I haven't quite worked out what the final design should be, either, so feel free to swear at me about that, too, if you have any ideas/whatever. * Bad documentation: https://www.mediawiki.org/wiki/Skin:Timeless * Bugs: https://phabricator.wikimedia.org/tag/timeless/ * To enable it: https://www.mediawiki.org/wiki/Special:Preferences#mw-prefsection-rendering If all goes well, we will move on to deploy it to the pilot wikis, as listed on the deployment task, sometime next week: https://phabricator.wikimedia.org/T154371 A huge thank you to all the insane people who have worked to get us to this point, when the entire notion of a new skin seemed something of an impossibility most of the way through. -I

12 16

Wikiscan statistics tool for Wikimedia projects
by Pine W 14 Aug '17

14 Aug '17

Wikiscan is an interesting tool for statistics fans. I suggest briefly reading this IEG page <https://meta.wikimedia.org/wiki/Grants:IEG/Wikiscan_multi-wiki>, then playing with the tool on https://wikiscan.org/ Pine

4 3

MediaWiki-GoatSniffer 0.11.1 released
by Legoktm 13 Aug '17

13 Aug '17

Hello! Straight from Wikimania, MediaWiki-GoatSniffer 0.11.1 is now available for use in your MediaWiki extensions and other projects. This release fixes bugs from 0.10.0 as well as some new features: * Add GoatSniffer ASCII art (Kunal Mehta) * Added OpeningKeywordBraceSniff (Umherirrender) * Add sniff to forbid PHP 7 scalar type hints (Kunal Mehta) * Enable Squiz.WhiteSpace.OperatorSpacing (Umherirrender) * Enforce "short" type definitions on @param in comments (Umherirrender) * Fix phpunit test on windows (Umherirrender) * Fix Undefined offset in FunctionCommentSniff (Umherirrender) I already updated most extensions to 0.11.0 a few days ago, it's up to each extension maintainer if they'd also like to update to 0.11.1. Thanks, -- Legoktm

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l August 2017