Wikitech-l July 2019

wikitech-l@lists.wikimedia.org

54 participants
68 discussions

Wednesday: Technical Advice IRC Meeting
by Raz Shuty 16 Jul '19

16 Jul '19

Sorry for cross-posting! Reminder: Technical Advice IRC meeting this week **Wednesday 3-4 pm UTC** on #wikimedia-tech. Questions can be asked in English and German! The Technical Advice IRC Meeting (TAIM) is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about Mediawiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! -- Raz Shuty Engineering Manager Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Phone: +49 (0)30 219 158 26-0 https://wikimedia.de Imagine a world, in which every single human being can freely share in the sum of all knowledge. That‘s our commitment. Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

Skipcaptcha assigned to users coming from throttle-exempted IP addresses
by Martin Urbanec 15 Jul '19

15 Jul '19

Hi, I created https://phabricator.wikimedia.org/T227487, which proposes to add skipcaptcha to all users coming from throttle-exempted IP addresses (see /wmf-config/throttle.php in operations/mediawiki-config for that). This can make some events go more smoothly. Given users coming from such addresses are generally trusted, this shouldn't be an issue IMHO. What do the others think? Martin

2 4

TechCom Radar 2019-07-10
by Kate Chapman 13 Jul '19

13 Jul '19

Hi All, Here are the minutes from this week's TechCom meeting: * RFC approved: Introduce a new namespace for collaborative judgements about wiki entities <https://phabricator.wikimedia.org/T200297> * IRC meeting moved to July 17 in #wikimedia-office Abstract schemas and schema changes: <https://phabricator.wikimedia.org/T191231> (note new time/date: July 17 2019 14:00 UTC/16:00 CEST/06:00 PDT) * IRC meeting on Merge Extension:Theme into core <https://phabricator.wikimedia.org/T122924> in #wikimedia-office on July 24th at 21:00 UTC/23:00 CEST/14:00 PDT * Did not require a RFC: Core should provide inline diffs as well as side by side <https://phabricator.wikimedia.org/T117279> You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org

1 0

Change to ResultWrapper indexing
by Gergo Tisza 12 Jul '19

12 Jul '19

Hi all, In the past, iterating ResultWrapper (the object returned by Database::select() and similar MediaWiki commands) resulted in 1-based indexes (that is, foreach ( $rw as $i => $_ ) { echo "$i "; } would print 1 2 3 4...). From 1.34 (or since a few weeks ago, if you use the master version), the indexing will be 0-based. Since there is no way to apply the usual deprecation process to this type of change, it's being announced here instead.

1 0

[Train] 1.34.0-wmf.13 status update
by Jeena Huneidi 11 Jul '19

11 Jul '19

The 1.34.0-wmf.13 version of MediaWiki is no longer blocked[0]! Thanks to Anomie, Krinkle, Jforrester, Tgr, Ebernhardsen, and everyone else who worked on unblocking the train. We plan to deploy the new version to both group1 and group2 today. -- Your humble train toiler [0]. <https://phabricator.wikimedia.org/T220738> -- Jeena Huneidi Software Engineer, Release Engineering Wikimedia Foundation

1 0

[Train] 1.34.0-wmf.13 status update
by Jeena Huneidi 10 Jul '19

10 Jul '19

The 1.34.0-wmf.13 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * PHP error from Special:OAuth: "Indirect modification of overloaded property User::$oAuthUserData" - https://phabricator.wikimedia.org/T227688 <https://phabricator.wikimedia.org/T227656> *Fatal from CirrusSearch\Job\LinksUpdate: "Call to a member function getLogVariables() on null" - https://phabricator.wikimedia.org/T227691 *Fatal on some Special:MyLanguage urls: MWException "Can't determine talk page associated with interwiki link" - https://phabricator.wikimedia.org/T227700 Once these issues are resolved train can resume. If these issues are resolved on a Friday the train will resume Monday. Thank you for your help resolving these issues! -- Your humble train toiler [0]. <https://phabricator.wikimedia.org/T220738> [1]. <https://tools.wmflabs.org/versions/> -- Jeena Huneidi Software Engineer, Release Engineering Wikimedia Foundation

1 0

Errors with tasks on Phabricator
by max 10 Jul '19

10 Jul '19

Hello. I hope this is suitable mailing list for my case, I didn't find a mailing list specifically for Phabricator. I can't create new task on Phabricator (about AutoWikiBrowser issues), when I post a task on page https://phabricator.wikimedia.org/maniphest/task/edit/form/1/ I got an error Unhandled Exception ("Error") Call to undefined method PhutilDOMNode::newRawString() Also, when I try to open some tasks from AWB workboard ( https://phabricator.wikimedia.org/project/view/1012/ ), I got a similar error Unhandled Exception ("Error") Call to undefined method PhutilDOMNode::setRawContent() It's about tasks https://phabricator.wikimedia.org/T213144 and https://phabricator.wikimedia.org/T214324 . Other users confirm this error on this tasks.

3 2

[Train] 1.34.0-wmf.13 status update
by Jeena Huneidi 10 Jul '19

10 Jul '19

The 1.34.0-wmf.13 version of MediaWiki is blocked[0]. The new version is deployed to group0[1], but can proceed no further until these issues are resolved: * action=history shows "username removed" for anonymous editors on mediawiki.org instead of IP addresses - https://phabricator.wikimedia.org/T227656 Once these issues are resolved train can resume. If these issues are resolved on a Friday the train will resume Monday. Thank you for your help resolving these issues! -- Your humble train toiler [0]. <https://phabricator.wikimedia.org/T220738> [1]. <https://tools.wmflabs.org/versions/> -- Jeena Huneidi Software Engineer, Release Engineering Wikimedia Foundation

1 0

Scrum of scrums/2019-07-10
by Željko Filipin 10 Jul '19

10 Jul '19

Hi, for HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-07-10 Željko -- = 2019-07-10 = == Product == === Contributors === ==== Editing ==== * Updates: ** VE as mobile default A/B test started on July 9th, delayed from original plan due to data instrumentation issues ** Improved transaction system in VE by more robustly handling (squashing) multiple transactions at once: https://phabricator.wikimedia.org/T188026 ** Preparing release of next version of edit cards on mobile and improved toolbar work === Readers === ==== iOS native app ==== * Updates: ** 6.3 to be released soon (talk pages, media/link flows in Editor) ( https://phabricator.wikimedia.org/project/view/3890/) ** Active development for bug fix release 6.3.1 ( https://phabricator.wikimedia.org/project/view/4092/) ==== Android native app ==== * Updates: ** Switched over suggested-edits queries to production API. Ready to release feature to Beta. ( https://phabricator.wikimedia.org/project/view/3959/ ) ** Android app is ready for a new release with image caption editing feature. We are currently testing before the big release. ** We also had a minor high-impact bug fixes release, which has helped improve the editing on the app. ==== Readers Web ==== * '''Updates:''' ** Summary: continuing development of the advanced mobile contributions and MobileFrontend architecture projects. ** Responsive website (MinervaNeue / MobileFrontend / Portals): *** Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions **** [https://phabricator.wikimedia.org/T224070 <nowiki>Update notifications icon (AMC & non-AMC)</nowiki>] **** [https://phabricator.wikimedia.org/T214540 <nowiki>[EPIC] AMC Navigation - user menu</nowiki>] **** [https://phabricator.wikimedia.org/T224735 <nowiki>[AMC] Updates to user pages</nowiki>] *** Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro… **** [https://phabricator.wikimedia.org/T225447 Tasking for next year] **** [https://phabricator.wikimedia.org/T193077 <nowiki>Remove Page's View functionality</nowiki>] **** [https://phabricator.wikimedia.org/T149909 <nowiki>[EPIC] Proposal: abandon use of template partials in MobileFrontend for components within components e.g. Button, Icon and Anchor classes </nowiki>] **** [https://phabricator.wikimedia.org/T219036 <nowiki>MFA: Create Notifications filter overlay using modern techniques</nowiki>] *** Miscellaneous: **** [https://phabricator.wikimedia.org/T224997 <nowiki>Update MobileFrontend-npm-run-lint-modules-docker to run node10</nowiki>] **** [https://phabricator.wikimedia.org/T225260 <nowiki>BUG: Notifications tray (mobile) - margins and borders</nowiki>] **** [https://phabricator.wikimedia.org/T220979 <nowiki>[Bug] Notification counts broken on mobile</nowiki>] **** [https://phabricator.wikimedia.org/T220668 <nowiki>Regression: Download icon doesn't download images</nowiki>] **** [https://phabricator.wikimedia.org/T212944 <nowiki>Update page issues folder structure</nowiki>] **** [https://phabricator.wikimedia.org/T205341 <nowiki>Split up reset.css rules to specific element selectors only where needed and remove file altogether</nowiki>] **** [https://phabricator.wikimedia.org/T195795 <nowiki>Use a clearly intended height on MinervaNeue header</nowiki>] **** [https://phabricator.wikimedia.org/T188697 <nowiki>Not possible to configure Minerva main menu to use Special:RandomRoot instead of Special:Random</nowiki>] ** Browser tests: *** [https://phabricator.wikimedia.org/T177260 <nowiki>Rewrite disabled MobileFrontend browser tests to phpunit tests and Node.js browser tests</nowiki>] ** Planning *** Desktop refresh planning ==== Readers Infrastructure ==== * Updates: ** The /page/mobile-html endpoint is ready to be consumed. Please give feedback, esp. if you see anything that needs to be changed. ** Structured talk page endpoint launched in the REST API ** SDC caption and Wikidata description edit suggestions endpoints launched in the REST API ** Machine vision middleware project in progress: https://www.mediawiki.org/wiki/Wikimedia_Product/Machine_vision_middleware ==== Multimedia ==== * Updates: ** preparing for release of arbitrary statements to production commons ==== Parsing ==== * Updates: ** Heads up for Services: https://phabricator.wikimedia.org/T226931 and https://phabricator.wikimedia.org/T217540 -- Kiwix filed this about reparsing support for renames / deletions of images. But this is not necessarily Kiwix specific since presumably apps will also see stale versions without Parsoid reparses. Change Propagation support seems to be missing for these events. ** Parsoid-PHP Port: ** Porting parser tests infrastructure so we can run parser tests in PHP instead of relying on JS+PHP hybrid testing as we have till now. ** Starting to port the rest of the mocha tests. ** Setting up more CI tests to prevent regressions. == Technology == === Fundraising Tech === * Updates: ** About to start testing India donation forms ** Updating remaining python2 tools to python3 ** CiviCRM <-> third party emailer data interchange enhancements ** More work to tweak fraud filters ** Recurring conversion ask still underway === Core Platform === (N/A for Scrum of Scrums, will follow up on blockers here) * Blocking: ** Performance *** <nowiki>{{PAGEID}}</nowiki> optimization; https://gerrit.wikimedia.org/r/519352 *** vary-revision-sha1 patches; https://gerrit.wikimedia.org/r/520721 & https://gerrit.wikimedia.org/r/519574 ** Release Engineering *** (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview. *** MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512 * Updates: ** mod to central auth to allow separate session storage ** Update test.wikipedia.org to use Kask === Engineering Productivity === ==== Performance ==== * Blocked by: ** SRE (Ops): mcrouter misconfigured (multi-dc broadcasts should be async, not sync) https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/492948/ ** CPT: *** <nowiki>{{PAGEID}}</nowiki> optimization; https://gerrit.wikimedia.org/r/519352 *** vary-revision-sha1 patches; https://gerrit.wikimedia.org/r/520721 & https://gerrit.wikimedia.org/r/519574 * Updates: ** resourceloader *** startup size reduced by 4K, impact from "EventLogging lightweight" project with @Analaytics last quarter, now seen in production. *** resourceloader: CR for various patches. Fomafix is awesome. *** resourceloader: CR for multi-dc prep of module_deps database storage (migrate from db stable to stash). ** Moving things off of $wgMainStash (T227376) *** https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/520964, https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/520965/, https://gerrit.wikimedia.org/r/521019, https://gerrit.wikimedia.org/r/521020, https://gerrit.wikimedia.org/r/521017, https://gerrit.wikimedia.org/r/521014 ==== Release Engineering ==== * Blocked by: ** Core Platform Team: *** (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview. *** MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512 * Blocking: ** Security team: We need to fix the ast availability in CI images to allow phan-seccheck upgrades https://phabricator.wikimedia.org/T227385 * Updates: ** Train Health *** Last week: 1.34.0-wmf.12 - NO TRAIN, WMF HOLIDAY (4 July) *** This week: 1.34.0-wmf.13 - https://phabricator.wikimedia.org/T220738 *** Next week: 1.34.0-wmf.14 - https://phabricator.wikimedia.org/T220739 ** All: Input greatly wished for on the "Future of CI" planning document: https://lists.wikimedia.org/pipermail/wikitech-l/2019-June/092227.html ** bd808/Niharika: FYI, we've moved CI for wikimania-scholarships to only test in PHP72 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224906 === Search Platform === * Updates: ** Fixed errors on links with broken UTF-8 URLs: https://phabricator.wikimedia.org/T227098 ** Created data pipeline workflow for glent method 0: https://phabricator.wikimedia.org/T216783 ** Did some capacity planning for ElasticSearch: https://phabricator.wikimedia.org/T221121 ** Some troubles reindexing wikidata: https://phabricator.wikimedia.org/T227136 ** Working on creating RDF export for SDC/MediaInfo: https://phabricator.wikimedia.org/T221917 ** Working on CirrusSearch configuration for cloudelastic: https://phabricator.wikimedia.org/T220625 ** Working on CirrusSearch query dispatcher: https://phabricator.wikimedia.org/T216429 === Security === * Blocked by: ** Release Engineering: We need to fix the ast availability in CI images to allow phan-seccheck upgrades https://phabricator.wikimedia.org/T227385 * Updates: ** Backlog *** John to explore funding of 3rd party audits this quarter stalled - https://phabricator.wikimedia.org/T155537, https://phabricator.wikimedia.org/T156960, https://phabricator.wikimedia.org/T148246, https://phabricator.wikimedia.org/T187846** Concept Review for the machine vision, new, to be assigned - https://phabricator.wikimedia.org/T227591 *** Parsoid-PHP, new, not quite ready for review, to be assigned - https://phabricator.wikimedia.org/T227209 ** Active *** Page Content Service route /page/mobile-html, started - https://phabricator.wikimedia.org/T227114 *** Security review of WebAuthn library dependencies, started - https://phabricator.wikimedia.org/T227244 *** Doublewiki (old), started - https://phabricator.wikimedia.org/T131199 *** Sec review of steward userJS, started - https://phabricator.wikimedia.org/T227221 *** CentralNotice Code Review request, assigned to Sam starting - https://phabricator.wikimedia.org/T226963 *** Planet wikimedia - assigned to Michal Anna, stalled - https://phabricator.wikimedia.org/T207246 ** Waiting *** Waiting on update from Yurik/Vega folks (upstream) to proceed stalled - https://phabricator.wikimedia.org/T222806 *** John and Scott to follow up with Raz re: risk ownership in-progress - https://phabricator.wikimedia.org/T216419 *** Labs db/sanitarium and maintain-views.yaml audits - transition to James F for review in-progress - https://phabricator.wikimedia.org/T169097, https://phabricator.wikimedia.org/T103011 ** Frozen (delayed indefinitely) *** Audiences user-testing concept review, stalled - https://phabricator.wikimedia.org/T220043 *** Audiences growth team emails concept review, stalled - https://phabricator.wikimedia.org/T220242 *** PageForms review from a long time ago, will post closure note next week, stalled - https://phabricator.wikimedia.org/T149869 === Site Reliability Engineering === * Blocking: ** Performance: mcrouter misconfigured (multi-dc broadcasts should be async, not sync) https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/492948/ * Updates: ** Goal planning in process, reach out to us if you have requests on SREs == TechCom == * Updates: ** IRC meeting moved to July 17 in #wikimedia-office Abstract schemas and schema changes: https://phabricator.wikimedia.org/T191231 (note new time/date: July 17 2019 14:00 UTC/16:00 CEST/06:00 PDT)

1 0

[Tech Talks] July 10, 2019, 4 PM UTC, A Deployment Pipeline Overview
by Subramanya Sastry 10 Jul '19

10 Jul '19

Hi Everyone, It's time for Wikimedia Tech Talks 2019 Episode 6! Next month's talk will take place July 10, 2019 at 4:00 PM UTC. Topic: A Deployment Pipeline Overview Speaker: Alexandros Kosiaris, Senior Operations Engineer Summary: The deployment pipeline project has been ongoing for a while, sometimes with more resources poured into it, sometimes less, but it's finally in a state that is ready to be used (it's already being used!). This tech talk is about a presentation to wider technical audiences, discussing the goals of the project, the implementation decisions and how it's meant to be used and adopted by the deployers of services (and eventually MediaWiki) in the coming months. YouTube stream for viewers: https://www.youtube.com/watch?v=i0FTcG7PxzI During the live talk, you are invited to join the discussion on IRC at #wikimedia-office Those in the SF office can watch this in R124. You can watch past Tech Talks here: https://www.mediawiki.org/wiki/Tech_talks If you are interested in giving your own tech talk, you can learn more here: https://www.mediawiki.org/wiki/Project:Calendar/How_to_schedule_an_event#Te… Subbu. (Standing in for Sarah Rodlund who is currently away on sabbatical)

1 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l July 2019