Wikitech-l October 2019

wikitech-l@lists.wikimedia.org

53 participants
66 discussions

Some phabricator helpers
by Amir Sarabadani 18 Oct '19

18 Oct '19

Hey, Today I made some phabricator helpers, I thought these might be useful for others. The first is a web page that gives you an overview of changes in any sprint board in the past N days (default value of N is seven). This is useful when you want to have a quick look of things that has been done to show them off in SoS, weekly updates, etc. Here's an example with performance team board: [1], The default boards are Wikidata sprint boards (like [2]) let me know if encounter any issues, have any suggestions or if you want to add your board to the default list. It's based on a CLI tool my colleague made a while ago. Of course it's easily doable to query them directly in phabricator but this combines several queires (things that are picked up, things that are waiting for review, etc.) into one small place, the output is slightly shorter and cleaner. If you know what Herald [3] is, you can skip this paragraph. Herald is set of rules in phabricator that gets automatically applied on tasks, patches, or anything. For example, if you add a ticket and add one of sprint boards of wikidata but you forget to add the umbrella project (#Wikidata [4]), it happily adds the umbrella project to the ticket. If you want to add some Herald rules to improve your workflow, let me know. Herald, albeit being very powerful, has one limitation, it doesn't move tasks to another column, this means if a task is being worked on (like it's part of a sprint) Herald can't move it to "In progress" column in the umbrella project. You probably know my bot "Maintaince bot", It continuously spams you, Today, I made it to handle column moving as well. So it's going to spam you even more (sorry) for tasks being moved around. You can disable notification for column moves in your settings in phabricator or set a filter for archiving maintenance bot emails. But if you want to add more rules to it (if you have been moving tasks around manually, you probably know it's a very tedious work). Let me know the rules and the column moves, and I add it to my bot as well. [1] https://tools.wmflabs.org/phabricator-reporter/sprint.php?project=&other=pe… [2]: https://tools.wmflabs.org/phabricator-reporter/sprint.php?project=RL+Module… [3]: https://phabricator.wikimedia.org/herald/ [4]: https://phabricator.wikimedia.org/tag/wikidata/ Best -- Amir Sarabadani (he/him) Software engineer Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 https://wikimedia.de Unsere Vision ist eine Welt, in der alle Menschen am Wissen der Menschheit teilhaben, es nutzen und mehren können. Helfen Sie uns dabei! https://spenden.wikimedia.de Wikimedia Deutschland — Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

Quibble 0.0.39 released
by Antoine Musso 18 Oct '19

18 Oct '19

Hello, I have released a new version of Quibble - version 0.0.39. It enables the MediaWiki REST API entry point (/rest.php), a feature required for an API testing tool. Thank you Clara Andrew-Wani for the patch. The CI job for mediawiki/tools/api-testing has been updated, other jobs will be progressively be updated next week. https://doc.wikimedia.org/quibble/changelog.html CI Docker images: docker-registry.discovery.wmnet/releng/quibble-coverage:0.0.39 docker-registry.discovery.wmnet/releng/quibble-fresnel:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch-bundle:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch-php70:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch-php71:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch-php72:0.0.39 docker-registry.discovery.wmnet/releng/quibble-stretch-php73:0.0.39 cheers, -- Antoine Musso

1 0

OOUI v0.35.0 released – new CSS unit approach
by Volker E. 18 Oct '19

18 Oct '19

Hello, end of last week saw releases of OOUI v0.35.0 and minor follow-up v0.35.1, they have rolled-out on normal train this week. The highlights were - Using `px` where applicable over `em`s. For most box sizing properties (min-width, min-height, margin, border, border-radius, padding, box-shadow, outline) `px` unit is sufficient to still provide accessible user font preference overrides to scale the text. Additionally, this change is simplifying and speeding up building interfaces for designers and developers. See https://phabricator.wikimedia.org/T220671 for further details. This change doesn't affect any current interfaces, it should result in no rendering differences at normal environment settings. - `infuse-by-id` feature got removed, it has been deprecated since v0.29.7 and has, to our knowledge, only been used internally any more. Use an HTMLElement or jQuery collection instead. Please verify that you are not using the feature any more. You can find details on additional new features, code-level, styling and interaction design amendments, and all improvements since v0.34.0 in the full changelog[0]. If you have any further queries or need help dealing with breaking changes, please let me know. As always, interactive demos[1] and library documentation is available on mediawiki.org[2], there is comprehensive generated code-level documentation and interactive demos and tutorials hosted on doc.wikimedia.org[3]. OOUI version: 0.35.0 MediaWiki version: 1.35.0-wmf.2 Date of deployment to production: Regular train, starting Tuesday 15 October [0]- https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md <https://doc.wikimedia.org/oojs-ui/master/demos/#widgets-mediawiki-vector-ltr> [1]- https://doc.wikimedia.org/oojs-ui/master/demos/#widgets-mediawiki-vector-ltr [2] - https://www.mediawiki.org/wiki/OOUI [3] - https://doc.wikimedia.org/oojs-ui/master/ Best, Volker -- Senior UX Engineer Wikimedia Foundation volker.e(a)wikimedia.org | @Volker_E

1 0

Train 1.35.0-wmf.2 Status Update
by Jeena Huneidi 17 Oct '19

17 Oct '19

The 1.35.0-wmf.2 version of MediaWiki is blocked[0]. The new version is deployed to group(s) 0 & 1[1], but can proceed no further until these issues are resolved: * Some revisions' contents are incorrect in the cache - wrong contents shown in history & diffs - https://phabricator.wikimedia.org/T235188 Once these issues are resolved train can resume. If these issues are resolved on a Friday the train will resume Monday. Thank you for your help resolving these issues! -- Your humble train toiler [0]. <https://phabricator.wikimedia.org/T233850> [1]. <https://tools.wmflabs.org/versions/> -- Jeena Huneidi Software Engineer, Release Engineering Wikimedia Foundation

1 0

TechCom Radar 2019-10-16
by Alexandra Paskulin 17 Oct '19

17 Oct '19

Hi all, Here are the minutes from this week's TechCom meeting: * Discussed: Section header "share" link < https://phabricator.wikimedia.org/T18691>. This RFC aims to make it easier for readers to share links to sections on wiki pages. * Discussed: RFC: Where to implement Desktop Improvements project <https://phabricator.wikimedia.org/T234907>. This RFC discusses the approach for implementing broad UI changes to the desktop interface of Wikimedia projects. * IRC discussion next week: Development policy: Require use of common storage abstractions <https://phabricator.wikimedia.org/T215465>. The meeting will take place on Freenode in the #wikimedia-office channel on 2019-10-23 at 21:00 UTC (14:00 PT, 23:00 CET). You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes>. See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar>. Best, - Alex -- Alex Paskulin Technical Writer Wikimedia Foundation

1 0

Scrum of scrums/2019-10-16
by Željko Filipin 17 Oct '19

17 Oct '19

Hi, for HTML version see https://www.mediawiki.org/wiki/Scrum_of_scrums/2019-10-16 Željko -- = 2019-10-16 = == Callouts == * Language team ->Core(?): Blocked on [[phab:T235188#5574342]] * SRE DBAs ** requested read-only time for enwiki 14th Nov to switchover the primary database master - [[phab:T234801]], already done ** s6 primary master switchover (read-only required) 19th Nov 05:00 AM UTC * DBAs, Performance: Heads up that PI will be pinging for reviews/review updates for the MachineVision extension later this week, as soon as the code settles a bit (DBA review: [[phab:T227355]], Perf review: [[phab:T230813]] ) == Product == === Editing === * Updates: ** Catch errors during document initialization ** Enforce that some files must not use the `ve` global (task [[phab:T228684]]) ** Parse relative hrefs on image nodes like on regular links (task [[phab:T193253]]) ** Fix Vector wikitext surface padding overrides when using custom browser font-size (task [[phab:T222217]]) === Growth === * Updates: ** Initial structure for Suggested Edits module ** Do not align the bottom of the homepage columns (task [[phab:T232420]]) ** StartEditing: Remove special message for add-change response (task [[phab:T232419]]) === iOS native app === * Updates: ** 6.5 in active development - [[phab:project/view/4245]] ***bug fixes *** History & diffs feature **** Core Platform working on Rest APIs for this === Android native app === * Updates: ** Working actively towards completion of Suggested edits V3 ** Working with the PI team to update backend support for the same. === Product Infrastructure === * Updates: ** MachineVision extension work in progress, still aiming to deploy to prod by end of month ** Still working to resolve [[phab:T229286]] ("'worker died, restarting' mobileapps issue") === Structured Data === * Blocked by: ** Wikidata/WMDE: [[phab:T229280]] following up on [[gerrit:534536]] ** Wikidata/WMDE: [[phab:T223792]] * Blocking: ** Search: RecentChange support for SDC: [[phab:T230862]] (actually the higher level task on which we are blocked: [[phab:T221917]]) * Updates: ** Machine Vision, bugfixing/tidy up on WikibaseMediaInfo === Parsing === * Updates: ** Fixing bugs in Parsoid/PHP based on HTML string compasion between Parsoid/JS & Parsoid/PHP. ~1% pages still have diffs that need investigation / bug fixing. ** Will sync with Services (CPT) and SRE to finalize deployment plans for initial deployment (no live client traffic) to identify any last lingering Parsoid crashers OR performance problems in a production context. === Language === * Blocked by: ** Language->Core(?) Blocked on [[phab:T235188#5574342]] * Updates: ** CX going out of beta in some Wikipedias next week. === UI Standardization === * Updates: ** OOUI v0.35.0 and 0.35.1 with one small revert released eo last week, latter already on this week's train ** Design Style Guide: *** Progressing “Components“ section *** Change to Git lfs for large binary files. If you've cloned the dir, throw away your current clone, re-clone it. https://github.com/wikimedia/WikimediaUI-Style-Guide In your repo directory type `git lfs pull`. If the lfs app is not installed follow https://github.com/git-lfs/git-lfs/wiki/Installation == Technology == === Analytics === * Blocking: ** Search: [[phab:T229882]] === Fundraising Tech === * Updates: ** Refining annual summary receipt for recurring donors: [[phab:T195907]] ** Restoring data lost during manual merges: [[phab:T232636]] ** Looking into reconciliation file discrepancies from S. Amer / India processor: [[phab:T235212]] ** Might need to add more params to CentralNotice banner hide cookies: [[phab:T235204]] ** Refining treatment of opt in and opt out data: [[phab:T234925]] ** Looking into errors on Amazon Pay donation form: [[phab:T234538]] == Core Platform == * Blocked by: ** SRE [[phab:T235478]] * Blocking: ** Wikidata/WMDE: In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: [[phab:T128486]]. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get [[phab:T128486]] unstuck. ** Scoring: Review of Jade API [[phab:T199834]] (Can we get a high level review in the short term? We want to build on this but not dig a hole.) ** Language->Core(?) Blocked on [[phab:T235188#5574342]] * Updates: ** history API done ** working on stretch goals ** echo notification storage === Engineering Productivity === ==== Performance ==== * Blocked by: ** SRE *** PHP7 fatal-error reports missing from type:mediawiki in Logstash. – [[phab:T234283]] *** mwdebug1002 might need to be reprovisioned, failing to report messages to Logstash. – [[phab:T214734]] ==== Release Engineering ==== * Updates: ** v3 of CI arch document for new CI wants review and feedback [[User:LarsWirzenius/NewCI]] ** Train Health *** Last week: 1.35.0-wmf.1 - [[phab:T233849]] *** This week: 1.35.0-wmf.2 - [[phab:T233850]] *** Next week: 1.35.0-wmf.3 - [[phab:T233851]] === Scoring Platform === * Blocked by: ** CPT: Review of Jade API [[phab:T199834]] * Updates: ** Cleanup for Jade API components and working through review [[phab:T199834]] *** Naming conflicts [[phab:T235003]] *** Central Auth (Found CentralAuth.lookup()!) ** Jade *** Continuing iterations on Jade designs (based on Design Review feedback) [[phab:T212370]] *** Reached out to Front-End Arch. WG. for recommendations for Jade UI. We got a response from Mark Holmquist and will be going to Eric Gardner for specific advice and reviewing SDC code (WikibaseMediaInfo) ** Completed second major review of Revscoring refactoring for Session orientation [[phab:T231214]] ** Firmed up cross-team deliverables for Topic Modeling work. [[phab:T235181]] ** Merged new features for Basque Language [[phab:T223788]] ** ORES celery workers struggling in Cloud VPS. Still looking into it. [[phab:T234926]] === Search Platform === * Blocked by: ** Structured Data: RecentChange support for SDC: [[phab:T230862]] (actually the higher level task on which we are blocked: [[phab:T221917]]) ** Analytics: [[phab:T229882]] * Updates: ** Error when searching for exact phrase on English Wikipedia: "Precondition failed: Must have a resultset set": [[phab:T234445]] ** Deploy A/B Test for Glent Method 0 [[phab:T233211]] ** Optimize the Sanitizer to produce a single job if all elasticsearch clusters are to be updated: [[phab:T233587]] === Security === * Updates: * In Progress: ** GRC Tool Eval ** MachineVision extension review ** FileImporter extension review ** Data Map update submission review === Site Reliability Engineering === * Blocking: ** Performance *** PHP7 fatal-error reports missing from type:mediawiki in Logstash. – [[phab:T234283]] *** mwdebug1002 might need to be reprovisioned, failing to report messages to Logstash. – [[phab:T214734]] ** Core Platform SRE [[phab:T235478]] * Updates: ** Started working on new goals ** Helping CPT get restrouter rate limiting working, deploying echostore == Wikimedia DE == === Wikidata === * Blocked by: ** Not sure who, Core Platform? Mentioned 2 weeks ago already with no result: : In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: [[phab:T128486]]. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get [[phab:T128486]] unstuck. * Blocking: ** Structured Data: [[phab:T229280]] following up on [[gerrit:534536]] coming up this week ** Structured Data: [[phab:T223792]] - also expect to unblock this week

1 0

December Deployment Freeze
by Tyler Cipriani 16 Oct '19

16 Oct '19

Hi All! tl;dr: December deployment freeze 2019-12-19–2020-01-02. Train resumes 2020-01-06. We're coming up to the time of year where we freeze our production deployments to allow for the holiday season's limited availability as well as to ensure the stability of our holiday fundraising. After talking with the fundraising team we've decided to stick with what we've done in years past[0][1][2][3][4] and freeze for the final week and the first week of the year. For this year that means the final deployment of the calendar year will be on 2019-12-19 and the first deployment of the new year will be on 2020-01-02. Train will resume running the week on 2020-01-06. <3 -- Tyler [0]. <https://wikitech.wikimedia.org/wiki/Deployments/Archive/2018/12> [1]. <https://wikitech.wikimedia.org/wiki/Deployments/Archive/2017/12> [2]. <https://wikitech.wikimedia.org/wiki/Deployments/Archive/2016/12> [3]. <https://wikitech.wikimedia.org/wiki/Deployments/Archive/2015/12> [4]. <https://wikitech.wikimedia.org/wiki/Deployments/Archive/2014/12>

1 0

MediaWiki 1.34.0-rc.0 is ready for testing
by Sam Reed 15 Oct '19

15 Oct '19

I'm pleased to announce the immediate availability of MediaWiki 1.34.0-rc.0, the first release candidate for 1.34.x. Download links at the end of the e-mail. The tag has been signed and pushed to Git. Please note that MediaWiki 1.34 no longer supports HHVM, and also the PHP version requirement has been raised from 7.0.13 in MediaWiki 1.33, to 7.2.9. This is not a final release and should not be used for production websites. Known issues are tracked in Phabricator on the release workboard [1]. As always please do try out the release candidate in a test environment and report any issues that you discover. Please use the #MW-1.34-Release [2] tag in Phabricator when reporting issues specific to this release. It is expected that MediaWiki 1.34 will become final in the second half of November 2019. Preliminary release notes: https://phabricator.wikimedia.org/source/mediawiki/browse/REL1_34/RELEASE-N… https://www.mediawiki.org/wiki/Release_notes/1.34 MediaWiki core with bundled extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.0.tar.gz Core only, no extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.0.ta… GPG signatures: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.0.ta… https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.0.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html Open Bugs: [1] https://phabricator.wikimedia.org/project/board/3386/ Bug report form: [2] https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?tags=MW-1.34-… ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.0.tar.gz Download without bundled extensions: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.0.ta… GPG signatures: https://releases.wikimedia.org/mediawiki/1.34/mediawiki-core-1.34.0-rc.0.ta… https://releases.wikimedia.org/mediawiki/1.34/mediawiki-1.34.0-rc.0.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html

1 0

Maintenance release: 1.31.5 and 1.32.5
by Sam Reed 15 Oct '19

15 Oct '19

Hi all, I would like to announce the release of MediaWiki 1.32.5 and 1.31.5. These releases primarily fix an issue in the backported security patch for T230402. This wasn't compatible with 1.32 and 1.31 as is, so modifications were required. It was fine for 1.33, hence no followup release for 1.33. Some other minor fixes are also included. == Links to all mentioned tasks == * https://phabricator.wikimedia.org/T230402 == Release notes == Full release notes for 1.31.5: https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_31/RELEASE-NOTES… https://www.mediawiki.org/wiki/Release_notes/1.31 Full release notes for 1.32.5: https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_32/RELEASE-NOTES… https://www.mediawiki.org/wiki/Release_notes/1.32 For information about how to upgrade, see <https://www.mediawiki.org/wiki/Manual:Upgrading> ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.32/mediawiki-1.32.5.tar.gz Download without bundled extensions: https://releases.wikimedia.org/mediawiki/1.32/mediawiki-core-1.32.5.tar.gz Patch to previous version (1.32.4): https://releases.wikimedia.org/mediawiki/1.32/mediawiki-1.32.5.patch.gz GPG signatures: https://releases.wikimedia.org/mediawiki/1.32/mediawiki-core-1.32.5.tar.gz.… https://releases.wikimedia.org/mediawiki/1.32/mediawiki-1.32.5.tar.gz.sig https://releases.wikimedia.org/mediawiki/1.32/mediawiki-1.32.5.patch.gz.sig Public keys: https://www.mediawiki.org/keys/keys.html ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.5.tar.gz Download without bundled extensions: https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.5.tar.gz Patch to previous version (1.31.4): https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.5.patch.gz GPG signatures: https://releases.wikimedia.org/mediawiki/1.31/mediawiki-core-1.31.5.tar.gz.… https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.5.tar.gz.sig https://releases.wikimedia.org/mediawiki/1.31/mediawiki-1.31.5.patch.gz.sig Public keys: https://www.mediawiki.org/keys/keys.html

1 0

s5 primary master switchover (read-only required) 15th October 05:00 AM UTC
by Manuel Arostegui 15 Oct '19

15 Oct '19

Hello, We have requested a 30 minutes read-only window for s5 wikis (T234303) for the 15th October from 05:00-05:30 AM UTC to switchover that section primary database master (T234300) db1070 is an old host and out of warranty that will be decommissioned (T217396). The new master will be db1100. We are going to do this on Tuesday 15th Oct from 05:00 to 05:30 AM UTC (we do not expect to use the 30 minutes window, if everything goes as expected). Impact: Writes will be blocked on the following wikis cebwiki dewiki enwikivoyage mgwiktionary shwiki srwiki Reads will remain unaffected. Communication will happen at #wikimedia-operations If you are around at that time and want to help with the monitoring, please join us! Thanks

1 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l October 2019