Wikitech-l August 2018

wikitech-l@lists.wikimedia.org

101 participants
93 discussions

TechCom Radar 2018-08-01
by Kate Chapman 06 Aug '18

06 Aug '18

Hi All, Here are the minutes from this week's TechCom meeting: * IRC Meeting hosted for: RFC: Modern Event Platform - Choose Schema Tech <https://phabricator.wikimedia.org/T198256> consensus in meeting was to move forward with JSONSchema with strict policies about what is allowed (e.g. no additionalProperties) and how to do schema evolution. * Discussion on RFC: Block users by page/namespace discussion continues <https://phabricator.wikimedia.org/T199917> * Triaged: Pages do not have stable identifiers <https://phabricator.wikimedia.org/T196950> and was decided to postpone until after Unify various deletion systems <https://phabricator.wikimedia.org/T20493> which may solve the issue * Triaged: Editor should flag mobile editing warnings <https://phabricator.wikimedia.org/T200880> seeking clarification and then will review again. * Triaged and shortly scheduling IRC meeting for: RfC: Release notes automation <https://phabricator.wikimedia.org/T200392> You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here: <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman TechCom Facilitator (Contractor)

1 0

Making PolyGerrit the default ui for gerrit
by Paladox 06 Aug '18

06 Aug '18

Hi, i have created this task [1] with i have uploaded this patch [2] to make polygerrit the default ui. The reason why is upstream are preparing to remove the gwtui very soon. In matter of fact upstream have disabled the gwtui on *.googlesource.com. Upstream already have this change [3] to remove the ui. Making PolyGerrit the default ui will get new users use to the new ui. GWTUI will still be available with ui switcher in the footer or you can append the url like https://gerrit.wikimedia.org/r/?polygerrit=0 PolyGerrit is stable, secure and also fast. It also has features that you cannot see in gwtui like user status, naming your patchiest (description), cc feature and also being able to tell who added you as a reviewer. This email is advanced notice before we change the default ui. any bugs todo with polygerrit / gerrit can be filled at https://phabricator.wikimedia.org/project/view/330/ and we can forward it upstream. [1] https://phabricator.wikimedia.org/T196812 [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/439444 [3] https://gerrit-review.googlesource.com/c/gerrit/+/116790

2 6

MediaWiki action api - query categories property of allimages list?
by Hogan (US), Michael C 04 Aug '18

04 Aug '18

Is there a way to use the allimages API to get categories applied to each File: page? If not, would it make sense to suggest adding a categories property using Phabricator or by some other communication channel? https://www.mediawiki.org/wiki/API:Allimages Thank you, Michael

2 1

2018-08-01 Scrum of Scrums meeting notes
by Grace Gellerman 03 Aug '18

03 Aug '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-01 = 2018-08-01= == Callouts == * SREs say FYI: ** Switchover tentative timeline announced. Please take a look and voice concerns if any Switchover: Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC Mediawiki: Wednesday, September 12th 2018: 14:00 UTC Switchback: Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on Monday) Mediawiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC * MCR Schema migrations are happening ** Beta is set to write both / read new with no problems identified ** Production set to write both / read old this week ** Starting with migration scripts to copy data from old schema to new one == Audiences == === Readers === ==== iOS native app ==== * Blocked by: - * Blocking: - * Updates: **6.0 in beta ( https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/), expected to push another beta this week ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Maintenance update released to Beta, will go to production tomorrow (Thurs) ** User testing of navigation design prototypes will commence shortly. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** RFC: Modernise our JavaScript with the goal that the startup module and mediawiki object should not depend on jQuery https://phabricator.wikimedia.org/T200868 ** Mobile website (MinervaNeue / MobileFrontend): *** Page issues UI and instrumentation: T191532 T191303 T197932 T197931 T200867 *** Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133 T197639 *** Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066 T197110 T198151 ** Product and design are collating research and interviews from Wikimania and working on advanced contributions ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** mobile-html exposed but needs fixes for CSP header and a URL to CSS. Won't run CollapseTable transform on server for the time being. ** Maps: *** New tile regeneration cron job for low-zoom vector tiles https://phabricator.wikimedia.org/T194787 *** Snapshot low DPI bug is waiting for a pull request review from upstream on third party library https://phabricator.wikimedia.org/T152196 *** Working on migrating test servers to Cloud VPS *** Working with SRE (Gehel) on migrating all servers to Debian Stretch ==== Multimedia ==== * No representative today - two team members on vacation and Mark has a conflicting meeting * Updates ** Breaking change in MediaWiki Core OOUI widget nearly caught us out - luckily something else broke in the meantime so the related fatal never occurred because of another fatal. Both fixed now. ** Search for SDC coming along slowly with various people on vacation. ** Next up: OOUI rendering for SDC first feature (captions), coming down the pipeline soon™ ** MCR rollout plan basically set, we'll need some time to sort out our integration, but should all work out well. === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: None * Blocking: None ** Updates: **Unblocked languages on previous issues. ** ==== Parsing ==== * Blocked by: * Blocking: * Updates: ==== Growth ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: ** CX patches still blocked from merging due to test failures occuring in Wikibase Lexeme ** Thanks to everyone who helped/are helping to solve issues (4 separate ones) that prevent merging patches to CX&Translate * Blocking: ** Providing guidance on https://phabricator.wikimedia.org/T195910 (ios app language selection related issue) * Updates: ** Grant Metrics enabled for translation in translatewiki.net ** Niklas will work on https://phabricator.wikimedia.org/T195293 (follow-ups to an issue causing an outage a while ago) === Audiences Design === ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** Preparation of OOUI v0.27.6 == Technology == === Analytics === * Blocked by: * Blocking: ** Outage in Eventlogging * Updates: ** Added data quality checks in mediawiki history and mediawiki history reduced datasets ** Cleaning of user directories in hadoop ** Improved data sanitization in Eventlogging (salt creation/rotation) ** Improved partition cleaning in hive === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Making our exchange rates available on a WMF-visible spreadsheet for travel reimbursement ** Work continues on the ingress scripts for EventLogging data from banner and landing page impressions ** Experimenting with different ways to let donors from certain countries opt in to emails ** CiviCRM: new search filters, looking at mailing house data import bug and data erasure requests ** Reviewing CiviCRM core team code for contact view editor ** More error-handling work prompted by full-scale tests of card processor's new API === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** Cherry-picked API statsd improvement into production. Updated API dashboard in Grafana. *** https://grafana.wikimedia.org/dashboard/db/api-backend-summary?refresh=5m&o… ** Platform Evolution kick-offs and TechConf prep are ongoing ** Language variants for summary REST API deployed - Page Previews will now show your preferred variant *** Only serbian language is supported now, but more will be added as Parsoid supports more conversions ** Memory issues with EventStreams service in codfw affected other services, now resolved. == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** MCR Schema migrations are happening *** Beta is set to write both / read new with no problems identified *** Production set to write both / read old this week *** Starting with migration scripts to copy data from old schema to new one ** Discussion on-going on whether a production test wiki is necessary in addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616 *** Requires Wikibase change propagation ** Development and code review continues === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: ** Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#A… *** Feedback needed from Wikidata team on how T200340 (*Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string*) could be prevented. *** Feedback needed from Readers/Performance team(s) on how T200346 (*wmf.14 failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run: HTTP request failure"*) could be prevented. *** Feedback needed from ORES/Wikidata team(s) on how T200412 (*PageTriage requires ORES to be installed*) could be prevented. *** Feedback needed from Wikidata team on how T200420 (*Wikidata dispatching stuck (not releasing lockmanager locks)*) could be prevented. *** Feedback needed from Readers team on how T200456 (*MapCacheLRU::has called with invalid key. Must be string or integer*) could be prevented. * Blocking: * Updates: ** Moved the beta deployment server to deployment-deploy01, yell if anything seems amiss there === Research === * Blocked by: None * Blocking: None * Updates: ** We've been analyzing the Citation usage data and improving the schema. - https://phabricator.wikimedia.org/T199457 ** Working on recommending missing articles based on translation pageview predictions. ** Have been interviewing candidates for a research position. === Scoring Platform === * Blocked by: ** Waiting for a TechCom review of JADE proposal for deployment. *** Trying to get Global Collaboration's attention about this. *** "Everything is a wiki page", yet we're not allowed to deploy an extension that might increase the number of wiki pages... Who will be blocked next? * Blocking: * Updates: ** GSoC project by Saurabh Batra to identify donations fraud has resulted in a successful model! We're beginning integration work now. === Search Platform === * Blocked by: * Blocking: * Updates: ** Lexeme fulltext search merged: https://phabricator.wikimedia.org/T196188 ** Started collecting click stats for Wikidata completion search: https://phabricator.wikimedia.org/T196186 ** Quality constraints violations are now in WDQS: https://phabricator.wikimedia.org/T172380 ** Fixed intitle search not matching stopwords: https://phabricator.wikimedia.org/T68969 ** Fixed problems in completion search on shard failure: https://phabricator.wikimedia.org/T180807 ** Added task to purge query click data according to privacy policy: https://phabricator.wikimedia.org/T189845 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960 ** Working on Esperanto analyzer: https://phabricator.wikimedia.org/T200099 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** eqiad row B and C upgrades went quite fine with some minor hiccups ** work on the switchover preparation ongoing. Tentative timeline posted. Take a look at calls out section == Wikidata == * Blocked by: * Blocking: ** ContentTranslation CI red because of failing Wikidata-related tests: https://phabricator.wikimedia.org/T200693 *** working on understanding and fixing failures * Updates: ** Work in Lexicographical data continues: *** adding senses *** improving the editor workflow *** https://phabricator.wikimedia.org/project/view/2292/ == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: ** move the meeting to 2 hours earlier as soon as week of 2018-08-06- look for new invite! ** some changes to the notes template ** keep the meeting as is- a forum for teams to share updates and ask for help and keep the notes as useful as possible ** decision to handle goals dependencies outside this meeting

2 1

phone cannot play mobile site video, but standard site video
by rupert THURNER 03 Aug '18

03 Aug '18

why is it that the excellent player is available on the standard wikipedia view, and not on mobile view? is this just my configuration? as eyample: * https://en.wikipedia.org/wiki/Polar_orbit * https://en.m.wikipedia.org/wiki/Polar_orbit the effect is that my mobile can play the standard view video, but not the mobile view video. rupert

2 1

New Beta Cluster Deployment Servers
by Tyler Cipriani 02 Aug '18

02 Aug '18

Hi All! There are new deployment servers in beta cluster: deployment-deploy01 and deployment-deploy02. These servers replace deployment-tin and deployment-mira (which I just shut down today). If you had a home directory on either deployment-tin or deployment-mira I've moved it to the new machines at: deployment-deploy01:~/deployment-tin-home deployment-deploy02:~/deployment-mira-home If you see anything amiss that you feel may be a result of this move, please file a task on phab or find me on IRC. Thanks to Daniel Zahn and Alex Monk for all their work on this task! Thanks! -- Tyler

1 0

Documentation for API query/revisions needs an update
by Nicolas Vervelle 02 Aug '18

02 Aug '18

Hi, today, I noticed that I was getting API warnings in WPCleaner for each call to API query/revisions : revisions - Because "rvslots" was not specified, a legacy format has been used for the output. This format is deprecated, and in the future the new format will always be used. This rvslots is not documented on API:Revisions and I don't find an email mentionning a compatibility problem on this subject. I tried the API Sandbox, but the documentation for rvslots is cryptic for me : " Which revision slots to return data for, when slot-related properties are included in rvprops. If omitted, data from the main slot will be returned in a backwards-compatible format." Any understandable explanation on this parameter and what value should I put, and what difference should I expect in the result ? Thanks Nico

2 1

MultiContent Revisions and changes to the XML dumps
by Ariel Glenn WMF 02 Aug '18

02 Aug '18

As many of you may know, MultiContent Revisions are coming soon (October?) to a wiki near you. This means that we need changes to the XML dumps schema; these changes will likely NOT be backwards compatible. Initial discussion will take place here: https://phabricator.wikimedia.org/T199121 For background on MultiContent Revisions and their use on e.g. Commons or WikiData, see: https://phabricator.wikimedia.org/T200903 (Commons media medata) https://phabricator.wikimedia.org/T194729 (Wikidata entites) https://www.mediawiki.org/wiki/Requests_for_comment/Multi-Content_Revisions (MCR generally) There may be other, better tickets/pages for background; feel free to supplement this list if you have such links. Ariel

1 0

SEMANTiCS 2018, Vienna, Sep 10-13, Contribute to the Vocarnival & the DBpedia Day
by Sebastian Hellmann 02 Aug '18

02 Aug '18

*# Vocarnival* The Vocabulary Carnival (Vocarnival) at SEMANTiCS 2018 is a unique opportunity for vocabulary publishers to showcase and share their work, meet the growing community of vocabulary publishers and users, and build useful semantic, technical and social links. The Vocarnival forms part of the SEMANTiCS programme with the Carnival Minute Madness and the marketplace. *Which are the expected vocabulary types? * All types! A very wide vocabulary definition applies to this competition, including ontologies, classifications, thesauri, concept and metadata schemes, independently of their format, be it RDF or not. *When is the submission deadline?* The submission deadline is set for September 3, 2018, 23:30 CET time. Get familiar with the technical requirements and the presentation format for your vocabulary submission. Afterwards, follow the steps below and get honored by a special prize if you have one of the best three posters. The winners will be announced during the respective Vocarnival Session at SEMANTiCS 2018. Please find all information here: _https://2018.semantics.cc/vocabulary-carnival_ *How to submit your Vocabulary to the Carnival? * *Step 1:*Make sure your vocabulary is accessible on the Web via a public URI. *Step 2:*Submit your vocabulary here: _https://2018.semantics.cc/submit-vocabulary-vocarnival_ *Step 3:*Register to SEMANTiCS 2018: _https://2018.semantics.cc/prices_ *Step 4:*Every poster will be presented in our exhibition area. The organising committee will select the best vocabulary poster and presentation for the awards. *# DBpedia Day - Call for Participation* At the beginning of SEMANTiCS 2018, the DBpedia Community will get together on the**10th of September for the DBpedia Day. Besides the following highlights, we want you to be a part of the day by telling us what cool things you do with DBpedia. Submit your proposal in our form: _https://goo.gl/forms/ngRWCjgH9ocDCrEb2_! *Highlights* - Keynote #1: Dealing with Open Domain Data by Mathieu d’Aquin (NUI Galway) - Keynote #2: Linked Open Data cloud - act now before it’s too late by Javier Fernández García (WU Wien) - DBpedia Association hour - DBpedia Chapter Session *Important Facts* - Web URL: _http://wiki.dbpedia.org/meetings/Vienna2018_ - When: September 10th, 2018 - Where: Gußhaus Campus of Vienna's Technical University, Gußhausstraße 27-29, 1040 Vienna, Austria - Call for Contribution: Submit your proposal in our form _https://goo.gl/forms/ngRWCjgH9ocDCrEb2_ - Attending the DBpedia Community Meeting costs €50 (excl. registration fee and VAT). DBpedia members get free admission, please contact your nearest DBpedia chapter or the _DBpedia Association_ <mailto:holze@infai.org>for a promotion code. /We are looking forward to your contributions and to seeing you at the SEMANTiCS in Vienna! /

1 0

Postgres and SQLite tests are now voting on mediawiki/core patches
by Kunal Mehta 01 Aug '18

01 Aug '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, MediaWiki core patches will now need to pass tests on postgres and sqlite (in addition to mysql of course) to be merged. For speed, CI won't run postgres/sqlite tests until after the patch has been +2'd (gate-and-submit queue). If you want to run them manually to debug a failure, you can comment "check sqlite" or "check postgres". Note that not all tests are passing under postgres/sqlite yet, we just disabled the remaining failing ones temporarily so these jobs could be enabled to prevent regressions. [1] tracks SQLite failures, and [2] for Postgres. [3] should find both :) Help definitely appreciated from people familiar with either DBMS to help fix the remaining test failures ! [1] https://phabricator.wikimedia.org/T191035 [2] https://phabricator.wikimedia.org/T195807 [3] https://codesearch.wmflabs.org/core/?q=fails%20under%20(postgres%7Csqlit e)&i=nope&files=tests%2Fphpunit&repos= - -- Legoktm -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAltiRfYACgkQUvyOe+23 /KLbxQ/+Nb+7WvF89Q5aIegYZhwIppG6cJAoEwU0zHtKSaUl4nOfCDnC7FnBnuni pgeixj9bF2T+pcR0nXZ1mchLtihWo8yercD5uDcRXjrPxaFduKRQonGLMDrzZsY7 18HRxeZ/QwjNDCnW6I+ITUbEkLwGT/4OtSqPfkUjOmAprePWXgu5hj2W6X91HMnm Lh0qeab/avAe1aEktoNJd96Xhwo1imr7xbeefHXZcrD3CICRFGKkwK/FCdIBHrtR lzxgmPS+C1VAV3Hy4w+/QUZHCXrJ7v0i696TblC+bg+EWQ/2m4g1C3PbgzLPhJ0J LPQkrOk5fmuftBbkIIDvBh+12a0c3ImUVPi9g4oqZ643+qIw3uAHlBl+FwoN7Tat By+UAlCUMyEm8uUj40cpIWkktP+D1tBOA2Ogb4XdYDcuoLvzw/Oh5JY3twp9Vj3A Y2Fc3uuJEemJc4vRt4Xb4mGw7ZvoxXH7G90ZYAostUmS2ubv4IAy0suWDU87WyQK 4jf4vohPQkaASJr5AazZGyhsFbvJDiA3PXahguFPdXnF4NTJDB+oSmZKzz7yh0qv Gij08lx2wH/DTP+qRuYaocdHygojU8hXMhyp2DK3HbWZGPVQdNhzOp/KS2uNpimB KK8nb2BzNUFU0cE9tIOowzZdQSjAc3eQX5GM+LVnSDDsew50SFU= =BEXH -----END PGP SIGNATURE-----

1 0

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l August 2018