Wikitech-l August 2018

wikitech-l@lists.wikimedia.org

101 participants
92 discussions

TechCom Radar 2018-08-22
by Kate Chapman 23 Aug '18

23 Aug '18

Hi All, Here are the minutes from this week's TechCom meeting: * Approved: RFC: Modern Event Platform - Choose Schema Tech <https://phabricator.wikimedia.org/T198256> * On Last Call (ending 5 September 2pm PST(21:00 UTC, 23:00 CET). RFC: Block users by page, namespace, and/or action (Partial Blocks) <https://phabricator.wikimedia.org/T199917> * Hosted an IRC discussion for: Introduce a new namespace for collaborative judgments about wiki entities <https://phabricator.wikimedia.org/T200297> * Minutes: <https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.20…> * Log: <https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.20…> * Accepted as a new RFC and will host IRC discussion on 29 August 2pm PST(21:00 UTC, 23:00 CET) in #wikimedia-office: RFC: Modern Event Platform: Schema Registry / Metadata Service <https://phabricator.wikimedia.org/T201643> This RFC outlines the current state of event schema registries and then options for where to go forward. The recommendation is to develop a new schema registry / metadata service. * Accepted as a new RFC and will be scheduling IRC meeting soon: ParallelMaintenance helper class for multi-process maintenance scripts <https://phabricator.wikimedia.org/T201970> this change would allow parallelizing of long running maintenance scripts. * Accepted as a new RFC and will be scheduling IRC meeting soon: RfC: Create a proper command-line runner for MediaWiki maintenance tasks <https://phabricator.wikimedia.org/T99268> this RFC proposes to create an organized structure and runner for running of maintenance tasks. * Accepted as a new RFC and will be scheduling IRC meeting soon: RFC: Modern Event Platform: Scalable Event Intake Service <https://phabricator.wikimedia.org/T201963> This RFC's goal is to decide if we should use something other than EventLogging/EventBus and lays out two possible options in addition to staying with the EventLogging/EventBus * Accepted as RFC, but needs more information prior to IRC meeting: Consolidate WikiPage action and special page systems <https://phabricator.wikimedia.org/T201967> originally brought up in 2011 this RFC seeks to unify the way that page actions are done. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here: <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman TechCom Facilitator (Contractor)

1 0

RFC Discussion Wednesday - new namespace for collaborative judgments about wiki entities
by Kate Chapman 22 Aug '18

22 Aug '18

Hi All, A reminder that TechCom is hosting a RFC discussion via IRC on Wednesday. Introduce a new namespace for collaborative judgments about wiki entities <https://phabricator.wikimedia.org/T200297> This meeting is to discuss the use of JADE to record the judgments and discuss concerns related to this approach. The meeting is scheduled for 22 August at 2pm PST(21:00 UTC, 23:00 CET) in #wikimedia-office If you haven't joined a #wikimediaoffice meeting before more information can be found here: <https://meta.wikimedia.org/wiki/IRC_office_hours#How_to_participate> More information regarding the TechCom RFC process is available here: https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Processes#RFC_… Thanks, Kate -- Kate Chapman TechCom Facilitator (Contractor)

5 4

2018-08-22 Scrum of Scrums meeting notes
by Grace Gellerman 22 Aug '18

22 Aug '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-22 = *2018-08-22* = == Callouts == * SRE: Switchover/Switchback dates finalized Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC MediaWiki: Wednesday, September 12th 2018: 14:00 UTC Switchback: Traffic: Wednesday, October 10th 2018 09:00 UTC MediaWiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC IMPORTANT: For the duration of the switchover (1 month), please refrain from large db schema changes and please avoid deploying any kind of new feature that requires creation of tables. IMPORTANT: There will be a train freeze in the week of Sept 10th and Oct 8th. * Release Engineering blocked by: Feedback needed (*how problems could have been prevented*) from many people/teams on a recent MediaWiki train related incident report. ** 1.32.0-wmf.13, 9 blockers, feedback needed for 8 of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train ** Aaron Schulz (Performance), Adam Wight (Scoring Platform), Bartosz Dziewoński (Contributors), Brad Jorsch (MediaWiki Platform), C. Scott Ananian (Contributors), Daniel Kinzler (Wikimedia Deutschland), Timo Tijhof (Performance), Prateek Saxena (Audiences Design) * Release Engineering looking for more participants to join the Code Health Metrics working group. This group's purpose is to define and later implement a set of core metrics that we will use to asses the health of our code base. More info: https://www.mediawiki.org/wiki/Code_Health_Group/projects/Code_Health_Metri… == Audiences == === Readers === ==== iOS native app ==== * Blocked by: - * Blocking: - * Updates: **6.0.0 released ( https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/ ) ** 6.0.1 to be released next week ( https://phabricator.wikimedia.org/tag/ios-app-v6.0.1-walrus-on-a-golf-cart/ ) ** 6.1 up next, release date TBD ( https://phabricator.wikimedia.org/tag/ios-app-v6.1-narwhal-on-a-bumper-car/ ) ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Finishing up polling Echo notifications (limited to certain types of notifications initially) ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** Mobile website (MinervaNeue / MobileFrontend): *** Page issues UI and instrumentation: T191528 T201124 T197932 T196150 *** Invest in the MobileFrontend & MinervaNeue frontend architecture: T188937 *** Avoid abrupt and jarring white flash in media viewer: T197110 *** Other fixes and hygiene: T197499 T199000 T197497 T202021 T201956 ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** PCS: *** Separating pagelib CSS from base CSS this week *** Adding simple header to mobile-html (title, description, page image) ** Maps: *** Nothing to report. ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Nothing to report ==== Multimedia ==== * Blocked by: * Blocking: * Updates ** SDoC: Discussion with search team about searching for related statements ** SDoC: prototyping depicts search ** SDoC: design artwork ** No longer blocked by MCR === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** No update. ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** Continuing work on Partial Blocks: https://phabricator.wikimedia.org/T2674 ** Updated the TechComm RFC to include Multiblocks: https://phabricator.wikimedia.org/T199917 ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** Improved/bug fixes: collapsed tables in visual diffs; insertion of horizontal rules; pages with lots of tables in WTE 2017; switching between visual editor and source mode; VE linking in IE11; regressions with icon displays; etc. ** Compact multiple transactions into one: ==== Growth ==== * Blocked by: ** SRE: Query about plausibility of measuring e-mail traffic to our no-reply addresses https://phabricator.wikimedia.org/T202329 * Blocking: * Updates: ** No update. ==== Language ==== * Blocked by: * Blocking: * Updates: ** No update. === Audiences Design === * Blocked by: * Blocking: * Updates: ** No update. ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** No update. == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Changes to hash and salt (every 90 days) appinstallIDs are on, these will be retained (hashed) forever **Working with performance in making eventlogging javascript module lighter so it can be loaded on 1st page load. **Working on computing “top contributors” metric per project so it is available in wikistats2, this is one of the most coveted reports by our community. **Spark available now in Jupyter notebooks. **Meetings around modern event data platform to define what parts will we start developing next quarter. === Cloud Services === * Blocked by: * Blocking: * Updates: ** No update. === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Put off upgrade of mediawiki on payments servers ** testing payment notification listener on debian stretch and php 7.0 ** Bugfixes and UI tweaks for new card processor API integration ** Nearly done new system for ingesting EventLogging data about banners and FR landing pages *** Activated EventLogging for all banner campaigns, sampled at 1% on the front end. ** Working on email Opt-In page ** CiviCRM: *** reviewing final group of patches for donor data export and deletion *** bugfixes on imports *** Looking at performance of donation imports === Core Platform === * Blocked by: * Blocking: * Updates: ** LoadBalancer overload investigation (T180918) ** TitleValue performance (T201801) ** Awaiting review: Security review for Guzzle 6.3.3 (T202143) ** In testing: Create GuzzleHttpRequest class as new default for HttpRequestFactory (T202110) ** Ready for testing: Convert MultiHttpClient to use Guzzle (T202352) ** Platform Evolution: developing sessions for TechConf ** REST mobile endpoints removed from projects other then wikipedia and wikivoyage ** New event type coming to EventBus on this train: mediawiki.revision-tags-change === Performance === * Blocked by: * Blocking: * Updates: ** Deferred jQuery loading is rolling out to all wikis on this week's train ** All wikis using mcrouter ** nutcracker writes have been disabled ** Mcrouter broadcast operations enabled for all wikis ** patched a bug in Html::inlineScript ** Removed use of StartProfiler.php from mw-init === Release Engineering === * Blocked by: ** Feedback needed (*how problems could have been prevented*) from many people/teams on a recent MediaWiki train related incident report. *** 1.32.0-wmf.13, 9 blockers, feedback needed for 8 of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train *** Aaron Schulz (Performance), Adam Wight (Scoring Platform), Bartosz Dziewoński (Contributors), Brad Jorsch (MediaWiki Platform), C. Scott Ananian (Contributors), Daniel Kinzler (Wikimedia Deutschland), Timo Tijhof (Performance), Prateek Saxena (Audiences Design) * Blocking: ** MediaWiki 1.29 final release and EOL; was due in June: https://phabricator.wikimedia.org/T197669 (w/ Security) * Updates ** New general purpose CI job that builds and runs test containers via Blubber/Docker based on config provided in each project (think `.travis.yml` file) *** Read more about Blubber here: https://wikitech.wikimedia.org/wiki/Blubber *** See recent builds at https://integration.wikimedia.org/ci/blue/organizations/jenkins/blubber-tes… *** Gives developers one major benefit of the CD pipeline work now, having control over their pre-merge and gating tests without having to mess with integration/config *** Only scheduled to run for a few repos at the moment, but will eventually be expanded to many more projects (we need to tune CI infra around it first) ** Looking for more participants to join the Code Health Metrics working group. This group's purpose is to define and later implement a set of core metrics that we will use to asses the health of our code base. More info: https://www.mediawiki.org/wiki/Code_Health_Group/projects/Code_Health_Metri… === Research === * Blocked by: None * Blocking: None * Updates: ** Deployed a new UnsourcedStatements campaign (en, fr, it): https://labels.wmflabs.org ** Finished the first phase of the "Elicit new editor interests" research. Starting the second phase soon. ** Looking into using Cassandra as a storage engine of Recommendation JS API. === Scoring Platform === * Blocked by: SRE, RelEng * Blocking: None * Updates: ** All SP repos have been moved to wikimedia organization in github. ** Git LFS support for ores models is going live, some help from RelEng would be great: https://phabricator.wikimedia.org/T192042 ** JADE scalability discussion continues, TechCom meeting is scheduled for today. ** PoolCounter support to limit number of external connections to ORES has started. SRE input would be appericiated: https://phabricator.wikimedia.org/T201824 ** Wikilabels robustness is being worked on, some puppet changes will need review. The node is being reimaged to stretch === Search Platform === * Blocked by: * Blocking: * Updates: ** Published blog post about search tokenization: https://wikimediafoundation.org/2018/08/07/anatomy-search-token-affection/ ** Added support for haswbstatement without value (any statement with given property) https://phabricator.wikimedia.org/T199886 ** Re-indexed wikis in Malay, Indonesian, and Polish, enabling Malay stemming and fixing errors in Polish stemming ( https://phabricator.wikimedia.org/T196780, https://phabricator.wikimedia.org/T186046) ** Created ElasticSearch plugin for Esperanto analysis: https://phabricator.wikimedia.org/T200099 ** Migrated ElasticSearch cluster to RAID0 and upgraded to Debian stretch: https://phabricator.wikimedia.org/T198391 ** Working on migrating communications from analytics to search cluster to Kafka: https://phabricator.wikimedia.org/T198490 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: ** MediaWiki 1.29 final release and EOL; was due in June: https://phabricator.wikimedia.org/T197669 (w/ RelEng) * Updates: ** === Site Reliability Engineering === * Blocked by: * Blocking: * Updates: ** No update. == Wikidata == * Blocked by: ** none * Blocking: ** none * Updates: ** Work in Lexicographical data continues: *** adding senses *** improving the editor workflow *** https://phabricator.wikimedia.org/project/view/2292/ ** Experiment about not using secondary SQL table for formatting item links being gradually deployed starting Thu Aug, 23rd *** https://phabricator.wikimedia.org/T201831 == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** No update. == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** MCR schema migrations are in progress *** Finished running populateContentTables.php except for a few small wikis *** Filed T202032: duplicate ar_rev_id values causing populateContentTables.php to fail ** Phase 2 (file caption support) development tasks nearing completion ** Phase 3 (statement support) development tasks commencing == SoS Meeting Bookkeeping == * Updates: **

1 0

ORES repositories are now moved to wikimedia organization in github
by Amir Sarabadani 22 Aug '18

22 Aug '18

Hey, ORES repositories used to exist in wiki-ai organization in github.com. For example you could reach them at github.com/wiki-ai/ores or github.com/wiki-ai/wikilabels They all are now moved to wikimedia organization. So they exist in github.com/wikimedia/ores or github.com/wikimedia/wikilabels. You can get list of all of scoring platform team repos in [1] This is needed for better organizational hierarchy and maintenance and also better support for git LFS [2]. The old URLs redirect to the new ones so you should not face any issues in developments but at one point in really far future these might stop working, so please make sure you update the urls. Also, if you encounter any issues, let me know. Sorry for any inconvenience and thank you for your contribution. [1]: https://github.com/orgs/wikimedia/teams/scoring-platform/repositories [2]: https://git-lfs.github.com/ Best -- Amir Sarabadani Software Engineer Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

1 0

OOUI v0.28.0 released
by Volker E. 20 Aug '18

20 Aug '18

Hello everyone, I'm pleased to announce that we've released OOUI v0.28.0 this Tuesday. Key highlights of this release: - New OOUI “Tutorials” section[0] Special thanks to GSOC student Hagar Shilo, who has provided us an excellent addition to our documentation. The tutorials simplify stepping into development with the library. - Final code cleanup step after major icon refinement[1], see below. Possible breaking changes: The following changes might cause breaking of your interface, please carefully consider if they affect your code. - Drop 'find' icon, deprecated in v0.26.2 - Drop 'settings' icon, deprecated in v0.27.0 - Drop cite icons, renamed and deprecated in v0.27.0 - Remove 'clip' & 'unClip', deprecated in v0.26.1 - Remove 'comment', deprecated in v0.26.1 - Remove deprecated 'userActive'/'userInactive', deprecated in v0.26.2 All six icon changes above have been deprecated and announced in former versions. With this release we've removed them completely. You can find details on additional new features, code-level and accessibility changes, styling and interaction design amendments, and all improvements since v0.27.0 in the full changelog[2]. I'd also like to give a shoutout to Alangi Derick and Tim Eulitz for their contributions. If you have any further queries or need help dealing with breaking changes, please let me know. As always, library documentation is available on mediawiki.org[3], there is comprehensive generated code-level documentation and interactive demos and tutorials hosted on doc.wikimedia.org[4]. OOUI version: 0.28.0 MediaWiki version: 1.32.0-wmf.18 Date of deployment to production: Regular train, starting Thursday 16 August [0] - https://doc.wikimedia.org/oojs-ui/master/demos/tutorials/index.html [1] - https://phabricator.wikimedia.org/T177432 [2] - https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md [3] - https://www.mediawiki.org/wiki/OOUI [4] - https://doc.wikimedia.org/oojs-ui/master/ Best, Volker -- Senior UX Engineer Wikimedia Foundation volker.e(a)wikimedia.org | @Volker_E

3 4

Discovery Weekly Update for the week starting 2018-08-13
by Chris Koerner 20 Aug '18

20 Aug '18

Hello, This is the weekly update from the Search Platform team for the week starting 2018-08-13. As always, feedback and questions welcome. == Discussions == === Search === * We re-indexed wikis in Malay, Indonesian, and Polish, adding stemming to Malay and ICU normalization to Indonesian [0], and fixing the worst pathological stemming errors in Polish [1]. ** Reindexing tickets are [2] and [3]. *Trey wrote a blog post about the difficulties of tokenization (breaking text up into words, more or less). [4] It's the first in a series covering the basics of search. == Did you know? == * Auto-antonyms (or contronyms, among other names) are words that have contradictory meanings. [5] Some cases arise from words that were originally distinct, but came to sound the same through normal sound change, such as “cleave”, which means both to hold fast (from Old English “clifian”) and to cut in two (from Old English “clēofan”). Other times, words just acquire novel but contradictory senses, such as “fast”, which means both to be securely attached to, and able to move quickly. Often the sense is quite clear from context, but when it is not, words can become so confusing that careful writers avoid them; these are sometimes called “skunked” words. [6] --- [0] https://phabricator.wikimedia.org/T196780 [1] https://phabricator.wikimedia.org/T186046 [2] https://phabricator.wikimedia.org/T200037 [3] https://phabricator.wikimedia.org/T200204 [4] https://wikimediafoundation.org/2018/08/07/anatomy-search-token-affection/ [5] https://en.wikipedia.org/wiki/Auto-antonym [6] https://en.wikipedia.org/wiki/Skunked_term Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R As always, feedback and questions welcome. Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

2 1

Sensitive IRC bots - be careful out there!
by Jon Robson 20 Aug '18

20 Aug '18

I just got banned from Freenode server for @ing a few people during a SWAT deploy. Be careful everyone! It's a dangerous world out there! I've taken the advice and emailed kline but in the meantime, you may want to be careful who/how many people you @. Will let you know when I know more and apologies if you can't get hold of me in the mean time! Jon Replay of the event: <jouncebot> Jdlrobson and nray: A patch you scheduled for Evening SWAT (Max 6 patches) is about to be deployed. Please be around during the process. Note: If you break AND fix the wikis, you will be rewarded with a sticker. 4:03 PM <jdlrobson> Jon Robson \o 4:03 PM <nray> Nicholas Ray \o 4:05 PM <jdlrobson> Jon Robson mark: twentyafterfour RoanKattouw thcipriani Niharika any of you able to swat right now? 4:05 PM ⇐ You were killed by Sigyn (sigyn@freenode/utility-bot/sigyn): (Spam is off topic on freenode.) 4:05 PM ⇐ jdlrobson quit (sid92657@gateway/web/ irccloud.com/x-maentctwgksrmedg) Killed (Sigyn (Spam is off topic on freenode.)) Check your host, port and ssl settingsDisconnected: You are banned from this server- Please do not spam users or channels on freenode. If in error, please contact kline(a)freenode.net. (2018/8/16 23.03) <https://www.irccloud.com/irc/freenode/channel/wikimedia-operations> -- Jon Robson Senior Software Engineer twitter: @jdlrobson linkedin: https://www.linkedin.com/in/jorobson/

1 1

Wednesday: Technical Advice IRC Meeting
by Michael Schönitzer 20 Aug '18

20 Aug '18

Reminder: Technical Advice IRC meeting again **Wednesday 3-4 pm UTC** on #wikimedia-tech. Question can be asked in English, German, Persian. The Technical Advice IRC Meeting (TAIM) is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about Mediawiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! Michi (for the Technical Advice IRC Meeting crew) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 0

huwiki, arwiki to be treated as 'big wikis' and run parallel jobs
by Ariel Glenn WMF 20 Aug '18

20 Aug '18

Starting September 1, huwiki and arwiki, which both take several days to complete the revsion history content dumps, will be moved to the 'big wikis' list, meaning that they will run jobs in parallel as do frwiki, ptwiki and others now, for a speedup. Please update your scripts accordingly. Thanks! Task for this: https://phabricator.wikimedia.org/T202268 Ariel

2 2

introduction
by Nadege Awah 20 Aug '18

20 Aug '18

Dear sir/madame; I am Awah Nadege Tayebatu, female and a Cameroonian. I am an Applied Geology student of the University of Buea, Cameroon. I will love to contribute code to MediaWiki and so will appreciate some guide on how to start contributing and some learning resources i can use as a beginner. Thank you.

3 2

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l August 2018