Wikitech-l October 2017

wikitech-l@lists.wikimedia.org

53 participants
68 discussions

Discovery Weekly Update for the week starting 2017-10-02

by Chris Koerner

Hello all, Here is the Discovery weekly update for 2017-10-02. As always, feedback and questions are welcome. ==Highlights== * The week of October 9th, we will deploy code to disable the automatic use of UI message fallback languages for linguistic analysis. In most cases, the messaging fallback language is unrelated to the main language of a wiki (e.g., Wolof falls back to French). A fuller description is on MediaWiki, and you can join the discussion there or on the related Phab ticket. [0] [1] * The Analysis team had several meetings to scope out new work to establish a baseline of metrics for the Structured Data on Commons project. [2] ==Discussions== === Search === * Trey is investigating linguistic analysis software that could be adapted for use on wiki projects. If you know of any open-source linguistic analysis software for languages that don't already have it on their wiki projects, please drop a note on Phab ticket T171652. [3] * David was busy with various tasks: ** relaxing the default "AND" of the retrieval query filter with minimum_should_match [4] ** change loading of cross-wiki configuration to use cirrus-dump-config api call [5] ** finishing up the work to upgrade Elastica to support elastic 5.5.x (will be in production next week [6] ** and adding Special:Search—add additional namespaces to search results for Persian Wikibooks , Hebrew Wikisource, and English Wikibooks [7] [8] [9] * We also stopped the A/B test that was running on 18 wikis with > 1% of search traffic, analysis will follow [10] === Analysis === * Chelsy investigated the full-text search pattern on mobile web and found interesting things: "we think that since people use full-text instead of prefix search results when they have a in-depth information need, and this kind of need is often driven by work/school project, we see more full-text searches on weekdays than weekends on both desktop and mobile web." [11] === Maps === * Paul kicked off the process to regenerate the map tiles in production that will probably finish early next week. We had to do this manually because of a bug in tileshell/node.js that we're working to resolve. [12] [13] [0] https://www.mediawiki.org/wiki/Wikimedia_Discovery/Disabling_Messaging_Fall… [1] https://phabricator.wikimedia.org/T147959 [2] https://phabricator.wikimedia.org/T174519 [3] https://phabricator.wikimedia.org/T171652 [4] https://phabricator.wikimedia.org/T177302 [5] https://phabricator.wikimedia.org/T156497 [6] https://phabricator.wikimedia.org/T174654 [7] https://phabricator.wikimedia.org/T176908 [8] https://phabricator.wikimedia.org/T176907 [9] https://phabricator.wikimedia.org/T176906 [10] https://phabricator.wikimedia.org/T177490 [11] https://phabricator.wikimedia.org/T176815 [12] https://phabricator.wikimedia.org/T176252 [13] https://phabricator.wikimedia.org/T175123 --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 7 months

Tomorrow: Weekly Technical Advice IRC Meeting

by Michael Schönitzer

Sorry for cross-posting! Reminder: Technical Advice IRC meeting again **tomorrow 3-4 pm UTC** on #wikimedia-tech. The Technical Advice IRC meeting is open for all volunteer developers, topics and questions. This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/ wiki/Technical_Advice_IRC_Meeting This meeting is an offer by WMDE’s tech team. Hope to see you there! Michi (for WMDE’s tech team) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

5 years, 7 months

Language engineering monthly report for August 2017

by Niklas Laxström

The language engineering monthly report for August 2017 is ready. **Highlights for this month** Language database is now an independent project to make reuse easier. It used to be part of jquery.uls library. It contains over 500 entries detailing basic information about languages, such as their autonym, their writing script, and region(s) of the world where they are spoken. https://github.com/wikimedia/language-data August was, so far, the most active month of 2017 for translatewiki.net with the highest number of translation updates (55k) and translation reviews (15k) by over 350 translators. **Full report** https://www.mediawiki.org/wiki/User:Nikerabbit/Monthly_report/2017-08 For those unfamiliar with this report, its goal is to summarize all technical changes to internationalization, translation tools and other language support products. It also highlights the diversity of contributors to this area and that many of them are volunteers.

5 years, 7 months

Wikidata recentchanges on commonswiki and ruwiki not shown

by Jaime Crespo

Hi all, This is a heads up that I asked, and other developers agreed with the decision, to *temporarily* disable wikidata-originated recentchanges appearing on commonswiki and ruwiki (Commons and Wikipedia in Russian): [0]. I cannot disclose right now all reasons (we will do when things are fixed), but please understand that server admins only do this in case of emergencies such as things being down or in a very broken state. For your tranquillity, this will not affect any wikidata functionality and has no edit or other data loss- it will only make wikidata edits not be *shown* (but they will take effect) on recentchanges and watchlist on other projects (but updates and wikilinks happen as usual) during the time it is disabled. Part of the story can be read at [1], even with only that information, the rollback I think is not much worse than the issues created. We do not discard extending this action to other wikis, too. We apologize for the impact this could have on vandalism patrolling- we will try to make things better soon, so that both errors are minimized but also new features can be active again soon. Regards, [0] <url:https://phabricator.wikimedia.org/source/mediawiki-config/browse/master…> [1] <url:https://phabricator.wikimedia.org/T171027> -- Jaime Crespo <http://wikimedia.org>

5 years, 7 months

TechCom Radar, 2017-10-04

by Kevin Smith

Hello all! With Daniel out, I volunteered to send this email. Find below the streamlined minutes of the last meeting of the Technical Committee. When Daniel returns, he'll fill in any details I may have missed. * RFC Approved: Introduce InterruptMutexManager. There was no further discussion, so the committee approved this RFC. <https://phabricator.wikimedia.org/T161749>. * Last week’s IRC discussion covered how long we need/want to keep support for HHVM. IRC meeting log: <https://tools.wmflabs.org/ meetbot/wikimedia-office/2017/wikimedia-office.2017-09-27-21.03.html> Thread on wikitech: <https://lists.gt.net/wiki/wikitech/844711>. RFC about bumping the PHP version (for context) <https://phabricator.wikimedia.org/T172165> * There was no IRC discussion this week (2017-10-04). * Next week's IRC discussion (2017-10-11): Move RunJobs.php to core < https://phabricator.wikimedia.org/T175146> <https://phabricator.wikimedia.org/T175146> As always, the discussion will take place in the IRC channel #wikimedia-office on Wednesday 21:00 UTC (2pm PDT, 23:00 CEST). You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. Kevin Smith Engineering Program Manager, Wikimedia Foundation

5 years, 7 months

Read-only Commons in preparation for 3D file support - 11 October

by Chris Koerner

Hello, (I posted this on the the Commons Village Pump, apologies for cross-posting) The Multimedia team at the foundation is getting closer to enabling support for uploading and displaying 3D models on Commons. We have to do some work on the database to get ready for 3D file support. This means we'll need to put Commons in read-only mode for about 30 minutes on Wednesday October, 11th at 6:00 UTC. [0] You will be able to read, but not edit Commons for a short period of time. * You will not be able to edit or upload media for approximately 30 minutes on Wednesday, 11 October, starting at 6:00 UTC (07:00 BST, 08:00 CEST, 02:00 EDT, 23:00 PDT). * If you try to edit or save during these times, you will see an error message. We hope that no edits will be lost during these minutes, but we can't guarantee it. If you see the error message, then please wait until everything is back to normal. Then you should be able to save your edit. But, we recommend that you make a copy of your changes first, just in case. Why? The team needs to modify the database primary master so it understands this new file type. This will then allow for the future ability to upload and display 3D models on Commons (and embed in other Wikimedia projects). Want a sneak-peek? Take a look at this programmatically created crystal on Test Wikipedia. [1] It is important to note that the ability to upload 3D files will not be available immediately after the maintenance ends (but at a later date), this only involves the contributor-impacting database work. How can folks monitor? You can keep track of the changes by joining #wikimedia-operations on freenode.net Where do I go with issues? If you have issues after the database work is completed, please report a ticket on the Wikimedia Bug tracker, Phabricator. [2] Please help share this with your community. [0] https://phabricator.wikimedia.org/T168661 [1] https://test.wikipedia.org/wiki/File:Programmatically_created_crystal.stl [2] http://phabricator.wikimedia.org Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 7 months

Using web fonts with good performance

by Joaquin Oltra Hernandez

A small TIL, Chrome has been championing this proposal, which I believe would solve the performance concerns that have been raised before about using web fonts, allowing us to have a more fine grained control about the behavior. Right now it is Chrome only, and Firefox and Webkit have it in development. Something to keep in mind for the near future! Links: - Spec proposal <https://tabatkins.github.io/specs/css-font-display/> - Browser usage <http://caniuse.com/#search=font-display> - MDN docs <https://developer.mozilla.org/en-US/docs/Web/CSS/@font-face/font-display> - Feature detection <https://jsfiddle.net/p7g8y7du/> - Controlling Font Performance with font-display <https://developers.google.com/web/updates/2016/02/font-display> - Video [1m40s] Font-Display: Micro Tip #14 - Supercharged <https://youtu.be/-lPTshDcr7o>

5 years, 8 months

Readers monthly update for September 2017

by Chris Koerner

Greetings, I'm here again with the monthly update from the Readers department. **New**: You can now subscribe to receive theses updates as on-wiki notifications or opt-in email! Handy if you subscribe to the digest of this mailing list or don't visit the archive frequently. Subscribe on MediaWiki.org: https://www.mediawiki.org/wiki/Newsletter:Readers_Monthly Thanks for reading, as always, feedback and questions are welcome. ==Discussions== === Apps=== * '''Android''': Progress being made with the Offline Library feature. There's a video demo and more information on Mediawiki.org. [0] [1] ===Web=== * We've updated the visual design for hatnotes on the mobile website to distinguish them from the remainder of the content. [2] * Due to issues with our current PDF rendering system, we will be pausing rendering for the book creator for the time being, until we can identify a proper solution. More information can be found on the project page. [3] * We have been planning and making roadmap updates for the updated mobile website project. [4] === Reading Infrastructure === * Reading Lists have been announced to the Wikipedia projects. [5] [6] === New Readers === * New Reader updates can be found at Meta. [7] === Multimedia === * In preparation for 3D object files on commons a short 30 minute read-only period for Commons will happen on October 11th. [8] * Community feedback is wanted on an update to the upload process on Commons for 3D objects [9] === Discovery === The Discovery team provides weekly updates. Here are their updates for the month. * 2017-09-11 [10] * 2017-09-18 [11] * 2017-09-25 [12] -- [0] https://www.youtube.com/watch?v=iESP20HGPiE [1] https://www.mediawiki.org/wiki/Wikimedia_Apps/Offline_support [2] https://phabricator.wikimedia.org/T173600 [3] https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality [4] https://www.mediawiki.org/wiki/Reading/Web/Projects/NewMobileWebsite [5] https://www.mediawiki.org/wiki/User:CKoerner_(WMF)/Reading_List_Discussion [6] https://www.mediawiki.org/wiki/Wikimedia_Apps/Synced_Reading_Lists [7] https://meta.wikimedia.org/wiki/New_Readers/Updates [8] https://commons.wikimedia.org/wiki/Commons:Village_pump#Read-only_Commons_i… [9] https://commons.wikimedia.org/wiki/Commons:Village_pump#Input_requested_on_… [10] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-09-11 [11] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-09-18 [12] https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-09-25 --- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Reading/Status_updates Yours, Chris Koerner Community Liaison Wikimedia Foundation

5 years, 8 months

2017-10-04 Scrum of Scrums meeting notes

by Grace Gellerman

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-10-04 *= 2017-10-04 =* contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering == Callouts == * Language: Need help to debug: https://phabricator.wikimedia.org/T173801 further * 3D deployed to testwiki, feel free to upload STL files to test it out * Mobile web disabling OCG [cc Operations] ( https://phabricator.wikimedia.org/T150871 ) * Need Ops review of patches for https://phabricator.wikimedia.org/T146381#3447319 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: none * Blocking: none * Updates: ** 5.6.1 release went well ( https://phabricator.wikimedia.org/project/view/2898/ ) - crash rate is low, 5 star rating ** Continuing work on 5.7.0 ( https://phabricator.wikimedia.org/project/view/2899/ ) - Onboarding updates, Improved analytics, iOS 11 support, iPhone X support. Public beta this week. ==== Android native app ==== * Blocked by: Reading List API/service * Blocking: none * Updates: ** Preparing for maintenance release with design updates / bug fixes for language variant issues. ** This is planned to be the last release that supports earlier Android versions than KitKat (<4.4). ==== Multimedia ==== * 3D deployed to testwiki, feel free to upload STL files to test it out * Next up: Work on MediaInfo, an extension for Wikibase, which will be central to our work on SDoC ** Adding API module to shortcut wbgetentities via filenames (instead of querying for the page ID, then the entity) ** Adding page_props entries for uploaded files to point to the relevant MediaInfo entity ==== Web ==== * Disabling OCG [cc Operations] * Investigating ChromeDriver as an alternative. ==== Discovery ==== * Working on creating a Labs Tool to automate portal builds ===== Maps ===== - Fixing release practices - Preparing to update versions in production ==== Reading Infrastructure ==== * finishing ReadingList proxy * MCS: adding fundraising announcement for France === Contributors === ==== UI Standardization ==== * Blocked by Design: `font` specifics upstream to WikimediaUI Base https://phabricator.wikimedia.org/T175877 * Updates (last week update was missing, due to meeting conflict, including important here): ** TransparencyReport made fully accessible – https://transparency.wikimedia.org/ https://phabricator.wikimedia.org/T173629 ** OOUI v0.23.2 (last week) & v0.23.3 released, among changes: *** UI design **** WikimediaUI theme: 10+ changes on toolbar code & design, most importantly unifying positioning and sizing of tools, toolgroups and menus (Volker E.) ***** https://phabricator.wikimedia.org/T176106 & https://phabricator.wikimedia.org/T177234 **** Apex theme: Begin killing `constructive` flag & streamline demo (James D. Forrester) – https://doc.wikimedia.org/oojs-ui/master/demos/ *** Accessibility **** WindowManager: Set `aria-hidden` by default and change toggleAriaIsolation behavior (Prateek Saxena) * Ongoing: ** OOUI icons: Work on icon set to be more harmonious and align to WikimediaUI Style Guide's guidelines ==== Global Collaboration ==== ==== Collaboration ==== * Releasing RCFilters as default experience to all wikis (except some FlaggedRevs ones) probably tomorrow (Oct 5) * We (WMF) need to get serious about Wikidata-triggered watchlist problems ( https://phabricator.wikimedia.org/T171027 ), Roan is going to dive into that and propose action ===== Language =====/quit * Blocked: See callout (https://phabricator.wikimedia.org/T173801 ) * Blocking: None, but https://phabricator.wikimedia.org/T107914 is holding due to infrequent cxserver updates. * Updates: ** CX-VE: Template adaptation, publishing and error handling work in progress ==== Parsing ==== * Nothing significant to update === Community Tech === * Not blocked * Not blocking * Nothing new, continuing work on GlobalPreferences == Technology == === Analytics === * New kafka cluster (kafka-jumbo) is using prometheus for metrics. * Working on Druid configuration so we have 2 clusters: public data and private data cluster. The public one will serve the wikistats 2.0 backend. * Issues with disk space on databases (db1002), trying to free up, have moved some tables to Hadoop, more info here: https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Hadoop._… * Working with legal to perserve data for litigation purposes. * Finished auditing of users and data access, carrying goals for next quarter: purging of eventlogging data and wikistats 2.0 alpha release * Gave talk at Strata about analytics in wikipedia in conjunction with Druid folks. Slides: https://www.google.com/url?q=https://docs.google.com/a/wikimedia.org/presen… === Scoring Platform === * Blocked by: * Blocking: ** About to unblock the new ORES cluster. Need one more iteration of stress testing. * Updates: ** Created a list of c. 50 community stakeholders, and will use that to communicate and get feedback on initial work on JADE. https://www.mediawiki.org/w/index.php?title=User:Keegan_(WMF)/sandbox https://www.mediawiki.org/wiki/JADE **Preparing a new major version release for revscoring 2.0, which we hope is seamless but may involve some turbulence for ORES consumers. The thresholds API has a breaking change. Planned deployment date is c. Oct 18th. === Search Platform === * Blocked by: none * Blocking: none * Updates: * Added more namespaces to default searches, per community requests ( https://phabricator.wikimedia.org/T170473) * Working on porting Selenium tests from Ruby to JS * Working on upgrade to Elastic 5.5 * Working on indexing Wikidata descriptions === Fundraising Tech === * Looking into possible issues with Kafkatee not getting us all the web logs we need: https://phabricator.wikimedia.org/T177331 * dealing with Safari's new privacy settings * Adding lots of metrics to https://grafana.wikimedia.org/dashboard/db/fundraising-overview?refresh=1m&… * Fixing issues with CiviCRM's de-duplication UI * Dealing with outgoing mail issue caused by PHPMailer security fix === Technical Operations === * Blocked by: none * Blocking: none * Updates: ** Goals completed: Streamline Service Delivery / Remove salt from our infrastructure / Prepare for puppet 4 / Improve database backups' coverage ** Asia DC unblocked, moving along with procurement == RelEng == ==== This week ==== * Blocking ** * Blocked ** Need Ops review of patches for https://phabricator.wikimedia.org/T146381#3447319 * Updates ** Mukunda taking over for 1.31.0-wmf.2 for the rest of this week == Security == * Reviews: ** Ex:FileImporter (T160982) ** Ex:WikipediaExtracts (T149424) ** pdfrw

5 years, 8 months

TechCom: No IRC meeting today

by Kevin Smith

Greetings all, There will not be a TechCom/RFC discussion on IRC today. The committee had selected a topic, but it didn't get announced in time, and the RFC proposer is unable to attend. We will reschedule that topic, and we will be refining our processes to try to avoid having this happen in the future. TechCom page, for reference: https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee Kevin Smith Engineering Program Manager, Wikimedia Foundation

5 years, 8 months

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l October 2017