Wikitech-l November 2017

wikitech-l@lists.wikimedia.org

60 participants
51 discussions

3D model support coming soon to Commons
by Chris Koerner 07 Nov '17

07 Nov '17

Hello! Just a quick note to let you all know that support for 3D models is coming to Commons! [0] The plan is to have the feature enabled by the end of November. There are a few technical items left to address. The feature will support the STL file format, one of the most common file formats for 3D models. [1] You can see an example of how a 3D model will appear on the test wiki. [2] (.gif) [3] This feature has been discussed in the Wikimedia community for a long time. Most recently the feature was #11 on the 2015 Community Tech Wishlist and was previously discussed on Commons in April as development progressed. [4] [5] There will be a blog post on the Wikimedia Blog once the feature is enabled. You can read more about the technical details of the feature and the help documentation on MediaWiki.org. [6] [7] [0] https://commons.wikimedia.org/wiki/Commons:Village_pump#3D_model_support_co… [1] https://wikipedia.org/wiki/Special:MyLanguage/STL_(file_format) [2] https://test.wikipedia.org/wiki/File:Programmatically_created_crystal.stl [3] https://commons.wikimedia.org/wiki/File:Demo_of_3D_model_in_MediaViewer.gif [4] https://meta.wikimedia.org/wiki/2015_Community_Wishlist_Survey/Commons#3D_m… [5] https://commons.wikimedia.org/wiki/Commons:Village_pump/Archive/2017/05#Pre… [6] https://www.mediawiki.org/wiki/Extension:3D [7] https://www.mediawiki.org/wiki/Help:Extension:3d Yours, Chris Koerner Community Liaison Wikimedia Foundation

1 0

Important news about the November dumps run!
by Ariel Glenn WMF 07 Nov '17

07 Nov '17

As was previously announced on the xmldatadumps-l list, the sql/xml dumps generated twice a month will be written to an internal server, starting with the November run. This is in part to reduce load on the web/rsync/nfs server which has been doing this work also until now. We want separation of roles for some other reasons too. Because I want to get this right, and there are a lot of moving parts, and I don't want to rsync all the prefetch data over to these boxes again next month after cancelling the move: ******** If needed, the November full run will be delayed for a few days. If the November full run takes too long, the partial run, usually starting on the 20th of the month, will not take place. ********* Additionally, as described in an earlier email on the xmldatadumps-l list: ********* files will show up on the web server/rsync server with a substantial delay. Initially this may be a day or more. This includes index.html and other status files. ********* You can keep track of developments here: https://phabricator.wikimedia.org/T178893 If you know folks not on the lists in the recipients field for this email, please forward it to them and suggest that they subscribe to this list. Thanks, Ariel

2 4

TechCom Radar, 2017-11-01
by Daniel Kinzler 07 Nov '17

07 Nov '17

Hello all! Here are the minutes from this week's meeting: * TechCom would like to thank Kevin Smith for his help with facilitating and note taking. We hope to see you around, Kevin! * Previous IRC meeting: How to modify all preferences? <https://phabricator.wikimedia.org/T178449>. Outcome: Introducing a PreferenceFactory service seems like a good idea, but there are several issues to resolve with the implementation as proposed. RFC remains under discussion. * Last Call canceled: Bump PHP requirement to 5.6 in 1.31 <https://phabricator.wikimedia.org/T178538>. The RFC goes back to “under discussion” due to an issue raised by Anomie <https://phabricator.wikimedia.org/T172165#3699606>. * Discussion on wikitech-l: Proposal regarding the handling of imported usernames <https://lists.wikimedia.org/pipermail/wikitech-l/2017-October/089047.html>. * Next IRC meeting: Gathering input on the RFC process. We want to hear from you what you like or dislike about the RFC process. If you have criticism or suggestions, please let us know. Note that we have diverged quite a bit from the process as documented at Requests_for_comment/Process. This session is part of a drive to overhaul our processes and improve documentation. As always, the discussion will take place in the IRC channel #wikimedia-office on Wednesday 21:00 UTC (2pm PDT, 23:00 CEST). * Daniel has published a rant about how unclear ownership makes it hard to address technical debt <https://www.mediawiki.org/wiki/User:Daniel_Kinzler_(WMDE)/Avoiding_the_Tech…>. This topic was brought up during the discussion about FauxRequest <https://phabricator.wikimedia.org/T169266>. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. -- Daniel Kinzler Principal Platform Engineer Wikimedia Deutschland Gesellschaft zur Förderung Freien Wissens e.V.

1 1

Tomorrow: Weekly Technical Advice IRC Meeting
by Michael Schönitzer 07 Nov '17

07 Nov '17

Sorry for cross-posting! Reminder: Technical Advice IRC meeting again **tomorrow 4-5 pm UTC** on #wikimedia-tech. The Technical Advice IRC meeting is open for all volunteer developers, topics and questions. This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting This meeting is an offer by WMDE’s tech team. Hosts of tomorrows meeting are: @addshore & @CFisch_WMDE. Hope to see you there! Michi (for WMDE’s tech team) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 0

Upcoming holidays/events and their impact on the deployment schedule
by Greg Grossmeier 06 Nov '17

06 Nov '17

Hello all, It's that time of year again where the density of holidays increases and at the same time our plans for fundraising also increase. Per our usual practice we will be not doing deployments at various points in the next few months. Here's the full outline: Reminder for all on we did last year: * No MW train the week of Thanksgiving (but SWAT deploys were open for high-priority things). * No deploys (at all) the last two weeks of December. People were happy with this. * The first week of January was normal (minus Monday being Jan 2nd, our observed New Year's Day holiday) deployment wise. * The second week was weird due to Dev Summit/All Hands: No MediaWiki train, only SWATs as needed on Mon/Tues/Wed. No SWATs/deploys during All Hands. I imagine we'll do similarly. In that case (looking at the calendar....) * No MW train the week of Thanksgiving (Nov 20th), SWATs open for high priority things * No deploys weeks of Dec 18th and 25th (last two weeks) * Normal week week of Jan 1st (minus no deploys that Monday) * The Dev Summit and WMF All Hands is the week of January 22nd, so that will be a "No Train but SWATs OK on Mon/Tues/Wed" week. * The following week (week of January 29th) the Release Engineering team will be on an offsite, so a week of "No Train, but SWATs and service deploys OK". This is now on-wiki at: https://wikitech.wikimedia.org/wiki/Deployments#Upcoming Best, Greg -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | Release Team Manager A18D 1138 8E47 FAC8 1C7D |

1 1

Start from random image in slideshow gallery
by Strainu 05 Nov '17

05 Nov '17

Hi there, Is there a way to start displaying a slideshow gallery from a random image without editing the site JavaScript, except for building a template that randomizes the content of the <gallery> tag? If not, is there a phab item for this feature? Thanks, Strainu

2 1

2017-11-01 Scrum of Scrums meeting notes
by Grace Gellerman 02 Nov '17

02 Nov '17

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-11-01 = 2017-11-01= Callouts: * If you notice anything weird with VE, let Services know, they are messing with Parsoid storage == Audiences == === Readers === ==== Multimedia ==== * Blocking: None * Blocked by: None * Updates: MediaInfo/Wikibase on Commons work is continuing, https://phabricator.wikimedia.org/T177022 * UploadWizard changes for 3D legal considerations, https://phabricator.wikimedia.org/T178513 * and discussions about MP3. * Heads up: Mark on vacation until Thursday next week - will respond but may be AFK ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** 5.7.0 released ( https://phabricator.wikimedia.org/project/view/2899/ ) - Visual updates to onboarding, iOS 11 support, iPhone X support ** Starting work on 5.7.1 - https://phabricator.wikimedia.org/project/view/3047/ (bug fixes) and 5.8 - https://phabricator.wikimedia.org/project/view/2913/ (faster article loads, synced reading lists) ==== Discovery ==== * Blocked by: * Blocking: * Updates: ** Lots up SVG related patch to wikipedia portal https://gerrit.wikimedia.org/r/#/q/topic:new-svg-sprites+(status:open+OR+st… ===== Maps ===== * Blocked by: N/A * Blocking: N/A * Updates: ** People are back from SOTM US ** Lots of relevant conversations relevant to our maps at SOTM US ==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** MCS getting ready for Parsoid section tags (in mobile-sections and Wiktionary definitions). Discussions about wrapping the sections content in a <div> on https://phabricator.wikimedia.org/T176959. ** MCS adding more title related properties to summary own implementation and mobile-sections lead portion. ** Continuing work on making Reading Lists production-ready ==== Services ==== * Blockers: none * Updates: ** Testing switching Parsoid to new storage in labs and production ** Summary will be served from new storage only starting tomorrow === Contributors === ==== Global Collaboration ==== * Blocked by: none * Blocking: none * Updates: ** Team offsite in Bangalore last week, not everyone's back yet ** Actually deployed Compact Language Links to dewiki last week (2017-10-25); was canceled the week before ==== Parsing ==== * Updates: ** Updating section wrapping code to not add the div wrapper around section content as per discussion in https://phabricator.wikimedia.org/T176959 ** Barring no other unforeseen issues, might be able to deploy this patch next week along with a couple other changes: (a) html5 section ids to match core changes (b) wrapping inline images using figure-inline tag; We'll bump our HTML version number at that time ==== Community Tech ==== * New wishlist survey starts next week * Global Preferences RFC will be discussed today * Deployed Unicode sections to Russian projects, addressing issues ==== Fundraising Tech ==== * Tweaks to CiviCRM reports, searches, and contact views * Deployed various minor CentralNotice code changes: https://gerrit.wikimedia.org/r/387627 * Backup card processor: still fixing Safari cookie issue, also adding retry on failure to certain API calls * Refactoring initial prometheus stats collector, adding more measurements === Search Platform === * Blocked by: none * Blocking: none * Updates: * Finished evaluating MLR training resource usage, updated docs: https://github.com/wikimedia/search-MjoLniR/blob/master/docs/running-in-ana… * Fixed search matches within section titles ( https://phabricator.wikimedia.org/T178522) * Fixing issues between completion suggester and multi-ns searches on some wikis (https://phabricator.wikimedia.org/T178474) * Enabled ElasticSearch prefix search on Wikidata, dealing with some special case regressions * Looking at top abandoned queries ( https://phabricator.wikimedia.org/T176997) * Working on porting Selenium tests from Ruby to JS * Working on upgrade to Elastic 5.5 * Added indexing Wikidata statements for P31 and P279 * Working on indexing Wikidata descriptions and adding them to fulltext search === Scoring Platform === * Blocked by: * Blocking: * Updates: ** Shiny new FAQ! *** https://www.mediawiki.org/wiki/ORES/FAQ ** Converted our tests from nosetests to pytest (Anyone else making the transition?) *** nosetests is under-maintained *** python community is moving towards pytest *** converting our repos was pretty straightforward === Release Engineering === * Blocking: None * Blocked: None * Updates: ** We had to pause the MediaWiki train last week due to a hard to diagnose issue in production: *https://phabricator.wikimedia.org/T179156* <https://phabricator.wikimedia.org/T179156> ** T171852 Tech talk: Selenium tests in Node.js https://phabricator.wikimedia.org/phame/post/view/78/tech_talk_selenium_tes… ** T173488 Selenium Ruby framework deprecated https://phabricator.wikimedia.org/phame/post/view/79/selenium_ruby_framewor… ** CI: Antoine was sick last week. But, he setup a simple package manager caching system for the docker based CI (a port of “castor” in our nodepool based CI). He will migrate some of the CI config related tox jobs to it. === Security === * Blocking: all who are waiting for security reviews * Blocked: none * Updates: ** Reviews *** BeautifulSoup *** mediawiki-services-chromium-render *** Marvin *** Ex:FIleImporter *** Ex:WikipediaExtracts *** Onboarding Erika Bjune to team === Analytics === * new host replaces db1047, EventLogging breathes a sigh of relief * continuing work on jumbo kafka cluster, EventLogging refine, mediawiki history final data vetting, Wikistats 2 alpha release

5 4

2017-10-25 Scrum of Scrums meeting notes
by Grace Gellerman 02 Nov '17

02 Nov '17

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-10-25 = 2017-10-25 = == Callouts == * Services are running a new JobQueue test in beta cluster, so if you see anything strange in beta - please notify * Mukunda broke scap in beta, will get it fixed soon! == Audiences == === Readers === ==== Multimedia ==== * Blocking: None * Blocked by: None * Updates: MediaInfo/Wikibase on Commons work is continuing, https://phabricator.wikimedia.org/T177022 * UploadWizard changes for 3D legal considerations, https://phabricator.wikimedia.org/T178513 * and discussions about MP3. * Heads up: Mark on vacation next week, plus three days in the following week - will respond but may be AFK ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** Apps offsite last week ** 5.7.0 will be released this week ( https://phabricator.wikimedia.org/project/view/2899/ ) - Visual updates to onboarding, iOS 11 support, iPhone X support ** Starting work on 5.7.1 - https://phabricator.wikimedia.org/project/view/3047/ and 5.8 - https://phabricator.wikimedia.org/project/view/2913/ ==== Reading Web ==== - currently offsite-ing ==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** Reading lists available in beta & labs: https://restbase-reading.wmflabs.org/en.wikipedia.beta.wmflabs.org/v1/ + http://readinglists.wmflabs.org/api/rest_v1/#/Reading_lists ==== Discovery ==== * Blocked by: * Blocking: * Updates: * continuing work on portal automation, general clean-ups, adding SVGs === Contributors === ==== Parsing ==== * Blocked by: Parsoid debian package upload blocked by change needed to the deb-upload script (Daniel Zahn replied on IRC y'day as he was rushing to catch a flight that the release server has changed). But, not sure if anything is needed on our end or will Ops fix this? I can create a phab ticket if required. * Blocking: * Updates: ** Parsing team back from offsite (last week). Nothing significant to report for purposes of SoS. Focusing on some perf work this week. ==== Services ==== * Blockers: none * Updates: ** All jobs in beta cluster are processed via kafka as a test. Please tell us if you notice anything weird ** Deprecated /titile/ and /title/{title}/ listings in REST API has been removed === Community Tech === * Preparing for a new wishlist survey * Deploying Unicode sections soon === TechOps === * Blocked by: ** Flow isAllowed gets actual revision text before it is needed https://phabricator.wikimedia.org/T172025 * Blocking: * Updates: ** Procurement for Asia datacenter has started ** We have IP addresses allocated ** Work on unifying production and CI build pipeline ongoing https://phabricator.wikimedia.org/T177276 ** Database shard s5 split into s8 ongoing https://phabricator.wikimedia.org/T172679 ** Work on porting varnish request stats scripts to Prometheus https://phabricator.wikimedia.org/T177199 ** Puppet modernization ongoing https://phabricator.wikimedia.org/T177254 === Search Platform === * Blocked by: none * Blocking: none * Updates: * Finished removal of messaging fallbacks from Elastic indexing ( https://phabricator.wikimedia.org/T177871) * Relaxing phrase query filter A/B finished, analyzing ( https://phabricator.wikimedia.org/T177956) * Checked language analyzers to see whether we want to research other morphological libraries (https://phabricator.wikimedia.org/T171652) ** See the plan in https://phabricator.wikimedia.org/T171652#3707331 * Looking at top abandoned queries ( https://phabricator.wikimedia.org/T176997) * Extended a set of default search namespaces on several wikis ( https://phabricator.wikimedia.org/T170473) * Enabled stricter throttling on WDQS to deal with clients that issue tons of short requests very fast * Enabling ElasticSearch prefix search on Wikidata today * Working on porting Selenium tests from Ruby to JS * Working on upgrade to Elastic 5.5 * Working on indexing Wikidata descriptions and adding them to fulltext search === Release Engineering === * Blocked by: None * Blocking: None * Updates: ** Mukunda broke scap in beta, will get it fixed soon! ( https://phabricator.wikimedia.org/T179013 ) ** Deployment logspam is mostly quiet, except one non-deployment related log from the tidy migration (Parsing/MW Platform know) ** Zeljko paired with Elena T. to get some Echo notification browser tests written (nodejs/mocha framework). ** Zeljko scheduled a Tech Talk on Oct 31st to discuss/teach the nodejs browser testing framework. ** Scap tech-debt project well underway, merged many improvements last week ** new/docker based CI: the phan job is now migrated ** Gerrit was upgraded last week (minor version) ** Working on git-lfs (large file store, for big binary blobs) support in Gerrit for ORES and Reading teams ** Redesigned (simplified) the Phabricator login screen < https://phabricator.wikimedia.org/D831>, should be deployed soon. === Security === * Blocked by: None * Blocking: whowever is waiting for security reviews * Updates: * Node Security Project 3.0.0 being released soon (available as nsp@next); please consider upgrading if you work on Node.js-based projects * Reviews: * pdfrw * more will be scheduled soon == Wikidata == * Preparing WikidataCon: https://www.wikidata.org/wiki/Wikidata:WikidataCon_2017 * We will live-stream the main tracks on Saturday and Sunday: https://www.wikidata.org/wiki/Wikidata:WikidataCon_2017/Program/Remote

3 2

[MediaWiki-announce] 1.28.x End of Life
by Chad Horohoe 01 Nov '17

01 Nov '17

Hi! It's November 2017, which means that the 1.28.x branch of MediaWiki has reached the end of its life. Lets wish it the best as it moves off to the great big code repository in the sky. All users are encouraged to upgrade to 1.29.x which is the latest stable branch. Note: 1.30.0 should be out by the end of the month, we've already branched and are working on making sure the release is ready-to-go :) -- Chad Horohoe _______________________________________________ MediaWiki announcements mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce

1 0

Today: Weekly Technical Advice IRC Meeting
by Michael Schönitzer 01 Nov '17

01 Nov '17

Sorry for cross-posting! Reminder: Technical Advice IRC meeting again **today 3-4 pm UTC** on #wikimedia-tech. The Technical Advice IRC meeting is open for all volunteer developers, topics and questions. This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_ Advice_IRC_Meeting This meeting is an offer by WMDE’s tech team. Hosts of todays meeting are: @addshore & @CFisch_WMDE. Hope to see you there! Michi (for WMDE’s tech team) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2017