Wikitech-l April 2018

wikitech-l@lists.wikimedia.org

71 participants
75 discussions

2018-04-18 Scrum of Scrums meeting notes
by Grace Gellerman 19 Apr '18

19 Apr '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-04-18#Android_native_app = 2018-04-18 = == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - Netherlands 2018-04-03 through 2018-05-01 * Analytics: we added trash folder to hadoop to “aid” in case of accidental deletions of data in cluster. * Need help from RelEng with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811 * Research: In the next two/three weeks we'll be collecting citation usage data via EventLogging: https://phabricator.wikimedia.org/T191086and https://meta.wikimedia.org/wiki/Schema:CitationUsage. cc Reading Infrastructure, Adam Baso, Security, Legal, Analytics. * Phabricator: Create tasks with a Deadline date/time which is displayed on workboards: https://phabricator.wikimedia.org/maniphest/task/edit/form/37/ == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Reading lists at 10% production, full rollout pending regression tests and finalizing marketing materials. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ===== Maps ===== * Blocked by: * Blocking: * Updates: ==== Multimedia ==== * Blocked by: * Blocking: * Updates: === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** GlobalPreferences, CodeMirror, TemplateWizard ==== Anti-Harassment Tools ==== * Blocked by: None * Blocking: None * Updates: ** Improving block notices on mobile ** Adding cookie blocking for anonymous users ==== Editing ==== * Blocked by: * Blocking: * Updates: ==== Parsing ==== * Blocked by: * Blocking: * Updates: ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ==== Language ==== * Blocked by: * Blocking: * Updates: === Audiences Design === * Blocked by: * Blocking: * Updates: ==== UI Std ==== * Blocked by: * Blocking: * Updates: ** OOUI – v0.26.4 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v… *** One hotfix, that has already made it to MW1.31 before, one keyboard accessibility improvement ** Continued work on icon/size unification aftermath in different products (Notifications, Flow, RevisionSlider) ** Style Guide technical and contents improvements ongoing with 2 open PRs currently ** Transforming core/extensions to use OOUI, 6 extensions accomplished last week, build on strong volunteer support == Technology == === Analytics === * Blocked by: * Blocking: * Updates: - Monitoring the launch of the page previews, currently working on the aggregation job. - Done with updates to jupyter notebooks for now - Issues with pageviews from Opera Mini not geo locating correctly in Africa are now resolved. - Fnishing new geowiki infrastructure before we turn off the old jobs that calculated this data (editors per country). - Google Summer of Code, plenty Code Reviews for contributions to Wikistats UI: http://stats.wikimedia.org/v2 === Cloud Services === * Blocked by: * Blocking: * Updates: === Fundraising Tech === * Blocked by: * Blocking: * Updates: Working on new recurring contribution API for main card processor Debugging CN patch deploy to add CSP headers on banner preview CiviCRM: Work on exports, fixing custom fields, new fraud-hunter's report Working on getting landing page and banner impression EventLogging data into payments cluster DBs === MediaWiki Platform === * Blocked by: * Blocking: * Updates: === Performance === * Blocked by: None * Blocking: None * Updates: ** Moving our apps/etc out of puppet, to scap deploy ** Blog post on Singapore DC should be up shortly, been working on that with Traffic ** Lots of CRs ** working with RelEng/Platform on a few changes to CI and to MW Core ** mcrouter is now deployed in deployment-prep, next steps are to configure, and working with SRE to figure out how to do cross-DC correctly. ** Trying out Digital Ocean for WebPageTest (got free credits from them) === Release Engineering === * Blocking ** Working on Scap 3.8.0 to unblock ores git-lfs deployments. * Blocked ** n/a * Updates ** Deadlines in phabricator are now visible on workboards. === Research === * Blocked by: ** None * Blocking: ** None * Updates: ** In the next two/three weeks we'll be collecting citation usage data via EventLogging: https://phabricator.wikimedia.org/T191086 and https://meta.wikimedia.org/wiki/Schema:CitationUsage. cc Reading Infrastructure, Adam Baso, Security, Legal, Analytics. === Scoring Platform === * Blocked by: * Blocking: * Updates: ** Waiting on the scap deployment to unblock us from git-lfs--it works on beta :) (Almost there! Thanks Releng!)* ** Virtualenv is now cached with deployments (so that we can quickly rollback) *** This is relevant for anyone who is deploying a python service with virualenvs as they might want to follow our lead ** New, dynamic table with ORES support status. *** https://tools.wmflabs.org/ores-support-checklist/ === Search Platform === * Blocked by: * Blocking: * Updates: - Need help with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811 - Selenium Wikibase tests still broken: https://phabricator.wikimedia.org/T189762 - Job queue issues fix merged: https://phabricator.wikimedia.org/T191024 https://phabricator.wikimedia.org/T190958 - Lexeme completion search merged: https://phabricator.wikimedia.org/T190970 Continuing work on Forms support - Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148 - Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: * Updates: === Services === * Blocked by: ** search with CirrusSearch job JSON serialization T191024 (Not any more according to Stas :) ** language with Translate job JSON serialization T192111 * Blocking: none? * Updates: ** There was an issue with wikidata recent changes job, resolved now ** EventBus (and kafka job queue) going to private wikis this week ** Cassandra 3.11.2 evaluation === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** ICU57 migration completed on all wikis ** Work started on upgrading all mediawiki application servers to Debian Stretch ** The image scalers have been decommissioned (thumbor provides fully that fuctionality now) ** mcrouter is being tested and are going to post an architecture proposal for review ** Discussions on establishing a timeline for deprecation of non-forward-secret ciphers and TLSv1.0 started ** Proton discussions came to a result on hosting this on 2 ganeti VMs per datacenter, will be resolved this week ** helm charts repo published https://releases.wikimedia.org/charts == Wikidata == * Blocked by: * Blocking: * Updates: **Send thanks to John and the security team for the quick response they gave us for our security review for our coming release **Lexeme will be released on May 23rd **wb_terms fire fighting is stopping, strategy work starts now how to get ourselves out of the situation properly and in a way we can scale == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** MediaWiki CodeSniffer performance improvements already released as version 18, thanks Lego! ** Backported a fix in a 10 year old File export/import util, please watch for positive/negative consequences if this sounds familiar: https://gerrit.wikimedia.org/r/426959 ** Final 2 sprints working on MoveFilesToCommons: https://phabricator.wikimedia.org/tag/move-files-to-commons/ ** DeepCategory integration in AdvancedSearch: https://phabricator.wikimedia.org/T170533 == SoS Meeting Bookkeeping == * Updates:

2 1

TechCom Radar 2018-04-18
by Kate Chapman 19 Apr '18

19 Apr '18

Hi All, Below are the minutes of this week's TechCom meeting: * RFC on Last Call until 2 May 2018: Tracking dependencies for multiple Content objects per page (MCR) <https://phabricator.wikimedia.org/T190063> No RFC IRC Meeting Next Week (25 April 2018) * RFC Implemented: Introduce PlatformSettings.php <https://phabricator.wikimedia.org/T182020> * RFC Implemented: Stop logging autopatrol actions <https://phabricator.wikimedia.org/T184485> * RFC Implemented: Replace HTML4 Tidy in MW parser with an equivalent HTML5 based tool <https://phabricator.wikimedia.org/T89331> * RFC Implemented: Require either PHP 7.0+ or HHVM in MW 1.31 <https://phabricator.wikimedia.org/T172165> * Page previews are now enabled by default for anon users on English Wikipedia * ICU migration is over for German Wikipedia * Last standing php5 running in production should be removed by 17 May 2018 You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. -- Kate Chapman TechCom Facilitator (Contractor)

1 0

[Blog post series]: Extension:Popups (Page Previews) front-end tooling
by Joaquin Oltra Hernandez 19 Apr '18

19 Apr '18

Hi! With the recent final release of Page previews (Extension:Popups), we have also published a series of technical blog posts about the frontend tooling that we have used for developing this extension. Master post: Extension:Popups (Page Previews) front-end tooling <https://phabricator.wikimedia.org/phame/post/view/93/extension_popups_page_…> Table of contents: - Automatic JavaScript file bundling and library consumption - Better minification for frontend sources - Fast and isolated JS unit tests - Conclusions We hope this is interesting to read and hopefully useful to other teams or projects working on products with complex front-end needs. We're more than happy to chat about these topics, or help you with these kind of workflows if you are interested. Have a nice day! --- Joaquin - Jhernandez - JHernandez (WMF) Readers Web Team

1 0

Page previews promoted out of beta on all Wikipedias
by Olga Vasileva 18 Apr '18

18 Apr '18

Hi all, Page previews[1] have now been promoted out of beta to the remaining two Wikipedias - English and German, after a series of consultations on both wikis [2][3][4]. The feature is now on by default for all logged-out users and off by default for all logged-in users (can be enabled using user preferences) on all Wikipedias. Further changes to configuration based on our conversations with communities (such as turning the feature on for new accounts) are coming up soon. Page previews allows readers to read an excerpt of a linked article’s lead section without leaving the page they’re currently on, by hovering their mouse over the link. It has been activated by default for logged-out users on all Wikipedias except German and English since August 2017, and numerous further bug fixes and technical improvements have been implemented since. A few weeks ago we published the results of our latest round of A/B testing [5]. We found that when the feature is enabled, readers will open pages in their browser slightly less often (a decrease of around 3–5% in regular pageviews). But on the other hand, they interact with a lot more different pages when one counts both the seen page previews and the regular pageviews (an increase of around 20–22% in the number of distinct pages interacted with via either method). In addition, the option to deactivate the feature was used very rarely (disable rates were around 0.01%). This leads us to believe that Page Previews is a welcomed feature that is helping readers learn more during their visits. More information about Page previews can be found on the project page on MediaWIki.org [1]. The team also recently wrote a few blog posts. One about the work that went into the design of the feature [6] and another giving an overview of the functionality [7]. If you see any issues, please report them in Phabricator. [8] Thanks, Olga [1] https://www.mediawiki.org/wiki/Page_Previews [2] https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)/Archive_16… [3] https://de.wikipedia.org/wiki/Wikipedia:Fragen_zur_Wikipedia/Archiv/2018/Wo… [4] https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(miscellaneous)#Next_S… [5] https://www.mediawiki.org/wiki/Page_Previews/2017-18_A/B_Tests [6] https://medium.com/freely-sharing-the-sum-of-all-knowledge/how-we-designed-… [7] https://blog.wikimedia.org/2018/04/17/wikipedia-page-previews/ [8] https://phabricator.wikimedia.org/tag/page-previews/ -- Olga Vasileva // Product Manager // Reading Web Team https://wikimediafoundation.org/

6 5

Discovery Weekly Update for the week starting 2018-04-09
by Chris Koerner 17 Apr '18

17 Apr '18

Heya, Another week, another update from the Search Platform team. This one is for the week starting 2018-04-09. As always, feedback and questions welcome. == Discussions == === Search === * New search code fully deployed & enabled on Wikidata. ==Events and News == * Erik and Trey went to the "OpenSource Connections Haystack Search Relevance Conference" and "Tom Tom Founders Festival Machine Learning Conference", which were back-to-back in Charlottesville, VA. Erik presented on how we use clickstream information to create training data for our learning to rank models at Haystack. [1] Trey wrote up trip notes—with lots of links—on MediaWiki. [2] == Other Noteworthy Stuff == * Fix for CirrusSearchCheckerJob errors rolled out. [3] * Stas implemented indexing Lexemes & Forms for WikibaseLexeme extension. [4] == Did you know? == *The English verb "to be" is kind of weird—the infinitive "be" and participles "being, been" start with "b-", while the preterite forms "was, were" start with "w-", and the present forms "am, is, are" start with vowels. The conjugations originally come from three or four different verbs! Why "three or four"? Wiktionary disagrees with itself a bit, listing four on the etymology of "is" [5] and three on the etymology of "be". [6] The conflation goes back at least to Proto-Germanic, [7] so German is similarly weird. [8] Dutch has a greatly simplified paradigm, but still shows some trace of the multiple sources. [9] Other languages, including ASL, Arabic, Bengali, Hawaiian, Hebrew, Indonesian, Japanese, Russian, Turkish, and Ukrainian at least partly avoid this mess by having a zero copula. [10] For search on-wiki, we deal with this problem in part with stemming [11] and stop words. [12] [0] https://www.wikidata.org/wiki/Wikidata:Project_chat#Improvements_on_the_sea… [1] https://commons.wikimedia.org/wiki/File:From_Clicks_to_Models_The_Wikimedia… [2] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/April_2018_Conferenc… [3] https://phabricator.wikimedia.org/T190958 [4] https://phabricator.wikimedia.org/T189745 [5] https://en.wiktionary.org/wiki/is#Etymology_1 [6] https://en.wiktionary.org/wiki/be#Etymology [7] https://en.wikipedia.org/wiki/Proto-Germanic_language [8] https://en.wiktionary.org/wiki/sein#Conjugation [9] https://en.wiktionary.org/wiki/zijn#Inflection [10] https://en.wikipedia.org/wiki/Zero_copula [11] https://en.wikipedia.org/wiki/Stemming [12] https://en.wikipedia.org/wiki/Stop_words --- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

1 0

Tomorrow: Technical Advice IRC Meeting
by Michael Schönitzer 17 Apr '18

17 Apr '18

Sorry for cross-posting! Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 3-4 pm UTC** on #wikimedia-tech. The Technical Advice IRC meeting is open for all volunteer developers, topics and questions. This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki /Technical_Advice_IRC_Meeting Hope to see you there! Michi (for WMDE’s tech team) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 0

File upload file in HTMLForm with ooui
by Toni Hermoso Pulido 17 Apr '18

17 Apr '18

Hello, I'm trying to migrate a HTMLForm to use ooui by following https://www.mediawiki.org/wiki/OOUI/Using_OOUI_in_MediaWiki htmlForm = HTMLForm::factory( 'ooui', $formDescriptor, 'myform' ); I noticed that a file upload form field that I had defined is not rendered correctly when using ooui. 'fileupload' => array( 'section' => 'upload', 'label' => 'Upload file', 'class' => 'HTMLTextField', 'type' => 'file' ), This is shown as a text field but not as a file upload, as I would have expected... Is there any way to handle this and using OOUI at the same time? Thanks!

3 5

Re: [Wikitech-l] Wikistats 2.0 - Now with Maps!
by יגאל חיטרון 17 Apr '18

17 Apr '18

Hello and thank you. What do you mean in country named "--"? Igal (User:IKhitron) On Feb 15, 2018 00:15, "Nuria Ruiz" <nuria(a)wikimedia.org> wrote: Hello from Analytics team: Just a brief note to announce that Wikistats 2.0 includes data about pageviews per project per country for the current month. Take a look, pageviews for Spanish Wikipedia this current month: https://stats.wikimedia.org/v2/#/es.wikipedia.org/reading/ pageviews-by-country Data is also available programatically vi APIs: https://wikitech.wikimedia.org/wiki/Analytics/AQS/ Pageviews#Pageviews_split_by_country We will be deploying small UI tweaks during this week but please explore and let us know what you think. Thanks, Nuria _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

6 12

Was macht dich diese Woche glücklich? / What's making you happy this week? (Week of 15 April 2018)
by Pine W 16 Apr '18

16 Apr '18

*Conference* The 2018 Wikimedia Conference <https://meta.wikimedia.org/wiki/Wikimedia_Conference_2018> starts this week in Germany. The core conference will occur from the 20th through the 22nd. *WMF Research Showcase* On Wednesday, the WMF Research Showcase <https://www.mediawiki.org/wiki/Wikimedia_Research/Showcase#April_2018> will include presentations on two subjects that I think will interest a number of Wikipedians: 1. "The Critical Relationship of Volunteer Created Wikipedia Content to Large-Scale Online Communities" 2. "The Rise and Decline of an Open Collaboration System, a Closer Look" *Photography* As often happens, Wikimedia Commons contributors have selected some great pictures of the day for this month <https://commons.wikimedia.org/wiki/Template:Potd/2018-04>. Here are a few examples: 1. https://commons.wikimedia.org/wiki/File:Lynx_lynx_-_05.jpg 2. https://commons.wikimedia.org/wiki/File:Mezquita_de_Agha_Bozorg,_Kashan,_Ir… 3. https://commons.wikimedia.org/wiki/File:Soyuz_TMA-13_Edit.jpg 4. https://commons.wikimedia.org/wiki/File:Rho_Ophiucus_Widefield.jpg 5. https://commons.wikimedia.org/wiki/File:Indosylvirana_urbis-Kadavoor-2017-0… 6. https://commons.wikimedia.org/wiki/File:Castillo_de_Zafra,_Campillo_de_Due%… 7 https://commons.wikimedia.org/wiki/File:Cirrus_front_over_Austnesfjorden,_A… 8 https://commons.wikimedia.org/wiki/File:Fr%C3%BChlingsallee_Tulpenbl%C3%BCt… What's making you happy this week? You are welcome to comment in any language Pine ( https://meta.wikimedia.org/wiki/User:Pine )

2 1

Announcing project ‘Invest in the MobileFrontend & MinervaNeue frontend architecture’
by Joaquin Oltra Hernandez 16 Apr '18

16 Apr '18

Hi! Over the next fiscal year, the Wikimedia Foundation Readers Web team will be making technical improvements to the mobile web codebases (MobileFrontend and MinervaNeue). The project, which we’re calling ‘Invest in the MobileFrontend & MinervaNeue frontend architecture’, contained in Output 2.7 of the Platform Evolution CDP [1], is currently in its specification and planning stages. The outcomes of the project are: 1. Improve developer experience (on-boarding, maintenance, development) 2. Reduce technical debt and make production improvements 3. Separate presentation and logic 4. Make Minerva and MobileFrontend better citizens of the MediaWiki ecosystem MobileFrontend & MinervaNeue, which power the Wikimedia mobile sites, make heavy use of client-side UIs with templates, CSS and JavaScript. Over the past eight years of developing a mobile-first wiki experience we have learnt and frontend technology has evolved. We will improve and modernize the code bases to continue supporting our mobile web users in the future. Please see Outcomes 1, 2 and 3 in the wiki page for more detail. Minerva will become an independent skin without a dependency on MobileFrontend, and vice versa. Please see Outcome 4 in the wiki page for more detail. Please visit the project page on MediaWiki.org to learn more about the outcomes and outputs, and share your questions. [2] N.B. This project is distinct from “Output 3.1: Contribution tools on mobile web via an existing mediawiki skin” [3], described in the FY 2018-2019 plan. _____________________ Joaquin Oltra Hernandez Senior Software Engineer, Readers Web [1]: https://wikifarm.wmflabs.org/platformevolution/index.php/Plan:FY18-19/2/7 [2]: https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFro… [3]: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2018-2019/…

3 5

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l April 2018