Wikitech-l January 2017

wikitech-l@lists.wikimedia.org

85 participants
80 discussions

ArchCom Status & Meeting Minutes, WD4
by Daniel Kinzler 27 Jan '17

27 Jan '17

Hi all! Here are the minutes from this week's ArchCom meeting. You can also find the minutes at <https://www.mediawiki.org/wiki/Architecture_committee/2017-01-25>. See also the ArchCom status page at <https://www.mediawiki.org/wiki/Architecture_committee/Status> and the RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. Here are the minutes, for your convenience: * Gabriel is considering use cases for storage of HTML for old revision: mw:Wikimedia_Services/Revision_storage_for_HTML_and_structured_data:_Use_cases * Continuing meta-discussion about ArchCom, touching on the following topics: ** Encouraging more RFC discussion on Phabricator ** Using IRC meetings as a broader office hour ** ArchCom’s involvement with strategy making and resource planning At the IRC meeting, we discussed MZMcBride’s proposal for Accessing page properties from wiki pages. We explored use cases, identified potential issues and formulated requirements. A summary can be found at T154738#2972889. Active RFCs, please have a look: * T66214: Define an official thumb API. Effort to define a client-controlled API for retrieving thumbnails with various options. * T128351: Notifications in core. * T124752: Expiring watchlist entries. * T145604: Future of magic links. Last Call: [RFC] Image and oldimage tables Please review the updated RFC page <mw:Requests_for_comment/image_and_oldimage_tables> and send any final comments here on Wikitech-l or comment on T589 by 2017-02-01. Next week on IRC: Discuss the planned schema changes for DB realignment & MCR (pending confirmation from Brion). See: * mw:Wikimedia_Developer_Summit/2017/Scaling_the_Wikimedia_database_schema * mw:User:Brion_VIBBER/Compacting_the_revision_table * mw:Multi-Content_Revisions/Content_Meta-Data#Database_Schema * mw:Requests_for_comment/Content_model_storage -- Daniel Kinzler Principal Platform Engineer Wikimedia Deutschland Gesellschaft zur Förderung Freien Wissens e.V.

1 0

Code of Conduct "‎Creation and renewal of the Committee" text
by Matthew Flaschen 26 Jan '17

26 Jan '17

Please participate in the discussion about the "‎Creation and renewal of the Committee" section. This is not to approve it yet, just a discussion: https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#.22Creation_and_r… Most of this text has been around for a while, but I made a few changes to the draft last week, so I wanted to give people an opportunity to comment, suggest changes, etc. I'll give it a few more days, then start the formal approval discussion. Thanks, Matt Flaschen

2 1

Rails Girls Summer of Code program: Interested in being a mentor?
by Srishti Sethi 26 Jan '17

26 Jan '17

Hello all, For the very first time, we are considering to submit Wikimedia's application for the Rails Girls Summer of Code (RGSOC) <http://railsgirlssummerofcode.org/> program. The goal of this program is to foster diversity in Open Source. Though it sounds from the name that the projects submitted should be in ROR/ Rails, but that's not true. Projects could be in any programming language. This program will run between *July-September 2017*. The best part (for us and them) -- students work in pairs on a project, and need to be working from the same city. More about the application guidelines: http://railsgirlssummerofcode.org/students/application/. For organizations applying, the process is different from the other outreach programs in a way, that we need to submit projects and mentors beforehand. If you have some tasks/projects in mind that you would be interested in mentoring, please reply to me ASAP, as the deadline to apply as an organization is almost there (*January 31st, less than six days remaining!* ). Your help would be much appreciated! Cheers, Srishti -- Srishti Sethi Developer Advocate Technical Collaboration team Wikimedia Foundation https://www.mediawiki.org/wiki/User:SSethi_(WMF)

1 0

2017-01-25 Scrum of Scrums meeting notes
by Grace Gellerman 26 Jan '17

26 Jan '17

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-01-25 = 2017-01-25 = == Product == === Reading === ==== iOS native app ==== * Last Week ** Continued work on 5.4 - Data model for Places, Login enhancements https://phabricator.wikimedia.org/project/view/2326/ ** Investigated issue which caused a spike in pageviews * This week ** Continue work on 5.4 - UI for Places, API integration for Places ** Release 5.4 Alpha channel with rough version of Places for internal feedback ====Android==== * Last week: ** Rework a significant portion of the app networking layer ** Trying to wrap up Wikidata description editing for a beta https://phabricator.wikimedia.org/T155917 ** Fixed account creation bug (API 25 only) ** Initial two-factor authentication support coming soon ** Android and iOS translations now exported on regular TranslateWiki schedule by TWN's L10n-bot \o/ * Next week (https://phabricator.wikimedia.org/project/view/2352/ ): ** Work towards release of Wikidata description editing ** Continue on improved offline experience ** Finish tasking for Q3 ====Reading Infrastructure==== * working on TemplateStyles, ORES architecture review * not blocking * blocked: ** WMDE on the last API i18n patch before we can move to hard deprecation: https://gerrit.wikimedia.org/r/#/c/321464/ ===== Mobile Content Service (MCS) ===== * Board: https://phabricator.wikimedia.org/project/board/1323/query/open/ * Deployed: ** Fix for page internal links in Android app https://phabricator.wikimedia.org/T155070 * Working on: ** New endpoint for 'On this day' (aka. Anniversaries). ** Trying to expand TFA/In the news/Anniversaries to more languages in a more automated fashion *** Seeing if we can use the FeaturedFeeds extension to find TFA titles and/or other data we need ====Web==== * Current Sprint: https://phabricator.wikimedia.org/project/board/2426/ * Last week: ** Branding improvements on Mobile Web (notification count this time) ** Deployed Wikidata descriptions on enwiki * This week: ** More branding work (search bar in tablets) ** Tech debt ** Page Images: Return free images by default ** Page Images documentation improvements ** New Readers prototypes (Hindi language variants) ** Enabling related pages to a subset of users ** Allow using RESTBase for PagePreviews === Communtiy Tech === * Blockers: None * Blocked: Nope * Updates: ** Pushed some patches for LoginNotify extension: *** https://gerrit.wikimedia.org/r/#/c/333563/ Update a deprecated hook *** https://gerrit.wikimedia.org/r/#/c/333671/ Some cleanup - removes EchoBasicFormatter which is no longer used ** Make language-appropriate collations default during install: https://gerrit.wikimedia.org/r/#/c/327762/ ** Make collations have a version number in them: https://gerrit.wikimedia.org/r/#/c/272419/ ** Create new Special:RangeContributions page to support viewing contributions across an IP range: https://phabricator.wikimedia.org/T145912 ** Add support for Task Forces to PageAssessments extension: https://phabricator.wikimedia.org/T154216 ** Add cookie when blocking anonymous users https://phabricator.wikimedia.org/T152462 ** Codesniffer patch: https://gerrit.wikimedia.org/r/#/c/330846/ === Editing === ==== UI Standardization ==== * Last week ** UI Standardization offsite with focus on style guide work, see WMF UI Std Offsite 2017-01 column on https://phabricator.wikimedia.org/tag/wmf-design/ * This week ** UI Std offsite summary, funnel agreements into tasks and publish early iteration of new style guide * Updates ** core/mediawiki.UI: Remove deprecated mediawiki.UI variables from core – https://phabricator.wikimedia.org/T154950 * Blocked - * Blocking ** https://phabricator.wikimedia.org/T156164 Outlining path forward on Devise a generic way for theme-agnostic stylesheets to adapt to the current theme https://phabricator.wikimedia.org/T112747 feedback from core devs gathered ==== Collaboration ==== * Recent Changes work ** mediawiki.rcfilters: Add the remaining MW core filters ** Create active/inactive behavior for complementary filters ** rcfilters: Remove implemented filters from list of links ** Various bug fixes ** Meeting about ReviewStream. We may change the scope of the project * Flow security bug fix * Flow and ORES extension minor fixes == German Technical Wishlist == * soon beginning work on adding "refines" param, in the Cite extension, to more easily allow referencing different pages, chapters, etc. of a book or publication https://phabricator.wikimedia.org/T151301 ** blocked on some discussions with JamesF in the ticket * ElectronPDF - need to be able to have alternative css styles for different view modes (e.g. printable) https://gerrit.wikimedia.org/r/#/c/333125/ == Wikidata == * Preparing deployment of Cognate extension in the next month(s), which will allow automated interwiki links on Wiktionary * Also deploying InterwikiSorting extension (soon, before Cognate). This splits functionality out of Wikibase. Interwiki links will now be sorted in all namespaces, vs. currently this is only automatically done for some namespaces. * working on federation for Wikibase * currently blocked on Labs not allowing us to setup new MediaWiki instances using Vagrant/Puppet https://phabricator.wikimedia.org/T155196 ** needed to setup test instances for testing improvements to Wikibase change dispatching, as well as testing structured data wiktionary + federation == Technology == === Analytics === * Dependencies: - ** https://phabricator.wikimedia.org/T156287 will need feedback from community and coordination of that feedback process - ** https://phabricator.wikimedia.org/T153923 will need feedback from research * Blocking: - ** piwik.wikimedia.org keeps getting periodic errors, we're looking into it might be a fundamental limitation of piwik: https://phabricator.wikimedia.org/T154558, for now take the data with a grain of salt * Updates: - ** AQS upgraded to node 6 (pageview API) - ** monthly granularity available now on pageview API for per-article stats (thanks GCI students!) - ** Fundraising banner data and map tile data available in druid/pivot, come talk to us if you want to slice and dice your dimensional data - ** ongoing work on extracting mediawiki history data from labs db so we can be public by default (Joseph + Cloud Services) - ** ongoing work on Kafka-based RecentChanges (Andrew + Collaboration) - ** Design of Wikistats 2.0 UI is nearing a community consultation phase. Ping for community liasons and communication, coordinating on task https://phabricator.wikimedia.org/T156287 === Services === * Blockers: none * Updates: ** Node 6 upgrade to all services *** Great improvements in heap usage **** RESTBase: https://phabricator.wikimedia.org/F5357383 **** Change-Prop: https://phabricator.wikimedia.org/F5357386 *** Kartotherian is still on hold with node 6 ** Wrapping up work for supporting revision parameter in mobile endpoints === Technical Operations === * '''Blocking''': ** None * '''Blocked''': ** by no-one * '''Updates''': ** Hardware problems with networking equipment. S1 master is a leaf of it, various minor incidents https://phabricator.wikimedia.org/T155875 ** Some labs home directories problems, mostly fixed ** Data center switchover prepartion goal ongoing https://phabricator.wikimedia.org/T154658 ** Asia DC work started, still on early stages === Discovery === * No blockers * Finished writing up, summarizing, and recommending extensive changes to TextCat (language detection): https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/TextCat_Improvements… Most of these implemented in TextCat code and will be deployed soon. * Designing framework to perform multiple secondary searches, need input for API from API consumers (will set up meeting with mobile team). https://phabricator.wikimedia.org/T156019 * Working on ES 5 upgrade * Working on improving wikidata search === Fundraising Tech === * Testing new PayPal integration * Adding a method to clear CentralNotice cache for a banner: https://phabricator.wikimedia.org/T154954 * Preventing unintended duplicate donations * Renewing PCI compliance doc * Sanitizing error alert mail === Release Engineering === * '''Bocked''' ** None * '''Blocking''' ** None * '''Updates''' ** scap 3.5 planned for this week, includes major improvements to rollback === Security === * Security Reviews ** Internal File Server configuration and access ** Popups extension library ** sec.Watch Wizard (ad-hoc)

1 0

Re: [Wikitech-l] [Analytics] Monthly page view stats that can now be queried via Pageview API.
by Erik Zachte 26 Jan '17

26 Jan '17

Thanks Analytics Team for this really good news! A lot of reporting tools will benefit. Erik Zachte -----Original Message----- From: Analytics [mailto:analytics-bounces@lists.wikimedia.org] On Behalf Of Wes Moran Sent: Wednesday, January 25, 2017 18:41 To: A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics. Subject: Re: [Analytics] [Wikitech-l] Monthly page view stats that can now be queried via Pageview API. Nice addition and work. Very useful indeed. > On Jan 25, 2017, at 11:43 AM, Jonathan Morgan <jmorgan(a)wikimedia.org> wrote: > > Awesome. Thanks Analytics team! > > - J > > On Wed, Jan 25, 2017 at 3:19 AM, Thomas Steiner <tomac(a)google.com> wrote: > >>> The Analytics team would like to announce that the Pageview API is >>> able >> to >>> return monthly pageview stats as of this week. >> >> Thanks, Nuria and team, very useful addition to the API. I have >> updated pageviews.js accordingly: >> https://github.com/tomayac/pageviews.js/commit/ >> 643d3f2e2840e06b82b7d007b3611d4702376261. >> >> Cheers, >> Tom >> >> -- >> Dr. Thomas Steiner, Employee (https://blog.tomayac.com, >> https://twitter.com/tomayac) >> >> Google Germany GmbH, ABC-Str. 19, 20354 Hamburg, Germany Managing >> Directors: Matthew Scott Sucherman, Paul Terence Manicle Registration >> office and registration number: Hamburg, HRB 86891 >> >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v2.1.17 (GNU/Linux) >> >> iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck0fjumBl3DChara >> CTersAttH3b0ttom.hTtP5://xKcd.c0m/1181/ >> -----END PGP SIGNATURE----- >> >> _______________________________________________ >> Analytics mailing list >> Analytics(a)lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/analytics >> > > > > -- > Jonathan T. Morgan > Senior Design Researcher > Wikimedia Foundation > User:Jmorgan (WMF) > <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)> > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

1 0

Re: [Wikitech-l] [Analytics] Monthly page view stats that can now be queried via Pageview API.
by Jonathan Morgan 26 Jan '17

26 Jan '17

Awesome. Thanks Analytics team! - J On Wed, Jan 25, 2017 at 3:19 AM, Thomas Steiner <tomac(a)google.com> wrote: > > The Analytics team would like to announce that the Pageview API is able > to > > return monthly pageview stats as of this week. > > Thanks, Nuria and team, very useful addition to the API. I have > updated pageviews.js accordingly: > https://github.com/tomayac/pageviews.js/commit/ > 643d3f2e2840e06b82b7d007b3611d4702376261. > > Cheers, > Tom > > -- > Dr. Thomas Steiner, Employee (https://blog.tomayac.com, > https://twitter.com/tomayac) > > Google Germany GmbH, ABC-Str. 19, 20354 Hamburg, Germany > Managing Directors: Matthew Scott Sucherman, Paul Terence Manicle > Registration office and registration number: Hamburg, HRB 86891 > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v2.1.17 (GNU/Linux) > > iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck0fjumBl3DChara > CTersAttH3b0ttom.hTtP5://xKcd.c0m/1181/ > -----END PGP SIGNATURE----- > > _______________________________________________ > Analytics mailing list > Analytics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics > -- Jonathan T. Morgan Senior Design Researcher Wikimedia Foundation User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>

1 0

Contribute to Wikimedia Foundation
by Nethmi Pathirana 26 Jan '17

26 Jan '17

Hi, I am Nethmi Pathirana, a 3rd year undergraduate from the Department of Computer Science and Engineering, University of Moratuwa. I am very interested in supporting your vision of sharing the knowledge freely around the world. I would like to support that by contributing to Media wiki as a developer. Can some one guide me on more specifics about contributing to media wiki and where I can find some beginner tasks/issues which I can try. Looking forward to working with you all! Thank you, Best Regards, Nethmi Pathirana

2 1

Handling support libraries that depend on php 5.6 via composer
by Erik Bernhardson 25 Jan '17

25 Jan '17

Within CirrusSearch we are in the progress of updating to use elasticsearch 5.x. This has a few changes to the API, and necessitates a new version of the Elastica support library. Elastica now depends on php 5.6 (but doesn't use any special features, they are simply only supporting non-EOL php versions). This specifically becomes an issue because jenkins tests the mediawiki/vendor repo with 5.5.9, and as such the tests reject any dependency that requires >= 5.6.0. There are a few options for handling this but i wanted to see what other people think: * Fork the library, publish it under wikimedia/elastica, and change the minimum version to 5.5.x This is a bit of a pain, but accomplishes the goal * Fake the platform[1] in mediawiki/vendor composer.json. This is sub-optimal because it applies to everything, not just a single dependency. I could see us accidentally pulling in code that will not meet our requirements. * We could use `--ignore-platform-reqs` on the command line, but this has the same problem as previously * We could hope external developers will answer our pleas for supporting EOL php, but i've emailed the elastica dev and they arn't interested in supporting EOL PHP. Barring other suggestions, I'm probably going to fork and re-publish Elastica via the wikimedia github. [1] https://getcomposer.org/doc/06-config.md#platform

3 3

Creating a broken link
by Victor Porton 25 Jan '17

25 Jan '17

How to create a broken ("edit", "red") link to a page? That is I want to generate a HTML code which displays a link, clicking which leads to the editor (for a page). The link should be red. What is the right way to do this?

4 5

How to clear backlinks cache?
by Victor Porton 25 Jan '17

25 Jan '17

The red/blue status of links with "arrows" produced by my NamespacePopups extension is not updated on my site after I create a new page to which the arrow link points (and so it should change from red to blue). Example of my page with arrows: https://withoutvowels.org/wiki/Tanakh:Genesis_1:7 I think this is because of the backlinks cache. I have 23253 pages in the namespace Tanakh:. Cache of links from every of them should be updated. (It seems that currently the cache contains only old regular links not my new "arrow" links.) Please help me to update all these pages. The thing I really need is to re-process every of these pages with ParserAfterTidy hook. (My hook adds the arrow keys to backlinks cache.) My current workaround is to run maintenance/update.php periodically. This updates the red links to blue as appropriate, but this does not help to make blue links after future edits. Note that I run maintenance/runJobs.php every minute. The software works correctly with these pages which I recently edited, but not with constant non-editable pages in Tanakh: namespace. Note that it all works well if I edit the page with my links. But I cannot edit all pages in Tanakh: namespace both because they are a multitude and because they are non-editable.

3 4

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l January 2017