https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-01-25
= 2017-01-25 =
== Product ==
=== Reading ===
==== iOS native app ====
* Last Week
** Continued work on 5.4 - Data model for Places, Login enhancements
https://phabricator.wikimedia.org/project/view/2326/
** Investigated issue which caused a spike in pageviews
* This week
** Continue work on 5.4 - UI for Places, API integration for Places
** Release 5.4 Alpha channel with rough version of Places for internal
feedback
====Android====
* Last week:
** Rework a significant portion of the app networking layer
** Trying to wrap up Wikidata description editing for a beta
https://phabricator.wikimedia.org/T155917
** Fixed account creation bug (API 25 only)
** Initial two-factor authentication support coming soon
** Android and iOS translations now exported on regular TranslateWiki
schedule by TWN's L10n-bot \o/
* Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
** Work towards release of Wikidata description editing
** Continue on improved offline experience
** Finish tasking for Q3
====Reading Infrastructure====
* working on TemplateStyles, ORES architecture review
* not blocking
* blocked:
** WMDE on the last API i18n patch before we can move to hard deprecation:
https://gerrit.wikimedia.org/r/#/c/321464/
===== Mobile Content Service (MCS) =====
* Board: https://phabricator.wikimedia.org/project/board/1323/query/open/
* Deployed:
** Fix for page internal links in Android app
https://phabricator.wikimedia.org/T155070
* Working on:
** New endpoint for 'On this day' (aka. Anniversaries).
** Trying to expand TFA/In the news/Anniversaries to more languages in a
more automated fashion
*** Seeing if we can use the FeaturedFeeds extension to find TFA titles
and/or other data we need
====Web====
* Current Sprint: https://phabricator.wikimedia.org/project/board/2426/
* Last week:
** Branding improvements on Mobile Web (notification count this time)
** Deployed Wikidata descriptions on enwiki
* This week:
** More branding work (search bar in tablets)
** Tech debt
** Page Images: Return free images by default
** Page Images documentation improvements
** New Readers prototypes (Hindi language variants)
** Enabling related pages to a subset of users
** Allow using RESTBase for PagePreviews
=== Communtiy Tech ===
* Blockers: None
* Blocked: Nope
* Updates:
** Pushed some patches for LoginNotify extension:
*** https://gerrit.wikimedia.org/r/#/c/333563/ Update a deprecated hook
*** https://gerrit.wikimedia.org/r/#/c/333671/ Some cleanup - removes
EchoBasicFormatter which is no longer used
** Make language-appropriate collations default during install:
https://gerrit.wikimedia.org/r/#/c/327762/
** Make collations have a version number in them:
https://gerrit.wikimedia.org/r/#/c/272419/
** Create new Special:RangeContributions page to support viewing
contributions across an IP range: https://phabricator.wikimedia.org/T145912
** Add support for Task Forces to PageAssessments extension:
https://phabricator.wikimedia.org/T154216
** Add cookie when blocking anonymous users
https://phabricator.wikimedia.org/T152462
** Codesniffer patch: https://gerrit.wikimedia.org/r/#/c/330846/
=== Editing ===
==== UI Standardization ====
* Last week
** UI Standardization offsite with focus on style guide work, see WMF UI
Std Offsite 2017-01 column on
https://phabricator.wikimedia.org/tag/wmf-design/
* This week
** UI Std offsite summary, funnel agreements into tasks and publish early
iteration of new style guide
* Updates
** core/mediawiki.UI: Remove deprecated mediawiki.UI variables from core –
https://phabricator.wikimedia.org/T154950
* Blocked -
* Blocking
** https://phabricator.wikimedia.org/T156164
Outlining path forward on Devise a generic way for theme-agnostic
stylesheets to adapt to the current theme
https://phabricator.wikimedia.org/T112747
feedback from core devs gathered
==== Collaboration ====
* Recent Changes work
** mediawiki.rcfilters: Add the remaining MW core filters
** Create active/inactive behavior for complementary filters
** rcfilters: Remove implemented filters from list of links
** Various bug fixes
** Meeting about ReviewStream. We may change the scope of the project
* Flow security bug fix
* Flow and ORES extension minor fixes
== German Technical Wishlist ==
* soon beginning work on adding "refines" param, in the Cite extension, to
more easily allow referencing different pages, chapters, etc. of a book or
publication https://phabricator.wikimedia.org/T151301
** blocked on some discussions with JamesF in the ticket
* ElectronPDF - need to be able to have alternative css styles for
different view modes (e.g. printable)
https://gerrit.wikimedia.org/r/#/c/333125/
== Wikidata ==
* Preparing deployment of Cognate extension in the next month(s), which
will allow automated interwiki links on Wiktionary
* Also deploying InterwikiSorting extension (soon, before Cognate). This
splits functionality out of Wikibase. Interwiki links will now be sorted in
all namespaces, vs. currently this is only automatically done for some
namespaces.
* working on federation for Wikibase
* currently blocked on Labs not allowing us to setup new MediaWiki
instances using Vagrant/Puppet https://phabricator.wikimedia.org/T155196
** needed to setup test instances for testing improvements to Wikibase
change dispatching, as well as testing structured data wiktionary +
federation
== Technology ==
=== Analytics ===
* Dependencies:
- ** https://phabricator.wikimedia.org/T156287 will need feedback from
community and coordination of that feedback process
- ** https://phabricator.wikimedia.org/T153923 will need feedback from
research
* Blocking:
- ** piwik.wikimedia.org keeps getting periodic errors, we're looking
into it might be a fundamental limitation of piwik:
https://phabricator.wikimedia.org/T154558, for now take the data with a
grain of salt
* Updates:
- ** AQS upgraded to node 6 (pageview API)
- ** monthly granularity available now on pageview API for per-article
stats (thanks GCI students!)
- ** Fundraising banner data and map tile data available in druid/pivot,
come talk to us if you want to slice and dice your dimensional data
- ** ongoing work on extracting mediawiki history data from labs db so
we can be public by default (Joseph + Cloud Services)
- ** ongoing work on Kafka-based RecentChanges (Andrew + Collaboration)
- ** Design of Wikistats 2.0 UI is nearing a community consultation
phase. Ping for community liasons and communication, coordinating on task
https://phabricator.wikimedia.org/T156287
=== Services ===
* Blockers: none
* Updates:
** Node 6 upgrade to all services
*** Great improvements in heap usage
**** RESTBase: https://phabricator.wikimedia.org/F5357383
**** Change-Prop: https://phabricator.wikimedia.org/F5357386
*** Kartotherian is still on hold with node 6
** Wrapping up work for supporting revision parameter in mobile
endpoints
=== Technical Operations ===
* '''Blocking''':
** None
* '''Blocked''':
** by no-one
* '''Updates''':
** Hardware problems with networking equipment. S1 master is a leaf of it,
various minor incidents https://phabricator.wikimedia.org/T155875
** Some labs home directories problems, mostly fixed
** Data center switchover prepartion goal ongoing
https://phabricator.wikimedia.org/T154658
** Asia DC work started, still on early stages
=== Discovery ===
* No blockers
* Finished writing up, summarizing, and recommending extensive changes to
TextCat (language detection):
https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/TextCat_Improvements…
Most of these implemented in TextCat code and will be deployed soon.
* Designing framework to perform multiple secondary searches, need input
for API from API consumers (will set up meeting with mobile team).
https://phabricator.wikimedia.org/T156019
* Working on ES 5 upgrade
* Working on improving wikidata search
=== Fundraising Tech ===
* Testing new PayPal integration
* Adding a method to clear CentralNotice cache for a banner:
https://phabricator.wikimedia.org/T154954
* Preventing unintended duplicate donations
* Renewing PCI compliance doc
* Sanitizing error alert mail
=== Release Engineering ===
* '''Bocked'''
** None
* '''Blocking'''
** None
* '''Updates'''
** scap 3.5 planned for this week, includes major improvements to rollback
=== Security ===
* Security Reviews
** Internal File Server configuration and access
** Popups extension library
** sec.Watch Wizard (ad-hoc)
Thanks Analytics Team for this really good news! A lot of reporting tools will benefit.
Erik Zachte
-----Original Message-----
From: Analytics [mailto:analytics-bounces@lists.wikimedia.org] On Behalf Of Wes Moran
Sent: Wednesday, January 25, 2017 18:41
To: A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics.
Subject: Re: [Analytics] [Wikitech-l] Monthly page view stats that can now be queried via Pageview API.
Nice addition and work. Very useful indeed.
> On Jan 25, 2017, at 11:43 AM, Jonathan Morgan <jmorgan(a)wikimedia.org> wrote:
>
> Awesome. Thanks Analytics team!
>
> - J
>
> On Wed, Jan 25, 2017 at 3:19 AM, Thomas Steiner <tomac(a)google.com> wrote:
>
>>> The Analytics team would like to announce that the Pageview API is
>>> able
>> to
>>> return monthly pageview stats as of this week.
>>
>> Thanks, Nuria and team, very useful addition to the API. I have
>> updated pageviews.js accordingly:
>> https://github.com/tomayac/pageviews.js/commit/
>> 643d3f2e2840e06b82b7d007b3611d4702376261.
>>
>> Cheers,
>> Tom
>>
>> --
>> Dr. Thomas Steiner, Employee (https://blog.tomayac.com,
>> https://twitter.com/tomayac)
>>
>> Google Germany GmbH, ABC-Str. 19, 20354 Hamburg, Germany Managing
>> Directors: Matthew Scott Sucherman, Paul Terence Manicle Registration
>> office and registration number: Hamburg, HRB 86891
>>
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v2.1.17 (GNU/Linux)
>>
>> iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck0fjumBl3DChara
>> CTersAttH3b0ttom.hTtP5://xKcd.c0m/1181/
>> -----END PGP SIGNATURE-----
>>
>> _______________________________________________
>> Analytics mailing list
>> Analytics(a)lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/analytics
>>
>
>
>
> --
> Jonathan T. Morgan
> Senior Design Researcher
> Wikimedia Foundation
> User:Jmorgan (WMF)
> <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l(a)lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Analytics mailing list
Analytics(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics
Awesome. Thanks Analytics team!
- J
On Wed, Jan 25, 2017 at 3:19 AM, Thomas Steiner <tomac(a)google.com> wrote:
> > The Analytics team would like to announce that the Pageview API is able
> to
> > return monthly pageview stats as of this week.
>
> Thanks, Nuria and team, very useful addition to the API. I have
> updated pageviews.js accordingly:
> https://github.com/tomayac/pageviews.js/commit/
> 643d3f2e2840e06b82b7d007b3611d4702376261.
>
> Cheers,
> Tom
>
> --
> Dr. Thomas Steiner, Employee (https://blog.tomayac.com,
> https://twitter.com/tomayac)
>
> Google Germany GmbH, ABC-Str. 19, 20354 Hamburg, Germany
> Managing Directors: Matthew Scott Sucherman, Paul Terence Manicle
> Registration office and registration number: Hamburg, HRB 86891
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2.1.17 (GNU/Linux)
>
> iFy0uwAntT0bE3xtRa5AfeCheCkthAtTh3reSabiGbl0ck0fjumBl3DChara
> CTersAttH3b0ttom.hTtP5://xKcd.c0m/1181/
> -----END PGP SIGNATURE-----
>
> _______________________________________________
> Analytics mailing list
> Analytics(a)lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/analytics
>
--
Jonathan T. Morgan
Senior Design Researcher
Wikimedia Foundation
User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
Hi,
I am Nethmi Pathirana, a 3rd year undergraduate from the Department of
Computer Science and Engineering, University of Moratuwa.
I am very interested in supporting your vision of sharing the knowledge
freely around the world. I would like to support that by contributing to
Media wiki as a developer. Can some one guide me on more specifics about
contributing to media wiki and where I can find some beginner tasks/issues
which I can try.
Looking forward to working with you all!
Thank you,
Best Regards,
Nethmi Pathirana
Within CirrusSearch we are in the progress of updating to use elasticsearch
5.x. This has a few changes to the API, and necessitates a new version of
the Elastica support library. Elastica now depends on php 5.6 (but doesn't
use any special features, they are simply only supporting non-EOL php
versions). This specifically becomes an issue because jenkins tests the
mediawiki/vendor repo with 5.5.9, and as such the tests reject any
dependency that requires >= 5.6.0.
There are a few options for handling this but i wanted to see what other
people think:
* Fork the library, publish it under wikimedia/elastica, and change the
minimum version to 5.5.x This is a bit of a pain, but accomplishes the goal
* Fake the platform[1] in mediawiki/vendor composer.json. This is
sub-optimal because it applies to everything, not just a single dependency.
I could see us accidentally pulling in code that will not meet our
requirements.
* We could use `--ignore-platform-reqs` on the command line, but this has
the same problem as previously
* We could hope external developers will answer our pleas for supporting
EOL php, but i've emailed the elastica dev and they arn't interested in
supporting EOL PHP.
Barring other suggestions, I'm probably going to fork and re-publish
Elastica via the wikimedia github.
[1] https://getcomposer.org/doc/06-config.md#platform
How to create a broken ("edit", "red") link to a page?
That is I want to generate a HTML code which displays a link, clicking
which leads to the editor (for a page). The link should be red.
What is the right way to do this?
The red/blue status of links with "arrows" produced by my
NamespacePopups extension is not updated on my site after I create a
new page to which the arrow link points (and so it should change from
red to blue).
Example of my page with arrows:
https://withoutvowels.org/wiki/Tanakh:Genesis_1:7
I think this is because of the backlinks cache.
I have 23253 pages in the namespace Tanakh:. Cache of links from every
of them should be updated. (It seems that currently the cache contains
only old regular links not my new "arrow" links.)
Please help me to update all these pages. The thing I really need is to
re-process every of these pages with ParserAfterTidy hook. (My hook
adds the arrow keys to backlinks cache.)
My current workaround is to run maintenance/update.php periodically.
This updates the red links to blue as appropriate, but this does not
help to make blue links after future edits.
Note that I run maintenance/runJobs.php every minute. The software
works correctly with these pages which I recently edited, but not with
constant non-editable pages in Tanakh: namespace.
Note that it all works well if I edit the page with my links. But I
cannot edit all pages in Tanakh: namespace both because they are a
multitude and because they are non-editable.
Hi.
I filed a request for comments (RFC) regarding accessing page properties
from wiki pages.
* Maniphest task: https://phabricator.wikimedia.org/T154738
* Wiki page: https://www.mediawiki.org/wiki/?curid=647378
There is an IRC meeting scheduled to discuss this RFC on Wednesday,
January 25, 2017 at 22:00 UTC (2 p.m. PST, 5 p.m. EST, 11 p.m. CET) in
#wikimedia-office on chat.freenode.net. All are welcome!
MZMcBride
Hi all,
In the process of the previous security release, T124940 was fixed in
core MediaWiki (it deals with unacceptably long shell inputs). There was
also a related fix in Math that I just noticed had never been released--even
thought it was disclosed (with a patch) on the task in question.
It's been published to https://gerrit.wikimedia.org/r/#/c/333309/ (for
master)
and is being backported to all supported branches (1.28.x, 1.27.x, 1.23.x)
This isn't an extension we bundle in core MW which explains the oversight.
-Chad
Hello volunteer developers & technical contributors!
The Wikimedia Foundation is asking for your feedback in a survey. We want
to know how well we are supporting your contributions on and off wiki, and
how we can change or improve things in the future.[1] The opinions you
share will directly affect the current and future work of the Wikimedia
Foundation. To say thank you for your time, we are giving away 20 Wikimedia
T-shirts to randomly selected people who take the survey.[2] The survey is
available in various languages and will take between 20 and 40 minutes.
Use this link to take the survey now:
https://wikimedia.qualtrics.com/SE/?SID=SV_6mTVlPf6O06r3mt&Aud=DEV&Src=DEV
You can find more information about this project here[3]. This survey is
hosted by a third-party service and governed by this privacy statement[4].
Please visit our frequently asked questions page to find more information
about this survey[5]. If you need additional help or have questions about
this survey, send an email to surveys(a)wikimedia.org.
Thank you!
Edward Galvez
Survey Specialist, Community Engagement
Wikimedia Foundation
[1] This survey is primarily meant to get feedback on the Wikimedia
Foundation's current work, not long-term strategy.
[2]Legal stuff: No purchase necessary. Must be the age of majority to
participate. Sponsored by the Wikimedia Foundation located at 149 New
Montgomery, San Francisco, CA, USA, 94105. Ends January 31, 2017. Void
where prohibited. Click here for contest rules.
[3] About this survey:
https://meta.wikimedia.org/wiki/Community_Engagement_
Insights/About_CE_Insights
[4] Privacy statement: https://wikimediafoundation.
org/wiki/Community_Engagement_Insights_2016_Survey_Privacy_Statement
[5] FAQ:
https://meta.wikimedia.org/wiki/Community_Engagement_
Insights/Frequently_asked_questions