https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-08-23
*= 2017-08-23 =*
== Callouts ==
* Core patch for range contributions needs more review from MediaWiki
people https://gerrit.wikimedia.org/r/#/c/349457/
* Community Tech would appreciate help unbikeshedding
https://phabricator.wikimedia.org/T152540
* Language: Request for review to services:
https://github.com/wikimedia/restbase/pull/855
* JobQueue constantly increasing https://phabricator.wikimedia.org/T173710
*Anti-Harassment Tools: Blocked by Performance team on
https://phabricator.wikimedia.org/T161059
* Parsing: * Work ongoing to introduce <figure-inline> output in Parsoid
for inline images (https://gerrit.wikimedia.org/r/#/c/370227/;
https://phabricator.wikimedia.org/T118520 ). If any reading / editing
clients have concerns, please leave comments on the patch. But, we'll
consult you all before deploying
== Audiences ==
=== Community Tech ===
==== Community Wishlist ====
* Blocked by:
** https://phabricator.wikimedia.org/T152540 is bogged down in bikeshedding
* Updates:
** Deployed LoginNotify
** Fourth time's the charm for CodeMirror
** Working on ArticleCreationWorkflow
==== Anti-Harassment Tools ====
* Blocked by: Performance team on https://phabricator.wikimedia.org/T161059
* Blocking: Nobody
* Current sprint board: https://phabricator.wikimedia.org/project/view/2931/
=== Readers ===
==== Multimedia ====
* 3d2png changes going out to beta today (Tuesday), should be nearly ready
for a push to testwiki to test out in a production environment
* Team is now ramping up with two new hires (see announcement emails
internally, else welcome Cormac and Ramsey)
* Off-site occurred after Wikimania, much productivity was had.
==== Web ====
* Page previews is deployed everywhere but enwiki and dewiki
* We have setup infrastructure and are ready to run an A/B test on these
wikis.
==== Infrastructure ====
* wrapping up work on MediaWiki side of ReadingLists
* PageContentService: wrapping up HTML endpoints; working on structured
reference lists endpoint
==== Android ====
* *Blocked by:* n/a
* *Blocking:* n/a
* Updates:
** Reading list UI updates promoted to production
** Offline compilations client-side work is nearly complete, only minor
onboarding/branding updates needed –
https://phabricator.wikimedia.org/project/view/2833/
** Work on an offline compilation file generation and storage service is
underway (https://phabricator.wikimedia.org/T172732 )—will not likely block
client-side support for existing ZIMs
** New engineers (Cooltey, Sharvani) started Monday 8/21
** PM search in progress
==== iOS ====
* Blocked by: none
* Blocking: none
* Updates:
** 5.6.0 w/ dark mode, on this day content released (
https://phabricator.wikimedia.org/project/view/2701/ ) , featured under
"Best new app updates" in the App Store
** Working on 5.6.1 with minor bug fixes (
https://phabricator.wikimedia.org/project/view/2898/ )
==== Discovery ====
* Blocked:
* Blocked Up:
* Updates:
** Special:Search AB thumbnail test
** Performance improvements to wikipedia.org portal &
==== Contributors ====
==== Editing ====
* Blocked by:
* Blocking:
* Updates:
==== Parsing ====
** 2/3 team members on vacation next week (1 on vacation this week) .. so,
between Wikimania, Kiwix Hackathon, and hiring, things have been and wil be
a bit slow around here till we get into September.
** Work ongoing to introduce <figure-inline> output in Parsoid for inline
images (https://gerrit.wikimedia.org/r/#/c/370227/ ;
https://phabricator.wikimedia.org/T118520 ). If any reading / editing
clients have concerns, please leave comments on the patch. But, we'll
consult you all before deploying
** Heads up: Similar work ongoing in core (
https://gerrit.wikimedia.org/r/#/c/370206/ and
https://gerrit.wikimedia.org/r/#/c/196532/ ) -- this will be a bit more
involved since gadgets might potentially be affected and will take a longer
time to get deployed.
==== Global Collaboration ====
===== Language =====
* Blocked by:
* Blocking:
* Updates:
** CX-VE work continue.
** Debugging of https://phabricator.wikimedia.org/T173038 and
https://phabricator.wikimedia.org/T173801
- *** Request for review to services:
https://github.com/wikimedia/restbase/pull/855
===== Collaboration =====
* Blocked by:
* Blocking:
* Updates:
** RCFilters: Add title attribute to [x] button (task T173608)
** RCFilters: Add title attribute to highlighted rows (task T173608)
** WLFilters: new 'watchlist activity' filter group (task T171127)
** WLFilters: convert mark as seen button to new style (task T171121)
** Enable RCFilters app on Watchlist (task T171132, task T171218)
** RCFilters: tweak old changes indicator (task T172213)
** RCFilters: Add marker between old and new changes in enhanced mode (task
T163426)
** (Flow) Localize namespaces in ba (task T173719)
** Various bug fixes
==== Contributors Design ====
* Blocked by:
* Blocking:
* Updates:
==== UI Standardization ====
* Updates:
** Major work on aligning remaining arbitrary, historically grown colors to
WikimediaUI color palette
*** MW core
*** Vector
*** MobileFrontend
*** MinervaNeue
*** ContentTranslation (some still pending)
*** Echo
*** VE
*** Flow
** OOUI: v0.22.5 released, among changes:
*** WikimediaUI theme: Align vars to WikimediaUI Base and remove them as
OOjs UI vars
*** WikimediaUI theme: Fix regression on disabled border
*** Accessibility: Add `title` attribute to the 'remove' button in
TagItemWidget (Moriel Schottlender)
* Ongoing:
** Preparation for OOUI v0.23.0
** Align TransparencyReport to WikimediaUI color palette and make it fully
accessible
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
** 1 team member in parental leave, 2 on vacation, fewer things happening
mostly maintenance work
** Identified an optimization to the EL purging script that will hopefully
speed it up more than 30x, will work on that next week
** Added 3 more nodes to the druid cluster
** Webrequest tagging has been deployed. For now, tags: portal and wdqs.
** Discussions around Wikistats2 backend: we plan to add a druid connector
to restbase.
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
* Still investigating db replication lag
* Main CC processor - continuing to update our API integration and audit
file processing
* updating our interrupted-donation-resolver to work generically so we can
use it for PayPal express checkout
* refinements to CiviCRM<->bulk mailer data flows
* CentralNotice clone campaign feature almost ready for CR
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Performance ===
* Blocked by:
* Blocking:
* Updates:
=== Release Engineering ===
* Blocked by: none
* Blocking: T171758 - releng folks are on it.
* Updates:
** Technical Debt: Developing communication campaign to roll out starting
next week
=== Research ===
* Blocked by:
* Blocking:
* Updates:
=== Scoring Platform ===
* Blocked by: RelEng: https://phabricator.wikimedia.org/T171758
* Blocking: None
* Updates:
* Most people are OOO
* Working on moving ORES to the new cluster
* Adding more support for new langauges
=== Search Platform ===
* Blocked by: none
* Blocking: none
* Updates:
** Wikimania + SDC offsite ( +vacations :)
** Continuing work on ML-assisted ranking
** Running A/B test with interleaving search results (
https://phabricator.wikimedia.org/T150032 ), finishing on 24th
** Running human graded relevancy test (
https://phabricator.wikimedia.org/T171740 )
** Working on getting categories into RDF storage (
https://phabricator.wikimedia.org/T157676 )
=== Security ===
* Blocked by: nobody
* Blocking: not aware of anything
* Updates:
* Worked on auditing which tables were replicated to labs, and if data
stored was consistent with privacy policy
* Looking into adjusting the views on WikiReplicas to be more
consistent with MediaWiki core
* Going to do a quick look over CentralnNotice
* Looked at MW pingback
=== Services ===
* Blocked by:
* Blocking:
* Updates:
=== Technical Operations ===
* Blocked by: none
* Blocking: none
* Updates:
** JobQueue constantly increasing https://phabricat
<https://phabricatabusor.wikimedia.org/T173710>abus
<https://phabricatabusor.wikimedia.org/T173710>or.wikimedia.org/T173710
<https://phabricatabusor.wikimedia.org/T173710>
== Wikidata ==
* Blocked by:
* Blocking:
* Updates:
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
Reminder: Technical Advice IRC meeting starting in 30 minutes on
#wikimedia-tech. More infos:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Sorry for cross-posting!
On Wednesday, August 23rd, 2017 at 3 pm UTC, we start with our weekly
Technical Advice IRC Meeting on #wikimedia-tech IRC channel.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting: https://www.mediawiki.org/wiki
/Technical_Advice_IRC_Meeting
This meeting is an offer by WMDE’s tech team. Hosts of the meeting are:
@addshore, @CFisch_WMDE.
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
If you guys had a bitcoin option in your donation form you'd get more
donations (like from me!). I don't have any balance in paypal, but
sending some bitcoin would be easy.
Cross-posting this cool blog post about how the Discovery Analysis team
'puppetized' the dashboard backend and learned a ton in the process:
https://blog.wikimedia.org/2017/08/21/discovery-dashboards-puppet/.
Cheers,
Deb
--
deb tankersley
irc: debt
Product Manager, Discovery
Wikimedia Foundation
---------- Forwarded message ----------
From: Mikhail Popov <mpopov(a)wikimedia.org>
Date: Mon, Aug 21, 2017 at 12:14 PM
Subject: Re: [discovery] Puppetized Discovery Dashboards and Shiny Server
module for Puppet
To: A public mailing list about Wikimedia Search and Discovery projects <
discovery(a)lists.wikimedia.org>
Howdy, Discoverers!
The blog post describing the dashboard Puppetization process just went
up[1]. It explains Puppet and includes tips & resources for learning Puppet
for non-Ops people. If you've been curious about the technology, I
recommend you check out the post.
Cheers,
Mikhail
[1] https://blog.wikimedia.org/2017/08/21/discovery-dashboards-puppet/
On Tue, Jun 20, 2017 at 12:16 PM, Mikhail Popov <mpopov(a)wikimedia.org>
wrote:
> Howdy,
>
> Happy to report that production[1] and development[2] sets of Discovery
> Dashboards are up and running again, this time managed by Puppet. (There
> was a bug with web proxies and DNS settings that delayed this
> announcement.) Theoretically they should be snappier to use now because
> there is no longer an extra virtualization (Vagrant) layer and they are
> running directly on Labs instances.
>
> R is a software and programming language mainly used for statistical
> inference, machine learning, and data wrangling & visualization. RStudio's
> Shiny[3] is a framework for developing web applications in R, and it's what
> Discovery's dashboards are written in.
>
> The Reading::Discovery::Analysis team (with guidance and help from
> Guillaume Lederrey) is proud to announce a new module available in Ops'
> Puppet repo: shiny_server[4], which installs & configures RStudio's Shiny
> Server[5] for serving R/Shiny applications. The module also provides
> resources for installing R packages from CRAN, GitHub, and other remote git
> repositories like Gerrit. For a practical example, refer to Discovery
> Dashboards base[6] and production[7] profiles.
>
> Cheers,
> Mikhail on behalf of Discovery Analysts
>
> [1] https://discovery.wmflabs.org
> [2] https://discovery-beta.wmflabs.org/
> [3] https://shiny.rstudio.com/
> [4] https://github.com/wikimedia/puppet/tree/production/modules/
> shiny_server
> [5] https://www.rstudio.com/products/shiny/shiny-server/
> [6] https://github.com/wikimedia/puppet/blob/production/modules/
> profile/manifests/discovery_dashboards/base.pp
> [7] https://github.com/wikimedia/puppet/blob/production/modules/
> profile/manifests/discovery_dashboards/production.pp
>
_______________________________________________
Discovery mailing list
Discovery(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/discovery
Sorry for cross-posting!
On Wednesday, August 23rd, 2017 at 3 pm UTC, we start with our weekly
Technical Advice IRC Meeting on #wikimedia-tech IRC channel.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting: https://www.mediawiki.org/
wiki/Technical_Advice_IRC_Meeting
This meeting is an offer by WMDE’s tech team. Hosts of the meeting are:
@addshore, @CFisch_WMDE.
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Hi all!
So, Wikimania happened! Yay! It was a busy time, lots of things were discussed
and revived. My appologies for not writing a Radar mail for so long - it's so
hard to concentrate when there is so much going on at the conference. So, here
are the minutes from the last TWO weeks' TechCom meeting.
You can also find the minutes at
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes/2017-0…>
and
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes/2017-0…>.
See also the TechCom activity page on the RFC board
<https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>.
On August 9th, we had our first public TechCom meeting during the Wikimania
Hackathon. Thanks to everyone who participated! Here is what we talked about:
* New RFC: Attribute anonymous contributions to the first IP address used in a
session <https://phabricator.wikimedia.org/T172477>
* Did NOT approve after last call, more discussion needed: HTML5 section ids
<https://phabricator.wikimedia.org/T152540>
* Input wanted: Allow anonymous recent changes to be filtered by IP range
<https://phabricator.wikimedia.org/T172376> (not resourced)
* Media format switching to webm for video (Brion)
* ContentTranslation to use VE, server-side adaptation logic (Roan)
* Progress on raising minimum PHP version for MediaWiki to 5.6/7
<https://phabricator.wikimedia.org/T172165>
* Input wanted: use-cases for delayed job execution
<https://phabricator.wikimedia.org/T172832>
* Active discussion: moving most of MediaWiki within a /core folder
<https://phabricator.wikimedia.org/T167038>
* TechCom to think about QA strategies/guidelines over the coming weeks (code
review, test coverage, etc).
I did not personally attend the Meeting on August 16, since I had an off-site to
attend. Here is what I gathered from the notes:
* LAST CALL for Comments: PostgreSQL schema change for consistency with MySQL
<https://phabricator.wikimedia.org/T164898>. Should no pertinent objections
remain unaddressed by August 30th, this RFC will be approved for implementation.
Please comment on the ticket.
* Discussion (Roan): want to work on filtering edits by “revertedness”. Could
use change tags, maybe.
* Work started on making MediaWiki core PSR4 compatible. Involves renaming every
class in core! <https://phabricator.wikimedia.org/T166010> (Tim)
* Ongoing work on migrating Job Queue to EventBus/Kafka (Gabriel)
* Discussion on how <section> tags may be used in the context of HTML5 section
ID migration (T152540) <https://phabricator.wikimedia.org/T114072> (Timo)
* Active discussion: JSON schema validation:
<https://phabricator.wikimedia.org/T147137>
* Active discussion: load multi-file packages via ResourceLoader
<https://phabricator.wikimedia.org/T133462>
PS: Goats are the new kittens <https://phabricator.wikimedia.org/tag/goatification/>
--
Daniel Kinzler
Principal Platform Engineer
Wikimedia Deutschland
Gesellschaft zur Förderung Freien Wissens e.V.
Hello All,
I'm reaching out to invite you to an ongoing discussion regarding MediaWiki
Technical Debt. The topic of technical debt has been discussed in a number
of forums, and there's even been some work towards reducing it.
This SIG's purpose is to get better alignment on what technical debt is,
how to approach reducing it, and what are things we can do to avoid it
moving forward.
If you'd like to attend, please register here by August 22nd:
https://goo.gl/forms/6sFWuBxfgGfwNUZ93
I'm trying to get a sense of those that are interested in attending and
their timezone. I look to schedule sessions that are timezone friendly.
Thanks and look forward to some good discussion.
Cheers,
JR
Jean-Rene Branaa (irc: jrbranaa)
RelEng Team