Wikitech-l February 2016

wikitech-l@lists.wikimedia.org

103 participants
107 discussions

2015-02-10 Scrum of Scrums notes
by Grace Gellerman 10 Feb '16

10 Feb '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-02-10 = 2015-02-10 = == Technology == === Analytics === * '''*Blocking'''*: Nobody we know of * '''*Blocked'''*: By nothing we're aware of * '''*Updates*'''*:* - ** organizing work to replace limn dashboards with dashiki - ** wikimetrics program global metrics deployed - ** moved wikimetrics from vagrant to docker-compose and it was a pleasant experience - ** working on cleaning up / organizing analytics files on dumps.wikimedia.org/other - ** estimating uniques with last access cookies is in the final stages of being productionized - ** Joseph's sanitization of pageview data (for long term retention and privacy) is up for review by halfak and anyone else interested === Architecture === * '''*Blocking'''*: ??? * '''*Blocked'''*: ??? * '''*Updates*'''*:* ** ??? === Performance === * '''*Blocking'''*: ??? * '''*Blocked'''*: ??? * '''*Updates*'''*:* ** ??? === Release Engineering === * '''*Blocking'''*: ** https://phabricator.wikimedia.org/T125003 - move CI slaves in Beta to Jessie and Node 4.2 * '''*Blocked'''*: none * '''*Updates*'''*:* ** Train deploy rolling out wmf.13 this week ** CI had some trouble due to lack of precise executioners on Monday, should be fixed now ** Lots of scap changes in puppet getting lined up: provider, scap::target, service::node === Research === * '''*Blocking'''*: * '''*Blocked'''*: * '''*Updates*'''*:* ** Reader survey will go out (most probably, if all the technical components work smoothly) as part of the deployment train tomorrow (Thursday) *** Working with the mobile web team *** Survey will run for a week in enwiki, using QuickSurveys and we expect to collect between 200-500K responses *** Sampling rates will be finalized today *** Documentation: https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Be… === Security === * '''*Blocking'''*: ** Maps: Security review for PHP schema composer module - https://gerrit.wikimedia.org/r/#/c/269325/ ** Graphs: Security review for SVG sanitization - https://github.com/cure53/DOMPurify * '''*Blocked'''*: Waiting to see how SessionManger goes before we deploy a bunch of patches * '''*Updates*'''*:* ** 2FA for Keystone done, working on Horizon integration next === Services === * '''*Blocking'''*: ??? * '''*Blocked'''*: ** https://phabricator.wikimedia.org/T125003 - move CI slaves in Beta to Jessie and Node 4.2 ** https://phabricator.wikimedia.org/T107307 - move CXServer to SCB ** https://phabricator.wikimedia.org/T107306 - Apertium pkgs for Jessie * '''*Updates*'''*:* ** separated out the framework part of RESTBase into https://github.com/wikimedia/hyperswitch ** Testing Brotli compression for Cassandra in staging, seeing OOMs ** restbase1007 bootstrapping *** rb1001 and rb1002 might run out of disk space because of it ** separate AQS off of RESTBase - https://phabricator.wikimedia.org/T126294 === Technical Operations === * '''*Blocking'''*: ORES * '''*Blocked'''*: none known * '''*Updates*'''*:* ** OTRS upgrade to 5.0.6 ** MultiDC work ongoing with the rest of Technology == Product == === Community Tech === * '''*Blocking'''*: none * '''*Blocked'''*: none * '''*Updates*'''*:* ** Continuing work on Gadgets 2.0 after recieving further feedback ** Continuing work on PageAssessments extension === Discovery === * '''*Blocking'''*: none * '''*Blocked'''*: ** Maps: Security review for PHP schema composer module - https://gerrit.wikimedia.org/r/#/c/269325/ ** Graphs: Security review for SVG sanitization - https://github.com/cure53/DOMPurify * '''*Updates*'''*:* ** Completion suggester changes done, probably not deployed yet due to SessionManager things ** Tuning suggester & morelike performance ** TextCat language detection merged, will work on making A/B test with it next ** Working on next year plans/budgets ** WDQS Blazegraph 2.0 update rolled back due to serious bug, investigating the bug ** Maps: blocked on security to deploy Kartographer extension ** Graphs: disabled http / https protocols, use custom protocols now ** Data: begining data storage planning (Yuri will add task # here :) === Editing === ==== Collaboration ==== * '''*Blocking'''*: ** Dry run patch for external store migration is merged. Now we need to set External Store up on Beta, then test the dry run patch there: https://phabricator.wikimedia.org/T119567 * '''*Blocked'''*: ** Flow dump generation on dumps.wikimedia.org: https://phabricator.wikimedia.org/T119511 * '''*Updates*'''*:* ** Human-readable name patch is almost done: https://phabricator.wikimedia.org/T121936 ** Cross-wiki notifications will soon be rolled out to "real" wikis (currently in production it is only on test and test2): *** 'testwikidatawiki' *** 'wikidatawiki' *** 'mediawikiwiki' *** 'commonswiki' *** 'hewiki' *** 'hewikibooks' *** 'hewikinews' *** 'hewikiquote' *** 'hewikisource' *** 'hewikivoyage' *** 'hewiktionary' *** 'frwiki' *** 'frwikibooks' *** 'frwikinews' *** 'frwikiquote' *** 'frwikisource' *** 'frwikiversity' *** 'frwikivoyage' *** 'frwiktionary' ==== Language ==== * '''*Blocking'''*: ** I have got some pings outside SoS, but don't know if those are blocking ** Packages for Jessie requested to speed up * '''*Blocked'''*: nope * '''*Updates*'''*:* ** ==== Multimedia ==== * '''*Blocking'''*: Not that I know of. * '''*Blocked'''*: *Metrics work* currently paused pending some burning questions for *halfak*, MarkTraceur to sit down with him this week. *Look out, Security*, we're hoping to get security review on a *new extension* (see below) in the next few months. * '''*Updates*'''*:* ** Labs instance with *ImageTweaks* (name WIP) going up today, *email to (wikitech|commons|multimedia)-l* later tonight ** Some work on *NewFiles*, in particular *filtering by tag*, but it's not going super. MatmaRex wanted some extra eyes on it, but I think he's contacted someone already. ==== Parsing ==== * '''*Blocking'''*: ??? * '''*Blocked'''*: ??? * '''*Updates*'''*:* ** The templatedata-based serialization patch ( https://gerrit.wikimedia.org/r/#/c/264043/ ) didn't go out this week after all -- yet to be reviewed. Possible it will get reviewed this week. ** Parsoid testing services (parsoid rt-testing; parsoid <--> php-parser html visual diff testing) fully puppetized and operational on ruthenium. Work ongoing to enable visual diff testing between production mediawiki and a non-production mediawiki (to test for example changes to parsing) using labs hardware ( https://phabricator.wikimedia.org/T120345 ). *** Would appreciate help from anyone familiar with hiera (to configure labs hardware to use existing puppet roles, and making any additional tweaks). ** This week, Arlo will start Parsoid-side work to separate out data-mw into its own RESTBase bucket -- deployment is still some ways away. We need to finalize REST API versioning policy ( https://phabricator.wikimedia.org/T124365 ) and also have all the various Parsoid clients updated. We will create phab tickets for dependent projects once T124365 is resolved. *** Last week, Flow, Services, and us had a meeting and figured out a strategy for Flow since they use VE, but also talk with Parsoid (and not RESTBase). ** Parsoid native implementation for <gallery> is underway (heads up: CX, VE, Flow, Reading) *** https://phabricator.wikimedia.org/P2506 is the spec for Parsoid's output if you want to provide feedback *** https://gerrit.wikimedia.org/r/#/c/264026/ is the WIP patch ** Tim working to collect source location information in the PHP preprocessor for errors / warnings and a way to expose them. Useful in general, but, also specifically in the context of work related to replacying Tidy. ==== VisualEditor ==== * '''*Blocking'''*: ??? * '''*Blocked'''*: ??? * '''*Updates*'''*:* ** ??? === Fundraising Tech === No blockers, most work is continued from last week * updates for new CiviCRM financial tracking * fixes and enhancements for backup credit card processor * prep for Latin America fundraising expansion * debugging email clickthrough tracking === Reading === ==== Android ==== * Updates: beta v2.1.140 released but will not be promoted due Wikipedia Zero incompatibilities. v2.1.141 coming soon. * Blocked: the options API was not designed for storing collection-like data. Gather collections don't support inter-wiki pages. ==== Reading Infrastructure ==== * SessionManager is coming back this week. Please let Brad, Bryan, and Gergő know if you spot any problems. Preferably before Friday afternoon.

1 0

MediaWiki core master now requires 5.5.9+ and other CI changes
by Legoktm 10 Feb '16

10 Feb '16

Hi, <https://gerrit.wikimedia.org/r/266931> has been merged, so MediaWiki core now requires PHP 5.5.9 or higher to run. We had to make some (read: a lot) of CI changes for that to happen, here's a quick summary: * php53 jobs are only triggered for REL1_2[3-6] branches * php55 jobs are only triggered for branches that are not REL1_2[3-6] * All extensions that previously had php53 tests now run them under both hhvm and php55 * composer related jobs were renamed to standardize with other CI jobs Since this is a large change for extensions, I went ahead and ran jobs for all extensions that have unittests, and collected the results: <https://www.mediawiki.org/wiki/User:Legoktm/PHP_5.5/Extensions>. Please take a look to see if your extension(s) are failing, and fix or file bugs as needed! Some of the failures aren't even related to HHVM/PHP5.5, the repos have just been broken. And if you run into any CI related issues, please file a bug in the #CI-Config Phab project! -- Legoktm

4 3

Today's RFC meeting on IRC: Per-language URLs for multilingual wiki pages
by Daniel Kinzler 10 Feb '16

10 Feb '16

In today's RFC meeting, we will discuss the following RFC: * Per-language URLs for multilingual wiki pages <https://phabricator.wikimedia.org/T114662> <https://phabricator.wikimedia.org/E140> The meeting will be on the IRC channel #wikimedia-office on chat.freenode.net at the following time: * UTC: Wednesday 22:00 * US PST: Wednesday 14:00 * Europe CET: Wednesday 23:00 * Australia AEDT: Thursday 09:00 -- Daniel Kinzler _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

1 0

Please welcome Chris Koerner to the Wikimedia Foundation
by Quim Gil 10 Feb '16

10 Feb '16

I am pleased to announce that Chris Koerner has joined the Wikimedia Foundation as Community Liaison on the Technical Collaboration team <https://meta.wikimedia.org/wiki/Technical_Collaboration>. His main responsibility is to support community engagement activities for projects led by the Discovery team <https://www.mediawiki.org/wiki/Wikimedia_Discovery>. https://meta.wikimedia.org/wiki/User:CKoerner_(WMF) Chris started his approach to the Wikimedia movement as administrator of a third party MediaWiki’s. He will be working remotely from Saint Louis, MO (USA). Here is an introduction in his own words: "I've been a MediaWiki fan since 2011, having used it inside a large healthcare organization to share knowledge among co-workers. From there I fell into the the larger Wikimedia rabbit hole and haven't looked back. I'm active in the MediaWiki Stakeholders' Group <https://www.mediawiki.org/wiki/MediaWiki_Stakeholders%27_Group>, a user group of third-party MediaWiki administrators, developers, and users who advocate for using MediaWiki. I also edit from time to time on the English Wikipedia. I've always loved technology and people. There's nothing like the feeling of sitting next to someone as they discover how they can use a bit of technology to solve a need. I've worked in desktop support, web development, marketing, and healthcare IT throughout my career. All along the way I've valued communication and transparency and love to encourage others to get involved. I'm an enthusiast photographer, a person who enjoys board and video games, and a total nerd who rides a motorcycle. Meaning, the bike looks cool, but not me." Please join me in welcoming Chris! -- Quim Gil Engineering Community Manager @ Wikimedia Foundation http://www.mediawiki.org/wiki/User:Qgil

3 2

Scheduled database maintenance (9 Feb)
by Jaime Crespo 10 Feb '16

10 Feb '16

Between 23:00 and 23:59 UTC, February 9th 2016 there is a scheduled maintenance window that will affect some of the wikis hosted by the Wikimedia Foundation. The maintenance is needed in order to perform necessary hardware, operating system and database upgrades. During the upgrade, content on affected wikis will be available at all times, but edits may fail during approximately 5 minutes within that schedule (these wikis will be in "read only mode"). The following wikis will be affected: bg.wikipedia.org bg.wiktionary.org cs.wikipedia.org en.wikiquote.org en.wiktionary.org eo.wikipedia.org fi.wikipedia.org id.wikipedia.org it.wikipedia.org nl.wikipedia.org no.wikipedia.org pl.wikipedia.org pt.wikipedia.org sv.wikipedia.org th.wikipedia.org tr.wikipedia.org zh.wikipedia.org All other wikis will *not* be affected by this maintenance. I apologize in advance for this disruption and will try to minimize the duration of the maintenance work. I will update <https://wikitech.wikimedia.org/wiki/Planned_Maintenance-February_9_2016> after the maintenance has finished. -- Jaime Crespo <http://wikimedia.org>

1 1

FOSDEM presentation (Converting LQT to Flow)
by Matthew Flaschen 09 Feb '16

09 Feb '16

I've uploaded my slides for my FOSDEM 2016 presentation (Converting LiquidThreads to Flow: Or, how I learned to stop worrying and love the batch) to Commons: https://commons.wikimedia.org/wiki/File:Converting_LQT_to_Flow_FOSDEM_2016.… Matt Flaschen

4 5

Re: [Wikitech-l] Splitting out GUI repo for WDQS
by Stas Malyshev 09 Feb '16

09 Feb '16

Hi! OK, GUI files moved to wikidata/query/gui and patches now have to be submitted against it. I imagine it will also be easier to set up testing there given that it's no longer dragging unrelated Java module around. Please tell me if anything doesn't work. Thanks, -- Stas Malyshev smalyshev(a)wikimedia.org

1 0

mediawiki +2 for Jan Zerebecki
by Jan Zerebecki 09 Feb '16

09 Feb '16

As is unwritten custom, I announce here on behalf of the Gerrit Administrators that per https://phabricator.wikimedia.org/T116506 Antoine "hashar" Musso gave Jan Zerebecki membership in the gerrit wikimedia group. Thx hashar. -- Regards, Jan Zerebecki

2 1

2017 Wikimedia Hackathon: Looking for Proposals
by Rachel Farrand 08 Feb '16

08 Feb '16

Hello! Is your organization interested in hosting and co-organizing the 2017 Wikimedia Hackathon? We are looking for proposals! There is a whole lot of new information available about hackathons, if you see anything missing or that needs to be clarified let me know. Specific to the 2017 Hackathon: https://www.mediawiki.org/wiki/Hackathons/2017_Decision_Process https://www.mediawiki.org/wiki/Hackathons#Hackathon_location_decision_proce… All Hackathons: https://www.mediawiki.org/wiki/Hackathons https://www.mediawiki.org/wiki/Hackathon_101 https://www.mediawiki.org/wiki/Hackathons/Hackathon_tips_for_organizers This year’s Wikimedia Hackathon 2016 <https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2016> will be held in Jerusalem in April. Ideally we will announce the host for 2017 before March 14th, 2016. If multiple chapters or organizations are interested, we hope to work together to figure out the the best solution. Any organizations interested in hosting should please create a Phabricator ticket and associate it with the Developer-Relations project. Example: https://phabricator.wikimedia.org/T96826 Please include as much information as possible from: proposing a hackathon <https://www.mediawiki.org/wiki/Hackathons/Proposing_a_hackathon> Please email me at rfarrand(a)wikimedia.org with any questions or concerns. I am not on the chapters@ list, so if there are any responses there please remember to keep me on CC. Looking forward to hearing from you!

1 0

Tech Talk: A Hands-on Estimation Exercise, With Discussion: Feb 8th
by Rachel Farrand 08 Feb '16

08 Feb '16

Please join for the following tech talk: *Tech Talk**:* A Hands-on Estimation Exercise, With Discussion *Presenter:* Joel Aufrecht *Date:* February 8th, 2016 *Time: *18:30 UTC <http://www.timeanddate.com/worldclock/fixedtime.html?msg=Tech+Talk%3A+A+Han…> Link to live YouTube stream <http://www.youtube.com/watch?v=b-zLwTez46M> *IRC channel for questions/discussion:* #wikimedia-office *Summary: *Estimation is an unnatural activity for human brains, which tend to hide our own ignorance from us. This brown-bag begins with an exercise, adapted from Steve McConnell's software estimation training, in balancing accuracy with precision. The exercise is fully available to remotees. Facilitated discussion follows, on what we can learn from the exercise and on general estimation and forecasting topics as raised.

2 2

← Newer
1
...
5
6
7
8
9
10
11
Older →

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l February 2016