Wikitech-l May 2016

wikitech-l@lists.wikimedia.org

113 participants
123 discussions

MediaWiki-Codesniffer 0.7.1 released
by Legoktm 07 May '16

07 May '16

Hello! MediaWiki-Codesniffer 0.7.1 is now available for use in your MediaWiki extensions and other projects. 0.7.0 was a botched release that had bugs, please don't use it. Here are the notable changes since the last release (0.6.0): * Also check for space after elseif in SpaceAfterControlStructureSniff (Lethexie) * Factor our tokenIsNamespaced method (addshore) * Make IfElseStructureSniff can detect and fix multiple white spaces after else (Lethexie) * Make SpaceyParenthesisSniff can fix multiple white spaces between parentheses (Lethexie) * Make spacey parenthesis sniff work with short array syntax (Kunal Mehta) * Speed up PrefixedGlobalFunctionsSniff (addshore) * Update squizlabs/php_codesniffer to 2.6.0 (Paladox) Thanks to some awesome work by Addshore, MW-CS is now twice as fast for large repos like mediawiki/core! This release also features contributions from GSoC student Lethexie who will be working on improving our static analysis tools this summer! -- Legoktm

1 0

2016-05-04 Scrum of Scrums meeting notes
by Grace Gellerman 06 May '16

06 May '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04 = 2016-05-04 = == Technology == === Release Engineering === For all: * T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs ** The migration of browsertests* to selenium* is almost complete, however, Željko needs people to claim their failing browser tests. See the task for more information. *** The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)? For operations: * T126594 - Disable HHVM fcgi server on CI slaves * Need help from ops to review and merge these two patches (we dont need HHVM running as a daemon on CI boxes): ** https://gerrit.wikimedia.org/r/#/c/269946/ ** https://gerrit.wikimedia.org/r/#/c/269947/ * https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool instances (contintcloud tenant) ** More instances needed. Clarified with Chase last week: pending Andrew. No urgency. * Two related tasks, each have patches that are needed to streamline the scap3 migration: ** T133211 - Automate the generation deployment keys (keyholder-managed ssh keys) *** https://gerrit.wikimedia.org/r/#/c/284418/ ** T132747 - scap::target shouldn't allow users to redefine the user's key *** https://gerrit.wikimedia.org/r/#/c/285519/ === Security === * Reviews: ** json-schema done, AuthManger done (no more comments, a few minor things before all patches are +1'ed) ** Starting on T129584 this week * Starting work on AuthService next week (heads up to Services, we'll probably be scheduling a few meetings with you) (Marko: ack && yay!) * Ops: ping again on T128819 === Services === (Marko cannot attend today, sorry) * RESTBase ** working on storing all auth checks locally (now we are calling the MW API every time) * EventBus / Change propagation ** started using it in production for the summary endpoint today ** more dependency updates to follow soon * Cassandra move to 2.2.6 soon ** first up: maps cluster * use Scap3 - https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html === Technical Operations * '''Blocking''': ** none * '''Blocked''': ** none * '''Updates''': ** May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully deployed till then ** started using letsencrypt for various small services == Product == === Reading === * Most of Reading engineering is at an offsite today, I believe. ==== Reading Infrastructure ==== * AuthManager core patches are just waiting for security +1s. Work is ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could use reviews if anyone is interested. === Editing === ==== Collaboration ==== * '''Blocking''': ** External store work. External Store deployed everywhere on Beta with no complications. Work on this continues. We now need to set up a second External Store on Beta for Flow, to test the migration. * '''Blocked''': ** Work on Flow dumps continuing on the ops side. https://phabricator.wikimedia.org/T119511 and https://phabricator.wikimedia.org/T89398 . * '''Updates''': ** Continuing notification work on: *** Cross-wiki notifications coming by default on May 12th! *** Echo email formatter *** Work continues on the new Echo MVC architecture ==== Parsing ==== * We got our first visual diff test run comparing Tidy with HTML5depurate. Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this as the basis for figuring out what things might break if we replace Tidy today and what needs fixing and where. * Scott has been working with Ops to get OCG kinks ironed out. ==== Language ==== * '''Blocking''': ** Apertium->Jessie. Yet to finalize plan and proceed. * '''Blocked''': * '''Updates''': ** cxserver service will be migrated to scap3 deployment soon. ** Translate (twn, meta,..) now using Apertium MT from cxserver. == Discovery == * '''Blocking''': none * '''Blocked''': none * Preparing for ElasticSearch 2.0 migration * Results for A/B test on portal language link location published: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_D… * TextCat A/B test launching soon * Portal A/B test adding descriptions to project links to start this week * WDQS redeployed, some performance issues * Graphs have ability to use WDQS directly now * Team offsite in 2 weeks (17-21) ==Analytics == *Scaling of pageview API , more work than anticipated *Working new domain analytics.wikimedia.org, wikistats 2.0 migration, meeting with research to map early states of project *Still trouble with jenkins * == Fundraising Tech == * coding new PayPal integration * pulling in lots of CiviCRM upstream changes * making CentralNotice fail gracefully in odd cache edge cases * Casey hanging out with reading offsite * more work towards replacing ActiveMQ

5 6

garbage characters show up when fetching wikimedia api
by Trung Dinh 06 May '16

06 May '16

Hi all, I have an issue why trying to parse data fetched from wikipedia api. This is the piece of code that I am using: api_url = 'http://en.wikipedia.org/w/api.php<http://en.wikipedia.org/w/api.php?action=query&list=recentchanges&rclimit=5…>' api_params = 'action=query&list=recentchanges&rclimit=5000&rctype=edit&rcnamespace=0&rcdir=newer&format=json&rcstart=20160504022715<http://en.wikipedia.org/w/api.php?action=query&list=recentchanges&rclimit=5…>' f = urllib2.Request(api_url, api_params) print ('requesting ' + api_url + '?' + api_params) source = urllib2.urlopen(f, None, 300).read() source = json.loads(source) json.loads(source) raised the following exception " Expecting , delimiter: line 1 column 817105 (char 817104" I tried to use source.encode('utf-8') and some other encodings but they all didn't help. Do we have any workaround for that issue ? Thanks :)

3 2

Fall 2015 Tool Labs user survey data published
by Bryan Davis 06 May '16

06 May '16

[0]: https://meta.wikimedia.org/wiki/Research:Annual_Tool_Labs_Survey -- Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> [[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA irc: bd808 v:415.839.6885 x6855

2 4

load.php will now enforce the "no sessions" constraint
by Brad Jorsch (Anomie) 05 May '16

05 May '16

It has long been the case that the load.php entry point, to support more aggressive caching, should not depend on details of the current session. For example, it should not access the session user, and should use its own 'lang' parameter for i18n messages rather than the session user's language. After a fair bit of work[1] by Gergő Tisza, Timo Tijhof, Bryan Davis, and myself, we have now flipped the switch to make attempted session access fail with an exception when serving load.php. This will go out to Wikimedia wikis with 1.28.0-wmf.1 next week.[2] We've had this in logging mode for a while and haven't seen any log messages in production recently, so we anticipate that this change won't cause any issues for Wikimedia wikis. Third-party wikis may have to update their extensions. If there are problems, they'll manifest as missing CSS or JavaScript in the page, and when examining the load.php output there will be a comment at the top reporting that a BadMethodCallException was caught. The logged exception's message will be "Sessions are disabled for this entry point". [1]: See https://phabricator.wikimedia.org/T127233 and its subtasks. [2]: See https://www.mediawiki.org/wiki/MediaWiki_1.28/Roadmap for the schedule. -- Brad Jorsch (Anomie) Senior Software Engineer Wikimedia Foundation

1 0

"Troubleshooting Git/Gerrit/git-review" docs: Help welcome.
by Andre Klapper 05 May '16

05 May '16

Hej, I went ahead & centralized the 5 git/Gerrit/git-review troubleshooting sections that I've found so far on random mediawiki.org pages into one single page (and eliminated duplicates with different solutions): https://www.mediawiki.org/wiki/Gerrit/Troubleshooting 1) More help is welcome to clean up and structure that page (plain git vs. git-review vs. Gerrit UI). 2) As a user, I prefer section headings to describe problems instead of solutions (as I don't know which solution is related to my problem). On https://www.mediawiki.org/wiki/Gerrit/Tutorial there is one section called "Pushing via HTTPS when SSH is not functional" which I'd also like to move to [[mw:Gerrit/Troubleshooting]]. Anyone knows how users would actually realize that SSH is not functional? (Specific output after a specific command?) How would Gerrit users realize they are behind a proxy server? Thanks for your help. andre -- Andre Klapper | Wikimedia Bugwrangler http://blogs.gnome.org/aklapper/

5 6

Analytics Kafka Upgrade next week
by Andrew Otto 05 May '16

05 May '16

Hiya, We’ll be upgrading the Analytics Kafka cluster from 0.8.2 to 0.9.0.1 next week. This is scheduled to start at Wednesday May 11th at 13:00 UTC (9:00 EST, 6:00 PST). If all goes well*, this should be a rolling upgrade with no downtime. Just a heads up, thanks! -Andrew & Luca *everybody knock on wood now

1 0

Fwd: [Wikimedia-l] Invitation to upcoming office hours with interim ED
by Pine W 05 May '16

05 May '16

Forwarding. Pine ---------- Forwarded message ---------- From: "Katherine Maher" <kmaher(a)wikimedia.org> Date: May 4, 2016 17:47 Subject: [Wikimedia-l] Invitation to upcoming office hours with interim ED To: <wikimedia-l(a)lists.wikimedia.org>, <wmfall(a)lists.wikimedia.org>, < wikimediaannounce-l(a)lists.wikimedia.org> Cc: Hi everyone, **Summary: I am delighted to invite you to join me for two upcoming office hours, where I’ll answer community questions and share updates on the Foundation’s work.** It’s been a busy few weeks around the Wikimedia Foundation offices. We shared our 2016-2017 annual plan, finished our quarterly reviews, and attended Wikimedia Conference 2016 in Berlin with the Wikimedia affiliates. [1] In Berlin, I had the chance to do one of my favorite things: sit with Wikimedians, listen, debate, and plan for the future. Of course, Berlin is just one gathering, and there are thousands of other perspectives out there. I want to hear more of these perspectives, and so I’m looking forward to hosting two office hours over the coming weeks. We plan to hold a traditional office hours on IRC, and will also experiment with a video Q&A. We hope these different formats will make it easier for more people to participate using their preferred communications channels. We’ve chosen two different time zones, with the goal of reaching as many people as possible. They are as follows: *Video session* *This session will be recorded, and the video will be posted on Commons/Meta. Due to video conferencing limitations, we encourage advance questions.* Wednesday, 11 May 2016 00:00-1:00 UTC | 17:00-18:00 PDT [2] *IRC session* *This session follows the May monthly metrics meeting.[4] Like other office hours, it will be held in #Wikimedia-office on Freenode.* Thursday, 26 May 2016 19:00-20:00 UTC | 12:00-13:00 PDT [3] We’re also collecting questions in advance for those who can’t make either of those sessions. We’ve created a page on Meta where you can leave questions or comments, check the details on the location of each session: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Executive_Director/May… Please share this invitation with others you think may be interested! I look forward to speaking soon, Katherine Translation notice - This message is available for translation on Meta-Wiki: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Executive_Director/May… [1] https://meta.wikimedia.org/wiki/Wikimedia_Conference_2016 [2] Time converter link: http://www.timeanddate.com/worldclock/fixedtime.html?hour=0&min=00&sec=0&da… [3] Time converter link: http://www.timeanddate.com/worldclock/fixedtime.html?hour=19&min=00&sec=0&d… [4] https://meta.wikimedia.org/wiki/WMF_Metrics_and_activities_meetings -- Katherine Maher Wikimedia Foundation 149 New Montgomery Street San Francisco, CA 94105 +1 (415) 839-6885 ext. 6635 +1 (415) 712 4873 kmaher(a)wikimedia.org _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines New messages to: Wikimedia-l(a)lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>

3 2

ArchCom-RFC status update: 2016-05-04
by Rob Lanphier 05 May '16

05 May '16

Hi everyone, I've included the ArchCom-RFC status update in this mail below, which now has a dedicated wiki page: <https://www.mediawiki.org/wiki/Architecture_committee/Status> Assuming we build the habit, this should be updated weekly. Rob ---- Recent RFC office hours - 2016-05-04: Phab:E169 - T130528: RFC: PSR-6 Cache interface in Mediawiki core - Declined. A lot of the discussion was about these three questions: 1. what problem was this RFC trying to solve? 2. if BagOStuff is an obstacle, then which is true? - a) need a better caching abstraction than BagOStuff? or - b) does BagOStuff just need incremental improvement - c) should BagOStuff be deprecated, and not replaced with anything? 3. if we decide to rethink our caching model, do we need tagged caching? Upcoming RFC office hours - 2016-05-11: Phab:E66/34(E171) - T113034: RFC: Overhaul Interwiki map, unify with Sites and WikiMap - The ArchCom-RfCs board has a "Ready for RFC meeting" column which should contain an ordered queue of RFCs planned for IRC office hour Entering Final Comment Period - Phab:T120164 - this is a last call for a process RFC about last calls. See RobLa's email to wikitech-l on 2016-05-04 about this. RFC inbox - ArchCom RFC board: - empty on 2016-05-04 Shepherd status - Brion - (?) - Daniel - Software Quality working group? - Working on Multi Content Rev Spec with Brion - Gabriel - T39902 RFC: Implement rendering of redlinks as post-processor (Gabriel): Solutions for highlighting links to non-existing pages in Parsoid HTML. Plan in place / agreed between Parsing and Services. Implementation in change propagation service ready, preparing for deploy possibly next week. - T122942 RFC: Support language variants in the REST API (Gabriel): Waiting for progress on more general question of language selection granularity / strategy & T114662. - Roan - I need to start the second part of T108655, but the recent comments have me confused. I'll need to talk to Timo and figure out what the subject of part two should be. - RobLa - Created mw:RFCstatus - still need to schedule an RFC triage meeting outside of ArchCom-RFC time - Tim - No update - Timo - No update No activity in the last two weeks - T123753 Establish retrospective reports for Security and Performance incidents (RobLa) - T122825 Service ownership and minimum maintenance requirements (Gabriel) - T124504 Transition WikiDev '16 working areas into working groups (RobLa) - T66214 Use content hash based image / thumb URLs & define an official thumb API (Brion) - T113034 RFC: Overhaul Interwiki map, unify with Sites and WikiMap (Daniel) - T128351 RFC: Notifications in core (Brion) - T122825 Service ownership and minimum maintenance requirements (Gabriel) - T54807: Identify and remove legacy preferences from MediaWiki core (no shepherd) - T88596 Improving extension management (Daniel) - T114444 RFC: Introduce notion of DOM scopes in wikitext (Tim)

1 0

Phabricator upgrade and UI changes
by Federico Leva (Nemo) 05 May '16

05 May '16

AFAICT, in the last few days there were two unannounced upgrades of Phabricator, to an unspecified version of the software, the second of which applied rather radical UI changes, especially to Maniphest. Initially I wasn't sure most/which UI changes were bad/good or why, but now I've observed myself for a few days and I took the time to take screenshots and describe my findings. Of course, most are about * the consistent enlargement of some items to the expense of others, * the introduction of a sidebar to host an ever-growing amount of buttons, * the move of most task information under the description or under the sidebar. Please comment on the reports, add your findings and file new reports for separate issues (I've not tested areas outside Maniphest, for instance): * https://phabricator.wikimedia.org/T134393 * https://phabricator.wikimedia.org/T134394 * https://phabricator.wikimedia.org/T134398 It would also be nice to have some precise and authoritative information on when Phabricator was upgrade to what version, what the release notes and gotchas are, etc. Did I miss such an announcement and if yes where is it? Nemo

5 4

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l May 2016