Wikitech-l August 2016

wikitech-l@lists.wikimedia.org

78 participants
104 discussions

Weigh in on whether to finalize "Diversity" and “Conflict of interest” sections of Code of Conduct
by Matthew Flaschen 23 Aug '16

23 Aug '16

Please comment on whether to approve the "Diversity" and "Conflict of interest" section of the draft Code of conduct for technical spaces: * Diversity - https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Diversity * Conflict of interest - https://www.mediawiki.org/wiki/Code_of_Conduct/Draft#Conflict_of_interest You can comment at https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Finalize_.22Diver… . A position and brief comment is fine. You can also send private feedback to conduct-discussion(a)wikimedia.org . Thanks again, Matt Flaschen

1 0

[MediaWiki-announce] Security Release - 1.27.1, 1.26.4, 1.23.15
by Chad Horohoe 23 Aug '16

23 Aug '16

I would like to announce the release of MediaWiki 1.27.1, 1.26.4, 1.23.15! These releases fix five security issues in core and one for the extension PdfHandler. Download links are given at the end of this email. == Security fixes == * (T139565) API: Generate head items in the context of the given title (CVE-2016-6335) * (T137264) XSS in unclosed internal links (CVE-2016-6334) * (T133147) Escape '<' and ']]>' in inline <style> blocks (CVE-2016-6333) * (T133147) Require login to preview user CSS pages (CVE-2016-6333) * (T132926) Do not allow undeleting a revision deleted file if it is the top file (CVE-2016-6336) * (T129738) Make $wgBlockDisablesLogin also restrict logged in permissions (CVE-2016-6332) * (T129738) Make blocks log users out if $wgBlockDisablesLogin is true (CVE-2016-6332) * (T115333) Check read permission when loading page content in ApiParse (CVE-2016-6331) * (T57548) Remove support for $wgWellFormedXml = false, all output is now well formed The following only affects 1.27 and above and is not included in the 1.26 and 1.23 upgrade: * (T139670) Move 'UserGetRights' call before application of Session::getAllowedUserRights() (CVE-2016-6337) The following fix is for the PdfHandler extension: * (T136402) Add -dSAFER to ghostscript as hardening measure == Release notes == Full release notes for 1.27.1: <https://www.mediawiki.org/wiki/Release_notes/1.27> Full release notes for 1.26.4: <https://www.mediawiki.org/wiki/Release_notes/1.26> Full release notes for 1.23.15: <https://www.mediawiki.org/wiki/Release_notes/1.23> For information about how to upgrade, see <https://www.mediawiki.org/wiki/Manual:Upgrading> ********************************************************************** 1.27.1 ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.27/mediawiki-1.27.1.tar.gz https://releases.wikimedia.org/mediawiki/1.27/mediawiki-core-1.27.1.tar.gz Patch to previous version: https://releases.wikimedia.org/mediawiki/1.27/mediawiki-1.27.1.patch.gz GPG signatures: https://releases.wikimedia.org/mediawiki/1.27/mediawiki-1.27.1.tar.gz.sig https://releases.wikimedia.org/mediawiki/1.27/mediawiki-1.27.1.patch.gz.sig https://releases.wikimedia.org/mediawiki/1.27/mediawiki-core-1.27.1.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html ********************************************************************** 1.26.4 ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.26/mediawiki-1.26.4.tar.gz https://releases.wikimedia.org/mediawiki/1.26/mediawiki-core-1.26.4.tar.gz Patch to previous version: https://releases.wikimedia.org/mediawiki/1.26/mediawiki-1.26.4.patch.gz GPG signatures: https://releases.wikimedia.org/mediawiki/1.26/mediawiki-1.26.4.tar.gz.sig https://releases.wikimedia.org/mediawiki/1.26/mediawiki-1.26.4.patch.gz.sig https://releases.wikimedia.org/mediawiki/1.26/mediawiki-core-1.26.4.tar.gz.… Public keys: https://www.mediawiki.org/keys/keys.html ********************************************************************** 1.23.15 ********************************************************************** Download: https://releases.wikimedia.org/mediawiki/1.23/mediawiki-1.23.15.tar.gz https://releases.wikimedia.org/mediawiki/1.23/mediawiki-core-1.23.15.tar.gz Patch to previous version: https://releases.wikimedia.org/mediawiki/1.23/mediawiki-1.23.15.patch.gz GPG signatures: https://releases.wikimedia.org/mediawiki/1.23/mediawiki-1.23.15.tar.gz.sig https://releases.wikimedia.org/mediawiki/1.23/mediawiki-1.23.15.patch.gz.sig https://releases.wikimedia.org/mediawiki/1.23/mediawiki-core-1.23.15.tar.gz… Public keys: https://www.mediawiki.org/keys/keys.html -Chad H. _______________________________________________ MediaWiki announcements mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce

1 0

The Revision Scoring weekly update
by Aaron Halfaker 23 Aug '16

23 Aug '16

Hey, This is the 18th weekly update from revision scoring team that we have sent to this mailing list. *Communications:* - Aaron presented on how user-feedback has been helping us address some sneaky biases in ORES' models. [1, 2, 3] *New development:* - We included 'autoreview' and 'patroller' groups in Turkish wiki models to get a fitness boost. [4] - We added some basic uwsgi metrics to grafana[5] and added a response timing metric from Change Propagation so that we can track any performance issues. [6] *Maintenance and robustness:* - We increased the number of workers per node in production for a 66% increase in total capacity for ORES[7] - We updated all of our edit quality models with the new version of revscoring [8] and sent an email out to wikitech-l and ai-l about the implications for tool developers. [9] - We decided not to make specialized models for ORES in beta labs. [10] Instead, we'll use the production models so that issues with them will be caught in beta. 1. https://phabricator.wikimedia.org/T143275 -- Present on user-feedback stories at Research Showcase 2. https://www.youtube.com/watch?v=rsFmqYxtt9w#t=29m00s -- Video of ORES user-feedback talk 3. https://www.mediawiki.org/wiki/File:Deploying_and_maintaining_AI_in_a_socio… 4. https://phabricator.wikimedia.org/T140474 -- Include specific user groups in the trwiki edit quality model 5. https://phabricator.wikimedia.org/T143081 -- Add uwsgi-related metrics to grafana 6. https://phabricator.wikimedia.org/T143568 -- Add median, 75% and 95% response time to ORES dashboard 7. https://phabricator.wikimedia.org/T143105 -- Increase celery workers to 40 per scb node 8. https://phabricator.wikimedia.org/T143125 -- Update editquality models with new version of revscoring 9. https://lists.wikimedia.org/pipermail/ai/2016-August/000068.html -- "[AI] New models coming to ORES & notes" 10. https://phabricator.wikimedia.org/T141980 -- Should we make a model for ores in beta? Sincerely, Aaron from the Revision Scoring team

1 0

SWAT deploy slot time changes (and adding European mid-day slot)
by Greg Grossmeier 22 Aug '16

22 Aug '16

tl;dr: Starting the week of August 22nd there will be 3 SWAT deploy windows: at 13:00, 18:00, and 23:00 UTC (6am, 11am, 4pm PDT). Hello all, I'm pleased to announce that after being heavily SF-focused for a long time we're adding a Europe-focused (and slightly better for Asia/India) SWAT window[0] starting on August 22nd[1]. This new SWAT window follows a couple changes to the SWAT process[2] and scap tooling[3] which make SWAT deploys less risky and stressful for all involved. We hope this additional window will make the lives of all teams and volunteers (at least slightly) better. <3, Greg and the Release Engineering Team [0] https://wikitech.wikimedia.org/wiki/SWAT_deploys [1] https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd [2] Utilizing mw1099/X-Wikimedia-Debug headers, see: https://wikitech.wikimedia.org/wiki/SWAT_deploys#Doing_the_deploy [3] Canary error rate checks built-in, see: https://lists.wikimedia.org/pipermail/wikitech-l/2016-August/086255.html -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |

2 2

T47317: Sections generated by tag extension do not show up in TOC
by Lord_Farin 22 Aug '16

22 Aug '16

All, I would like to draw your attention to ticket https://phabricator.wikimedia.org/T47317. This ticket highlights some issues with the way sections, headers and the TOC are handled in the parser in combination with tag extensions and parser functions. Basically the problem is that the TOC is created before strip markers are substituted, which prevents some sections from showing up in the TOC. This issue is limiting the usefulness of such constructs, so I am very interested to spend some time on it with people well-versed in the parser code and in particular the formatHeadings function. Of course, there are plenty more details I could give but before flooding wikitech-l with those I thought I'd poll for the interest in addressing this. Maybe the next step could be some chat over IRC or another medium? Thanks in advance, Lord_Farin

2 1

Nook Tablet browser hangs
by Jay Michael 21 Aug '16

21 Aug '16

Can you tell me how to find out if Wikipedia has changed something about how pages are served? In particular, what's changed about how images are served, whether the server is using a new SSL certificate, and whether the server's support for OCSP has changed? As of 10 August 2016, when I try to view Wikipedia pages with the browser on a Nook Tablet, the page never stops loading, the browser is hung, I have to reboot the tablet to try anything else. I requested help on my (JMichael_ll) Talk page. I was advised to try WP:VPT. I reposted there. I think that's still not the best place to ask. When I sent mail to info-en(a)wikimedia.org, I was advised to try here.

2 1

[MediaWiki-announce] Security Release Pre-Announcement (1.27, 1.26, 1.23)
by Chad Horohoe 19 Aug '16

19 Aug '16

Hi everyone, I would like to give everyone advance notice of a pending security release for all supported branches. The release will come out on Monday, August 22nd. There are several security fixes for core and one extension that will be included in this release, along with the normal backports that have made it into the branches already. The version numbers will be: 1.27.1 1.26.4 1.23.14 Please let me know if you have any other questions. Thanks and have a great weekend. -Chad _______________________________________________ MediaWiki announcements mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce

1 0

Fwd: [Wikimedia-l] Facebook CTO on strategy, Internet access, Wikipedia
by Pine W 19 Aug '16

19 Aug '16

Forwarding, since the subjects may be of interest to people on the Wikitech, AI, and Research lists. I'm unqualified to evaluate Damon's comments and the FB exec's comments about AI, so please refrain from shooting the messenger if these aren't helpful or interesting to those of you who do know enough about AI to make well-educated assessments. Regards, Pine ---------- Forwarded message ---------- From: "Damon Sicore" <damon(a)sicore.com> Date: Aug 18, 2016 21:35 Subject: [Wikimedia-l] Facebook CTO on strategy, Internet access, Wikipedia To: "Wikimedia Mailing List" <wikimedia-l(a)lists.wikimedia.org> Cc: Hi, I usually don't recommend these things, but this interview with Schrep [1] [2] is interesting and insightful. I recommend listening to it instead of reading. He discusses FB's ten year plan, AI, VR, Internet access for all, mentions Wikipedia several times, confirms their insatiable hunger for structured data, and reveals several details on their innovation approach. Trigger Warning: Corporate Speak Make no mistake, I've nothing but contempt and spite for Facebook, but having worked with Mike I also know he demonstrates formidable intellect and is a decent person. He's incredibly capable in building amazing teams and predicting (more like sniffing out) the future of tech. I watch his moves closely to stay sharp. He's right about how papers are coming out constantly which augment current AI tech in interesting new ways. I believe we're living in interesting times for computer science and mathematics--computational linguistics and probabilistic search in particular. A person can't read the CS and math papers fast enough in order to keep up with the innovation. A lot of it is trivial, sure, but some is quite startling in impact as they combine a few smaller things which seemed previously innocuous yet when used together they solve key problems. When looking into tech and strategy for WMF and the engineers it supports, I'd be very interested in the direction Facebook is going and the technologies they plan on investing in, so passing it along. Yours faithfully, Damon [1] http://www.metisstrategy.com/interview/mike-schroepfer/ [2] https://en.wikipedia.org/wiki/Mike_Schroepfer Damon Sicore 512 963 5126 https://damon.sicore.com 6E98 FBFB D192 D325 B85D D4FF FD2A 20ED DC1D 3975 _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/ wiki/Mailing_lists/Guidelines New messages to: Wikimedia-l(a)lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>

1 0

New MediaWiki structure test for message existence in ResourceLoader modules
by Krinkle 18 Aug '16

18 Aug '16

Hi all, I've been working on a new structure test that ensures interface messages, exported as part of a ResourceLoader module, actually exist. This avoids broken interface messages from showing up in the interface undetected, and catches left-over references to messages that were removed. Commit: https://gerrit.wikimedia.org/r/#/c/277457/ Task: https://phabricator.wikimedia.org/T129976 Thanks to everyone who's helped over the past 5 months to make this test passing in core and various extensions. Now that the test landed, we can finally prevent new issues instead of chasing them after the fact in error logs. Best, -- Krinkle

2 1

2016-08-17 Scrum of Scrums meeting notes
by Grace Gellerman 18 Aug '16

18 Aug '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-08-17 = 2016-08-17 = == Product == === Reading === ==== Reading Web ==== * Current sprint: https://phabricator.wikimedia.org/project/view/2126/ * Next sprint: https://phabricator.wikimedia.org/project/view/2158/ * Lazy loading images on mobile web is going live very soon * Heads up, we're looking to release Related Articles on mobile web potentially in 6-10 weeks. More api.php calls. * Any ideas on "Various browser tests failing due to login error" ( https://phabricator.wikimedia.org/T142600 )? ==== Mobile Content Service (MCS) ==== Not stripping title attributes from links anymore. https://gerrit.wikimedia.org/r/#/c/304785/ ==== Android native app ==== * Current sprint: https://phabricator.wikimedia.org/project/view/2142/ * Next sprint: * Beta release this week with minor feed updates (tab icon update, access to tabs from the feed, persistent dismissal of cards) * Nav overhaul work continues apace * Working with Discovery to get Nearby search going ==== iOS native app ==== * 5.0.6 shipped this week: https://phabricator.wikimedia.org/tag/ios-app-v5.0.6-hotfix/ * Current release board: https://phabricator.wikimedia.org/project/board/1736/ ** Major features are iPad and Find in Page ** Feature Complete and in beta ** Still wrapping up minor tweaks and bug fixes * Next release board: https://phabricator.wikimedia.org/project/view/2150/ ** Started development this week week ** Adding iOS 10 support ** Dropping iOS 8 support ** Major features are Widgets and Feed improvements ** Expected to go to beta in early september ==== Reading Infrastructure ==== * === Security === * MediaWiki 1.27.1 release delayed to this week * Security reviews this week: Html5Depurate, GlobalGroupPermisions, PerformanceInspector * Planning for captcha improvements continues ** https://phabricator.wikimedia.org/T125132 ** https://phabricator.wikimedia.org/T141490 ** First step will be re-generating images using current script === Editing === === Collaboration === * Blocked: * Blocking: * Updates: === Language === * Blocked: * Blocking: * Updates: ** Security review for Youdao needed: https://phabricator.wikimedia.org/T143185 ** Apertium->Jessie packaging work almost done; Few packages left to upload. ** Improvements in Content Translation continue: MT card, templates, DB errors. === Multimedia === * Blocked: ** Is there an update on thumbor production status? (Performance?) It's still blocking ImageTweaks deployment. * Blocking: ** None of which we're aware. * Updates: ** Continuing our work on FileAnnotations; currently pending on a decision on whether we're waiting for structured data or will go early and re-write content after the fact when it goes live. === Parsing === * Blocked: * Blocking: * Updates: === VisualEditor === * Blocked: ** We (and other teams depending on Phlogiston) remain blocked with Ops/Labs on server issues, with the system either completely broken or impaired continuously since mid-June; this week it's T142742, before that T141796, T142165, T137736 and others from related issues. Is there a better mechanism for getting these kinds of issues fixed more rapdily? * Blocking: ** Parsing team are still waiting for our response on "native" Parsoid <gallery> implementation. Thalia and Ed will look at it more. * Updates: ** Major work this week on client-side DOM diffing (for smaller save bandwidth demands), re-orderable transactions (for enhanced IME support and maybe offline editing), and the new wikitext editor (now merged in a feature-flagged state; Beta Feature expected in a month or so). == Technology == === Release engineering === * '''Blocked''' ** ops - need a set of eyes on https://gerrit.wikimedia.org/r/#/c/302601/ so we can easily put logs for Java-based applications into Logstash * '''Blocking''' ** Security - security release of 1.27.1 & co. This week. * Updates: ** New SWAT window schedule starting Aug 22nd *** See: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd *** And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team *** https://phabricator.wikimedia.org/T137970 === Analytics === * loading of new AQS (pageview API) cluster ongoing, will switch over to it when done * new event bus logging from mw hooks merged, will start being available on event bus soon * re-ran massive sqoop of all mediawiki databases, parallelizing most of the small wikis together, and dbstore1002 doesn't seem impacted * re-worked some dataset documentation to help people transition from the old pagecounts-raw: https://wikitech.wikimedia.org/wiki/Analytics/Data * Joseph and Luca are on vacation for two and one week respectively === Services === * Blockers: none * Kafka upgraded to 0.9, now working on replacing the driver in Change-Prop * Parsoid move to scap3 is in progress * Puppetisation of the PDF render electron service === Research === * Substantial update to ORES is live ** CPU usage down by 66% ** Memory usage down by 26% ** Some minor regressions that will be handled in incoming patches. === Community Tech === * Updating affected abuse filters as the wikis receive the new code for norm and ccnorm function https://phabricator.wikimedia.org/T29987 * Working on acceptance tests for InternetArchiveBot ( https://phabricator.wikimedia.org/T140386) and releasing some code as a composer package (https://phabricator.wikimedia.org/T140135) * Migrations to centralauth database for cross-wiki watchlist https://phabricator.wikimedia.org/T141951 ** Semi-blocker: update on when the watchlist IDs will be added by the TCB team * Testing numeric sorting on Swedish Wikipedia https://phabricator.wikimedia.org/T142113 * Helping out with Education Program’s Dashboard tool * Nearing completion of feature releases for CopyPatrol === Discovery === * No blockers * Working on BM25 implementation * Working on multi-wiki indexes * Working on integrating Polestar (http://vega.github.io/polestar/) and WDQS GUI to allow create graphs visually from WDQS results * Improved suggestions with typos in first characters: https://phabricator.wikimedia.org/T107006 * Analysis of ASCII folding/stemming on enwiki: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Re-Ordering_Stemming… ** TLDR: results positive, we should do it * Summary of Portal changes published: https://lists.wikimedia.org/pipermail/wikitech-l/2016-August/086312.html === Interactive Team === * Working on deploying <mapframe> and <maplink> to all non-Wikipedia sites * Working on replacing GeoHack with <maplink> + info screen on all Wikipedias * Working on deploying Tabular data on Commons. Already synced up with Wikidata. * In progress of deploying eqiad maps cluster === Technical Operations === * '''Blocked''' ** None * '''Blocking''' ** None * Updates: ** apertium packages for LE reviews ongoing ** thumbor service getting installed this week, no definite ETA yet, but ongoing ** Work ongoing on puppetDB, xkey, varnish4 == Wikidata == * Blockers: None. * Implemented user feedback on ArticlePlaceholder. * Series of small fixes to make error messages in the UI more actionable. * Need Ops input on https://phabricator.wikimedia.org/T142944. Performance and caching considerations when we make ArticlePlaceholder pages visible to search engines. * Today: ArchCom meeting about proposals for content model storage. First step towards allowing multiple content objects. https://phabricator.wikimedia.org/E261 == Fundraising Tech == * More queue work * Running CiviCRM batch de-duplication, fixing issues as they arise == Architecture == https://www.mediawiki.org/wiki/Architecture_committee/Status 2016W33: 2016-08-17 (Wednesday) * ArchCom Planning meeting: [https://phabricator.wikimedia.org/E260 Phab:E260] 20 UTC (1pm PDT) ** Notes: [https://www.mediawiki.org/wiki/Architecture_committee/2016-08-17 Architecture committee/2016-08-17] * ArchCom-RFC office hour: [https://phabricator.wikimedia.org/E261 Phab:E261] 21 UTC (2pm PDT) ** Agenda: [https://phabricator.wikimedia.org/T105652 Revisiting T105652 (content model storage)]

3 4

← Newer
1
2
3
4
5
6
7
8
...
11
Older →

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l August 2016