Wikitech-l June 2016

wikitech-l@lists.wikimedia.org

78 participants
85 discussions

[ANNOUNCEMENT] MathML/SVG as the default rendering mode on all projects
by Marko Obrovac 06 Jun '16

06 Jun '16

Hello, On Tuesday, May 31 we have deployed a change to the production cluster that sets MathML with SVG fall-back as the default rendering mode for mathematical formulae for all Wikimedia projects~[1]. This change brings scaleable and selectable formulae to the whole Wikimedia community, not just logged-in users, thus opening new perspectives for better rendering, accessibility, search, equation sharing, font and unicode support, styling, line breaking… We are very excited about this feature seeing the light of day, not only because of the visible improved experience for our reader and editors, but also because this project has been carried out in collaboration with the community. In particular, this achievement would not have been possible without Moritz Schubotz (aka User:Physikerwelt), who has been the lead developer of Mathoid, the rendering service responsible for producing the MathML and SVG code that the end-users see on the web-site. You can read more about this awesome feature on the MathML Association’s web-site~[2]. Best, The WMF Services Team [1] https://phabricator.wikimedia.org/T131177 [2] http://mathml-association.org/announcement/2016/05/31/wikipedia.html -- Marko Obrovac, PhD Senior Services Engineer Wikimedia Foundation

2 1

Discovery Weekly Update for the week starting 2016-05-30
by Chris Koerner 04 Jun '16

04 Jun '16

Hello, Here is this week's update from the Discovery department. * Trey completed a quick survey [1] of the effects of removing quotes and trailing question marks from poorly-performing queries. ** There's now a Phab ticket [2] to look into removing training question marks from queries. * Released language detection and re-sorting of top 10 languages to wikipedia.org portal [3] * Draft completion of analysis on how long a typical session is on the wikipedia portal [4] * Chris (our community liaison) presented [5] at EMWCon [6] on what Technical Collaboration does for * MediaWiki admins and developers. There was a small mention of the work of Discovery, which was well received. * Jan did a CREDIT showcase demo [7] for the new language detection on the portal * Trey did a CREDIT showcase presentation [8] for the TextCat language detection demo ** The [TextCat] demo is available to try. [9] * Katie Horn started her first week as Director, Head of Discovery [1] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Quotes_and_Questions [2] https://phabricator.wikimedia.org/T133711 [3] https://phabricator.wikimedia.org/T133432 [4] https://phabricator.wikimedia.org/T134301 [5] http://livestream.com/internetsociety/emwcon/videos/124154153 [6] https://www.mediawiki.org/wiki/EMWCon_Spring_2016 [7] https://www.youtube.com/watch?v=0s81r17M-wk&t=4m18s [8] https://www.youtube.com/watch?v=0s81r17M-wk&t=15s [9] https://tools.wmflabs.org/textcatdemo/ ---- Feedback and suggestions on this weekly update are welcome! The full update, and archive of past updates, can be found on Mediawiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates -- Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

2016-06-01 Scrum of Scrums meeting notes
by Grace Gellerman 03 Jun '16

03 Jun '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-06-01 = 2016-06-01 = == Product == === Reading === ==== Reading Infrastructure ==== * AuthManager coming soon - it's on the beta cluster now! Please indicate if you hae a serious blocker now at https://phabricator.wikimedia.org/T135504 ==== Web ==== * Starting Hovercards A/B test during this sprint (with 1% in HU.wiki) * Rolling lazy loaded images / references to medium sized wikis * Blocked (Ops/Analytics) - https://phabricator.wikimedia.org/T127883 ==== iOS ==== ==== Android ==== * Production release 2.2.146 rollout out this Tuesday. https://lists.wikimedia.org/pipermail/mobile-l/2016-May/010243.html (New features include: reading lists, edit here, Show redirect source in search results, updates for AuthManager, No longer download and widen high-quality images when on a metered connection.) * Working on new feed UI ==== Mobile Content Service ==== * Adding first couple of new feed endpoints this week (enwiki featured article, most read articles, aggregated endpoint for previous and future feed microservices) === Community Tech === * We're going to be testing the PageAssessments extension on Labs this week (https://www.mediawiki.org/wiki/Extension:PageAssessments) * Continuing work on new CopyPatrol Tool ( http://tools.wmflabs.org/plagiabot) * More investigation on Category collation * No blockers === Editing === ==== Language ==== * Blocked: Parallel Corpora dumps: https://phabricator.wikimedia.org/T127793 (Tech Ops) ==== Multimedia ==== * Blocked: New repository request for FileAnnotations so we can experiment and do design/code review on Mark's crappy prototype * Updates ** ImageTweaks waiting on Thumbor and a few other things, no news there AFAIK ** Gallery slideshow core work coming along, no huge updates from prtksxna ** UW fatals rate waaaay down since last year, thanks Sentry people for helping us track it ==== Parsing ==== * Tidy replacement: With latest HTML5Depurate and visual diff test run, ~93.4% of test pages render with pixel perfect accuracy. Working through remaining diff scenarios (a lot of the diffs are harmless minor pixel shifts) to identify real issues and having wikitext be fixed or fix core parser as required. ** Tim working on a HTML5 parser to fix some core parser issues around doBlockLevels. * Will attempt switching Parsoid to service-runner sometime next week (Arlo & Services) * Arlo close to getting html2html endpoint done (last remaining blocker to enable Parsoid new HTML version with separate data-mw) ** VE & CX: Please start planning how to handle this new version. * Kunal working on using the new Linker code for files/images. ==== Collaboration ==== * Blocked - None * Blocking - No change * Updates ** Working on Echo special page, for both JS and no-JS users ** Schema changes we requested are done, we now need to backfill and use the new schema == Technology == === Services === * RESTBase ** enforcing rate limits as of today *** pageview: 10 req/s *** transforms: 5 req/s * Change Propagation ** now handles summary and MCS updates as well as purges ** partially moved RestbaseUpdateJobs from job runners to it *** still missing transclusions * MathML enabled by default across all projects ** proper caching and purging still a TODO *** RESTBase side for purging proposed in https://github.com/wikimedia/restbase/pull/628 *** need Ops help for the Varnish side of things - https://phabricator.wikimedia.org/T136205#2343850 === Technical Operations === * '''Blocking''': none * '''Blocked''': none * Updates: ** libicu update successful ** Started preliminary work on migrating appservers to jessie ** Last day of Riccardo ** Getting graphite into better shape === Analytics === * Loaded 3 months of pageview data into Druid and querying it is very fast * Cleaning up limn-flow-data, limn-edit-data, and limn-languge-data a little bit, deploying today * Working on processing data from the mediawiki databases and turning it into an analytics-friendly schema (one example is slowly changing dimensions such as page_title recorded as (page_id, page_title, valid_from, valid_to)) * pageview requests that miss the cache are rate-limited to 10 req/s. More req/s than that will throw 429 === Security === * Two-factor usability surveying prep continues * Reviews: Ex:DoubleWiki, Ex:TemplateStyles, Use of wheels for deployment by Analytics === Discovery === * '''Blocking''': none * '''Blocked''': none * Tomasz last day at WMF was on Friday, Katie Horn leading Discovery now * ElasticSearch 2.3 upgrade in progress: https://phabricator.wikimedia.org/T133124 * TextCat A/B test for english wiki started * Updated Portal language stats. === Fundraising Tech === * Fixed CentralNotice tests, now enforcing ES3 * More work to get off ActiveMQ, remove SPOF * Testing new processor in Israel, Japan and Ukraine ** We quit messing with language fallback and just got the last few missing messages translated to Ukrainian * Ready to test new PayPal integration method * Enhancing fraud & dos mitigation measures === Release Engineering === * '''Blocking''': None * '''Blocked''': Nada * '''Update:''' ** Auth Manager rolling out *soon*

4 3

Should we switch the default category collation to uca-default?
by Ryan Kaldari 03 Jun '16

03 Jun '16

There are currently 94 WMF wikis using UCA category collation rather than the default "uppercase" collation. The Unicode Collation Algorithm (UCA) is the official standard for how to sort Unicode characters, and generally follows how a human would typically alphabetize strings. For example, uppercase collation sorts Aztec, Ärsenik, Zoo, Aardvark as "Aardvark, Aztec, Zoo, Ärsenik", but uca-default collation sorts them as "Aardvark, Ärsenik, Aztec, Zoo". UCA collation also (optionally) supports natural numeric sorting so that 100, 1, 99 sorts as "1, 99, 100" rather than "1, 100, 99". The WMF Community Tech team has recently posted proposals on English Wikipedia and several Wiktionaries asking if these communities would support switching to UCA collation. The proposal on English Wikipedia has received unanimous support so far.[1] We thought that Wiktionaries would be more skeptical of the change, but so far we have received only positive responses.[2] Since it seems that most wikis are receptive to switching to UCA, maybe we should just make it the default rather than waiting on all the wikis to request it separately. Of the large Wikipedias, French, Dutch, Polish, Portuguese, and Russian are already using UCA, and German is in the process of switching.[3] For non-Latin scripts, my understanding is that UCA will be a big improvement, especially if we switch them to language-specific implementations, like uca-ja, uca-zh, uca-ar, etc. Three questions: 1. Does switching the default collation from "uppercase" to "uca-default" sound like a good idea? 2. Should this be proposed on meta or is it too technical? 3. Are there any wikis that would need to opt out of this for some reason? (I know there are issues with Kurdish,[4] but that's the only one I know about.) 1. https://en.wikipedia.org/wiki/Wikipedia_talk:Categorization#OK_to_switch_En… 2. https://phabricator.wikimedia.org/T128502 3. https://phabricator.wikimedia.org/T128806 4. https://phabricator.wikimedia.org/T48235

8 9

Campaigns extension / ServerSideAccountCreation log - does anyone still use it?
by Brad Jorsch (Anomie) 03 Jun '16

03 Jun '16

Question 1: Would anyone care if we kill the "loginCTA" campaign, which tracks when people use the link at the bottom of Special:UserLogin to get to the account creation page? Question 2: Would anyone care if we remove the extension entirely from Wikimedia wikis? Wikiapiary seems to show only one user outside of Wikimedia. Background: The extension needs a rewrite for AuthManager, and in particular the "loginCTA" campaign will be a bit of a pain to keep working. If someone is making use of the extension that's fine, but if not we may as well not continue to spend development resources on it. -- Brad Jorsch (Anomie) Senior Software Engineer Wikimedia Foundation

4 7

Code of Conduct amendments text
by Matthew Flaschen 02 Jun '16

02 Jun '16

Please participate in the discussion about how the Code of Conduct should be amended: https://www.mediawiki.org/wiki/Talk:Code_of_Conduct/Draft#Changing_the_Code… Thanks, Matt Flaschen

1 0

2016W22 ArchCom RFC meeting (2016-06-01)
by Rob Lanphier 01 Jun '16

01 Jun '16

Hi everyone, We're planning to have our regular ArchCom-RFC IRC meeting in a couple of hours. Phab event: <https://phabricator.wikimedia.org/E198> Location: #wikimedia-office IRC channel Meeting type: Problem definition Time: 2016-06-01 Wednesday 21:00 UTC (2pm PDT, 23:00 CEST) The experiment using Phab Conpherence rooms for public discussions continues with Phab:Z425. I will optimistically say this has not *yet* succeeded :-) [1] The topic ArchCom agreed to focus on this week is Security. Here's a few candidate topics for us to discuss in today's meeting: * T135963: Add support for Content-Security-Policy (CSP) headers in MediaWiki * T75953: RFC: MediaWiki HTTPS policy * T123753: Establish retrospective reports for #security and #performance incidents Broadly speaking: the theme for today is "security is everyone's job". Really, it is. If you have +2 rights, and you *don't* think security is your job, please think about why you deserve to keep that right. We all have a responsibility to step up our game in this area. Let's use today's IRC meeting to figure out how we intend to step up. Rob [1] The thing that makes me optimistic about Conpherence is that it's a persistent log of a linear conversation that integrates well with the rest of Phabricator. The Z425 Conpherence: <https://phabricator.wikimedia.org/Z425> More thoughts later here: <https://www.mediawiki.org/wiki/User:RobLa-WMF/Conpherence>, and the talk page there is a good place for off-thread replies.

2 1

[MediaWiki-announce] First release candidate for 1.27 (1.27.0-rc.0)
by Chad Horohoe 01 Jun '16

01 Jun '16

Hello everyone, I am happy to announce the availability of the first release candidate of the new MediaWiki 1.27 series! MediaWiki 1.27 includes all changes released in the smaller 1.27.0-wmf.* software deployments to Wikimedia sites over six months, totaling approximately 2800+ commits by around 165 authors. This is a large release that contains many new features and bug fixes. This will be a LTS release, supported until 2019 with security fixes. This is a summary of the major changes of interest to users and administrators: https://www.mediawiki.org/wiki/MediaWiki_1.27 You can always consult the RELEASE-NOTES-1.27 file for the full list of changes in this version. Full release notes: * https://phabricator.wikimedia.org/diffusion/MW/browse/REL1_27/RELEASE-NOTES… * https://www.mediawiki.org/wiki/Release_notes/1.27 ********************************************************************** Download: http://download.wikimedia.org/mediawiki/1.27/mediawiki-1.27.0-rc.0.tar.gz http://download.wikimedia.org/mediawiki/1.27/mediawiki-core-1.27.0-rc.0.tar… GPG signatures: http://download.wikimedia.org/mediawiki/1.27/mediawiki-core-1.27.0-rc.0.tar… http://download.wikimedia.org/mediawiki/1.27/mediawiki-1.27.0-rc.0.tar.gz.s… Public keys: https://www.mediawiki.org/keys/keys.html -Chad _______________________________________________ MediaWiki announcements mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-announce

1 0

AuthManager enabled in beta
by Gergo Tisza 01 Jun '16

01 Jun '16

Hi all, AuthManager [1] has been enabled on the beta cluster. If you see anything strange, please file a bug and cc anomie (Brad) and me. If you are maintaining authentication-related code, and have some time to test it, that would be awesome. If you see serious breakage, please file blockers for T135504 [2]. If everything goes well, this will result in very little visible change on the web interface - some special page names are different (signup is on Special:CreateAccount now), with the old ones redirecting; some interface messages are different at login and account creation; pages which asked for the password for extra security (such as email change) might send you through the login form instead; there are some new special mages (Special:ChangeCredentials, Special:RemoveCredentials). For the API, this is a larger change: action=login becomes deprecated and might break in certain situations (e.g. when the system wants you to change your password), and action=createaccount requires different parameters. (Bot passwords and OAuth are unaffected.) Hopefully all affected API clients have been updated already; if not, please file blockers for T134945 [3], and update soon. To avoid extra maintenance burden, we are aiming to convert everything to AuthManager before 1.27 is fully released, which means we have to move faster than we would normally prefer. We apologize for any inconvenience this might cause. regards, Gergő https://www.mediawiki.org/wiki/User:Tgr_(WMF) [1] https://www.mediawiki.org/wiki/Manual:SessionManager_and_AuthManager [2] https://phabricator.wikimedia.org/T135504 - Enable AuthManager in WMF production [3] https://phabricator.wikimedia.org/T134945 - Update API clients for AuthManager

1 0

CREDIT showcase today - starting in 50 minutes
by Adam Baso 01 Jun '16

01 Jun '16

Hi all, Today's CREDIT showcase starts in about 50 minutes. See you there. https://www.mediawiki.org/wiki/CREDIT_showcase -Adam

1 0

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l June 2016