Wikitech-l November 2016

wikitech-l@lists.wikimedia.org

94 participants
104 discussions

Call graph creator applied to MediaWiki and extensions
by Seb35 11 Nov '16

11 Nov '16

Hello, I wanted to share a recent work I’ve done to better visualise the dependencies between classes, with the call graph [1]. For the extension I am currently developping (MediaWikiFarm [2]), I wanted to obtain the call graph. First I did it by hand, but then I found a program doing the job, phpCallGraph [3], but unfortunately it was unmaintained since 2009 (PHP 5.2 era). I did maintenance and it partly works [4], I still have issues with the autoloader. Here are some preliminary results I got: (these are packages without much external dependencies due to autoloader issues) * Extension:MediaWikiFarm https://www.mediawiki.org/wiki/File:Call_graph_of_extension_MediaWikiFarm.s… * Extension:Math https://www.mediawiki.org/wiki/File:Call_graph_of_extension_Math.svg * Extension:CentralAuth https://www.mediawiki.org/wiki/File:Call_graph_of_extension_CentralAuth.svg * directory 'includes' of MediaWiki without subdirectories (too big) https://www.mediawiki.org/wiki/File:Call_graph_of_MediaWiki%E2%80%99s_direc… I plan to improve this software (see README on GitHub), please say if you if you are interested by this type of graph and/or interested in contributing. Thanks, Seb35 [1] https://en.wikipedia.org/wiki/Call_graph (the overapproximation of the static call graph to be precise) [2] https://www.mediawiki.org/wiki/Extension:MediaWikiFarm [3] http://phpcallgraph.sourceforge.net [4] https://github.com/Seb35/phpcallgraph

3 2

Active/inactive Summit proposals (was Re: Wikimedia Developer Summit Weekly)
by Quim Gil 11 Nov '16

11 Nov '16

Hi Jonathan, On Thu, Nov 10, 2016 at 7:12 PM, Jonathan Morgan <jmorgan(a)wikimedia.org> wrote: > Hi Quim, > > Could you provide a little more detail about what is required from session > proposers for the Nov. 28th deadline? It says "Deadline for consolidating a > discussion, regularly summarized in the proposal." But I'm not sure yet I'm > expected to do. > > I see that a plurality of submissions are currently in the "missing active > discussion" lane on the Phab board. To me, that wording implies that unless > there is active discussion on the phab ticket, the proposal is unlikely to > be selected. Is that accurate? If so, what kind of discussion should I be > encouraging, as a session proposer, and how much discussion is enough? > Your question is totally fair. :) We are building this process as we go, and your ideas and criticism are very important ingredients. I have tried to explain reasons and expectations about this deadline at https://www.mediawiki.org/wiki/Wikimedia_Developer_Summit/2017/Call_for_par… Additional questions and feedback about this deadline and the selection process in general are welcome in the related Talk page: https://www.mediawiki.org/wiki/Talk:Wikimedia_Developer_Summit/2017/Call_fo… > It seems clear that I should be letting people know about my session. > Should I encourage them to post a comment indicating their interest, or to > ask a question in the thread? Or is it enough if some people subscribe to > the task? > "Passive" demonstrations of interest like subscribing to the related Phabricator task (or awarding tokens, a possibility that we have started to discuss) are definitely useful to prove that someone is interested about the topic beyond the person or small group proposing it. However, active discussions are the sauce of the Summit. There is a lot of competition for the pre-scheduled slots. We'd rather assign these slots to the discussions that are already ongoing and will clearly benefit from, say, well advertised 90 minutes in one room with video recording. Theoretically relevant proposed topics relying on a discussion just starting at the Summit are playing a gable. It might just work, but from the Program committee perspective that is risky gamble to bet our (rather expensive) space and participants' attention span. -- Quim Gil Engineering Community Manager @ Wikimedia Foundation http://www.mediawiki.org/wiki/User:Qgil

1 0

The Revision scoring weekly update
by Aaron Halfaker 10 Nov '16

10 Nov '16

Hey, This is the 29th weekly update from revision scoring team that we have sent to this mailing list. Deployments: - We deployed logging changes to ORES that will reduce the verbosity[1] - We also deployed revscoring 1.3.0 and new models built with it to WMF labs[2]. This won't change anything important from a user-perspective, but it paves the way for developing new modeling strategies. Maintenance and robustness: - We fixed puppet so that log file directories are also created on the celery worker nodes (affects wmflabs)[3] - We fixed an issue with our recall_at_fpr metrics which was incorrectly defined and implemented a recall_at_precision metric to take its place[4] New development: - We've made a lot of progress on modeling sentences and have just started experimenting with a sentence model from featured articles[5] - We're reviewing a dataset of spam/vandalism/attack new page creations for public release[6]. This dataset will help our collaborators work with us on modeling the quality of drafts and supporting new page triage. 1. https://phabricator.wikimedia.org/T149730 -- Deploy logging changes to ORES 2. https://phabricator.wikimedia.org/T150447 -- Deploy revscoring 1.3.0 and updated editquality and wikiclass to wmflabs 3. https://phabricator.wikimedia.org/T149925 -- /srv/log/ores/ not created on worker nodes 4. https://phabricator.wikimedia.org/T149825 -- Implement recall at precision (and fix FPR metrics) 5. https://phabricator.wikimedia.org/T148867 -- Implement sentences datascources & experiment with normalization. 6. https://phabricator.wikimedia.org/T150307 -- Create manually vetted dataset of spam/vandalism/attack pages Sincerely, Aaron from the Revision Scoring team

1 0

OOjs UI 0.18.0 release (breaking change)
by Volker E. 09 Nov '16

09 Nov '16

Hello everyone, we've released OOjs UI 0.18.0 today. It will be in MediaWiki core from 1.29.0-wmf.2, which will be deployed to Wikimedia production in the regular train, starting on Tuesday 15 November. As in this release there are six breaking changes, at least nominally, please carefully look over them to see if they affect your code. Breaking changes since last release: * TextInputWidget: remove `isValid()` method, deprecated since v0.12.3 (Ricordisamoa) Though named "isValid", this function has always returned a Promise, and not a boolean (the Promise was resolved with true/false). Way back over a year ago in v0.12.3 we introduced `getValidity()` instead, with saner semantics (it returns a Promise that is resolved or rejected depending on validitity), with the old function left in for backwards compatibility. We're now removing the old function; if you're still using it, you'll need to switch over. * ComboBoxWidget: Remove this deprecated alias for ComboBoxInputWidget (James D. Forrester) We renamed the `ComboBoxWidget` to `ComboBoxInputWidget` a year ago, refactoring it to inherit from `TextInputWidget`, with the old names left as deprecated backwards-compatible options. We're now removing the old name; if you're still using it, you'll need to simply switch over the name of the widget you call. * core: Remove {add|remove}CaptureEventListener (James D. Forrester) We provided 'addCaptureEventListener' and its sibling as proxies for 'node.addEventListener' and its sibling with special code to support Internet Explorer 8. However, from version 0.15.0 we dropped support for that browser (as MediaWiki did), so this indirection was no longer necessary. We're now removing the old methods; if you're still using it, you'll need to simply switch over to the native ones. * icons: Remove deprecated alias 'photoGallery' (Ed Sanders) We renamed the 'photoGallery' icon to 'imageGallery' in v0.13.3 in November 2015, and left the old name as a duplicate for a while for backwards compatibility. We're now removing the old name; if you're still using it, you'll need to simply switch over to the new one. * InputWidget: Remove deprecated #setRTL function (James D. Forrester) We renamed the 'setRTL' function to 'setDir' in v0.13.1 to be more standard in our naming and not imply that LTR is the normal direction. We left the old name for more than a year, but now it's removed, so you'll switch from passing a boolean to one of the strings 'ltr' and 'rtl'. * MediaWiki theme: Remove deprecated `constructive` variables (Volker E) We scrapped the 'constructive' flagged state in the MediaWiki theme some time ago. This also removes the Less variables, which we had temporarily set to the same values as the 'progressive' flag. This might be a breaking change if you were using these downstream, but it is unlikely. Deprecations since last release: * Break out parts of TextInputWidget into a new SearchInputWidget (Prateek Saxena) TextInputWidget is being simplified to reduce load, with specialised assumptions around behaviour and what icons to display by default moved down into a bespoke sub-classed widget for that use case. The old parameters will be respected for now for backwards-compatibility, but please switch over soon if you're using the widget for search. * CapsuleMultiSelectWidget: Rename to CapsuleMultiselectWidget (Bartosz Dziewoński) The capital letter on the 'S' is out of keeping with the rest of our widgets, so we renamed it. The old name is left for backwards-compatibility for at least one full release cycle, but please do switch over sooner rather than later. Additional details are in the full changelog[0]. If you have any further queries or need help dealing with deprecations, please let me know. As always, a general set of library documentation is available on mediawiki.org[1], and there is some comprehensive generated code-level documentation and interactive demos hosted on doc.wikimedia.org[2]. [0] - https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md [1] - https://www.mediawiki.org/wiki/OOjs_UI [2] - https://doc.wikimedia.org/oojs-ui/master/ Best, Volker -- Senior UX Engineer, Editing Wikimedia Foundation volker.e [at] wikimedia @Volker_E

1 0

2016-11-09 Scrum of Scrums meeting notes
by Grace Gellerman 09 Nov '16

09 Nov '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-11-09 =2016-11-09= ==Product== ===Reading=== ==== Mobile Content Service ==== * Deployed: * Added more testing of response formats. * Removed hard-coded blacklist for most-read. Now using a more dynamic way to filter out pages that should not appear in the list of most-read articles. * Working on figuring out a short-term and medium-term solution for too small thumbnails for TFA and POTD in feed. (Once we get a better thumbnail API then we would be eager to switch to that, of course.) - Extra info: The cause of this problem is that now summary data (including a thumbnail) for the feed gets hydrated using the details from the /page/summary endpoint, and that is currently always capping the thumbnail size to 320px. A potential medium-term solution would be to increase the thumnails size cap in the summary endpoint from 320px to 640px and have the clients change the thumbnail URLs to have the size capped to at most 320px for the items the client is showing at a smaller size (trending, link previews, ...). https://phabricator.wikimedia.org/T149450 ====Android==== * Current sprint (https://phabricator.wikimedia.org/project/view/2331/): * Continuing Q2 goals for Wikidata descriptions * Beta coming soon * Cleaned up lots of little tech debts * Fix some UI bugs and memory leaks * Next sprint: * More Q2 goals for Wikidata descriptions (mostly polish) ====Web==== * Current sprint: https://phabricator.wikimedia.org/project/board/2336/ - * Hovercards re-write - * Page images API change to return free and non-free images - * Bugfixes - * Trending service * Next sprint: * Similar to current sprint * Also tech debt ====iOS=== https://phabricator.wikimedia.org/project/view/2220/ * Last week: - * In the news - bug fixes, UI updates, & tweaks to notification scheduling logic - * Fixed remaining issues from persistance layer update - * Finished first pass of accessibility changes - VoiceOver improvements for the explore feed & both widgets * This week: * More 5.3.0 beta feedback & fixes * Add donation announcement card to the news feed * Set up nightly alpha builds and investigate speedup of automated tests run on each pull request ==== Reading Infrastructure ==== * Not blocking/blocked * finishing up action API error localization and pageview data integration (T47843, T144865) * planning to deploy the latter with PageViewInfo extension in first week of December === Discovery: Interactive Team === * Launching <mapframe> on ruwiki today * Shared multilingual tabular and map data on Commons is on beta cluster, getting ready for launch, hopefully within 1-2 weeks ** Posted on wikitech-l, FB, T134426 ** Demo: https://en.wikipedia.beta.wmflabs.org/wiki/Maplink-page and https://en.wikipedia.beta.wmflabs.org/wiki/Dimpvis_-_Fertility_vs_Life_Expe… === Community Tech === // Sorry, I won't be able to make it to the meeting today. * Started with the wishlist survey this week: https://meta.wikimedia.org/wiki/2016_Community_Wishlist_Survey ** Urge everyone to take a look and comment on proposals relevant to their field of expertise * Starting to work on updating CentralAuth migration scripts to populate the additional fields added for global watchlist. https://phabricator.wikimedia.org/T149111 * Work continues, albeit a little slowly, on the ticket for sending a cookie with each block to prevent abuse: https://phabricator.wikimedia.org/T5233 ** Can use more reviews: https://gerrit.wikimedia.org/r/#/c/48029/ ** Eventlogging for the feature: https://phabricator.wikimedia.org/T146230 * French copypatrol version ready to be deployed, waiting for Eranbot to start getting data (i.e. plagiarized edit records) for frwiki ===Wikidata / WMDE=== * more work on automated sitelinks for Wiktionary (Cognate extension) * Wikibase Repo federation / foreign repo access (for Wiktionary and Commons support) * RevisionSlider - out of beta (feature) for German and Arabic Wikipedia on Nov 22 (per community request) * ElectronPDF ** extension had security review, we addressed the issues and wait for review again ** depends on service to be deployed (it's also in security review) == Technology == === Analytics === * Blockers: none * Blocked: none Updates: ** Hiring: an offer is about to be made to a candidate, we continue to review new candidates ** MediaWiki History (edits, users, pages, all projectws except commons and wikisources) is being vetted, results seem good if not very good. *** Varnishkafka errors are down to a not-yet-seen level with Varnish4. Thanks Luca and the traffic team for the thorough work. === Architecture / ArchCom === === Release Engineering === * Blocking ** * Blocked ** * Updates ** 1.28 rc.1 today ** Help squash boogz! https://phabricator.wikimedia.org/project/board/1982/ === Security === * Security Reviews * Linter extension * Continued work on CSRF mitigation for anons ( https://phabricator.wikimedia.org/T40417) * Reviewing patch to login workflow ( https://gerrit.wikimedia.org/r/#/c/312865/) * Repairing OpenVAS scanning for FrTech * OATHAuth * Deployed extension on all private wikis * Deployed account prefix configuration in production ( https://gerrit.wikimedia.org/r/#/c/320266/) * Password Handling * Increased password length for bots to eight characters ( https://gerrit.wikimedia.org/r/#/c/318951/) * Strengthened password requirements for Abuse filter editors ( https://gerrit.wikimedia.org/r/#/c/319000/) * Strengthened password requirements for all users on private wikis ( https://gerrit.wikimedia.org/r/#/c/319598/) === Services === * Blockers: none * Updates: nothing big, tech debt and small improvements ** Working on improving CORS and redirection support in RESTBase: https://phabricator.wikimedia.org/T149295 ** Electron PDF Rendering Service passed security review - preparing for deployment. === Technical Operations === * Blocked: ** None * Blocking: ** None * Updates: ** Container registry implemented for our kubernetes goal. It will be read only of course. ** labsdbs setup and provisioned ** ulsfo and codfw are varnish 4 ** gallium is no more (Big thank you to releng!) ** Got plans to deploy the Trending Edits Service by the end of November (with Services) === Performance == * Blocked ** Operations code review on Thumbor https://gerrit.wikimedia.org/r/#/c/315648/ https://gerrit.wikimedia.org/r/#/c/317522/ ** Consensus/Dev summit to unlock further work on active/active DC project (etcd, session storage, varnish, etc.) * Blocking: ** None * Updates: ** Ori is a volunteer now ** Decision about team management still pending ** UCMini in speed mode "blacklisting" to be treated as grade C browser merged ** Working through resource limiting on Thumbor (issue where IM consumes huge amounts of disk due to lack of limit) ** Investigation on frontend performance regression merged, to investigate if people opening tabs in background tabs are responsible for spike in higher percentiles after recent change === Fundraising Tech === * Bugfixing, log quieting * Fixing offline donation imports and mailing list exports * Still puzzling over CentralNotice bug ** patch: https://gerrit.wikimedia.org/r/318488 ** bug: https://phabricator.wikimedia.org/T144952 * Testing more streamlined mobile donation flows === Editing === ==== Collaboration ==== * Flow in multi datacenters: merge and test this week, release next week (hopefully) * Flow beta feature: fixing broken user pages before re-enabling the beta feature, no ETA for all pages to be fixed * ERI ReviewStream: agreement with Services about way to go and next steps * ERI Special:RecentChanges: new filters in Core, new UI in the making * Blocking or blocked: none

1 0

Shared localized maps data demo
by Yuri Astrakhan 09 Nov '16

09 Nov '16

I would like to show one of the projects that Interactive team has been hacking on: localizable maps data (GeoJSON), stored on Commons, and usable from multiple wikis. I hope we can get it polished and enabled in production soon enough - so far, lab's beta cluster only: https://en.wikipedia.beta.wmflabs.org/wiki/Maplink-page

1 1

Congratulations to {4} Outreachy'13 selects from Wikimedia
by Tony Thomas 09 Nov '16

09 Nov '16

Hello all, Happy to announce that we have *four* selections for Outreachy'13 this time for the December-March round! You can find the timeline for the event here - https://wiki.gnome.org/Outreachy/2016/DecemberMarch#Schedule Listing down the projects: 1. https://phabricator.wikimedia.org/T147727 - Provide cumulative statistics for all programs a user has participated in - Sejal Khatri. Mentors: Ragesoss, Capt_Swing 2. https://phabricator.wikimedia.org/T148074 - Create Python library to serialize Wikimedia Quiz format, GIFT quiz format, etc - Anna Liao. Mentors: John Mark Vandenberg, Marielle Volz 3. https://phabricator.wikimedia.org/T148287- 5 subprojects with the Reading Department at Wikimedia - Zareen Farooqui. Mentors: Tilman Bayer, Jon Katz 4. https://phabricator.wikimedia.org/T147953 - Hacking: Wiki Radio - Neslihan. Mentors: Nirzar, Adam Baso Congratulations to all students and mentors invovled. This time too, we had to turn down couple of strong applications due to strict outreachy norms on academic and other commitments. We welcome to try again for the 2017 Google Summer of Code and Outreachy as well, and continue at a volunteer capacity. Announcement Link: https://wiki.gnome.org/Outreachy/2016/DecemberMarch#Wikimedia Thanks, Tony Thomas <https://www.mediawiki.org/wiki/User:01tonythomas> Home <http://www.thomastony.me> | Blog <https://tttwrites.wordpress.com/> | ThinkFOSS <http://www.thinkfoss.com>

4 3

2016W45 ArchCom-RFC meeting: official thumb API
by Daniel Kinzler 09 Nov '16

09 Nov '16

Hi all! Today at the ArchoCom-RFC meeting [E355], we will talk about defining an official thumbnail API [T66214]. At last week's ArchCom meeting, Gabriel said that at least the first part of this RFC (without the hashing bit) is good for an IRC meeting. So let's see how for we can get today. Gabriel, can you say something regarding the status of the RFC, and the desired outcome of today's meeting? Thanks! The meeting will be at the usual time (Wednesday 21 UTC, 14 PDT, 23 CET) and place (#wikimedia-office). For an overview of ArchCOm activity, see [ArchComStatus]. -- Daniel PS: my appologies for initially linking to the wrong RFC in [E355]. [E355]: <https://phabricator.wikimedia.org/E355> [T66214]: <https://phabricator.wikimedia.org/T66214> [ArchComStatus]: <https://www.mediawiki.org/wiki/ArchComStatus> -- Daniel Kinzler Senior Software Developer Wikimedia Deutschland Gesellschaft zur Förderung Freien Wissens e.V.

1 0

1.28 release blocker bugs that welcome help
by Andre Klapper 08 Nov '16

08 Nov '16

MediaWiki 1.28.0 is around the corner [1] & some bug reports are marked as "need to get fixed for 1.28" [2] but do not yet have patches. Your attention, help, and code is welcome: I984b80815633a8 (Stub out DatabaseBase::getSearchEngine()) introduces breaking change without deprecation https://phabricator.wikimedia.org/T147683 Unnecessary words "Creating Category" appear when editing a category page https://phabricator.wikimedia.org/T149510 Error: 42P01 ERROR: table "unittest_user_groups" does not exist https://phabricator.wikimedia.org/T149454 WikiPage::getLastPurgeTimestamp() returning an array https://phabricator.wikimedia.org/T150191 Thanks in advance! andre [1] https://lists.wikimedia.org/pipermail/wikitech-l/2016-October/086859.html [2] https://phabricator.wikimedia.org/maniphest/query/B3w1whqqIxJj/#R -- Andre Klapper | Wikimedia Bugwrangler http://blogs.gnome.org/aklapper/

1 0

Phabricator access
by Denny Vrandečić 07 Nov '16

07 Nov '16

Phabricator still has my wikimedia.de Email-Address and tries to confirm it's me by sending an Email to that address. Is there a way to reset the email? (The weird thing is that I seem to receive those Emails on my regular gmail account, but for logging in it still requires that I verify the wikimedia.de address? I am a bit confused)

3 2

← Newer
1
...
5
6
7
8
9
10
11
Older →

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2016