Wikitech-l February 2018

wikitech-l@lists.wikimedia.org

53 participants
60 discussions

(Large) Discrepancies between API-Statistics and Stepwise API-based extraction [Update]
by Rüdiger Gleim 02 Feb '18

02 Feb '18

Hello, thanks to Brad for the information regarding the discrepancies between the actual numbers fetched from the API and the Statistics which stem from a dedicated (but not necessarily sync) table. Running initSiteStats.php --update --active --use-master solved most issues. Since I do not own the Wiki nor have access to the system I politely asked the Admin to do so. What remains is a gap between the number of edits/revisions from the statistics page and the numbers I get when iterating ov6er the pages and fetching queries via: http://wiki.muenster.org/api.php?action=query&prop=revisions&pageids=2085&r… The number of pages and users do match- so Iam sure I do not miss any pages. Statistics report 37660 revisions, querying via API over all pages sums up to 32659, thus missing 5001 revisions. Running initSiteStats.php did also update the Statistics report from 46329 to 37660. => Is my assumpting correct that the sum of all Revisions queried via api.php?action=query&prop=revisions&pageids= should match the statistics number of revisions? => At first I also queried for content which resulted in 968 cases where I lacked permissions to query. So I omitted the content for test purposes. But this did not solve the problem. => What is the difference between continue=|| and rvcontinue=123456? Until now I have only been using rvcontinue. Including continue did not make a difference, but I could not find out what the meaning of continue=|| is. Thank you (again) for your time and support. Best Wishes, Rüdiger

2 1

Intro to Performance talk from Readers Monthly December 2017
by Adam Baso 02 Feb '18

02 Feb '18

Hello! I'll keep this speedy. Ian Marlier from the Wikimedia Foundation's Performance team presented an Intro to Performance last month at the Readers monthly meeting. Check it out! *YouTube:* https://www.youtube.com/watch?v=TCOOh7eJ08k *WebM:* https://commons.wikimedia.org/wiki/File:Intro_to_Performance.webm *PDF:* https://commons.wikimedia.org/wiki/File:Intro_to_Performance.pdf -Adam

1 0

Special:Export was overloading enwiki databases; limits have been set
by Jaime Crespo 02 Feb '18

02 Feb '18

Exporting pages on en.wikipedia may result on a failure, this is being investigated right now. For stability reasons, time to export pages has been temporarily limited to avoid an worse outage, afecting regular page views and edits. While we do not have right now any advice regarding changing behaviours when exporting pages, we advice to check any exports done are successful until this is resolved, specially if done unattended by bots- a portion of those exports could be failing and people may not be aware. Right now only a single, not-logged-in user is probably affected on en.wikipedia around 1200 times in the last 12 hours, but it could affect in the future other users on other wikis, too. This is publicly tracked on: https://phabricator.wikimedia.org/T186318 If you use the wikiexport function and it is still working for you/started failing, feel free to provide us feedback on the ticket above. Pregenerated dumps at https://dumps.wikimedia.org/backup-index.html or wikireplicas would be almost universally a better way to get mass-revisions. -- Jaime Crespo <http://wikimedia.org>

1 0

Test coverage reports for patchsets
by Kunal Mehta 02 Feb '18

02 Feb '18

Hi, I've been working on a tool, phpunit-patch-coverage[0], that tries to provide test coverage reports for patches before they are merged[1]. Since it takes 2-3 hours to do a full coverage report for MediaWiki core, the tool figures out what files were modified, and runs those tests. For now I've set up a job that runs for MediaWiki core, and leaves a comment like "PHP test coverage increased (or stayed the same)"[2] or "PHP test coverage decreased :-("[3]. This job is slow so it is run separately from unit tests to avoid delaying that feedback. I'm sure there are bugs, please report them in the Phabricator project[4], along with any feature requests on how we can make this more useful. This should be considered beta quality software for now :-). [0] https://packagist.org/packages/mediawiki/phpunit-patch-coverage [1] https://phabricator.wikimedia.org/T101544 [2] https://gerrit.wikimedia.org/r/#/c/407592/ [3] https://gerrit.wikimedia.org/r/#/c/407157/2 [4] https://phabricator.wikimedia.org/project/profile/3222/ -- Legoktm

1 0

RevisionInsertComplete vs. RevisionRecordInserted
by Stas Malyshev 01 Feb '18

01 Feb '18

Hi! I've noticed that RevisionInsertComplete hook is now deprecated in favor of RevisionRecordInserted. However, EventBus still uses RevisionInsertComplete. Is this going to change soon? If so, will the underlying event/topic change too? I couldn't find anything in Phabricator about this - is there plan to change it or still use old hook for now and foreseeable future? Thanks, -- Stas Malyshev smalyshev(a)wikimedia.org

2 2

Adding extension to packagist under "mediawiki" vendor
by Tobias Oetterer 01 Feb '18

01 Feb '18

Hey I have released a mediawiki extension and would like to make it available via composer. Obviously, I need the help of someone with access to the mediawiki vendor. I dug through the documentation on [0], especially the Packagist guidelines and tried to reach one of the listed people, alas to no avail. If anyone could point me in the right direction or better yet, has the needed permission to add [1] that would be wonderful. [0]: https://www.mediawiki.org/wiki/Manual:Developing_libraries [1]: https://github.com/oetterer/BootstrapComponents Cheers, Tobias -- If this email is rather brief, it is not meant to be impolite but to respect your time. <http://five.sentenc.es/> http://five.sentenc.es No trees were killed to send this message, but a large number of electrons were terribly inconvenienced Paderborn University Zentrum IMT Warburger Straße 100 33098 Paderborn Office: N5.338 Phone: 05251/60-2194 Internet: <http://imt.uni-paderborn.de/> http://imt.uni-paderborn.de

2 2

MediaWiki codesearch updates, co-maintainers wanted
by Kunal Mehta 01 Feb '18

01 Feb '18

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, A few updates on codesearch.wmflabs.org: * The OOUI git repository is now indexed * The operations/dns and operations/mediawiki-config git repositories are now indexed * Should properly restart automatically after rebooting the instance * Better error messages and diagnostics from the web if a hound instance goes down[1] At the same time, I'm also looking for anyone interested in co-maintaining the service with me. So far it's been relatively stable, but I don't think it will always be like that - and there has been one outage where I wasn't around. Please let me know offlist if you are interested in helping out. It's a small bit of Python plus some docker. [1] https://codesearch.wmflabs.org/_health Thanks! - -- Legoktm -----BEGIN PGP SIGNATURE----- iQJLBAEBCgA1FiEE+h6fmkHn9DUCyl1jUvyOe+23/KIFAlpyqVUXHGxlZ29rdG1A bWVtYmVyLmZzZi5vcmcACgkQUvyOe+23/KLexQ//RjstTE/y9/FUMbxZSyzGPP08 d/4ljCRQTN1/ZrpO2MDRCu1RZ0gAmKMffyCE/W/oVgeL6T/9kwPBgFI5PMChOeti BCvq9tvVht04NzitwSbxknK6UTLw8h/v2xsKYbcFIm9xTACs1XMYOQTFVt+zil4s lFHOCY8K2pQ1EnTtvDUgPoY7/iPfZuXSMYwQpPjGmDyJe13bwyKvUKf7YV1W4uji V01ifOj+poRRq8z2U98bLLWeu5odSGl/vcGriqWlnQQOaZ6ndqxjouzM50JY+R+M 4VaQ11v49jHGjg23Q0i2STU400T7Io53mjQqmTow7QdgkrGoosElDgVrF5+fanhr NScTnXrXM0j+6dfYOp97ut2W6ZlzaGaNAT7wD07ZP5MnCqAJBQqzKVyzU631Fts5 K5/Q1aOl8ijGe/g8sialKGBdxQ8nMbo5eHaWN2Ie+DMpEJQJJoPE/+prmxTDg8qy qUkPgZbNbv84zXilAiHQvet09rWVXsOfDg/z2F0s7Eg0X7GKSY2ywNARLEeVGLJ4 VFPc2VCJzx+eDd+56lT/7MupT7TcjoxL6Z4+hzSINM96ut3gEvKy/sA83i1xCxIv LjE7sHXJEHbUILARl/+MVcXScu+AGrO+hc5FCDl4D2lUEIN1MnkZ5Tm1TsWtw+9V MgYAKYuoaxbp5al3lJc= =LLsi -----END PGP SIGNATURE-----

1 0

+2 nomination for WMDE-leszek in mediawiki/*
by Addshore 01 Feb '18

01 Feb '18

Hi, I've filed <https://phabricator.wikimedia.org/T185593>, nominating WMDE-leszek for +2 in mediawiki/ repos. -- Addshore

2 1

MediaWiki PHP profiling - Now also on Beta Cluster
by Krinkle 01 Feb '18

01 Feb '18

Hi all, Wikimedia's production configuration of MediaWiki supports enabling request profiling, to obtain call-graphs, flame graphs, and other useful details about the PHP execution. In production, this can be enabled by using the WikimediaDebug browser extension. For instructions see https://wikitech.wikimedia.org/wiki/X-Wikimedia-Debug. Until now, none of these profiling modes were available on the Beta Cluster. As of today, the "Plaintext request profile" is supported on Beta Cluster. This profile can be obtained by adding ?forceprofile=1 to any web request, and making sure the X-Wikimedia-Debug header is set. To make this easier to enable from a web browser, the WikimediaDebug browser extension was updated (WikimediaDebug v1.9.1) to also send X-Wikimedia-Debug headers on Beta Cluster requests. (For the time being, the backend host names are ignored for Beta Cluster requests, this is a future to-do.) Example from cURL: $ curl -H 'X-Wikimedia-Debug: 1' ' https://en.wikipedia.beta.wmflabs.org/w/load.php?debug=false&modules=startu… ' Fr those with shell access, it can also be used on maintenance scripts (in production, or in the Beta Cluster) by setting PHP=hhvm before the mwscript command and adding the --profiler=text option. -- Timo [0] https://phabricator.wikimedia.org/T180766

1 0

Phabricator monthly statistics - 2018-01
by communitymetrics＠wikimedia.org 01 Feb '18

01 Feb '18

Hi Community Metrics team, This is your automatic monthly Phabricator statistics mail. Accounts created in (2018-01): 399 Active Maniphest users (any activity) in (2018-01): 937 Task authors in (2018-01): 533 Users who have closed tasks in (2018-01): 265 Projects which had at least one task moved from one column to another on their workboard in (2018-01): 302 Tasks created in (2018-01): 2325 Tasks closed in (2018-01): 1924 Open and stalled tasks in total: 37430 Median age in days of open tasks by priority: Unbreak now: 76 Needs Triage: 369 High: 631 Normal: 856 Low: 1118 Lowest: 1068 (How long tasks have been open, not how long they have had that priority) Active Differential users (any activity) in (2018-01): 20 TODO: Numbers which refer to closed tasks might not be correct, as described in https://phabricator.wikimedia.org/T1003 . Yours sincerely, Fab Rick Aytor (via community_metrics.sh on phab1001 at Thu Feb 1 00:00:29 UTC 2018)

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l February 2018