I'd like an accurate, visually pleasing way to count how many unreviewed revisions there are in trunk, for when I'm encouraging volunteer code review. TL;DR version: it would be great if someone fixed up RobLa's chart, corrected its errors, and put a chart generator in the CodeReview MediaWiki extension.
The JavaScript behind RobLa's CRStats chart http://toolserver.org/~robla/crstats/ gives me some current numbers. By inspecting http://toolserver.org/~robla/crstats/data/trunkall/crstatsdata.js I believe I see we have 279 revisions left to review in trunk.
But the CodeReview statistics page at https://secure.wikimedia.org/wikipedia/mediawiki/wiki/Special:Code/MediaWiki... mentions that there are 344 NEW revisions in /trunk . That's more than the 279 that Rob's script counts; which should I believe?
Rob believes the problem is with his script. He has checked to see whether the problem is that his report, run every night at midnight UTC, falls out of sync with the CodeReview statistics page; that's not it.
Rob says:
Bummer, it looks like my script.... I probably won't get around to fixing up the script, but I've got a couple ideas about how to fix it...
the details for those who care about what it would take to fix my script or just implement it correctly in PHP in MediaWiki. What throws my script off is that I'm calculating the revision history starting way back in history and moving forward, piecing together the history of code review from our revision log plus status changes. It used to be safe to assume that all revisions started life as "new", and then use the status changes to step each revision through the rest of the workflow. However, one new-ish feature of the CodeReview extension is the ability to automatically set the start state to "deferred" based on the path of the checkin, which means those changes never show up in the status change log. My initial hack was to step through twice: first time to determine the initial state (assuming that if initial state != final state, then final state was the actual initial state). A more correct approach is to just start at the end (where we have a correct accounting of state) and reconstruct states backwards.
On Sun, Aug 28, 2011 at 2:55 AM, Sumana Harihareswara sumanah@wikimedia.org wrote:
I'd like an accurate, visually pleasing way to count how many unreviewed revisions there are in trunk, for when I'm encouraging volunteer code review. TL;DR version: it would be great if someone fixed up RobLa's chart, corrected its errors, and put a chart generator in the CodeReview MediaWiki extension.
The JavaScript behind RobLa's CRStats chart http://toolserver.org/~robla/crstats/ gives me some current numbers. By inspecting http://toolserver.org/~robla/crstats/data/trunkall/crstatsdata.js I believe I see we have 279 revisions left to review in trunk.
But the CodeReview statistics page at https://secure.wikimedia.org/wikipedia/mediawiki/wiki/Special:Code/MediaWiki... mentions that there are 344 NEW revisions in /trunk . That's more than the 279 that Rob's script counts; which should I believe?
Is it possible that Rob's script doesn't count new revs in extensions that are not deployed at Wikimedia?
Roan
Sumana Harihareswara wrote:
I'd like an accurate, visually pleasing way to count how many unreviewed revisions there are in trunk, for when I'm encouraging volunteer code review. TL;DR version: it would be great if someone fixed up RobLa's chart, corrected its errors, and put a chart generator in the CodeReview MediaWiki extension.
Have you tried filing a bug in Wikimedia's bug tracker: https://bugzilla.wikimedia.org/?
MZMcBride
In case you're wondering about other code review statistics:
The 1.18 revision report https://secure.wikimedia.org/wikipedia/mediawiki/wiki/MediaWiki_roadmap/1.18... mentions 62 new revisions that need some action. The data behind Rob's chart at http://toolserver.org/~robla/crstats/crstats.118all.html says it's more like 73. But the revision report subtracts out several that are tagged no-deploy and the like. So it's accurate enough for our purposes.
Glancing away from commits for a moment: it's pretty easy to check on the number of unreviewed patches in Bugzilla via the needs-review keyword. That number right now is 478. I heartily welcome and encourage any coder to visit a few of those issues, see if the patch applies cleanly to current trunk, and give the original submitter some feedback.
https://bugzilla.wikimedia.org/buglist.cgi?keywords=patch%2C%20&query_fo...
On 31/08/11 21:48, Sumana Harihareswara wrote:
The 1.18 revision report https://secure.wikimedia.org/wikipedia/mediawiki/wiki/MediaWiki_roadmap/1.18...
We should really integrate that revision report into the CR extension.
Where is the code used to generate the report?
On Wed, Aug 31, 2011 at 1:41 PM, Ashar Voultoiz hashar+wmf@free.fr wrote:
On 31/08/11 21:48, Sumana Harihareswara wrote:
The 1.18 revision report https://secure.wikimedia.org/wikipedia/mediawiki/wiki/MediaWiki_roadmap/1.18...
We should really integrate that revision report into the CR extension.
Where is the code used to generate the report?
Latest version is here: https://gitorious.org/~hexmode/mwcrstats/hexmodes-mwcrstats/commits/master
Rob
wikitech-l@lists.wikimedia.org