On 05/07/2013 08:47 AM, Andre Klapper wrote:
On Mon, 2013-05-06 at 12:52 -0700, Greg Grossmeier wrote:
Also, the majority of bugs that are in the Highest/Immediate priority level (from my gut assessment, I don't have the data here) are found after a deploy to non-WP projects.
I agree with that impression: We don't get many (manually found) highest/immediate prio bug reports after the first deployment phase, most of them after phase 2, and a few after phase 3 (e.g. when we failed to understand the explosive force of an issue).
Backing that impression up with Bugzilla data: <tl;dr>: That's hard.
Long version: I tried a Bugzilla query for tickets created in the last four months, that at some point in their lifetime had Priority = {Highest | Immediate}, restricted it to the products {MediaWiki, MediaWiki extensions, Wikimedia}, made buglist.cgi display the "Opened" column (via "Change columns" at the bottom); dropped the last 9 characters of the "Opened" column (to get rid of the time and only have the date, though that's UTC so does not perfectly fit our deployment *time*), imported the resulting CSV into OOCalc, cumulated a bit, and summed up all those tickets that got filed in a certain deployment phase && at *some* point became highest/immediate. See attachment.
The results don't back up my impression. One potential reason: Development teams file tickets *at some point* and don't see priority immediately, and when tickets get triaged they get higher priority at some point later on. Maybe results would look different if I the query excluded reporters that are employees? Don't want to spend too much time trying though.
andre
Andre, thanks for trying to run the query on this. Yeah, we split, rename, reprioritize, and otherwise mess with our Bugzilla tickets so often that it'd probably be a huge travail to thoroughly research the question I asked, and that would delay this decision beyond this week. So I'm fine with going on people's rough estimates and impressions instead of going the "ALL DATA ALL THE TIME" route.