New subject: Is this the right list to ask questions about parserTests

14 Jul 2009


      Can anyone tell me which of the parser tests are supposed to fail? Also, is there a trunk version for which only these tests fail?
--- On Fri, 7/10/09, Aryeh Gregor Simetrical+wikilist@gmail.com wrote:
...
From: Aryeh Gregor Simetrical+wikilist@gmail.com
Subject: Re: [Wikitech-l] Is this the right list to ask questions about parserTests
To: "Wikimedia developers" wikitech-l@lists.wikimedia.org
Date: Friday, July 10, 2009, 3:49 PM
On Fri, Jul 10, 2009 at 6:35 PM, dan
nessettdnessett@yahoo.com
wrote:
...
I don't want to irritate people by asking
inappropriate questions on this list. So please direct me to
the right list if this is the wrong one for this question.
...
I ran parserTests and 45 tests failed. The result
was:
...
Passed 559 of 604 tests (92.55%)... 45 tests failed!
I expect this indicates a problem, but sometimes test
suites are set up so certain tests fail. Is this result good
or bad?
We usually have about 14 failures.  We should really
be able to mark
them as expected, but our testing framework doesn't support
that at
the moment.  The current workaround is to use --record
and --compare,
but that's a pain for a few reasons.
I get 49 test failures.  It looks like someone broke a
lot of stuff.
It happens; frankly, we don't take testing too seriously
right now.
There are no real automated warnings.  Brion used to
have a bot post
parser test results daily to wikitech-l, but that was
discontinued.
So people tend to break parser tests without noticing.

Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l