On Fri, Jul 10, 2009 at 6:35 PM, dan nessettdnessett@yahoo.com wrote:

I don't want to irritate people by asking inappropriate questions on this list. So please direct me to the right list if this is the wrong one for this question.

I ran parserTests and 45 tests failed. The result was:

Passed 559 of 604 tests (92.55%)... 45 tests failed!

I expect this indicates a problem, but sometimes test suites are set up so certain tests fail. Is this result good or bad?

We usually have about 14 failures. We should really be able to mark them as expected, but our testing framework doesn't support that at the moment. The current workaround is to use --record and --compare, but that's a pain for a few reasons.

I get 49 test failures. It looks like someone broke a lot of stuff. It happens; frankly, we don't take testing too seriously right now. There are no real automated warnings. Brion used to have a bot post parser test results daily to wikitech-l, but that was discontinued. So people tend to break parser tests without noticing.