Hello,
Jenkins now detects parser tests registered in MediaWiki extensions, which has some side effects (see end of this mail).
I have merged today a change in MediaWiki core that let it recognize parser tests in extensions. That is done by looking at the $wgParserTestFiles https://gerrit.wikimedia.org/r/#/c/63164/
Then I updated our MediaWiki extensions Jenkins jobs to have them invoke phpunit with '--testsuite extensions' which make use of the above code. The job change is https://gerrit.wikimedia.org/r/#/c/62622/
Some extensions were missing and have been added to Jenkins and Zuul: - Arrays - BookManager - NaturalLanguageList - ReplaceSet - Transliterator - Variables
Others are now running unit tests in addition to lint checks: - Cite - Poem - wikihiero
Some extensions are failing parser tests and need action:
BookManager: https://bugzilla.wikimedia.org/49879 NaturalLanguageList https://bugzilla.wikimedia.org/49881 Transliterator https://bugzilla.wikimedia.org/49882
The Math extension does not pass test since texvc is not build. We need a job to verify it compiles properly and the tests are passing. That is logged as https://bugzilla.wikimedia.org/49884
I have disabled voting for the four related jobs.