[QA] ULS changes now triggers Browsertests!!

Antoine Musso hashar+wmf at free.fr
Thu Dec 5 14:11:26 UTC 2013


Hello,

Amir, Niklas, Ċ½eljko and I had a pairing session this morning. We
focused on browser tests for the UniversalLanguageSelector and making
them run using phantomjs and a default installation of MediaWiki and the
extension.

Lot of the tests are meant to be run against the beta wikis,
commons.wikimedia.org or translatewiki.net.  They thus do not pass on a
freshly installed wiki as it used by continuous integration system.

To workaround it I proposed to tag the tests requiring special
configuration with @needs-custom-settings and skip them entirely when
running the tests automatically.  Related patch:
  https://gerrit.wikimedia.org/r/#/c/97487/

The tests are now passing:

 https://integration.wikimedia.org/ci/job/mwext-browsertests-UniversalLanguageSelector-phantomjs/69/

Each build archive a HTML report generated by cucumber (report.html) and
have Jenkins produce a test report.


Although the tests are being run whenever a patchset is generated, they
are not yet blocking changes that break the tests.  We will make them
'voting' later on once proven they are stable enough.

Need to do the same process for other extensions having browsertests :-D

cheers,

-- 
Antoine "hashar" Musso




More information about the QA mailing list