[QA] red, green, refactor

Chris McMahon cmcmahon at wikimedia.org
Wed Jun 12 01:35:39 UTC 2013


After doing some sorting of which tests are properly supported in which
environments, the current status of the builds at
https://wmf.ci.cloudbees.com is:

https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_9/
is
failing because of a bug in VisualEditor in IE9:
https://bugzilla.wikimedia.org/show_bug.cgi?id=49187

https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_9/
is
failing because of a bug in AFTv5 in IE9:
https://bugzilla.wikimedia.org/show_bug.cgi?id=49445

https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_8/
is
failing because of a bug in UniversalLanguageSelector (ULS) in IE8
https://bugzilla.wikimedia.org/show_bug.cgi?id=49447

Some other builds are still somewhat flaky[1], and it seems much of the
flakyness, particularly in beta labs, has to due with failure to login
properly.   I'm going to see if I can improve that situation shortly.

It is awfully nice to finally have all the IE builds sorted properly and
running fairly reliably.  Between a number of new tests, some changes in
beta labs, an issue with linking to the correct Sauce Labs pages, we've had
a fair amount of technical debt in recent times, but from now on a red
build indicates an issue to be addressed and not a false failure.

[1] https://www.google.com/search?q=flaky+tests
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20130611/351262a3/attachment.html>


More information about the QA mailing list