[QA] red, green, refactor
Chris McMahon
cmcmahon at wikimedia.org
Wed Jun 12 01:35:39 UTC 2013
After doing some sorting of which tests are properly supported in which
environments, the current status of the builds at
https://wmf.ci.cloudbees.com is:
https://wmf.ci.cloudbees.com/job/browsertests-test2.wikipedia.org-windows-internet_explorer_9/
is
failing because of a bug in VisualEditor in IE9:
https://bugzilla.wikimedia.org/show_bug.cgi?id=49187
https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_9/
is
failing because of a bug in AFTv5 in IE9:
https://bugzilla.wikimedia.org/show_bug.cgi?id=49445
https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-windows-internet_explorer_8/
is
failing because of a bug in UniversalLanguageSelector (ULS) in IE8
https://bugzilla.wikimedia.org/show_bug.cgi?id=49447
Some other builds are still somewhat flaky[1], and it seems much of the
flakyness, particularly in beta labs, has to due with failure to login
properly. I'm going to see if I can improve that situation shortly.
It is awfully nice to finally have all the IE builds sorted properly and
running fairly reliably. Between a number of new tests, some changes in
beta labs, an issue with linking to the correct Sauce Labs pages, we've had
a fair amount of technical debt in recent times, but from now on a red
build indicates an issue to be addressed and not a false failure.
[1] https://www.google.com/search?q=flaky+tests
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20130611/351262a3/attachment.html>
More information about the QA
mailing list