They are indeed false positives. I think I know what's happening here. Basically the tests are not atomic - they are trying to watch an article that is already watched and have the consequence of making that article watched. I have an idea of how to fix this.

Does Watir have a concept of a tear down step?


On Wed, Mar 19, 2014 at 1:45 PM, Arthur Richards <arichards@wikimedia.org> wrote:
I tested these manually and think they may be false positives, but can someone else take a look to make sure these tests and what's in betalabs is OK? We should get this resolved asap so we can be sure the state of things is healthy on betalabs for tomorrow's deployment.


On Wed, Mar 19, 2014 at 12:19 PM, <jenkins-no-reply@cloudbees.com> wrote:
FAILURE: MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox Build #434 (Wed, 19 Mar 2014 18:40:00 +0000)

Test Result

2 failed, 1 skipped

Failed Tests

Test NameDurationAge
Manage Watchlist.Add an article to the watchlist 37 sec1
Manage Watchlist.Remove an article from the watchlist 38 sec1

All Tests

PackageDurationFailSkipTotal
(root)30 min2161
Wikitext Editor (TEST RUN ON WIKIPEDIA 1 min 14 sec003




--
Arthur Richards
Software Engineer, Mobile
[[User:Awjrichards]]
IRC: awjr