I have some spare time and am trying to do something about the test failure noise. I figured I'd start with enwiki because when I see test failure there, I get particularly nervous.

On Sun, Feb 9, 2014 at 11:19 PM, jenkins-no-reply@cloudbees.com wrote:

*Test Name**Duration**Age* Header Validation.Receive notification message - Upload Iconhttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Header%20Validation/Receive_notification_message___Upload_Icon 12 sec27https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/269/

mobile-frontend-photo-upload-anon was updated with new language (login -> log in) in commit 5eba35e78f028fdaab61de2e28dcc9f025ab236f. This is currently live on enwiki (as visible with https://en.wikipedia.org/wiki/MediaWiki:Mobile-frontend-photo-upload-anon), but for some reason the actual toast message appears out of date. What is causing this?

Login.Already logged inhttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Login/Already_logged_in24 sec19https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/277/

The related code change for this (https://gerrit.wikimedia.org/r/#/c/110118/) is not currently on enwiki (should be with next deployment to enwiki on Thursday). In a given feature file (eg features/login.feature), is it possible to specify target environments (eg @en.m.wikipedia.org) for individual scenarios, or do the targets only apply to the whole feature file?

Search.Search from Loginhttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Search/Search_from_Login22 sec 5https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/291/

Search.Search from Nearbyhttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Search/Search_from_Nearby19 sec 5https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/291/ Search.Search from Uploadshttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Search/Search_from_Uploads21 sec 5https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/291/ Search.Search from Watchlisthttps://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/296/testReport/junit/(root)/Search/Search_from_Watchlist21 sec 5https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.org-linux-firefox/291/

None of these are currently live on enwiki - the feature file should not currently have @en.m.wikipedia.org set as one of the targets.