We just pushed some new UI elements from beta to stable which has now hit beta labs. These haven't propagated to test2 or enwiki yet so these tests are now failing.

How best should we do prevent these failures from recording while these servers haven't been updated? Is there anyway browser tests can be clever and run themselves based on the current commit on master of the server they are hitting?

On Thu, Jan 23, 2014 at 1:36 PM, jenkins-no-reply@cloudbees.com wrote:

• FAILURE: MobileFrontend-test2.m.wikipedia.org-linux-firefox Build

#218 https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/ (Thu, 23 Jan 2014 21:13:13 +0000)* *Test Result*https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/ 10 failed, 3 skipped Failed Tests *Test Name**Duration**Age* Editor.Closing editor (browser button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Editor/Closing_editor__browser_button_30 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Editor.Closing editor (overlay button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Editor/Closing_editor__overlay_button_31 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Language selection.Closing language overlay (browser button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_22 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Lead image tutorial.See tutorial as new userhttps://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Lead%20image%20tutorial/See_tutorial_as_new_user31 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Lead image uploads.Closing upload preview (browser button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Lead%20image%20uploads/Closing_upload_preview__browser_button_32 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Lead image uploads.Closing upload preview (overlay button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Lead%20image%20uploads/Closing_upload_preview__overlay_button_34 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Notification.Closing notifications (overlay button)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Notification/Closing_notifications__overlay_button_29 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Notification.Opening notificationshttps://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Notification/Opening_notifications1.1 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Search.Opening searchhttps://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Search/Opening_search4 ms2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ Special:Uploads tutorial.Link to tutorial for new userhttps://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)/Special_Uploads%20tutorial/Link_to_tutorial_for_new_user32 sec2https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/216/ All Tests *Package**Duration**Fail**Skip**Total* (root)https://wmf.ci.cloudbees.com/job/MobileFrontend-test2.m.wikipedia.org-linux-firefox/218/testReport/junit/(root)16 min10351