We get a lot of failures on the Chrome build.  The Firefox one seems a lot more stable in comparison although occasionally gets hit by similar problems.

Problem 1: There seems to be more connection problems here - sometimes page simply don't load. Usually hits Chrome builds. This can effect important steps such as opting into beta.  [0]

Problem 2: Selector issues - the language test Language selection.Closing language overlay (overlay button) persistently fails. It seems to fail to match an element even though I can see it in the screencast. Do selectors work differently in the Firefox driver to Chrome driver?As these work fine in Firefox [1]

Problem 3: Browser back button doesn't seem to work in the Chrome driver. Is that setup correctly? [2]

Problem 4: Opting into beta or alpha sometimes fails due to a cookie not setting correctly. I raised a bug [4] help on fixing that bug would be most appreciated.

[0] https://saucelabs.com/jobs/4e5d15a40a7f4c2eb06b59f78e87e859

[1] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_/

[2] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_/

[3] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit/

[4] https://bugzilla.wikimedia.org/show_bug.cgi?id=62583

On Thu, Mar 13, 2014 at 1:01 AM, <jenkins-no-reply@cloudbees.com> wrote:

FAILURE: MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome Build #318 (Thu, 13 Mar 2014 07:32:46 +0000)

Test Result

6 failed, 2 skipped

Failed Tests

Test Name	Duration	Age
Encourage new users to Keep Going.I see a KeepGoing message after completing my edit	1 min 11 sec	1
Language selection.Closing language overlay (browser button)	10 sec	4
Language selection.Closing language overlay (overlay button)	8.9 sec	24
Nearby pages.Nearby button visible	18 sec	1
Search.Search from Watchlist	12 sec	1
VisualEditor.I can edit a page using VisualEditor	19 sec	2

All Tests

Package	Duration	Fail	Skip	Total
(root)	22 min	6	2	62

_______________________________________________
Mobile-l mailing list
Mobile-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mobile-l