[QA] [WikimediaMobile] Problems with QA MobileFrontend Chrome builds

[Arthur Richards]

Thanks for bringing this convo to the lists. Chris has mentioned in IRC a
few times now ongoing issues with the Chrome driver and if I recall
correctly expressed that the QA group was hoping to get them resolved
shortly. Any update, Chris?


On Thu, Mar 13, 2014 at 11:03 AM, Jon Robson <jrobson at wikimedia.org> wrote:

> We get a lot of failures on the Chrome build.  The Firefox one seems a lot
> more stable in comparison although occasionally gets hit by similar
> problems.
>
> Problem 1: There seems to be more connection problems here - sometimes
> page simply don't load. Usually hits Chrome builds. This can effect
> important steps such as opting into beta.  [0]
> Problem 2: Selector issues - the language test Language selection.Closing
> language overlay (overlay button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_> persistently
> fails. It seems to fail to match an element even though I can see it in the
> screencast. Do selectors work differently in the Firefox driver to Chrome
> driver?As these work fine in Firefox [1]
> Problem 3: Browser back button doesn't seem to work in the Chrome driver.
> Is that setup correctly? [2]
> Problem 4: Opting into beta or alpha sometimes fails due to a cookie not
> setting correctly. I raised a bug [4] help on fixing that bug would be most
> appreciated.
>
> [0] https://saucelabs.com/jobs/4e5d15a40a7f4c2eb06b59f78e87e859
> [1]
> https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_/
> [2]
> https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_/
> [3]
> https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit/
> [4] https://bugzilla.wikimedia.org/show_bug.cgi?id=62583
>
>
> On Thu, Mar 13, 2014 at 1:01 AM, <jenkins-no-reply at cloudbees.com> wrote:
>
>>   * FAILURE: MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome
>> Build #318
>> <https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/>
>> (Thu, 13 Mar 2014 07:32:46 +0000)*
>> *Test Result*<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/>
>>  6 failed, 2 skipped
>>   Failed Tests  *Test Name**Duration**Age*  Encourage new users to Keep
>> Going.I see a KeepGoing message after completing my edit<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Encourage%20new%20users%20to%20Keep%20Going/I_see_a_KeepGoing_message_after_completing_my_edit> 1
>> min 11 sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/>  Language
>> selection.Closing language overlay (browser button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__browser_button_> 10
>> sec4<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/314/>  Language
>> selection.Closing language overlay (overlay button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Language%20selection/Closing_language_overlay__overlay_button_> 8.9
>> sec24<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/294/>  Nearby
>> pages.Nearby button visible<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Nearby%20pages/Nearby_button_visible> 18
>> sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/>  Search.Search
>> from Watchlist<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/Search/Search_from_Watchlist> 12
>> sec1<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/317/>  VisualEditor.I
>> can edit a page using VisualEditor<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)/VisualEditor/I_can_edit_a_page_using_VisualEditor> 19
>> sec2<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/316/>  All
>> Tests  *Package**Duration**Fail**Skip**Total*  (root)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/318/testReport/junit/(root)>22
>> min6262
>>
>
>
> _______________________________________________
> Mobile-l mailing list
> Mobile-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>
>


-- 
Arthur Richards
Software Engineer, Mobile
[[User:Awjrichards]]
IRC: awjr
+1-415-839-6885 x6687
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20140313/f47a6387/attachment.html>