Re: [Analytics] Problems with QA MobileFrontend Chrome builds

---------- Forwarded message ---------- From: Jon Robson &lt;jrobson(a)wikimedia.org&gt; Date: Thu, Mar 13, 2014 at 11:03 AM Subject: Problems with QA MobileFrontend Chrome builds To: jenkins-no-reply(a)cloudbees.com Cc: Chris McMahon &lt;cmcmahon(a)wikimedia.org&gt;rg>, mobile-l < mobile-l(a)lists.wikimedia.org&gt;gt;, "QA (software quality assurance) for Wikimedia projects." &lt;qa(a)lists.wikimedia.org&gt; We get a lot of failures on the Chrome build. The Firefox one seems a lot more stable in comparison although occasionally gets hit by similar problems. Problem 1: There seems to be more connection problems here - sometimes page simply don't load. Usually hits Chrome builds. This can effect important steps such as opting into beta. [0] Problem 2: Selector issues - the language test Language selection.Closing language overlay (overlay button)<https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.b… persistently fails. It seems to fail to match an element even though I can see it in the screencast. Do selectors work differently in the Firefox driver to Chrome driver?As these work fine in Firefox [1] Problem 3: Browser back button doesn't seem to work in the Chrome driver. Is that setup correctly? [2] Problem 4: Opting into beta or alpha sometimes fails due to a cookie not setting correctly. I raised a bug [4] help on fixing that bug would be most appreciated. [0] https://saucelabs.com/jobs/4e5d15a40a7f4c2eb06b59f78e87e859 [1] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs… [2] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs… [3] https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs… [4] https://bugzilla.wikimedia.org/show_bug.cgi?id=62583 On Thu, Mar 13, 2014 at 1:01 AM, &lt;jenkins-no-reply(a)cloudbees.com&gt; wrote: -- Jon Robson * http://jonrobson.me.uk * https://www.facebook.com/jonrobson * @rakugojon