[QA] [reading-wmf] browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce - Build # 771 - Failure!

[Jon Robson]

Okay in this case it was actually a failing test. Saucelabs was
unfortunately masking it. Fix has been merged and Firefox search in pages
is now working again. Thanks guys!


On Mon, Aug 3, 2015 at 2:48 PM, Dan Duvall <dduvall at wikimedia.org> wrote:

> This appears to be an issue solely with the annotation to the SauceLabs
> job that is supposed to occur after each failed scenario. In other words,
> trust the Jenkins build status over the SauceLabs status for now.
>
> I'm able to reproduce the failure pretty consistently against Beta Cluster
> with both a local FF WebDriver connection and via SauceLabs, so I would
> consider it a true failure, possibly a need to refactor the test—I see a
> `sleep 5` in the step so perhaps it's a timing issue.
>
> On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <jrobson at wikimedia.org> wrote:
>
>> QA peeps, this test keeps failing but when I click the sauce labs url
>> https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells me
>> it passed so we're having a lot of difficulty trying to debug this.
>>
>> Is it possible to grab some help from someone to work out why this keeps
>> happening? It's responsible for most of our red builds now.
>>
>> Context:
>> https://phabricator.wikimedia.org/T105589
>> https://phabricator.wikimedia.org/T98476
>>
>> On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <jenkins-bot at wikimedia.org>
>> wrote:
>>
>>> * FAILURE:
>>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce
>>> Build #771
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/>
>>> (Mon, 03 Aug 2015 02:42:00 +0000)*
>>> *Test Result*
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/>
>>> 1 failed, 3 skipped
>>> Failed Tests *Test Name**Duration**Age* Search.Search with search in
>>> pages button
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40
>>> sec1
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> All
>>> Tests *Package**Duration**Fail**Skip**Total* (root)
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26
>>> min1368
>>>
>>> _______________________________________________
>>> reading-wmf mailing list
>>> reading-wmf at lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>>
>>>
>>
>> _______________________________________________
>> QA mailing list
>> QA at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/qa
>>
>>
>
>
> --
> Dan Duvall
> Automation Engineer
> Wikimedia Foundation <http://wikimediafoundation.org>
>
> _______________________________________________
> reading-wmf mailing list
> reading-wmf at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20150803/9b96d409/attachment-0001.html>