[QA] [reading-wmf] browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce - Build # 771 - Failure!

[Dan Duvall]

This appears to be an issue solely with the annotation to the SauceLabs job
that is supposed to occur after each failed scenario. In other words, trust
the Jenkins build status over the SauceLabs status for now.

I'm able to reproduce the failure pretty consistently against Beta Cluster
with both a local FF WebDriver connection and via SauceLabs, so I would
consider it a true failure, possibly a need to refactor the test—I see a
`sleep 5` in the step so perhaps it's a timing issue.

On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <jrobson at wikimedia.org> wrote:

> QA peeps, this test keeps failing but when I click the sauce labs url
> https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells me
> it passed so we're having a lot of difficulty trying to debug this.
>
> Is it possible to grab some help from someone to work out why this keeps
> happening? It's responsible for most of our red builds now.
>
> Context:
> https://phabricator.wikimedia.org/T105589
> https://phabricator.wikimedia.org/T98476
>
> On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <jenkins-bot at wikimedia.org>
> wrote:
>
>> * FAILURE:
>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce
>> Build #771
>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/>
>> (Mon, 03 Aug 2015 02:42:00 +0000)*
>> *Test Result*
>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/>
>> 1 failed, 3 skipped
>> Failed Tests *Test Name**Duration**Age* Search.Search with search in
>> pages button
>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40
>> sec1
>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> All
>> Tests *Package**Duration**Fail**Skip**Total* (root)
>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26
>> min1368
>>
>> _______________________________________________
>> reading-wmf mailing list
>> reading-wmf at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>
>>
>
> _______________________________________________
> QA mailing list
> QA at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/qa
>
>


-- 
Dan Duvall
Automation Engineer
Wikimedia Foundation <http://wikimediafoundation.org>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20150803/a583acc8/attachment.html>