[QA] [reading-wmf] browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce - Build # 771 - Failure!

[Toby Negrin]

Agree -- thanks Jon

On Tue, Aug 4, 2015 at 5:21 AM, Joaquin Oltra Hernandez <
jhernandez at wikimedia.org> wrote:

> Thanks Jon for consistently paying attention to the browser tests. You
> rock.
>
> On Tue, Aug 4, 2015 at 2:21 AM, Jon Robson <jrobson at wikimedia.org> wrote:
>
>> Okay in this case it was actually a failing test. Saucelabs was
>> unfortunately masking it. Fix has been merged and Firefox search in pages
>> is now working again. Thanks guys!
>>
>>
>> On Mon, Aug 3, 2015 at 2:48 PM, Dan Duvall <dduvall at wikimedia.org> wrote:
>>
>>> This appears to be an issue solely with the annotation to the SauceLabs
>>> job that is supposed to occur after each failed scenario. In other words,
>>> trust the Jenkins build status over the SauceLabs status for now.
>>>
>>> I'm able to reproduce the failure pretty consistently against Beta
>>> Cluster with both a local FF WebDriver connection and via SauceLabs, so I
>>> would consider it a true failure, possibly a need to refactor the test—I
>>> see a `sleep 5` in the step so perhaps it's a timing issue.
>>>
>>> On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <jrobson at wikimedia.org>
>>> wrote:
>>>
>>>> QA peeps, this test keeps failing but when I click the sauce labs url
>>>> https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells
>>>> me it passed so we're having a lot of difficulty trying to debug this.
>>>>
>>>> Is it possible to grab some help from someone to work out why this
>>>> keeps happening? It's responsible for most of our red builds now.
>>>>
>>>> Context:
>>>> https://phabricator.wikimedia.org/T105589
>>>> https://phabricator.wikimedia.org/T98476
>>>>
>>>> On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <jenkins-bot at wikimedia.org>
>>>> wrote:
>>>>
>>>>> * FAILURE:
>>>>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce
>>>>> Build #771
>>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/>
>>>>> (Mon, 03 Aug 2015 02:42:00 +0000)*
>>>>> *Test Result*
>>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/>
>>>>> 1 failed, 3 skipped
>>>>> Failed Tests *Test Name**Duration**Age* Search.Search with search in
>>>>> pages button
>>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40
>>>>> sec1
>>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> All
>>>>> Tests *Package**Duration**Fail**Skip**Total* (root)
>>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26
>>>>> min1368
>>>>>
>>>>> _______________________________________________
>>>>> reading-wmf mailing list
>>>>> reading-wmf at lists.wikimedia.org
>>>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> QA mailing list
>>>> QA at lists.wikimedia.org
>>>> https://lists.wikimedia.org/mailman/listinfo/qa
>>>>
>>>>
>>>
>>>
>>> --
>>> Dan Duvall
>>> Automation Engineer
>>> Wikimedia Foundation <http://wikimediafoundation.org>
>>>
>>> _______________________________________________
>>> reading-wmf mailing list
>>> reading-wmf at lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>>
>>>
>>
>> _______________________________________________
>> reading-wmf mailing list
>> reading-wmf at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>
>>
>
> _______________________________________________
> reading-wmf mailing list
> reading-wmf at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20150804/9d78a39e/attachment.html>