[QA] Help needed! Re: [reading-wmf] browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce - Build # 50 - Still Failing!

[Jon Robson]

It's on/off.
It's been failing since day 1 see:
https://integration.wikimedia.org/ci/job/browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/
43-47 and 49-51 all fail.

I'm pretty sure it's race conditions based on the fact adding a sleep in
https://gerrit.wikimedia.org/r/246801 fixes it - but I'd really like to
understand better rather than hacking around it.


On Thu, Oct 29, 2015 at 7:50 AM, Antoine Musso <hashar+wmf at free.fr> wrote:

> Le 28/10/2015 22:27, Jon Robson a écrit :
> > QA team
> > We're struggling to identify why this is happening and it's spamming our
> > inboxes
> > https://gerrit.wikimedia.org/r/246801 seems to fix the issue for unknown
> > reasons.
> > Any help you can provide on the patch would be much appreciated.
>
> Hello,
>
> For build #50, it shows a 503:
>
> 21:19:18   Scenario: Internal survey is visible when bucketed
>            # features/internal_survey.feature:22
>
> 21:19:29     Given the quick survey test pages are installed
>            # features/support/step_definitions/common_steps.rb:1
>
> 21:19:29       unexpected HTTP response (503) (MediawikiApi::HttpError)
>
> The mediawiki_api gem should give more details really :-/   I have
> looked at logstash-beta.wmflabs.org but haven't found any error around
> that time.
> One off error?..
>
>
> Build #49 and #51 have a different one:
>
>
> 14:32:10   Scenario: External survey is not present when dismissed
>            # features/external_survey.feature:23
> 14:32:29     And the page has fully loaded
>            # features/support/step_definitions/common_steps.rb:72
> 14:32:29     Then I should not see the survey
>            # features/support/step_definitions/common_steps.rb:83
> 14:32:29       expected visible? to return false, got true
> (RSpec::Expectations::ExpectationNotMetError)
>
>
> I ran the job again (build #52) and it passes now :-(
>
> --
> Antoine "hashar" Musso
>
>
> _______________________________________________
> QA mailing list
> QA at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/qa
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20151029/2ff241b8/attachment.html>