[QA] Help needed! Re: [reading-wmf] browsertests-QuickSurveys-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce - Build # 50 - Still Failing!

[Antoine Musso]

Le 28/10/2015 22:27, Jon Robson a écrit :
> QA team
> We're struggling to identify why this is happening and it's spamming our
> inboxes
> https://gerrit.wikimedia.org/r/246801 seems to fix the issue for unknown
> reasons.
> Any help you can provide on the patch would be much appreciated.

Hello,

For build #50, it shows a 503:

21:19:18   Scenario: Internal survey is visible when bucketed
           # features/internal_survey.feature:22

21:19:29     Given the quick survey test pages are installed
           # features/support/step_definitions/common_steps.rb:1

21:19:29       unexpected HTTP response (503) (MediawikiApi::HttpError)

The mediawiki_api gem should give more details really :-/   I have
looked at logstash-beta.wmflabs.org but haven't found any error around
that time.
One off error?..


Build #49 and #51 have a different one:


14:32:10   Scenario: External survey is not present when dismissed
           # features/external_survey.feature:23
14:32:29     And the page has fully loaded
           # features/support/step_definitions/common_steps.rb:72
14:32:29     Then I should not see the survey
           # features/support/step_definitions/common_steps.rb:83
14:32:29       expected visible? to return false, got true
(RSpec::Expectations::ExpectationNotMetError)


I ran the job again (build #52) and it passes now :-(

-- 
Antoine "hashar" Musso