[QA] Tests timing out when running via Jenkins/SauceLabs

[Željko Filipin]

On Mon, Nov 18, 2013 at 9:29 PM, S Page <spage at wikimedia.org> wrote:
>
> There's an explicit test for RL errors in
> features/step_definitions/create_account_steps.rb in
> qa/browsertests.git has a
>   Then(/^page has no ResourceLoader errors$/) do
>
> I think that assertion should be performed when visiting every page.
>

I have added it to Bugzilla[1] so it does not get forgotten.


> Are there any implicit sleep() calls in tests? When I watch WebDriver run
> tests, it sometimes seems to wait a long time before moving to the next
> step, it's not clear what it's doing. The few sleep calls I've seen in
> tests are just 1 or 2 seconds.
>

We are sometimes explicitly waiting for an element to appear[2][3].


> (Is there a verbose mode for cucumber?)
>

Cucumber is "just" a test runner, so you probably do not need it's verbose
output. We are already running all Jenkins jobs with Cucumber's verbose
output. For example, see [4] and [5].

Željko
--
1: https://bugzilla.wikimedia.org/show_bug.cgi?id=57304
2: http://watirwebdriver.com/waiting/
3: https://github.com/cheezy/page-object/wiki/Ajax-Calls
4:
https://github.com/wikimedia/mediawiki-selenium/blob/master/docs/jobs.md#browsertests-commonswikimediabetawmflabsorg
5:
https://wmf.ci.cloudbees.com/job/browsertests-commons.wikimedia.beta.wmflabs.org-linux-chrome/472/console
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20131120/edad34bd/attachment.html>