<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Thu, Nov 21, 2013 at 3:30 AM, S Page <span dir="ltr"><<a href="mailto:spage@wikimedia.org" target="_blank">spage@wikimedia.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div><a href="https://www.mediawiki.org/wiki/Quality_Assurance/Browser_testing/Running_tests" target="_blank">https://www.mediawiki.org/wiki/Quality_Assurance/Browser_testing/Running_tests</a> says you can set BROWSER_LABEL but doesn't give the possible values.<br>
<br></div>I guessed at BROWSER_LABEL=phantomjs , and it sort of worked, see below. Is that what you did? Immediately my cursor froze and the Linux out-of-memory handler ran. :-/ I have PhantomJS 1.9.0 installed on Ubuntu 13.10</blockquote>
</div><br>I do not have a lot of time to update the page right now, but I did my best. Valid values for BROWSER_LABEL will probably change soon, so I will not spend time now documenting it. For now, lowercase name of any major browser will work.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra">Your machine should not blow up when you run tests in phantomjs.</div><div class="gmail_extra"><br></div><div class="gmail_extra">This is how I run tests in phantomjs 1.9.2 and the latest commit of browsertests repository.</div>
<div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra"><div class="gmail_extra">$ export BROWSER_LABEL=phantomjs<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">$ export MEDIAWIKI_USER=Selenium_user</div>
<div class="gmail_extra">$ export MEDIAWIKI_PASSWORD=not-the-real-one</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">$ export MEDIAWIKI_URL=<a href="http://commons.wikimedia.beta.wmflabs.org/wiki/" target="_blank">http://commons.wikimedia.beta.wmflabs.org/wiki/</a></div>
<div class="gmail_extra">$ bundle exec cucumber -t @<a href="http://commons.wikimedia.beta.wmflabs.org" target="_blank">commons.wikimedia.beta.wmflabs.org</a><br></div><div class="gmail_extra">...</div><div class="gmail_extra">
Failing Scenarios:</div>
<div class="gmail_extra">cucumber features/upload_wizard.feature:28 # Scenario: Navigate to Release rights page</div><div class="gmail_extra">cucumber features/upload_wizard.feature:36 # Scenario: Navigate to Describe page</div>
<div class="gmail_extra">cucumber features/upload_wizard.feature:46 # Scenario: Navigate to Use page</div><div class="gmail_extra">5 scenarios (3 failed, 2 passed)</div><div class="gmail_extra">37 steps (3 failed, 17 skipped, 17 passed)</div>
<div class="gmail_extra">4m29.849s</div></div><div class="gmail_extra"><br></div><div class="gmail_extra">$ export MEDIAWIKI_URL=<a href="http://en.wikipedia.beta.wmflabs.org/wiki/" target="_blank">http://en.wikipedia.beta.wmflabs.org/wiki/</a><br>
</div><div class="gmail_extra">$ bundle exec cucumber -t @<a href="http://en.wikipedia.beta.wmflabs.org" target="_blank">en.wikipedia.beta.wmflabs.org</a></div><div class="gmail_extra">...</div><div class="gmail_extra">Failing Scenarios:</div>
<div class="gmail_extra">cucumber features/aftv5.feature:22 # Scenario: Click Yes return and click No</div><div class="gmail_extra">cucumber features/preferences_datetime.feature:15 # Scenario: Preferences Date Time</div>
<div class="gmail_extra">31 scenarios (2 failed, 29 passed)</div><div class="gmail_extra">163 steps (2 failed, 5 skipped, 156 passed)</div><div class="gmail_extra">7m7.580s</div><div><br></div></div><div class="gmail_extra">
$ export MEDIAWIKI_URL=<a href="http://test2.wikipedia.org/wiki/" target="_blank">http://test2.wikipedia.org/wiki/</a><br></div><div><div>$ bundle exec cucumber -t @<a href="http://test2.wikipedia.org">test2.wikipedia.org</a></div>
<div>...</div><div>Failing Scenarios:<br></div><div>cucumber features/hotcat.feature:20 # Scenario: Hotcat category link</div><div>cucumber features/upload_wizard.feature:23 # Scenario: Navigate to Upload page</div><div>
cucumber features/upload_wizard.feature:28 # Scenario: Navigate to Release rights page</div>
<div>cucumber features/upload_wizard.feature:36 # Scenario: Navigate to Describe page</div><div>cucumber features/upload_wizard.feature:46 # Scenario: Navigate to Use page</div><div>39 scenarios (5 failed, 34 passed)</div>
<div>214 steps (5 failed, 21 skipped, 188 passed)</div><div>10m58.657s</div></div><div><br></div><div>It is interesting that <a href="http://commons.wikimedia.beta.wmflabs.org/" target="_blank">commons.wikimedia.beta.wmflabs.org</a> failures were Watir::Wait::TimeoutError and Watir::Exception::UnknownObjectException, but <a href="http://commons.wikimedia.beta.wmflabs.org">commons.wikimedia.beta.wmflabs.org</a> and <a href="http://test2.wikipedia.org">test2.wikipedia.org</a> were all Net::ReadTimeout (except for one Watir::Exception::UnknownObjectException at <a href="http://test2.wikipedia.org">test2.wikipedia.org</a>).</div>
<div><br></div></div><div class="gmail_extra">
Željko</div></div>