<div dir="ltr">Okay in this case it was actually a failing test. Saucelabs was unfortunately masking it. Fix has been merged and Firefox search in pages is now working again. Thanks guys!<div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Aug 3, 2015 at 2:48 PM, Dan Duvall <span dir="ltr"><<a href="mailto:dduvall@wikimedia.org" target="_blank">dduvall@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>This appears to be an issue solely with the annotation to the SauceLabs job that is supposed to occur after each failed scenario. In other words, trust the Jenkins build status over the SauceLabs status for now.<br></div><div><br></div><div>I'm able to reproduce the failure pretty consistently against Beta Cluster with both a local FF WebDriver connection and via SauceLabs, so I would consider it a true failure, possibly a need to refactor the test—I see a `sleep 5` in the step so perhaps it's a timing issue.</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <span dir="ltr"><<a href="mailto:jrobson@wikimedia.org" target="_blank">jrobson@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div dir="ltr">QA peeps, this test keeps failing but when I click the sauce labs url <a href="https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85" target="_blank">https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85</a> it tells me it passed so we're having a lot of difficulty trying to debug this.<div><br></div><div>Is it possible to grab some help from someone to work out why this keeps happening? It's responsible for most of our red builds now.</div><div><br></div><div>Context:</div><div><a href="https://phabricator.wikimedia.org/T105589" target="_blank">https://phabricator.wikimedia.org/T105589</a><br></div><div><a href="https://phabricator.wikimedia.org/T98476" target="_blank">https://phabricator.wikimedia.org/T98476</a><br></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <span dir="ltr"><<a href="mailto:jenkins-bot@wikimedia.org" target="_blank">jenkins-bot@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>
<div>
<table>
<tbody><tr>
<td align="left"><b style="font-size:250%"> <span style="color:red">FAILURE:</span> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce Build #<a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/" target="_blank">771</a> (Mon, 03 Aug 2015 02:42:00 +0000)</b></td>
</tr>
</tbody></table>
<br>
<table><tbody><tr><td><h1><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/" target="_blank"><b>Test Result</b></a></h1>
<div>
<div>
1 failed, 3 skipped
</div>
<div style="width:100%;min-height:1em;background-color:#729fcf">
<div style="width:1.4705882400%;min-height:1em;background-color:#ef2929;float:left"></div><div style="width:4.4117647100%;min-height:1em;background-color:#fce94f;float:left"></div>
</div>
<h2>Failed Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Test Name</b></td><td style="width:5m"><b>Duration</b></td><td style="width:5em"><b>Age</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button" target="_blank">Search.Search with search in pages button</a></td><td>40 sec</td><td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/" target="_blank">1</a></td>
</tr>
</tbody></table>
<h2>All Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Package</b></td><td style="width:6em"><b>Duration</b></td><td style="width:5em"><b>Fail</b></td><td style="width:5em"><b>Skip</b></td><td style="width:5em"><b>Total</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)" target="_blank">(root)</a></td><td>26 min</td><td>1</td><td>3</td><td>68</td>
</tr>
</tbody></table>
<br>
</div>
</td></tr></tbody></table></div><br></div></div>_______________________________________________<br>
reading-wmf mailing list<br>
<a href="mailto:reading-wmf@lists.wikimedia.org" target="_blank">reading-wmf@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/reading-wmf" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/reading-wmf</a><br>
<br></blockquote></div><br></div>
<br></div></div>_______________________________________________<br>
QA mailing list<br>
<a href="mailto:QA@lists.wikimedia.org" target="_blank">QA@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/qa" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/qa</a><br>
<br></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div><div dir="ltr">Dan Duvall<div>Automation Engineer</div><div><a href="http://wikimediafoundation.org" target="_blank">Wikimedia Foundation</a><br></div></div></div>
</font></span></div>
<br>_______________________________________________<br>
reading-wmf mailing list<br>
<a href="mailto:reading-wmf@lists.wikimedia.org">reading-wmf@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/reading-wmf" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/reading-wmf</a><br>
<br></blockquote></div><br></div>