<div dir="ltr"><div>Both of these failures are legit, actually. The first one fails every time because there's no "Settings" menu item for the mobile view on beta ATM. The second one is intermittent but fails because clicking "search within pages" fails to do anything ~ 20% of the time—I was able to reproduce this through repeated executions of the tests and by pausing at the "click search" step to initiate it manually.<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">Is there someone on your team that can own verification of such failures before escalating them to QA/RelEng? We're here to help troubleshoot/refactor the trickier stuff but that first one seemed pretty trivial to repro.</div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <span dir="ltr"><<a href="mailto:jrobson@wikimedia.org" target="_blank">jrobson@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">More flaky weirdness. cc'ing QA</div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <span dir="ltr"><<a href="mailto:jenkins-bot@wikimedia.org" target="_blank">jenkins-bot@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
<div>
<table>
<tbody><tr>
<td align="left"><b style="font-size:250%"> <span style="color:red">FAILURE:</span> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce Build #<a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/" target="_blank">685</a> (Tue, 16 Jun 2015 16:31:43 +0000)</b></td>
</tr>
</tbody></table>
<br>
<table><tbody><tr><td><h1><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/" target="_blank"><b>Test Result</b></a></h1>
<div>
<div>
2 failed, 3 skipped
</div>
<div style="width:100%;min-height:1em;background-color:#729fcf">
<div style="width:3.5714285700%;min-height:1em;background-color:#ef2929;float:left"></div><div style="width:5.3571428600%;min-height:1em;background-color:#fce94f;float:left"></div>
</div>
<h2>Failed Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Test Name</b></td><td style="width:5m"><b>Duration</b></td><td style="width:5em"><b>Age</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu" target="_blank">Menus open correct page for anonymous users.Check links in menu</a></td><td>23 sec</td><td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/" target="_blank">2</a></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button" target="_blank">Search.Search with search in pages button</a></td><td>34 sec</td><td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/" target="_blank">1</a></td>
</tr>
</tbody></table>
<h2>All Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Package</b></td><td style="width:6em"><b>Duration</b></td><td style="width:5em"><b>Fail</b></td><td style="width:5em"><b>Skip</b></td><td style="width:5em"><b>Total</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)" target="_blank">(root)</a></td><td>24 min</td><td>2</td><td>3</td><td>56</td>
</tr>
</tbody></table>
<br>
</div>
</td></tr></tbody></table></div><br></div></div>_______________________________________________<br>
reading-wmf mailing list<br>
<a href="mailto:reading-wmf@lists.wikimedia.org" target="_blank">reading-wmf@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/reading-wmf" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/reading-wmf</a><br>
<br></blockquote></div><br></div>
<br>_______________________________________________<br>
QA mailing list<br>
<a href="mailto:QA@lists.wikimedia.org">QA@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/qa" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/qa</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">Dan Duvall<div>Automation Engineer</div><div><a href="http://wikimediafoundation.org" target="_blank">Wikimedia Foundation</a><br></div></div></div>
</div></div>