<div dir="ltr"><a href="https://phabricator.wikimedia.org/T102901">https://phabricator.wikimedia.org/T102901</a> < I've raised a bug. Looks like something funky is happening.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 17, 2015 at 4:03 PM, Dan Duvall <span dir="ltr"><<a href="mailto:dduvall@wikimedia.org" target="_blank">dduvall@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span class="">On Wed, Jun 17, 2015 at 3:44 PM, Dan Duvall <span dir="ltr"><<a href="mailto:dduvall@wikimedia.org" target="_blank">dduvall@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Both of these failures are legit, actually. The first one fails every time because there's no "Settings" menu item for the mobile view on beta ATM. The second one is intermittent but fails because clicking "search within pages" fails to do anything ~ 20% of the time—I was able to reproduce this through repeated executions of the tests and by pausing at the "click search" step to initiate it manually.<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">Is there someone on your team that can own verification of such failures before escalating them to QA/RelEng? We're here to help troubleshoot/refactor the trickier stuff but that first one seemed pretty trivial to repro.</div></div></blockquote><div><br></div></span><div>My mistake. Looking at the SauceLabs replay of the first one does indeed show "Settings" in the menu, although it doesn't show when I run the test locally (still running against beta). Still, it would be nice to establish a practice of verifying internally before escalating to other teams. (Where are those illusive QA analysts we saw in the new org chart ... ?)</div><div><div class="h5"><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <span dir="ltr"><<a href="mailto:jrobson@wikimedia.org" target="_blank">jrobson@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">More flaky weirdness. cc'ing QA</div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <span dir="ltr"><<a href="mailto:jenkins-bot@wikimedia.org" target="_blank">jenkins-bot@wikimedia.org</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>
<div>
<table>
<tbody><tr>
<td align="left"><b style="font-size:250%"> <span style="color:red">FAILURE:</span> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce Build #<a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/" target="_blank">685</a> (Tue, 16 Jun 2015 16:31:43 +0000)</b></td>
</tr>
</tbody></table>
<br>
<table><tbody><tr><td><h1><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/" target="_blank"><b>Test Result</b></a></h1>
<div>
<div>
2 failed, 3 skipped
</div>
<div style="width:100%;min-height:1em;background-color:#729fcf">
<div style="width:3.5714285700%;min-height:1em;background-color:#ef2929;float:left"></div><div style="width:5.3571428600%;min-height:1em;background-color:#fce94f;float:left"></div>
</div>
<h2>Failed Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Test Name</b></td><td style="width:5m"><b>Duration</b></td><td style="width:5em"><b>Age</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu" target="_blank">Menus open correct page for anonymous users.Check links in menu</a></td><td>23 sec</td><td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/" target="_blank">2</a></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button" target="_blank">Search.Search with search in pages button</a></td><td>34 sec</td><td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/" target="_blank">1</a></td>
</tr>
</tbody></table>
<h2>All Tests</h2>
<table border="1" style="border-collapse:collapse;border-spacing:2px;border-color:gray;white-space:nowrap;width:100%">
<tbody><tr>
<td><b>Package</b></td><td style="width:6em"><b>Duration</b></td><td style="width:5em"><b>Fail</b></td><td style="width:5em"><b>Skip</b></td><td style="width:5em"><b>Total</b></td>
</tr>
<tr>
<td><a href="https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)" target="_blank">(root)</a></td><td>24 min</td><td>2</td><td>3</td><td>56</td>
</tr>
</tbody></table>
<br>
</div>
</td></tr></tbody></table></div><br></div></div>_______________________________________________<br>
reading-wmf mailing list<br>
<a href="mailto:reading-wmf@lists.wikimedia.org" target="_blank">reading-wmf@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/reading-wmf" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/reading-wmf</a><br>
<br></blockquote></div><br></div>
<br></div></div>_______________________________________________<br>
QA mailing list<br>
<a href="mailto:QA@lists.wikimedia.org" target="_blank">QA@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/qa" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/qa</a><br>
<br></blockquote></div><span><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div><div dir="ltr">Dan Duvall<div>Automation Engineer</div><div><a href="http://wikimediafoundation.org" target="_blank">Wikimedia Foundation</a><br></div></div></div>
</font></span></div></div>
</blockquote></div></div></div><div><div class="h5"><br><br clear="all"><div><br></div>-- <br><div><div dir="ltr">Dan Duvall<div>Automation Engineer</div><div><a href="http://wikimediafoundation.org" target="_blank">Wikimedia Foundation</a><br></div></div></div>
</div></div></div></div>
<br>_______________________________________________<br>
QA mailing list<br>
<a href="mailto:QA@lists.wikimedia.org">QA@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/qa" rel="noreferrer" target="_blank">https://lists.wikimedia.org/mailman/listinfo/qa</a><br>
<br></blockquote></div><br></div>