<div dir="ltr">Head's up that Chris Mcmahon is on vacation all this week. That said, it would be great to hear from anyone in QA about this - it has been a long standing issue.</div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Thu, Jul 10, 2014 at 10:51 AM, Tomasz Finc <span dir="ltr"><<a href="mailto:tfinc@wikimedia.org" target="_blank">tfinc@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
ChrisMC,<br>
<br>
Are these failures unique to mobile? They seem look to be at the<br>
infrastructure level so i'm guessing it would affect others.<br>
<br>
What other information do you need from us to be able to remedy these?<br>
<span class="HOEnZb"><font color="#888888"><br>
--tomasz<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On Wed, Jul 9, 2014 at 5:54 PM, Jon Robson <<a href="mailto:jdlrobson@gmail.com">jdlrobson@gmail.com</a>> wrote:<br>
> Indeed. The tests have been failing for a month now, and had been<br>
> passing green before the move to <a href="http://integration.wikimedia.org" target="_blank">integration.wikimedia.org</a><br>
> It would be really good to get these back to being useful.<br>
><br>
> I'm not sure how our interaction with saucelabs changed during that<br>
> move, but is there anything that can be done on the short term to get<br>
> it back to how they were before when we were on cloudbees?<br>
><br>
> Thanks Juliusz for the good summary of the problems!<br>
><br>
><br>
> On Wed, Jul 9, 2014 at 3:57 PM, Juliusz Gonera <<a href="mailto:jgonera@wikimedia.org">jgonera@wikimedia.org</a>> wrote:<br>
>> Today I worked a bit on fixing failing browser tests. The good news is that<br>
>> some tests detected a regression in core that caused full text search on<br>
>> mobile to not work. The bad news is that many of the failures seem to be<br>
>> caused by problems with Saucelabs and/or beta labs, examples:<br>
>><br>
>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Wikitext%20Editor%20%28TEST%20RUN%20ON%20WIKIPEDIA%20SO%20SHOULD%20NOT%20CAUSE%20SAVES%29/Opening_editor/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Wikitext%20Editor%20%28TEST%20RUN%20ON%20WIKIPEDIA%20SO%20SHOULD%20NOT%20CAUSE%20SAVES%29/Opening_editor/</a><br>
>> Editor doesn't seem to load, possible causes: beta labs API error, or<br>
>> problem with connection between saucelabs and beta labs<br>
>><br>
>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Issues/Closing_page_issues__browser_back_/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Issues/Closing_page_issues__browser_back_/</a><br>
>> getaddrinfo: Name or service not known (SocketError) - seems like a problem<br>
>> with network on saucelabs<br>
>><br>
>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Page%20actions%20menu%20when%20logged%20in/I_can_add_the_page_to_my_watchlist/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Page%20actions%20menu%20when%20logged%20in/I_can_add_the_page_to_my_watchlist/</a><br>
>> Saucelabs recording shows "no data received" error in Chrome, either beta<br>
>> labs problem or saucelabs network problem<br>
>><br>
>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Generic%20special%20page%20features/Search_from_Watchlist/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/lastBuild/testReport/junit/%28root%29/Generic%20special%20page%20features/Search_from_Watchlist/</a><br>
>> same as above<br>
>><br>
>> Those are just a few examples from recent failures, but they make tracking<br>
>> regressions really tedious and time consuming. I know we are planning to<br>
>> move away from Saucelabs and use our own servers to run the tests. When will<br>
>> this happen? Is there any deadline?<br>
>><br>
>> Thanks,<br>
>> --<br>
>> Juliusz<br>
>><br>
>> _______________________________________________<br>
>> Mobile-l mailing list<br>
>> <a href="mailto:Mobile-l@lists.wikimedia.org">Mobile-l@lists.wikimedia.org</a><br>
>> <a href="https://lists.wikimedia.org/mailman/listinfo/mobile-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/mobile-l</a><br>
>><br>
><br>
><br>
><br>
> --<br>
> Jon Robson<br>
> * <a href="http://jonrobson.me.uk" target="_blank">http://jonrobson.me.uk</a><br>
> * <a href="https://www.facebook.com/jonrobson" target="_blank">https://www.facebook.com/jonrobson</a><br>
> * @rakugojon<br>
><br>
> _______________________________________________<br>
> Mobile-l mailing list<br>
> <a href="mailto:Mobile-l@lists.wikimedia.org">Mobile-l@lists.wikimedia.org</a><br>
> <a href="https://lists.wikimedia.org/mailman/listinfo/mobile-l" target="_blank">https://lists.wikimedia.org/mailman/listinfo/mobile-l</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Arthur Richards<div>Team Practices Lead</div><div>[[User:Awjrichards]]</div><div>IRC: awjr</div><div>+1-415-839-6885 x6687</div></div>
</div>