<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div><br></div><div class="gmail_extra"><br><div class="gmail_quote"><div class="">On Mon, Jun 16, 2014 at 12:02 PM, Jon Robson <span dir="ltr"><<a href="mailto:jrobson@wikimedia.org" target="_blank">jrobson@wikimedia.org</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">I appreciate this is a lot of work, and I appreciate all the work<br>
going in to this but this seems a bit hasty in the MobileFrontend<br>
perspective to be honest. Both of these MobileFrontend builds do not<br>
seem to be reliable yet (I hope they will be soon). There is not a<br>
single green yet and the browser tests on Cloudbees were running<br>
reliably.<br></blockquote><div><br></div></div><div>Not all that reliably. </div><div>Beta labs threw errors all weekend. The latest MF build for Firefox shows one failure </div><div><a title="Show details" style="text-decoration:underline;color:rgb(92,53,102);font-family:Verdana,Helvetica,'sans serif';font-size:11px;white-space:nowrap;background-color:rgb(240,240,240)"><br>
</a></div><div><a title="Show details" style="text-decoration:underline;color:rgb(92,53,102);font-family:Verdana,Helvetica,'sans serif';font-size:11px;white-space:nowrap;background-color:rgb(240,240,240)"><img src="https://integration.wikimedia.org/ci/static/1c781d88/images/16x16/document_add.png" style="vertical-align:middle;border:0px"></a><span style="color:rgb(0,0,0);font-family:Verdana,Helvetica,'sans serif';font-size:11px;white-space:nowrap;background-color:rgb(240,240,240)"> </span><a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/lastCompletedBuild/testReport/(root)/Special_History%20(Note%20test%20may%20take%20a%20long%20time%20to%20run%20on%20first%20run)/Check_more_button_exists/" style="color:rgb(92,53,102);padding-right:16px;font-family:Verdana,Helvetica,'sans serif';font-size:11px;white-space:nowrap;background-color:rgb(240,240,240)" target="_blank">Special:History (Note test may take a long time to run on first run)</a> </div>
<div><br></div><div>WMF Jenkins builds for MF on beta labs from here on out will be at least as reliable as Cloudbees, and should be more reliable.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>-Chris</div>
</font></span><div><div class="h5"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
This is basically rendering our browser test infrastructure useless<br>
right now... :(<br>
<br>
<a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/7/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/7/</a><br>
for example is reporting 11 failures.<br>
<br>
The error that is most troubling is in build 8 for Chrome<br>
<a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/8/testReport/(root)/Special_History%20(Note%20test%20may%20take%20a%20long%20time%20to%20run%20on%20first%20run)/Check_more_button_exists/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/8/testReport/(root)/Special_History%20(Note%20test%20may%20take%20a%20long%20time%20to%20run%20on%20first%20run)/Check_more_button_exists/</a><br>
<br>
and reports:<br>
unexpected response, code=404, content-type="text/plain"<br>
ERROR Job 3df97eb43e474d21a195884c18a2df77 is not in progress. It may<br>
have recently finished, or experienced an error. You can learn more at<br>
<a href="https://saucelabs.com/jobs/3df97eb43e474d21a195884c18a2df77" target="_blank">https://saucelabs.com/jobs/3df97eb43e474d21a195884c18a2df77</a><br>
(Selenium::WebDriver::Error::WebDriverError)<br>
<br>
Can we get these passing green as soon as possible? How can I help?<br>
<br>
On Mon, Jun 16, 2014 at 11:09 AM, James Forrester<br>
<div><div><<a href="mailto:jforrester@wikimedia.org" target="_blank">jforrester@wikimedia.org</a>> wrote:<br>
> Chris,<br>
><br>
> Thanks. :-)<br>
><br>
> J.<br>
><br>
><br>
> On 16 June 2014 11:04, Chris McMahon <<a href="mailto:cmcmahon@wikimedia.org" target="_blank">cmcmahon@wikimedia.org</a>> wrote:<br>
>><br>
>><br>
>><br>
>><br>
>> On Mon, Jun 16, 2014 at 10:57 AM, James Forrester<br>
>> <<a href="mailto:jforrester@wikimedia.org" target="_blank">jforrester@wikimedia.org</a>> wrote:<br>
>>><br>
>>> Chris, Željko,<br>
>>><br>
>>> Thank you so much, this is great; is there anything I can do to help move<br>
>>> over the remaining VE browser tests?<br>
>><br>
>><br>
>> We're continuing to port more builds early tomorrow, we'll put the VE<br>
>> builds at the top of the list.<br>
>> -Chris<br>
>><br>
>><br>
>>><br>
>>><br>
>>> J.<br>
>>><br>
>>><br>
>>> On 16 June 2014 09:26, Chris McMahon <<a href="mailto:cmcmahon@wikimedia.org" target="_blank">cmcmahon@wikimedia.org</a>> wrote:<br>
>>>><br>
>>>><br>
>>>> Hi all,<br>
>>>><br>
>>>> After some doing some spikes last week, Željko and I moved our first six<br>
>>>> official builds from Cloudbees to WMF Jenkins.<br>
>>>><br>
>>>> They all run against beta labs and they all use our nifty WMF SauceLabs<br>
>>>> account:<br>
>>>><br>
>>>> VisualEditor (currently failing with a known problem in beta labs):<br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/</a><br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/</a><br>
>>>><br>
>>>> MobileFrontend:<br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/</a><br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/</a><br>
>>>><br>
>>>> Flow:<br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/</a><br>
>>>><br>
>>>> <a href="https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/" target="_blank">https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/</a><br>
>>>><br>
>>>> I have deleted the corresponding six jobs from Cloudbees. As we port<br>
>>>> more builds reliably to WMF Jenkins, I will continue to delete the<br>
>>>> corresponding builds from Cloudbees.<br>
>>><br>
>>><br>
>>><br>
>>><br>
>>> --<br>
>>> James D. Forrester<br>
>>> Product Manager, VisualEditor<br>
>>> Wikimedia Foundation, Inc.<br>
>>><br>
>>> <a href="mailto:jforrester@wikimedia.org" target="_blank">jforrester@wikimedia.org</a> | @jdforrester<br>
>><br>
>><br>
><br>
><br>
><br>
> --<br>
> James D. Forrester<br>
> Product Manager, VisualEditor<br>
> Wikimedia Foundation, Inc.<br>
><br>
> <a href="mailto:jforrester@wikimedia.org" target="_blank">jforrester@wikimedia.org</a> | @jdforrester<br>
</div></div></blockquote></div></div></div><br></div></div>
</div><br></div>