[QA] Fwd: Moving builds off Cloudbees: VisualEditor, MobileFrontend, Flow

[Chris McMahon]

On Mon, Jun 16, 2014 at 12:02 PM, Jon Robson <jrobson at wikimedia.org> wrote:

> I appreciate this is a lot of work, and I appreciate all the work
> going in to this but this seems a bit hasty in the MobileFrontend
> perspective to be honest. Both of these MobileFrontend builds  do not
> seem to be reliable yet (I hope they will be soon). There is not a
> single green yet and the browser tests on Cloudbees were running
> reliably.
>

Not all that reliably.
Beta labs threw errors all weekend.  The latest MF build for Firefox shows
one failure

 Special:History (Note test may take a long time to run on first run)
<https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/lastCompletedBuild/testReport/(root)/Special_History%20(Note%20test%20may%20take%20a%20long%20time%20to%20run%20on%20first%20run)/Check_more_button_exists/>


WMF Jenkins builds for MF on beta labs from here on out will be at least as
reliable as Cloudbees, and should be more reliable.

-Chris


>
> This is basically rendering our browser test infrastructure useless
> right now... :(
>
>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/7/
> for example  is reporting 11 failures.
>
> The error that is most troubling is in build 8 for Chrome
>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/8/testReport/(root)/Special_History%20(Note%20test%20may%20take%20a%20long%20time%20to%20run%20on%20first%20run)/Check_more_button_exists/
>
> and reports:
> unexpected response, code=404, content-type="text/plain"
> ERROR Job 3df97eb43e474d21a195884c18a2df77 is not in progress. It may
> have recently finished, or experienced an error. You can learn more at
> https://saucelabs.com/jobs/3df97eb43e474d21a195884c18a2df77
> (Selenium::WebDriver::Error::WebDriverError)
>
> Can we get these passing green as soon as possible? How can I help?
>
> On Mon, Jun 16, 2014 at 11:09 AM, James Forrester
> <jforrester at wikimedia.org> wrote:
> > Chris,
> >
> > Thanks. :-)
> >
> > J.
> >
> >
> > On 16 June 2014 11:04, Chris McMahon <cmcmahon at wikimedia.org> wrote:
> >>
> >>
> >>
> >>
> >> On Mon, Jun 16, 2014 at 10:57 AM, James Forrester
> >> <jforrester at wikimedia.org> wrote:
> >>>
> >>> Chris, Željko,
> >>>
> >>> Thank you so much, this is great; is there anything I can do to help
> move
> >>> over the remaining VE browser tests?
> >>
> >>
> >> We're continuing to port more builds early tomorrow, we'll put the VE
> >> builds at the top of the list.
> >> -Chris
> >>
> >>
> >>>
> >>>
> >>> J.
> >>>
> >>>
> >>> On 16 June 2014 09:26, Chris McMahon <cmcmahon at wikimedia.org> wrote:
> >>>>
> >>>>
> >>>> Hi all,
> >>>>
> >>>> After some doing some spikes last week, Željko and I moved our first
> six
> >>>> official builds from Cloudbees to WMF Jenkins.
> >>>>
> >>>> They all run against beta labs and they all use our nifty WMF
> SauceLabs
> >>>> account:
> >>>>
> >>>> VisualEditor (currently failing with a known problem in beta labs):
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/
> >>>>
> >>>> MobileFrontend:
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/
> >>>>
> >>>> Flow:
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/
> >>>>
> >>>>
> https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/
> >>>>
> >>>> I have deleted the corresponding six jobs from Cloudbees.  As we port
> >>>> more builds reliably to WMF Jenkins, I will continue to delete the
> >>>> corresponding builds from Cloudbees.
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> James D. Forrester
> >>> Product Manager, VisualEditor
> >>> Wikimedia Foundation, Inc.
> >>>
> >>> jforrester at wikimedia.org | @jdforrester
> >>
> >>
> >
> >
> >
> > --
> > James D. Forrester
> > Product Manager, VisualEditor
> > Wikimedia Foundation, Inc.
> >
> > jforrester at wikimedia.org | @jdforrester
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20140616/4bcd1ed0/attachment.html>