[QA] [WikimediaMobile] Continuous Automation Tests

[Adam Baso]

To follow up with the lists, it seems that there are already continuously
running tests that email mobile-l upon failure, but we were unlucky (or
lucky, depending on your worldview) that failures weren't triggered because
the core article reading experience in the mobile web in general continued
to hum along.

Consequently, we're working with Michelle on defining a few positive and
negative tests relating to image tags, banners, and external hyperlinks.

Thanks all!
-Adam


On Tue, Sep 17, 2013 at 11:32 AM, Michelle Grover <mgrover at wikimedia.org>wrote:

> Sure can are these tests already setup in cloudbees to run?
>
>
> On Tue, Sep 17, 2013 at 11:17 AM, Adam Baso <abaso at wikimedia.org> wrote:
>
>> Is there a way to have the general mobile web automation tests run
>> continuously, alerting #wikimedia-mobile and select individuals in the case
>> there are failing tests?
>>
>> Sorry if this has been asked and answered, or is already the case and I
>> missed it somehow.
>>
>> A bug introduced to ZeroRatedMobileAccess interfered with MobileFrontend
>> yesterday. It was spotted manually. It would be cool to increase the odds
>> of automatically being notified of failing tests from the general mobile
>> web (the Wikipedia Zero automation tests do positive/negative tests for
>> in-scope Wikipedia Zero, and only a couple of negative tests for the
>> general mobile web). To be fair, tests won't always catch errant behavior,
>> but they improve the odds!
>>
>> Props to Arthur, Jon, Juliusz, and Max spotting the issue last night and
>> Yuri and Yuvi (Yuri !== Yuvi) getting the fix in shortly thereafter (
>> https://bugzilla.wikimedia.org/show_bug.cgi?id=54209).
>>
>> Thanks.
>> -Adam
>>
>> _______________________________________________
>> Mobile-l mailing list
>> Mobile-l at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20130917/873bcc6b/attachment.html>