[QA] run browser tests against production Wikipedia?

Chris McMahon cmcmahon at wikimedia.org
Thu Sep 19 20:23:14 UTC 2013


On Thu, Sep 19, 2013 at 1:21 PM, Rachel Thomas <rachelqa99 at gmail.com> wrote:

> From Zeljko's gerrit code, it looks like he already removed the production
> tests.   I was going to say that it could be still valuable to run them.
> There may be a time when test2 is not updated correctly with the right
> versions of features that we want to test, or is down for maintenance, and
> it would be a good idea to have a backup test running on production
> server.    Also, those tests do not seem to be ones that would take a lot
> of time or horsepower to run, so it wouldn't be much overhead to run those.
>

Yes, I think we should consciously choose the tests to run against
production, the four noted above were more accidents of history than chosen
deliberately.


>
> --Rachel
>
> *Gnome FOSS Outreach Program for Women Intern
> Browser Test Automation, Wikimedia Foundation*
>
> Notes from the Bleeding Edge <http://www.bleededge.blogspot.com/>
>
>
>
> On Thu, Sep 19, 2013 at 4:12 PM, Željko Filipin <zfilipin at wikimedia.org>wrote:
>
>> On Thu, Sep 19, 2013 at 12:57 PM, Chris McMahon <cmcmahon at wikimedia.org>wrote:
>>
>>> Open question:  is it worthwhile to run read-only browser tests against
>>> the production wiki, e.g. https://en.wikipedia.org?
>>>
>>
>> I did some cleanup on how tests run. Feel free to comment here or in
>> Gerrit:
>>
>> https://gerrit.wikimedia.org/r/#/c/85098/
>>
>> Željko
>>
>> _______________________________________________
>> QA mailing list
>> QA at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/qa
>>
>>
>
> _______________________________________________
> QA mailing list
> QA at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/qa
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/qa/attachments/20130919/3c8fd897/attachment-0001.html>


More information about the QA mailing list