<quote name="John Mark Vandenberg" date="2015-05-29"
time="04:11:05 +0700">
On Fri, May 29, 2015 at 2:07 AM, Greg Grossmeier
<greg(a)wikimedia.org> wrote:
<quote name="John Mark Vandenberg"
date="2015-05-29" time="01:39:52 +0700">
It was reported by pywikibot devs almost as soon
as we detected that
the test wikis were failing in our travis-ci tests. It was 12 hours
before a MediaWiki API fix was submitted to Gerrit, and it took four
additional *days* to get merged. The Phabricator task was marked
Unbreak Now! all that time.
Which shows the tooling works, but not the social aspects. The backport
process (eg SWAT and related things) will improve soon as well which
should address much of this.
Your tooling depends on pywikibot developers (all volunteers) merging
a patch within your branch-deploy cycle, which fires off a Travis-CI
build of *pywikibot* unit tests which runs some tests against
test.wikipedia.org and
test.wikidata.org ? And your proposing to
shorten the window in which all this can happen and get useful bug
reports out.
That's not "my" tooling, that's pywikibot's ;). But, the point is,
there
was a problem identified in your testing that was reported and fix
submitted in a reasonable amount of time. The failure to get it merged,
however, was the failure.
A little crazy but OK. The biggest problem with that
approach is
Travis-CI is not very reliable - often they are backlogged and tests
are not run for days. So I suggest that you arrange to run the
pywikibot tests daily (or more regularly) on WMF test/beta servers,
and the unit tests of any other client which is a critical part of
processes on the Wikimedia wikis.
I would support having pywikibot use WMF hosted integration testing.
Please file a task with your current setup in the
#continuous-integration-config project:
https://phabricator.wikimedia.org/project/profile/1208/
Not-a-great-response-but: can you specifically
ping me in phabricator
(I'm @greg) for issues like that above?
That is a process problem. The MediaWiki ops & devs need to detect &
escalate massive API breakages, especially after creating the fix
which needs to be code reviewed.
Concur.
--
| Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E |
| identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |