<quote name="Chris McMahon" date="2014-03-06" time="17:55:48 -0700">
On Thu, Mar 6, 2014 at 5:49 PM, OQ overlordq@gmail.com wrote:
So I'm confused on the timeline here.
Did the commit get merged before the testsuite found the breakage, or did the commit get merged despite the testsuite failing?
The commit was merged late Wednesday. The automated tests that demonstrated the problem failed over Wednesday night and we analyzed the failures early Thursday morning, which is routine.
And to clarify more: Not all tests run right away, some are more expensive and run on a schedule. These are part of that.
Should some of these tests be moved up to run immediately? Yeah, but we'd need to define the set of 'smoke tests' (tests that just test basic functionality, quickly) because we can't run all the tests all the time.
Greg