[Webkit-unassigned] [Bug 108288] On EWS bots, run tests on patch once instead of twice if some tests fail.

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=108288





--- Comment #6 from Timothy Loh <timloh at chromium.org>  2013-01-30 01:11:08 PST ---
(In reply to comment #4)
> (From update of attachment 185388 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=185388&action=review
> 
> > Tools/ChangeLog:13
> > +        Currently the bots will re-run all the tests for a patch if some tests
> > +        fail twice. Since we retry failures on NRWT, this functionality doesn't
> > +        help us much. To compensate for not re-running everything, the number of
> > +        retries is now a parameter to NRWT which we set as 3 in RunTests.run().
> > +        Flakiness detection here is temporarily removed until we can read it
> > +        from full_results.json.
> 
> How many times does a flaky test need to fail in a row in order to cause the EWS to report a false failure?  Previously, the test would need to flake four times in a row.

Flaky tests will still need to fail four times in a row (one fail + three retries), but it's a trivial change to increase the number to (say) ten.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.