[Webkit-unassigned] [Bug 108288] On EWS bots, run tests on patch once instead of twice if some tests fail.
bugzilla-daemon at webkit.org
bugzilla-daemon at webkit.org
Wed Jan 30 01:09:09 PST 2013
https://bugs.webkit.org/show_bug.cgi?id=108288
--- Comment #6 from Timothy Loh <timloh at chromium.org> 2013-01-30 01:11:08 PST ---
(In reply to comment #4)
> (From update of attachment 185388 [details])
> View in context: https://bugs.webkit.org/attachment.cgi?id=185388&action=review
>
> > Tools/ChangeLog:13
> > + Currently the bots will re-run all the tests for a patch if some tests
> > + fail twice. Since we retry failures on NRWT, this functionality doesn't
> > + help us much. To compensate for not re-running everything, the number of
> > + retries is now a parameter to NRWT which we set as 3 in RunTests.run().
> > + Flakiness detection here is temporarily removed until we can read it
> > + from full_results.json.
>
> How many times does a flaky test need to fail in a row in order to cause the EWS to report a false failure? Previously, the test would need to flake four times in a row.
Flaky tests will still need to fail four times in a row (one fail + three retries), but it's a trivial change to increase the number to (say) ten.
--
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
More information about the webkit-unassigned
mailing list