[webkit-dev] More on test flakiness

Peter Kasting pkasting at google.com
Wed Dec 2 15:02:11 PST 2009


On Wed, Dec 2, 2009 at 2:51 PM, Julie Parent
<jparent+webkit at gmail.com<jparent%2Bwebkit at gmail.com>
> wrote:

> As Eric just said to me in person, another option is to just re-run *any*
> failing test twice, and only turn tree red if it fails twice.  (Chromium
> just recently started doing this, and it has greatly improved our tree
> greenness).


Do we still note the flaky tests so we can try to fix them?  I worry that
some flakiness is actually due to real bugs (that cause product flakiness)
as opposed to test bugs, though I'm not sure that seeing tests fail flakily
actually helps us address that...

PK
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20091202/915ce43a/attachment.html>


More information about the webkit-dev mailing list