[webkit-dev] More on test flakiness

Dirk Pranke dpranke at chromium.org
Wed Dec 2 15:12:27 PST 2009

On Wed, Dec 2, 2009 at 3:02 PM, Peter Kasting <pkasting at google.com> wrote:
> On Wed, Dec 2, 2009 at 2:51 PM, Julie Parent <jparent+webkit at gmail.com>
> wrote:
>> As Eric just said to me in person, another option is to just re-run *any*
>> failing test twice, and only turn tree red if it fails twice.  (Chromium
>> just recently started doing this, and it has greatly improved our tree
>> greenness).
> Do we still note the flaky tests so we can try to fix them?  I worry that
> some flakiness is actually due to real bugs (that cause product flakiness)
> as opposed to test bugs, though I'm not sure that seeing tests fail flakily
> actually helps us address that...

Yes, we still track flaky tests.

-- Dirk

More information about the webkit-dev mailing list