[webkit-dev] More on test flakiness

[Dirk Pranke]

On Wed, Dec 2, 2009 at 3:02 PM, Peter Kasting <pkasting at google.com> wrote:
> On Wed, Dec 2, 2009 at 2:51 PM, Julie Parent <jparent+webkit at gmail.com>
> wrote:
>>
>> As Eric just said to me in person, another option is to just re-run *any*
>> failing test twice, and only turn tree red if it fails twice.  (Chromium
>> just recently started doing this, and it has greatly improved our tree
>> greenness).
>
> Do we still note the flaky tests so we can try to fix them?  I worry that
> some flakiness is actually due to real bugs (that cause product flakiness)
> as opposed to test bugs, though I'm not sure that seeing tests fail flakily
> actually helps us address that...

Yes, we still track flaky tests.

-- Dirk