[webkit-dev] More on test flakiness
dpranke at chromium.org
Wed Dec 2 15:12:27 PST 2009
On Wed, Dec 2, 2009 at 3:02 PM, Peter Kasting <pkasting at google.com> wrote:
> On Wed, Dec 2, 2009 at 2:51 PM, Julie Parent <jparent+webkit at gmail.com>
>> As Eric just said to me in person, another option is to just re-run *any*
>> failing test twice, and only turn tree red if it fails twice. (Chromium
>> just recently started doing this, and it has greatly improved our tree
> Do we still note the flaky tests so we can try to fix them? I worry that
> some flakiness is actually due to real bugs (that cause product flakiness)
> as opposed to test bugs, though I'm not sure that seeing tests fail flakily
> actually helps us address that...
Yes, we still track flaky tests.
More information about the webkit-dev