[webkit-dev] Test flakiness.

[Tim Horton]

On Dec 3, 2013, at 1:51 PM, Samuel White <samuel_white at apple.com> wrote:

> Hey everyone,
> 
> I've noticed the following build message:
> 
> Unexpected flakiness: text-only failures (1)
>  platform/mac/accessibility/search-predicate-element-count.html [ Failure Pass ]
> 
> Oddly, when this test is run ALONE (locally of course), it always passes. Yet, sometimes when run with other tests (say all accessibility tests), it fails. This suggests to me that this test should be considered 'flaky' as order matters (which is odd). What are the criteria for marking a test flaky? Thanks.

[from the right address]

It would be ideal if you could figure out *why* the test is flaky. What state are the tests that run before it setting that isn’t getting reset? Can you narrow it down to a pair of tests?

> - Sam
> _______________________________________________
> webkit-dev mailing list
> webkit-dev at lists.webkit.org
> https://lists.webkit.org/mailman/listinfo/webkit-dev