[webkit-dev] Skipping Flakey Tests

[Maciej Stachowiak]

On Sep 25, 2009, at 1:49 PM, Eric Seidel wrote:

> Hum...  Discussion kinda died.  I'm interested in soliciting more
> input, particularly from Apple folks.
>
> Unless silence indicates that others agree with David Levin, Yaar and
> Dimitri that we should skip flakey tests?
>
> If that's the case, then I'd love a review on:
> https://bugs.webkit.org/show_bug.cgi?id=29322
> :)

I like Dave Levin's idea that the first action should be to instrument  
the tests so we can find out why they intermittently fail. Especially  
if the failure is reproducible on the bots but not on developer  
systems. Using the skip list should be a last resort, because that  
hides the failure instead of helping us diangose the cause.

Regards,
Maciej