[webkit-dev] Skipping Flakey Tests
mjs at apple.com
Fri Sep 25 14:42:21 PDT 2009
On Sep 25, 2009, at 1:49 PM, Eric Seidel wrote:
> Hum... Discussion kinda died. I'm interested in soliciting more
> input, particularly from Apple folks.
> Unless silence indicates that others agree with David Levin, Yaar and
> Dimitri that we should skip flakey tests?
> If that's the case, then I'd love a review on:
I like Dave Levin's idea that the first action should be to instrument
the tests so we can find out why they intermittently fail. Especially
if the failure is reproducible on the bots but not on developer
systems. Using the skip list should be a last resort, because that
hides the failure instead of helping us diangose the cause.
More information about the webkit-dev