[webkit-dev] Skipping Flakey Tests

[Eric Seidel]

Alexey and I have been discussing if WebKit should add flakey tests to
Skipped lists:
https://bugs.webkit.org/show_bug.cgi?id=29322

Alexey asked that I bring the discussion to a larger audience.

Pros:
- Buildbots stay green.
- Red bots/tests means your change caused an error.

Cons:
- Skipped tests may be more likely to be forgotten (and thus never fixed).

What does WebKit think?  Should we skip flakey tests which can't be
resolved in a timely manner (and instead track issues via bugs) as
WebKit policy?  Or should we reserve the skipped list for other
conditions (like bugs in the OS)?

Thoughts?

-eric