[webkit-dev] Best practices for failing a flaky tests (was Re: Switching to new-run-webkit-tests)

[Gustavo Noronha Silva]

On Wed, 2011-07-06 at 09:11 -0700, Ryosuke Niwa wrote:

> For flaky tests, you can add
> BUG##### :
> http/tests/misc/favicon-loads-with-icon-loading-override.html = TEXT
> PASS
> in mac or mac-leopard test_expectations.txt
> 
> 
> Although flaky tests only make the bots orange.

That seems to not be the case for gtk+ 32 bits release. When a single
test fails or crashes it is showing all tests that have no expected
results as failures, apparently, and when there are only flaky tests
reported the bot is still red. Is that a bug? Any recommendations on
what to do?

Cheers,

-- 
Gustavo Noronha Silva <gns at gnome.org>
GNOME Project