[webkit-dev] Best practices for failing a flaky tests (was Re: Switching to new-run-webkit-tests)

Ryosuke Niwa rniwa at webkit.org
Mon Jul 11 13:15:17 PDT 2011


On Mon, Jul 11, 2011 at 1:02 PM, Gustavo Noronha Silva <gns at gnome.org>wrote:
>
> That seems to not be the case for gtk+ 32 bits release. When a single
> test fails or crashes it is showing all tests that have no expected
> results as failures, apparently, and when there are only flaky tests
> reported the bot is still red. Is that a bug? Any recommendations on
> what to do?
>

It shows up on the master but flaky tests or missing results do not make the
bot red as far as I know.  What makes the bot red is the one test that was
failing or crashing.

If flaky tests or missing results make the bot red, then it's a bug so
please let me know.

- Ryosuke
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20110711/106eed28/attachment.html>


More information about the webkit-dev mailing list