[webkit-dev] EWS doesn't lie!

[Alexey Proskuryakov]

Hi WebKit hackers,

It sometimes happens that people land patches despite EWS detecting layout test regressions, especially when these seem too unlikely to believe.

In my experience, EWS has been very stable recently, and if tester bubbles are red, it almost certainly means that the patch is faulty. Even if they don't turn red, but remain yellow for a long time, there is a good chance that the patch introduces flaky failures, so EWS can't make up its mind about exactly which tests regressed.

If you click on a yellow bubble, that takes you to a page with additional details, where you can see which tests are failing. I'd like to look into improving how this information is presented at some point in the future, yet even now, it shouldn't be too time consuming to check what's going on.

For reference, we currently have mac and mac-wk2 EWS bots running regression tests in release mode. Other bots only verify that the patch builds, and don't run tests. No bots use debug mode as far as I know, so debug-only build failures and assertions will not be detected. Please run tests locally to catch as many of those as possible.

- WBR, Alexey Proskuryakov