[webkit-dev] Best practices for failing a flaky tests (was Re: Switching to new-run-webkit-tests)

Ryosuke Niwa rniwa at webkit.org
Wed Jul 6 09:11:45 PDT 2011

On Wed, Jul 6, 2011 at 9:00 AM, Adam Roben <aroben at apple.com> wrote:
> OK. Then I have another question:
> What should I do to make the Leopard and SnowLeopard bots green, now that
> they have switched to NRWT?

Looking at

You can http/tests/cookies/third-party-cookie-relaxing.html
and storage/domstorage/localstorage/storagetracker/storage-tracker-7-usage.html
are real failures so you can add skip those, rebaseline, or revet changes
that caused the failure.

For flaky tests, you can add
BUG##### : http/tests/misc/favicon-loads-with-icon-loading-override.html =
in mac or mac-leopard test_expectations.txt

Although flaky tests only make the bots orange.

- Ryosuke
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20110706/47d062d5/attachment.html>

More information about the webkit-dev mailing list