[webkit-dev] Using Skipped vs. test_expectations.txt, WAS Switching to new-run-webkit-tests

[Eric Seidel]

We've intentionally left that decision up to the ports.

Mac has a stop-gap test_expectations.txt file, which depending on the
result of this discussion will likely be expanded, or removed:
http://trac.webkit.org/browser/trunk/LayoutTests/platform/mac/test_expectations.txt
That exists solely to record tests which are flaky under NRWT but run
normally under ORWT, but can easily be replaced with Skipped entries
now that we've switched.

Qt (as of 23 minutes ago) has a similar file:
http://trac.webkit.org/browser/trunk/LayoutTests/platform/qt/test_expectations.txt

-eric

On Wed, Jul 6, 2011 at 8:58 AM, Adam Roben <aroben at apple.com> wrote:
> On Jul 6, 2011, at 11:53 AM, Adam Roben wrote:
>
>> Now that more and more ports are switching to NRWT, it would be great for someone to explain what the best practices are for dealing with failing and flaky tests.
>
> Two specific questions I have:
>
> 1) Are the ports that have switched to NRWT no longer using Skipped files?
> 2) Are the ports that have switched to NRWT now using test_expectations.txt files?
>
> But I'm interested in a more general overview, too.
>
> -Adam
>
>