[webkit-dev] Using Skipped vs. test_expectations.txt, WAS Switching to new-run-webkit-tests

[Eric Seidel]

Nm, Adam Barth already split the thread in a nicer name too.  Folks
can reply there. :)

On Wed, Jul 6, 2011 at 9:12 AM, Eric Seidel <eric at webkit.org> wrote:
> We've intentionally left that decision up to the ports.
>
> Mac has a stop-gap test_expectations.txt file, which depending on the
> result of this discussion will likely be expanded, or removed:
> http://trac.webkit.org/browser/trunk/LayoutTests/platform/mac/test_expectations.txt
> That exists solely to record tests which are flaky under NRWT but run
> normally under ORWT, but can easily be replaced with Skipped entries
> now that we've switched.
>
> Qt (as of 23 minutes ago) has a similar file:
> http://trac.webkit.org/browser/trunk/LayoutTests/platform/qt/test_expectations.txt
>
> -eric
>
> On Wed, Jul 6, 2011 at 8:58 AM, Adam Roben <aroben at apple.com> wrote:
>> On Jul 6, 2011, at 11:53 AM, Adam Roben wrote:
>>
>>> Now that more and more ports are switching to NRWT, it would be great for someone to explain what the best practices are for dealing with failing and flaky tests.
>>
>> Two specific questions I have:
>>
>> 1) Are the ports that have switched to NRWT no longer using Skipped files?
>> 2) Are the ports that have switched to NRWT now using test_expectations.txt files?
>>
>> But I'm interested in a more general overview, too.
>>
>> -Adam
>>
>>
>