[Webkit-unassigned] [Bug 78127] New: REGRESSION (NRWT): Results for new non-text-only tests are always put in the most-specific platform directory

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=78127

           Summary: REGRESSION (NRWT): Results for new non-text-only tests
                    are always put in the most-specific platform directory
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: aroben at apple.com
                CC: eric at webkit.org, hyatt at apple.com, darin at apple.com,
                    ojan at chromium.org, dpranke at chromium.org


To reproduce:

1. cat > LayoutTests/fast/new-test.html
Hi!
^D
2. run-webkit-tests fast/new-test.html

NRWT will put the new results in platform/mac-lion/fast, while ORWT will put the results in platform/mac/fast.

NRWT always puts results for new non-text-only tests in the most-specific platform directory. This doesn't match ORWT, which had the following policy:

> For cross-platform tests, text-only results should go in the cross-platform directory,
> while render tree dumps should go in the least-specific platform directory.
http://trac.webkit.org/browser/trunk/Tools/Scripts/old-run-webkit-tests?rev=105162#L1728

ORWT's policy was to assume that new tests were as cross-platform as possible (i.e., that the results would be valid on all variants of the base platform), while NRWT's policy seems to assume that new tests are as platform-specific as possible. We should be encouraging people to write cross-platform tests, so I think ORWT's policy is better.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.