[Webkit-unassigned] [Bug 60381] New: NRWT has unexpected failures for MISSING tests when run with --no-pixel

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=60381

           Summary: NRWT has unexpected failures for MISSING tests when
                    run with --no-pixel
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: tony at chromium.org
                CC: abarth at webkit.org, ojan at chromium.org,
                    dpranke at chromium.org


abarth is trying to get the ews chromium linux bots to run layout tests.  He's using --no-pixel to start.  There are two tests that are marked as MISSING because there are no png files checked in.  When running running with --no-pixel, these tests fail text diff (i.e., TEXT failure) and show up as unexpected failures.

Maybe when running --no-pixel, if a test is marked as MISSING we still need to check for a png file?  Another possibility is to have MISSING imply other failures, but that reduces the incentives to remove MISSING from test_expectations.txt.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.