[Webkit-unassigned] [Bug 101976] New: garden-o-matic doesn't know about reftests

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=101976

           Summary: garden-o-matic doesn't know about reftests
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: dpranke at chromium.org
                CC: abarth at webkit.org, dglazkov at chromium.org,
                    ojan at chromium.org


So, if a reftest fails it shows up as an ImageFailure, and will let you happily rebaseline it. However, NRWT will notice that the test is a reftest, log a warning, and ignore the baselines.

I believe the information about whether the test is or isn't a reftest is in results.json, so we probably just need to make the UI aware of it. If not, it certainly would be easy to add.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.