[Webkit-unassigned] [Bug 94815] New: Support ignore-metrics baselines

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=94815

           Summary: Support ignore-metrics baselines
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: allan.jensen at nokia.com


It would be valuable to be able to generate baselines that does not depend on specific layout metrics, for tests where layout is not important, such as CSS selectors or HTML parsing.

It is possible to create new metric-less baseline with by generating the baseline using NRWT with --ignore-metrics. Unfortunately these baseline will only PASS if NRWT is always run with --ignore-metrics, and will always FAIL if it is not.

I propose to detect that a baseline has been generate with --ignore-metrics, and if it was automatically strip metrics from the output result before comparing output and expected result. 

Note this will only work NRWT, since as far as I know only NRWT support ignore-metrics. On the other hand stripping is only a small set of regular expressions, and shouldn't be too hard to import to ORWT if necessary.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.