[Webkit-unassigned] [Bug 47293] New: run-webkit-tests should identify if new failing/passing platform specific results match general expected results

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=47293

           Summary: run-webkit-tests should identify if new
                    failing/passing platform specific results match
                    general expected results
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: PC
        OS/Version: Mac OS X 10.5
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: joepeck at webkit.org


If a platform has expected results for a failing test, and eventually that test starts passing,
it would be great if run-webkit-tests could point out that the new results match the
general, non-platform-specific results.

Example:

  LayoutTests/platform/fake-platform/fast/blah-expected.txt => "FAIL - not yet supported"
  LayoutTests/fast/blah-expected.txt => "PASS"

After implementing "blah" and running tests you could see something like:

  Tests where results did not match expected results:
  fast/blah.html    expected | actual | diff | pretty diff | *

  Tests now matching non-platform-specific results:
  fast/blah.html

It would also be helpful if run-webkit-tests pointed out that the results are platform specific
for a dumpAsText() test.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.