[Webkit-unassigned] [Bug 188795] New: REGRESSION(r234993): [GTK] Test results page ignores TestExpectations, shows 1800 failures

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=188795

            Bug ID: 188795
           Summary: REGRESSION(r234993): [GTK] Test results page ignores
                    TestExpectations, shows 1800 failures
           Product: WebKit
           Version: Other
          Hardware: PC
                OS: Linux
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: mcatanzaro at igalia.com
                CC: bugs-noreply at webkitgtk.org, lforschler at apple.com,
                    simon.fraser at apple.com

Since r234993 "Modernize results.html" our test results page has gone crazy. For example:

https://build.webkit.org/results/GTK Linux 64-bit Release (Tests)/r235110 (7847)/results.html

shows 1815 tests that failed pixel/audio diff. But the bot dashboard reports only 13 layout test failures. And looking at the text file, there were indeed only 13 failures:

https://build.webkit.org/builders/GTK Linux 64-bit Release (Tests)/builds/7847/steps/layout-test/logs/stdio

The problem seems to be that the platform TestExpectations file is now ignored, so all the expected failures are showing up as unexpected failures.

It seems this issue only affects GTK: the results for macOS, iOS, Windows, and WPE are all fine.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20180821/e45c68de/attachment.html>