[Webkit-unassigned] [Bug 178782] New: platform/wk2/TestExpectations ignored in flakiness dashboard for GTK platforms

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=178782

            Bug ID: 178782
           Summary: platform/wk2/TestExpectations ignored in flakiness
                    dashboard for GTK platforms
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: aboya at igalia.com
                CC: lforschler at apple.com

The following layout test is having an unexpected result on GTK according to the flakiness dashboard:

http/tests/loading/resourceLoadStatistics/grandfathering.html

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#tests=http%2Ftests%2Floading%2FresourceLoadStatistics%2Fgrandfathering.html

The interesting bit is that it should not because it's marked as expected [ Pass Failure Timeout ] in WK2 expectations file.

platform/wk2/TestExpectations
689:webkit.org/b/172452 http/tests/loading/resourceLoadStatistics/grandfathering.html [ Pass Failure Timeout ]

And GTK+ tests are run with those expectations in mind:

> run-webkit-tests --gtk http/tests/loading/resourceLoadStatistics/grandfathering.html 
Using port 'gtk-wk2'
Test configuration: <, x86, release>
Placing test results in /webkit/WebKitBuild/Release/layout-test-results
Baseline search path: platform/gtk -> platform/wk2 -> generic
Using Release build
Pixel tests disabled
Regular timeout: 15000, slow test timeout: 75000
Command line: /webkit/Tools/jhbuild/jhbuild-wrapper --gtk run /webkit/WebKitBuild/Release/bin/WebKitTestRunner -

Found 1 test; running 1, skipping 0.

Running 1 test

Running 1 WebKitTestRunner.     

The test ran as expected.                                          

Stopping HTTP server ...

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20171025/27302331/attachment-0001.html>