[Webkit-unassigned] [Bug 229992] run-webkit-tests showing as failed tests which are already included in TestExpectations

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Tue Sep 7 10:42:29 PDT 2021


https://bugs.webkit.org/show_bug.cgi?id=229992

--- Comment #3 from Alexey Proskuryakov <ap at webkit.org> ---
This gets ugly with reftests though - creating an -expected.html that matches incorrect rendering is harder than just landing expected results in -expected.txt. It would also create substantial confusing, because there isn't any indication of the -expected.html being a failure, like there is with "FAILED" lines in text tests.

So I think that there is an issue here, just not sure what to do about it. Maybe stop printing "failed" for expected failures completely? Those are somewhat relevant for flaky tests though, where one wants to run it thousands of times to see if the failure reproduces. Could consider only printing them in verbose mode.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20210907/a0906d06/attachment.htm>


More information about the webkit-unassigned mailing list