[Webkit-unassigned] [Bug 161003] Many of the expected results from imported/w3c are wrong (contain FAIL strings)

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Sat Aug 20 05:21:54 PDT 2016


https://bugs.webkit.org/show_bug.cgi?id=161003

--- Comment #5 from youenn fablet <youennf at gmail.com> ---
The W3C tests have two purposes:
- conformance: we want to progressively reduce the number of FAIL
- regression: whether FAIL or PASS, these tests reduce the risk to change some behavior without knowing it. Making a test expectation as fail is counter productive here.

To be noted also that these tests generally contain more than one test, some of them being PASS and others FAIL.

It might be better to have specific -expected files if ports have different results.

When refreshing W3C tests, I use the results of the iOS bots to update their specific -expected.txt files. It would be great if GTK/EFL bots could also give me those results.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20160820/c97f82a7/attachment-0001.html>


More information about the webkit-unassigned mailing list