[Webkit-unassigned] [Bug 169449] run-bindings-tests does not print "FAIL" for a test where IDL generation failed

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=169449

--- Comment #3 from Sri Vijayaraghavan <svijayaraghavan at apple.com> ---
(In reply to comment #1)
> It's not true that the test output does not point to a specific failure.

Ah, I should have said: the information doesn't come from run-bindings-tests.

Ideally we'd have information about the specific failures in there (eg. "TestMapLike.idl" specifically, as opposed to "something failed, please manually look at the output"). That would enable EWS to make better decisions about patches that fix some failures on a red tree, for example.

In the absence of that, Bindings EWS will have to continue to treat such cases as generic failures as it does currently. (eg. Comment 41 on https://bugs.webkit.org/show_bug.cgi?id=159781 )

(In reply to comment #2)
> At least as it stands today, not printing FAIL also means that the failing
> test name is not in JSON results, so the recently added bindings EWS
> provides less information about the issue.

We can add stuff to the JSON results without printing, but we don't have any information currently (beyond the fact that something failed).

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20170313/5df4516f/attachment.html>