<html>
<head>
<base href="https://bugs.webkit.org/" />
</head>
<body>
<p>
<div>
<b><a class="bz_bug_link
bz_status_NEW "
title="NEW - run-bindings-tests does not print "FAIL" for a test where IDL generation failed"
href="https://bugs.webkit.org/show_bug.cgi?id=169449#c3">Comment # 3</a>
on <a class="bz_bug_link
bz_status_NEW "
title="NEW - run-bindings-tests does not print "FAIL" for a test where IDL generation failed"
href="https://bugs.webkit.org/show_bug.cgi?id=169449">bug 169449</a>
from <span class="vcard"><a class="email" href="mailto:svijayaraghavan@apple.com" title="Sri Vijayaraghavan <svijayaraghavan@apple.com>"> <span class="fn">Sri Vijayaraghavan</span></a>
</span></b>
<pre>(In reply to <a href="show_bug.cgi?id=169449#c1">comment #1</a>)
<span class="quote">> It's not true that the test output does not point to a specific failure.</span >
Ah, I should have said: the information doesn't come from run-bindings-tests.
Ideally we'd have information about the specific failures in there (eg. "TestMapLike.idl" specifically, as opposed to "something failed, please manually look at the output"). That would enable EWS to make better decisions about patches that fix some failures on a red tree, for example.
In the absence of that, Bindings EWS will have to continue to treat such cases as generic failures as it does currently. (eg. <a href="show_bug.cgi?id=169449#c41">Comment 41</a> on <a class="bz_bug_link
bz_status_REOPENED "
title="REOPENED - Test bug - please disregard"
href="show_bug.cgi?id=159781">https://bugs.webkit.org/show_bug.cgi?id=159781</a> )
(In reply to <a href="show_bug.cgi?id=169449#c2">comment #2</a>)
<span class="quote">> At least as it stands today, not printing FAIL also means that the failing
> test name is not in JSON results, so the recently added bindings EWS
> provides less information about the issue.</span >
We can add stuff to the JSON results without printing, but we don't have any information currently (beyond the fact that something failed).</pre>
</div>
</p>
<hr>
<span>You are receiving this mail because:</span>
<ul>
<li>You are the assignee for the bug.</li>
</ul>
</body>
</html>