[Webkit-unassigned] [Bug 160996] WebRTC: [GTK] Improve video element MediaStream player to support more advanced test cases

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=160996

Carlos Alberto Lopez Perez <clopez at igalia.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |alex at igalia.com,
                   |                            |bugs-noreply at webkitgtk.org,
                   |                            |clopez at igalia.com,
                   |                            |eocanha at igalia.com,
                   |                            |pnormand at igalia.com

--- Comment #2 from Carlos Alberto Lopez Perez <clopez at igalia.com> ---
I think is better to mark tests as failing or timing out rather than just skip them.

Otherwise when any of the following happens:

 * Some revision introduces a regression that makes the test crash
 * Some revision makes the test pass

It goes completely undetected.


A real example.. I'm checking that now, of the 5 mediastream tests skipped assigned to this bug, 2 are working now. And nobody was aware of that.

If those 5 test were marked as failing, the bots would notice the new passes.

But with skipped tests nobody notices.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20170118/b3658cef/attachment-0001.html>