[Webkit-unassigned] [Bug 160023] [GTK] Fix some video/canvas tests that should be passing

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=160023

--- Comment #10 from Miguel Gomez <magomez at igalia.com> ---
(In reply to comment #9)
> Comment on attachment 284217 [details]
> Patch
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=284217&action=review
> 
> It likely fails on Mac-WebKit1 because only WebKitTestRunner was updated,
> not DumpRenderTree.

Yeah, my fault. I run the tests in elcapitan but forgot about the platforms that use DRT.

> > LayoutTests/fast/canvas/canvas-createPattern-video-loading.html:62
> > +            tolerance = testRunner.videoCanvasPixelComparisonTolerance;
> 
> This is pretty ugly, can't you simply have a GTK-specification version of
> these tests under platform/gtk?

The problem with these tests is that we cannot just create specific expectations for gtk, as the test output includes whether it's failure or success, and also two of them include the tolerance value in the output. We would need to add as expectation an output of the tests that indicates failure, which is weird. So we need to modify the tests somehow to increase that tolerance in the comparison somehow when using GStreamer and Cairo.

But then, from what I've been testing, it's not possible to override a general test with another one placed in platform/gtk (at least I haven't found a way to do so, please correct me if I'm wrong). Maybe adding those tests to the TestExpectations as expected failures and then adding new ones in platform/gtk, but this would mean that we would need to copy every new test that gets added that performs a similar comparison, which is a pain.

I think this approach is a nice solution, having a tolerance value defined for each platform and make the tests to use it. This patch had some problems, but I'll send a new improved version that I think should also work for platforms that use DRT.

As I don't have those platforms to test, I'll the EWS test it for me.

Is that ok for you Chris? Or am I missing something? Comments are very welcome :)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20160722/0437b89f/attachment.html>