[webkit-dev] Increasing the number of cross-platform/port expected results

[Andras Becsi]

Hi,

I like this concept of reftests because it seems easier to maintain and 
scales better on multiple ports than the current form of testing.
On the other hand it has to be noted that it would apparently be much 
work to create reference tests for the current tests which doesn't 
appear to be a trivial task, furthermore the testing process would be 
much slower than now becasue, as I experienced it, running the pixel 
tests is really slow (at least on the Qt port) and we have to generate 
two pictures per test if we introduce reftests.

BTW, does the python based layout testing framework, which was checked 
in recently, support pixel tests? AFAIK it can run multiple DRT's in 
parallel and speed up the testing process which wouldn't be bad a bad 
thing in this case either.

Regards,
Andras

2010-02-23 19:04 keltezéssel, Sam Weinig írta:
>
>
> On Tue, Feb 23, 2010 at 12:58 PM, Dirk Schulze <vbs85 at gmx.de
> <mailto:vbs85 at gmx.de>> wrote:
>
>     Am Dienstag, den 23.02.2010, 08:34 -0800 schrieb Simon Fraser:
>
>      > It could be an image, or it could be a configuration of <div>
>     elements, or a table, or something else that can be configured to
>     look exactly the same as the CSS border property being tested.
>      >
>      > Simon
>
>     I like the idea of reftests. But how do we write tests for box-shadows,
>     gradients or patterns on a text (like in SVG)? All basic graphical
>     elements would still need pixel-tests, or do you have another idea?
>
>
> Mozilla has been using this technique for years. Perhaps we can pick
> their brains for some good tricks. Or, dare I say it, share some tests.
>
> -Sam