[webkit-dev] Tests that fail across different architectures

[Simon Fraser]

On Oct 8, 2010, at 9:16 AM, Martin Robinson wrote:

> The GTK+ port runs layout tests on both a x86_64 and i386 operating
> system installations. We have a growing list of tests that generate
> different expected results between achitectures. These are almost all
> SVG tests. Last night tests were added that even have different
> results between our debug and release bots.
> 
> Here's an example of a failure:
> http://build.webkit.org/results/GTK%20Linux%2064-bit%20Debug/r69399%20(14499)/svg/custom/relative-sized-inner-svg-pretty-diff.html
> 
> Tests that depend on this amount of precision are very sensitive to
> rounding differences between architectures and library versions. I'm
> just curious what the approach should be that isn't skipping these
> tests. Perhaps a fudge factor in the output?

Yes, I would round the output to some number of significant digits (or decimal places perhaps).

Simon