[webkit-dev] A proposal for handling "failing" layout tests and TestExpectations

Ryosuke Niwa rniwa at webkit.org
Wed Aug 15 17:19:07 PDT 2012


I have a concern that a lot of people wouldn't know what the "correct"
output is for a given test.

For a lot of pixel tests, deciding whether a given output is correct or not
is really hard. e.g. some seemingly insignificant anti-alias different may
turn out be a result of a bug in Skia and other graphics library or WebCore
code that uses it.

As a result,

   - people may check in wrong "correct" results
   - people may add "failing" results even though new results are more or
   less correct


This leads me to think that just checking in the current output as
-expected.png and filing bugs separately is a better approach.

- Ryosuke
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20120815/fdc19317/attachment.html>


More information about the webkit-dev mailing list