[webkit-dev] add NeedsRebaseline keyword to TestExpectations as a way to hande updating pixel tests?

[Stephen Chenney]

I also like this idea. I particularly like the side effect of making it
clear when a patch is modifying a test result that is itself not
necessarily up to date.

I suggest a policy that says you must rebaseline a test before committing a
patch that would change that test (if the test is marked as needing
rebaselining). Otherwise I see the potential for situations in which the
status of a test gets confused due to overlapping patches or roll-outs.

That also means we need an easy way to determine if a patch affects tests
that are not reporting errors due to rebaselining. Can we have
new-run-webkit-tests show, in the test results summary, the tests that you
failed that need rebaselining?

Cheers,
Stephen.

On Thu, Oct 4, 2012 at 6:18 PM, Emil A Eklund <eae at chromium.org> wrote:

> That sounds like a great idea!
> It is too hard to do this right today and having an easy way to
> indicate that a test needs to be rebaselined across some or a subset
> of platforms would be great.
>
> --
> Emil
> _______________________________________________
> webkit-dev mailing list
> webkit-dev at lists.webkit.org
> http://lists.webkit.org/mailman/listinfo/webkit-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20121004/52d1e45d/attachment.html>