[webkit-dev] handling failing tests (test_expectations, Skipped files, etc.)

[Robert Hogan]

On Monday 09 April 2012 22:42:33 Dirk Pranke wrote:
> Hi all,
> 
> Recently I've noticed more people making changes and adding test
> failure suppressions to various ports' test_expectations.txt files.
> This is great!

Hi Dirk,

It would be good to have a page describing the right thing to do for each 
of the ports for each of the following situations:

- Adding a new test with rendtree/pixel results
- Changing the rendtree/pixel results for existing tests

I think the correct practice will differ between ports as only the Chromium 
bots (AFAIK) check pixel results. So this has the unfortunate consquence 
that when you change the expected pixel result for a test that has pixel 
results on all platforms you end up with stale png results in the tree for 
those that you are not in a position either to generate yourself or 
persuade someone on #webkit to generate for you.

Thanks,
Robert