[webkit-dev] handling failing tests (test_expectations, Skipped files, etc.)
lists at roberthogan.net
Mon Apr 9 15:34:32 PDT 2012
On Monday 09 April 2012 22:42:33 Dirk Pranke wrote:
> Hi all,
> Recently I've noticed more people making changes and adding test
> failure suppressions to various ports' test_expectations.txt files.
> This is great!
It would be good to have a page describing the right thing to do for each
of the ports for each of the following situations:
- Adding a new test with rendtree/pixel results
- Changing the rendtree/pixel results for existing tests
I think the correct practice will differ between ports as only the Chromium
bots (AFAIK) check pixel results. So this has the unfortunate consquence
that when you change the expected pixel result for a test that has pixel
results on all platforms you end up with stale png results in the tree for
those that you are not in a position either to generate yourself or
persuade someone on #webkit to generate for you.
More information about the webkit-dev