[Webkit-unassigned] [Bug 105003] Whitelist a subset of tests to be ran on run-perf-tests by default

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=105003





--- Comment #4 from Stephanie Lewis <slewis at apple.com>  2012-12-18 01:31:47 PST ---
When calculating a tests value I usually look at reproducibility, coverage/sensitivity, external interest, and length of time to run/difficulty to set up.  If a test's results are not consistent then tracking it's progress creates a burden as opposed to being helpful.  If a test is testing some obscure technologies or doesn't pick up major regressions in what it does test it may not be valuable.  Tests that are run by the media externally are good to keep an eye on.  Length of time to run may not matter here, but if a test breaks a lot if may also impose a burden.

I think a good first step would be figuring out which tests have less than a 2% difference over a significant number of runs of the same source and go from there.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.