[Webkit-unassigned] [Bug 97510] Some perf. tests have variances that differ greatly between runs

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=97510





--- Comment #16 from Ryosuke Niwa <rniwa at webkit.org>  2012-10-01 16:18:21 PST ---
(In reply to comment #15)
> IMO you want to run enough iterations so that issues in repeating code are found (i.e. if the javascript heap size increases each time slowing stuff down), but running multiple instances does improve variance and it reduces the risk of an entire run being an outlier.

In V8 at least, there are some global variables that are initialized at startup, which is then used to compute hashes, etc... So just increasing the number of iterations doesn't help. See results labeled "(approach 1)",

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.