[Webkit-unassigned] [Bug 43253] SunSpider run times are not reproducible

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=43253





--- Comment #4 from Paul Biggar <pbiggar at mozilla.com>  2010-08-06 17:04:42 PST ---
(In reply to comment #3)
> I don't think summing the absolute differences from the mean for each subtest is a statistically valid procedure, for computing the variance of the total score.

This is true. I ran it past our resident stats expert dmandelin, who confirmed it to be "not too bad as a rough measure". It seemed to work so I stopped there. As I understand it, this is complicated by the fact that the benchmarks run for wildly different lengths of time. I don't know if you'd consider solving this for 0.9.2.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.