[Webkit-unassigned] [Bug 97510] Some perf. tests have variances that differ greatly between runs

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=97510





--- Comment #12 from Kentaro Hara <haraken at chromium.org>  2012-09-24 18:51:24 PST ---
General comment: In my experience, an average value is strongly affected by a couple of outliers. How about calculating the average value after discarding one or two outliers (i.e. discarding one or two largest values)? Or how about using a median instead of an average?

What we are interested in is not the distribution of execution times but the execution time in "common cases". In that sense, in order to observe what we want to observe, it might make more sense to observe a median or an average that ignores outliers than observe a pure average of all values.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.