[Webkit-unassigned] [Bug 97510] Some perf. tests have variances that differ greatly between runs

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Mon Sep 24 18:50:57 PDT 2012


https://bugs.webkit.org/show_bug.cgi?id=97510





--- Comment #12 from Kentaro Hara <haraken at chromium.org>  2012-09-24 18:51:24 PST ---
General comment: In my experience, an average value is strongly affected by a couple of outliers. How about calculating the average value after discarding one or two outliers (i.e. discarding one or two largest values)? Or how about using a median instead of an average?

What we are interested in is not the distribution of execution times but the execution time in "common cases". In that sense, in order to observe what we want to observe, it might make more sense to observe a median or an average that ignores outliers than observe a pure average of all values.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.


More information about the webkit-unassigned mailing list