[Webkit-unassigned] [Bug 172968] Consider using geometric mean in Speedometer 2.0

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=172968

--- Comment #7 from Mathias Bynens <mathias at qiwi.be> ---
(In reply to Ryosuke Niwa from comment #6)
> Another reason we should probably consider using geomean is that we now have
> both release & debug builds of Ember.js after
> https://trac.webkit.org/changeset/221205 and
> https://trac.webkit.org/changeset/221206.
> 
> We did this because we noticed that debug build was 4x slower and therefore
> constitutes a fundamentally different kind of a test.
> 
> However, if we used arithmetic mean to compute the score, then we’re
> effectively giving 4x more weight to debug build of Ember.js compared to its
> release build even though only ~5% of websites that use Ember.js use debug
> builds in production.

IMHO that just means we should remove the debug build of Ember.js from the benchmark altogether.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20170827/1023a76d/attachment.html>