[Webkit-unassigned] [Bug 174201] Speedometer 2.0: Use production builds where possible

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=174201

--- Comment #9 from Ryosuke Niwa <rniwa at webkit.org> ---
(In reply to Harald Kirschner from comment #8)
> (In reply to Ryosuke Niwa from comment #6)
> > Remember, what we're trying to do is to measure the performance of browser,
> > not production websites.
> 
> Addy asked me for feedback on this issue as I gave input the initial v2
> changes and as the Spidermonkey team started looking at Speedometer v2.
> 
> I understand it is hard to clearly separate Speedometer from the frameworks
> it tests from the real world. Speedometer was announced [1] as "a benchmark
> that measures the responsiveness of real-world web applications". While best
> practices could differ between frameworks (I could not find any examples),
> the default premise should be that real-world web apps use production builds.

I wouldn't make such an assumption. When I first wrote Speedometer, many real world Ember apps were using debug builds. We really need to do a careful assessment of each framework & library separately.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20170717/0c89f15c/attachment-0001.html>