[Webkit-unassigned] [Bug 94668] Perf test results is incomprehensive

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=94668


Ryosuke Niwa (vacation: 8/26-9/10) <rniwa at webkit.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |eae at chromium.org,
                   |                            |leviw at chromium.org,
                   |                            |ojan at chromium.org




--- Comment #4 from Ryosuke Niwa (vacation: 8/26-9/10) <rniwa at webkit.org>  2012-08-24 02:12:24 PST ---
(In reply to comment #3)
> Both the perfalizer and the tabular view compare the same revision.
> 
> I think it would be useful to provide option to compare a range of revisions (avg of them) with a revision.

There is a way already!

run-perf-tests --description "~"

> Hmm... It would be also good if we could provide an overall/summarized result:
> 
> I mean something like:
> 
> From 100 FastMalloc results
> 69 were better
> 31 were worse
> 
> What is your opinion?

Yeah, but counting 0.1% improvement and 70% regression equally as "1" is quite misleading.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.