[Webkit-unassigned] [Bug 164948] New: Animometer run-benchmark results are unnecessarily nested or aggregated

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Fri Nov 18 12:48:35 PST 2016


https://bugs.webkit.org/show_bug.cgi?id=164948

            Bug ID: 164948
           Summary: Animometer run-benchmark results are unnecessarily
                    nested or aggregated
    Classification: Unclassified
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: clopez at igalia.com
                CC: lforschler at apple.com

The json results generated by the Animometer benchmark when ran with the run-benchmark tool have two 


Animometer': {metrics': {Score': [Geometric']},
                 tests': {Animometer': {metrics': {Score': [Geometric']},
                                            tests': {Canvas Arcs': {metrics': {Score': {current': [1425.4671861375848]}}},
                                                       Canvas Lines': {metrics': {Score': {current': [6041.67557789635]}}},
                                                       Design': {metrics': {Score': {current': [120.42884422240773]}}},
                                                       Focus': {metrics': {Score': {current': [106.53534015865043]}}},
                                                       Images': {metrics': {Score': {current': [141.71080576796632]}}},
                                                       Leaves': {metrics': {Score': {current': [986.0850870259096]}}},
                                                       Multiply': {metrics': {Score': {current': [1080.5982243695066]}}},
                                                       Paths': {metrics': {Score': {current': [4659.013255111744]}}},
                                                       Suits': {metrics': {Score': {current': [1137.5734845930879]}}}}}}}


Notice how there is a main aggregated geometric result with name Animometer, which contains inside another result of the same type and name.

This is wrong, see the output of read-results:

$ Tools/Scripts/run-benchmark --read-results-json animometer.result 
Animometer:Score:Geometric: 250pt stdev=0.0%
          Animometer:Score:Geometric: 250pt stdev=0.0%
                    Canvas Arcs:Score: 256pt stdev=0.0%
                    Canvas Lines:Score: 967pt stdev=0.0%
                    Design:Score: 50.0pt stdev=0.0%
                    Focus:Score: 255pt stdev=0.0%
                    Images:Score: 208pt stdev=0.0%
                    Leaves:Score: 103pt stdev=0.0%
                    Multiply:Score: 336pt stdev=0.0%
                    Paths:Score: 915pt stdev=0.0%
                    Suits:Score: 184pt stdev=0.0%


Notice here how two entries with "Animometer:Score:Geometric: 250pt " appear

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20161118/d5c53666/attachment.html>


More information about the webkit-unassigned mailing list