<html>
<head>
<base href="https://bugs.webkit.org/" />
</head>
<body><table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>Bug ID</th>
<td><a class="bz_bug_link
bz_status_NEW "
title="NEW - Animometer run-benchmark results are unnecessarily nested or aggregated"
href="https://bugs.webkit.org/show_bug.cgi?id=164948">164948</a>
</td>
</tr>
<tr>
<th>Summary</th>
<td>Animometer run-benchmark results are unnecessarily nested or aggregated
</td>
</tr>
<tr>
<th>Classification</th>
<td>Unclassified
</td>
</tr>
<tr>
<th>Product</th>
<td>WebKit
</td>
</tr>
<tr>
<th>Version</th>
<td>WebKit Nightly Build
</td>
</tr>
<tr>
<th>Hardware</th>
<td>Unspecified
</td>
</tr>
<tr>
<th>OS</th>
<td>Unspecified
</td>
</tr>
<tr>
<th>Status</th>
<td>NEW
</td>
</tr>
<tr>
<th>Severity</th>
<td>Normal
</td>
</tr>
<tr>
<th>Priority</th>
<td>P2
</td>
</tr>
<tr>
<th>Component</th>
<td>Tools / Tests
</td>
</tr>
<tr>
<th>Assignee</th>
<td>webkit-unassigned@lists.webkit.org
</td>
</tr>
<tr>
<th>Reporter</th>
<td>clopez@igalia.com
</td>
</tr>
<tr>
<th>CC</th>
<td>lforschler@apple.com
</td>
</tr></table>
<p>
<div>
<pre>The json results generated by the Animometer benchmark when ran with the run-benchmark tool have two
Animometer': {metrics': {Score': [Geometric']},
tests': {Animometer': {metrics': {Score': [Geometric']},
tests': {Canvas Arcs': {metrics': {Score': {current': [1425.4671861375848]}}},
Canvas Lines': {metrics': {Score': {current': [6041.67557789635]}}},
Design': {metrics': {Score': {current': [120.42884422240773]}}},
Focus': {metrics': {Score': {current': [106.53534015865043]}}},
Images': {metrics': {Score': {current': [141.71080576796632]}}},
Leaves': {metrics': {Score': {current': [986.0850870259096]}}},
Multiply': {metrics': {Score': {current': [1080.5982243695066]}}},
Paths': {metrics': {Score': {current': [4659.013255111744]}}},
Suits': {metrics': {Score': {current': [1137.5734845930879]}}}}}}}
Notice how there is a main aggregated geometric result with name Animometer, which contains inside another result of the same type and name.
This is wrong, see the output of read-results:
$ Tools/Scripts/run-benchmark --read-results-json animometer.result
Animometer:Score:Geometric: 250pt stdev=0.0%
Animometer:Score:Geometric: 250pt stdev=0.0%
Canvas Arcs:Score: 256pt stdev=0.0%
Canvas Lines:Score: 967pt stdev=0.0%
Design:Score: 50.0pt stdev=0.0%
Focus:Score: 255pt stdev=0.0%
Images:Score: 208pt stdev=0.0%
Leaves:Score: 103pt stdev=0.0%
Multiply:Score: 336pt stdev=0.0%
Paths:Score: 915pt stdev=0.0%
Suits:Score: 184pt stdev=0.0%
Notice here how two entries with "Animometer:Score:Geometric: 250pt " appear</pre>
</div>
</p>
<hr>
<span>You are receiving this mail because:</span>
<ul>
<li>You are the assignee for the bug.</li>
</ul>
</body>
</html>