[Webkit-unassigned] [Bug 132784] New: DYEBench should fail when the variance is more than 5%

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=132784

           Summary: DYEBench should fail when the variance is more than 5%
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: rniwa at webkit.org
                CC: mjs at apple.com, darin at apple.com, barraclough at apple.com,
                    benjamin at webkit.org, akling at apple.com


As far as I'm concerned, the variance on DYEBench should be no more than 5%.
e.g. Safari consistently reports the variance below 1% on many systems I've tested.

Since the variance of more than 5% indicates something went wrong,
we shouldn't even report the arithmetic mean.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.