[Webkit-unassigned] [Bug 32804] New: SunSpider: crypto-aes has a call to Date.getTime() which makes it non-deterministic

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=32804

           Summary: SunSpider: crypto-aes has a call to Date.getTime()
                    which makes it non-deterministic
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: PC
        OS/Version: Mac OS X 10.5
            Status: UNCONFIRMED
          Severity: Normal
          Priority: P2
         Component: JavaScriptCore
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: nnethercote at mozilla.com


This is true as of SunSpider-0.9.1, but has been true for longer than that,
AFAICT.  IMHO a benchmark suite should be deterministic.  The variation caused
by the Date.getTime() is large enough that it changes the amount of code is
traced by TraceMonkey.  I'd suggest hard-wiring a particular date+time into the
test.

There may be some other non-determinism in SunSpider.  string-base64 and
string-validate-input both call Math.random(), for example.

Thanks for introducing version numbers for SunSpider, BTW, I think that's an
excellent decision.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.