[Webkit-unassigned] [Bug 185918] test262/Runner.pm: randomize tests for performance

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Wed May 23 15:17:55 PDT 2018


https://bugs.webkit.org/show_bug.cgi?id=185918

--- Comment #3 from valerie <valerie at bocoup.com> ---
(In reply to Alexey Proskuryakov from comment #2)
> Comment on attachment 341115 [details]
> Patch
> 
> View in context:
> https://bugs.webkit.org/attachment.cgi?id=341115&action=review
> 
> > Tools/Scripts/test262/Runner.pm:296
> > +        @files = shuffle @files;
> 
> Anything random in tests makes me nervous because it can make reproducing
> results hard. Can the same result be achieved without randomness?

Hmm -- so this randomize the order in which the tests are run to even the load across the child processes (there are some groups of slow tests). The tests all stand alone.

I thought of alphabetizing the tests (instead of shuffle), as the "slow" groupings are groupings within directories, but unfortunately the naming convention is also consistent in such a way that slow tests would be grouped.

This is not a very great performance increase -- and I'm not married to seeing it committed, it's just here to get feedback from Michael :)

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20180523/bc9489b3/attachment.html>


More information about the webkit-unassigned mailing list