[webkit-dev] WindScorpion

[Zoltan Herczeg]

Dear Webkit Developers,

We have extended the SunSpider benchmark system with some new JavaScript
benchmarks. These JS examples are collected from the Internet and they are
freely available. Its name is WindScorpion, which is another name of
SunSpider. You can download it from:

http://www.inf.u-szeged.hu/opensource/download/get.php?name=WindScorpion.tgz

To use it, simply copy them the the SunSpider/tests directory, and extend
the LIST file with the names.

The individual test cases are designed to run around 2 seconds, but this
time increases when you put them under SunSpider.

Besides from the benchmark, we are also made some coverity tests. (It
seems your automated coverity measurement site is down for some time). The
mozilla regression tests (JavaScriptCore/tests) are also included as they
are good for reference.

 * gcc (function coverage)
   * there are 2034 functions in the jsc binary
   * Num of functions covered by sunspider: 998
   * Num of functions covered by windscorpion: 940
   * Num of functions covered by regression test: 1406
   * Num of functions covered by sunspider but not covered by
windscorpion: 142
   * Num of functions covered by sunspider but not covered by regression
test: 2
   * Num of functions covered by windscorpion but not covered by
sunspider: 84
   * Num of functions covered by windscorpion but not covered by
regression test: 3
   * Num of functions covered by regression test but not covered by
sunspider: 410
   * Num of functions covered by regression test but not covered by
windscorpion: 469
 * gcc (AST node coverage)
   * there are 77 node types in the jsc binary
   * Num of node types covered by sunspider: 55
   * Num of node types covered by windscorpion: 63
   * Num of node types covered by regression test: 71
   * Num of node types covered by sunspider but not covered by
windscorpion: 5
   * Num of node types covered by sunspider but not covered by regression
test: 0
   * Num of node types covered by windscorpion but not covered by
sunspider: 13
   * Num of node types covered by windscorpion but not covered by
regression test: 1
   * Num of node types covered by regression test but not covered by
sunspider: 16
   * Num of node types covered by regression test but not covered by
windscorpion: 9

Two of the WindScorpion tests are not included in the package, because
they have a strange behaviour when used under SunSpider.
  * randPrime.js - the runtime is somehow increased to 16 seconds from 2
  * wordreplace.js - the runtime is "undefined", if all wind scorpion
benchmarks are included in the LIST. However, it is working, if this
file is appended alone to the end of the LIST file.

We plan to investigate them later.

If you wish, you can extend SunSpider with some of them.

Cheers,
Zoltan