[webkit-qt] Layout Test Week

[Simon Hausmann]

On Friday, May 11, 2012 04:46:52 PM ext Simon Hausmann wrote:
[...]

Alright, a week later I can see many unskipped tests and a whole lot of 
bugfixes landed in trunk. Yay!

On Monday around noon on the WK2 bot we had the following pass rate:

=> Results: 24115/29610 tests passed (81.4%)

=> Tests to be fixed (5495):
      2 crashes                  ( 0.0%)
     11 tests timed out          ( 0.2%)
      2 no expected results found ( 0.0%)
     22 text diff mismatch       ( 0.4%)
     32 image mismatch           ( 0.6%)
   5426 skipped                  (98.7%)


Now we're a fair bit further:

=> Results: 24695/29674 tests passed (83.2%)

=> Tests to be fixed (4979):
     11 tests timed out          ( 0.2%)
      9 no expected results found ( 0.2%)
     22 text diff mismatch       ( 0.4%)
     33 image mismatch           ( 0.7%)
   4904 skipped                  (98.5%)

That's a pretty good result for just a few days (including a public holiday)!

I hope that aside from the metrics this exercise also helped everyone to get a 
better idea of how good or bad the situation with the tests is really is. 

Thanks again :)

Simon