[webkit-qt] Layout Test Week

[Alexis Menard]

On Fri, May 18, 2012 at 10:38 AM, Simon Hausmann
<simon.hausmann at nokia.com> wrote:
> On Friday, May 11, 2012 04:46:52 PM ext Simon Hausmann wrote:
> [...]
>
> Alright, a week later I can see many unskipped tests and a whole lot of
> bugfixes landed in trunk. Yay!
>
> On Monday around noon on the WK2 bot we had the following pass rate:
>
> => Results: 24115/29610 tests passed (81.4%)
>
> => Tests to be fixed (5495):
>      2 crashes                  ( 0.0%)
>     11 tests timed out          ( 0.2%)
>      2 no expected results found ( 0.0%)
>     22 text diff mismatch       ( 0.4%)
>     32 image mismatch           ( 0.6%)
>   5426 skipped                  (98.7%)
>
>
> Now we're a fair bit further:
>
> => Results: 24695/29674 tests passed (83.2%)
>
> => Tests to be fixed (4979):
>     11 tests timed out          ( 0.2%)
>      9 no expected results found ( 0.2%)
>     22 text diff mismatch       ( 0.4%)
>     33 image mismatch           ( 0.7%)
>   4904 skipped                  (98.5%)
>
> That's a pretty good result for just a few days (including a public holiday)!

Including also INdT that couldn't access to the office after Monday
lunch to Thursday so we wasted a fair amount of time to get home
office up and running.

>
> I hope that aside from the metrics this exercise also helped everyone to get a
> better idea of how good or bad the situation with the tests is really is.

Maybe we should do this test week sprint once a while no?

>
> Thanks again :)
>

Thanks.

> Simon
> _______________________________________________
> webkit-qt mailing list
> webkit-qt at lists.webkit.org
> http://lists.webkit.org/mailman/listinfo.cgi/webkit-qt



-- 
Alexis Menard (darktears)
Software Engineer
openBossa @ INdT - Instituto Nokia de Tecnologia