[webkit-dev] Cross browser automated tests

[Sylvain Pasche]

Hi,

This is an announcement of a project that may be of interest. The idea 
is to run test cases automatically on some versions of the main 
browsers. Test results should help authors/spec authors/vendors see what 
feature is implemented where and vendors could integrate these tests in 
their regression testing framework.

For now the framework is able to run a subset of WebKit and Mozilla 
automated tests. For the WebKit tests in particular, it runs the 
LayoutTests that use the layoutTestController.dumpAsText() API and 
compare result with a testcase-exepected.txt file.

Results are visible on http://www.browsertests.org. Note that there are 
some features not implemented or limitations that result in tests that 
should pass which fail and reversely. Source code and some documentation 
is available at http://code.google.com/p/browsertests/.

One of the possible future improvements is to run Mozilla tests using 
DumpRenderTree. That means that Mozilla tests could be integrated in 
WebKit's automated testing harness.

If you have questions/suggestions/ideas they're welcome. There's also a 
discussion group on http://groups.google.com/group/browsertests.


Sylvain