[webkit-dev] Running W3C tests using wptserve
youennf at gmail.com
Sun Feb 1 00:42:17 PST 2015
2015-02-01 3:08 GMT+01:00 Benjamin Poulain <benjamin at webkit.org>:
> Hi Youenn,
> Thanks for working on this.
> How do we run the imported tests? Do we just use run-webkit-test passing
> Is there a way to get the percentage of W3C tests that succeed? It would be
> useful to have a report per directory so that we improve it over time until
> we reach 100%.
That is part of another tool: https://bugs.webkit.org/show_bug.cgi?id=134766
It basically uses run-webkit-test on the whole W3C test suite (or a subset).
It checks conformance by searching for PASS/FAIL assertions.
You can find an old version of the report here:
That tool would also be used to discriminate which tests to import.
https://bugs.webkit.org/show_bug.cgi?id=134767 would then be used to
refresh LayoutTests/imported/w3c (new tests, -expected.txt
I plan to write a page on the wiki when these things will start to
appear on the trunk.
Any suggestion/help most welcome.
> On 1/31/15 11:57 AM, youenn fablet wrote:
>> Hi all,
>> W3C wptserve server is now used to serve all tests under
>> Currently, only two tests are run within that folder:
>> - web-platform-tests/domparsing/DOMParser-parseFromString-html.html
>> - web-platform-tests/domparsing/insert-adjacent.html
>> Should there be any issus with those tests, the problem may be related
>> to running wptserve.
>> The wptserve server log is dumped in the the layout-test-results folder.
>> Please let me know if you see any such issue, particularly on WebKit bots.
>> Next planned steps in that area are:
>> 1. Update Tools/Scripts/import-w3c-tests according this new set-up
>> 2. Migrate already imported W3C WPT tests within
>> 3. Further improve the tools to make import of new tests and re-import
>> existing tests as easy as possible
>> Any suggestion welcome.
>> webkit-dev mailing list
>> webkit-dev at lists.webkit.org
> webkit-dev mailing list
> webkit-dev at lists.webkit.org
More information about the webkit-dev