[Webkit-unassigned] [Bug 127095] run-webkit-tests should support assert-only js tests w/o expected.txt files

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=127095





--- Comment #9 from youenn fablet <youennf at gmail.com>  2014-01-27 00:36:54 PST ---
(In reply to comment #8)
> Again, I don't think we can avoid generating lines just because they start with "PASS".

OK, it is probably safer to keep it the way it is for layout tests.

To help the task of importing W3C tests and ensuring that imported tests remain consistent with W3C repository, a complementary tool may be helpful though.

Such a tool (based on import-w3c-tests and run-webkit-tests) could regularly and automatically compute:
- Which tests have been imported and are in sync with W3C repository
- Which tests have been imported and are out of sync with W3C repository
  - How bad this affects the test result (unchanged, probably switched to passing, switched to failing…)
- Which tests remain to be imported (partially imported folder or newly added tests) and their state:
  - Tests that are crashing/hanging (good to fix!)
  - Tests that are failing (ideally with a link to a related bug entry if any)
  - Tests that are potentially passing
  - Tests that were potentially passing and are no longer passing

That said, this is clearly less a priority than doing the actual job of importing W3C tests :)

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.