[Webkit-unassigned] [Bug 216921] New: Support for web-platform-tests crashtests

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=216921

            Bug ID: 216921
           Summary: Support for web-platform-tests crashtests
           Product: WebKit
           Version: Other
          Hardware: Unspecified
               URL: https://web-platform-tests.org/writing-tests/crashtest
                    .html
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: fred.wang at free.fr
                CC: ap at webkit.org, darin at apple.com, emilio at crisal.io,
                    gsnedders at apple.com, youennf at gmail.com

Follow-up of the discussion of https://bugs.webkit.org/show_bug.cgi?id=186045#c77

A new concept of "crashtest" was introduced in WPT (last year maybe?). I'm not exactly sure about the details and how we handle them in WebKit, but I'm opening this to track any work needed, if we are interested in supporting this. The doc is https://web-platform-tests.org/writing-tests/crashtest.html ; basically the idea is just to load a test page and the test pass iff the page does not crash.

Some quick summary of TODO things:

* Adjust the importer. I'm just importing my recent crashtests in bug 216871 and I see the test files are just treated as "resource files".

* Adjust the runner, to be more robust with how we handle crashing test (see bug 186045 comment 80).

* Add support for "test-wait" class, which should just be refactoring the logic for reftest-wait (see bug 186045 comment 82). If we don't do that, we could easily have false positive PASS results since we would close the test page before the full testing is performed.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20200924/8db9d845/attachment-0001.htm>