[Webkit-unassigned] [Bug 281439] New: [run-webkit-tests]: Make it possible to run only tests in Interop

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=281439

            Bug ID: 281439
           Summary: [run-webkit-tests]: Make it possible to run only tests
                    in Interop
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: gsnedders at apple.com
                CC: ap at webkit.org, jbedard at apple.com,
                    ryanhaddad at apple.com,
                    webkit-bug-importer at group.apple.com

When working on Interop, there are times when developers might want to run only the tests in Interop.

There's a few potential variants here:

 * Running tests with a given label,
 * Running tests in a given Interop category (which is formed of a number of labels),
 * Running all tests in Interop 20xx.

The data is basically split between https://github.com/web-platform-tests/results-analysis/blob/main/interop-scoring/category-data.json and https://github.com/web-platform-tests/wpt.fyi/blob/main/webapp/static/interop-data.json, and we can get all the labels from https://wpt.fyi/api/metadata?includeTestLevel=true&product=chrome rather than manually re-parsing all of https://github.com/web-platform-tests/wpt-metadata.

(Arguably this can already be done by writing a script to enumerate all the tests in one of those variants and put them in a file and then just run with --test-list, but it would be easier for developers to just have this all integrated into run-webkit-test.)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20241014/dd26fe08/attachment.htm>