[webkit-dev] Another WPT bite

[Michael[tm] Smith]

Brady Eidson <beidson at apple.com>, 2017-05-13 17:11 -0700:
> 
> 
> > On May 12, 2017, at 7:43 PM, Ryosuke Niwa <rniwa at webkit.org> wrote:
> > 
> > On Fri, May 12, 2017 at 7:31 PM, Alexey Proskuryakov <ap at webkit.org> wrote:
> >> 
> >> When there is a test failure that I need to communicate to others, I say
> >> something "please open
> >> <https://trac.webkit.org/export/216812/webkit/trunk/LayoutTests/fast/images/destroyed-image-load-event.html>
> >> in Safari to reproduce". That's very easy to do, and makes it very easy for
> >> others to work on the issue.
> >> ...
> > 
> > Note that W3C's web-plaform-tests are hosted on
> > http://w3c-test.org/tools/runner/index.html so you can could do the
> > same thing.
> 
> Note Alexey's URL example points to a specific revision of a specific test.
> 
> A frustration that has often come up while I've been working on
> leading-edge features in WebKit is that the w3c-test.org
> <http://w3c-test.org/> tests are constantly updated and therefore are a
> moving target.  One cannot use the same test repeatedly over some length
> of time and expect it to remain consistent.

True. But of course the tests are under version control and you can always
locate any specific revision of one you want to test against; e.g.:

  https://raw.githubusercontent.com/w3c/web-platform-tests/b2e3ab7/service-workers/service-worker/activate-event-after-install-state-change.https.html

For practical reasons on w3c-test.org we can’t directly archive a runnable copy
of every single revision of of every single test. But I would be very willing to
look into adding a service somewhere that does something similar to what
rawgit.com or whatever do—that is, (1) given a URL like the above for specific
revision of a file in a github repo, then (2) load and run it.

rawgit.com itself can of course already load specific revisions of WPT
tests, but when you try it you’ll run into the general problem of the test
files specifying a /resources/testharness.js path to the harness; e.g.:

  https://rawgit.com/w3c/web-platform-tests/b2e3ab7/service-workers/service-worker/activate-event-after-install-state-change.https.html

...which expects to find https://rawgit.com/resources/testharness.js.

But that’s not a hard problem to solve. As I mentioned earlier, I imagine
that with very little effort needed, I could get a similar service set up
that’s WPT-specific and WPT-aware in that it will have the test harness
available at for the /resources/testharness.js URL path.

  —Mike

-- 
Michael[tm] Smith https://people.w3.org/mike
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: not available
URL: <http://lists.webkit.org/pipermail/webkit-dev/attachments/20170514/92777016/attachment.bin>