[webkit-dev] run-bindings-tests

Eric Seidel eric at webkit.org
Thu Sep 8 12:02:24 PDT 2011


I'm not currently working on bindings, so I don't have very strong
opinions for or against the script.

I added it to the bots back in June so that the results would stop breaking.


It's possible such script would be more useful w/o checked in results, unclear.

I will point out that Darin Adler, was at one point at least one happy
customer of this script:
https://bugs.webkit.org/show_bug.cgi?id=62880#c5

-eric

On Thu, Sep 8, 2011 at 11:49 AM, Alexey Proskuryakov <ap at webkit.org> wrote:
>
> 08.09.2011, в 11:32, Eric Seidel написал(а):
>
>> FYI:  As many of you already know, the build.webkit.org bots run
>> "run-bindings-tests" on (almost) all platforms.
>>
>> They've been running (mostly w/o incident) on the bots since 6/20:
>> http://trac.webkit.org/changeset/89267
>>
>>
>> These just make sure that our generated bindings look sane, by
>> comparing the generated results against checked-in baselines.
>>
>> run-bindings-tests makes it easier to make cross-platform bindings
>> changes w/o needing a Gtk/Qt/V8/etc. port of WebKit.
>>
>> If you're changing binding generation you should be aware of this script.
>
> As discussed on IRC, I do not think that bots should run this test at all. It has a non-trivial maintenance cost, but provides very little benefit. Even the time spent by multiple engineers on IRC today discussing bot complaints is likely more than the test could save in the lifetime of the project, at my guesstimate.
>
> A test like this is almost like keeping a separate text file with a number of space characters in WebKit sources, and chastising anyone who fails to update this text file with their commit. Why would we care about the number of spaces, or about the exact look of generated code?
>
> Specifically, this is today's failure: <http://build.webkit.org/builders/SnowLeopard%20Intel%20Release%20%28Tests%29/builds/32923/steps/bindings-generation-tests/logs/stdio> - a test that complains about such changes doesn't test for the right thing.
>
> A script like this might be useful to run locally when making bindings changes if in doubt, comparing "before" and "after" results. There is no need to check in most recent results for this though. I'm not sure if this gives you more than manually copying DerivedSources directory and diffing new derived sources to that, but if someone finds a little automation valuable, then why not.
>
> - WBR, Alexey Proskuryakov
>
>


More information about the webkit-dev mailing list