[Webkit-unassigned] [Bug 252905] New: [GTK] Lots of WebGL2 tests are flaky

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Fri Feb 24 07:47:24 PST 2023


https://bugs.webkit.org/show_bug.cgi?id=252905

            Bug ID: 252905
           Summary: [GTK] Lots of WebGL2 tests are flaky
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: WebKitGTK
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: clopez at igalia.com
                CC: alex at igalia.com, bugs-noreply at webkitgtk.org
            Blocks: 251107

Since the WebGL2 tests were activated at 259348 at main lot of them have started to cause unexpected errors.

Some of this tests are really really flaky.

To the point they are causing issues on the EWS bots.

I have seen some runs where some of this WebGL2 tests fail with patch (a patch totally unrelated to this).
When the bot repeats the failure 11 times the test fails 11 times
Then the bot builds without patch
And then the test passes 11 times

Something weird is going on with this tests.
It is not normal that they can give 11 times a failure on a row and then 11 times a pass on another row.
It looks like if the flakiness was decided at build-time rather than a run-time (either you got a build that is going to fail always or always going to pass). So the result doesn't change until you rebuild or something like that. Just speculation on my part here.

Example of runs where I saw this:

https://ews-build.webkit.org/#/builders/35/builds/42754
https://ews-build.webkit.org/#/builders/35/builds/42758
https://ews-build.webkit.org/#/builders/35/builds/42761
https://ews-build.webkit.org/#/builders/35/builds/42768
https://ews-build.webkit.org/#/builders/35/builds/42780
https://ews-build.webkit.org/#/builders/35/builds/42809
https://ews-build.webkit.org/#/builders/35/builds/42818
https://ews-build.webkit.org/#/builders/35/builds/42838
https://ews-build.webkit.org/#/builders/35/builds/42876
https://ews-build.webkit.org/#/builders/35/builds/42883
https://ews-build.webkit.org/#/builders/35/builds/42907
https://ews-build.webkit.org/#/builders/35/builds/42917
https://ews-build.webkit.org/#/builders/35/builds/42933
https://ews-build.webkit.org/#/builders/35/builds/42934
https://ews-build.webkit.org/#/builders/35/builds/42953
https://ews-build.webkit.org/#/builders/35/builds/42969
https://ews-build.webkit.org/#/builders/35/builds/42977
https://ews-build.webkit.org/#/builders/35/builds/42978
https://ews-build.webkit.org/#/builders/35/builds/42993
https://ews-build.webkit.org/#/builders/35/builds/43002
https://ews-build.webkit.org/#/builders/35/builds/43010
https://ews-build.webkit.org/#/builders/35/builds/43044
https://ews-build.webkit.org/#/builders/35/builds/43050
https://ews-build.webkit.org/#/builders/35/builds/43054
https://ews-build.webkit.org/#/builders/35/builds/43066
https://ews-build.webkit.org/#/builders/35/builds/43072
https://ews-build.webkit.org/#/builders/35/builds/43083
https://ews-build.webkit.org/#/builders/35/builds/43089
https://ews-build.webkit.org/#/builders/35/builds/43121


I initially gardened some of this at 260776 at main but I missed a few them.
I'm going to add all of the ones that I detected are failing in an upcoming gardening patch

On WPE the issue happens also but much less often than in GTK.


Referenced Bugs:

https://bugs.webkit.org/show_bug.cgi?id=251107
[Bug 251107] [GTK][WPE] WebGL2 failures for GTK and WPE ports
-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20230224/4c43bacf/attachment.htm>


More information about the webkit-unassigned mailing list