[Webkit-unassigned] [Bug 255035] New: [ews] A PR that failed to fix a pre-existing test failure was marked as green even though the test was still failing

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Wed Apr 5 09:20:43 PDT 2023


https://bugs.webkit.org/show_bug.cgi?id=255035

            Bug ID: 255035
           Summary: [ews] A PR that failed to fix a pre-existing test
                    failure was marked as green even though the test was
                    still failing
           Product: WebKit
           Version: Other
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: ryanhaddad at apple.com
                CC: aakash_jain at apple.com, jbedard at apple.com,
                    webkit-bug-importer at group.apple.com

Here is an interesting case with our EWS + results DB integration, but I’m not sure how we’d mitigate it: 
https://github.com/WebKit/WebKit/pull/11769 was supposed to fix TestWebKitAPI.WebKit.MediaBufferingPolicy, and since EWS was ignoring the failure based on post-commit results, it ignored the fact that the test continued to fail with the PR and marked the run as ✅ https://ews-build.webkit.org/#/builders/18/builds/1253

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20230405/078ef714/attachment.htm>


More information about the webkit-unassigned mailing list