[Webkit-unassigned] [Bug 261840] New: REGRESSION(268166 at main): [ macOS ] 4 API tests under TestWebKitAPI.WKInspectorExtensionHost: 2 constantly failing, 2 constantly timing out

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Wed Sep 20 14:06:24 PDT 2023


https://bugs.webkit.org/show_bug.cgi?id=261840

            Bug ID: 261840
           Summary: REGRESSION(268166 at main): [ macOS ] 4 API tests under
                    TestWebKitAPI.WKInspectorExtensionHost: 2 constantly
                    failing, 2 constantly timing out
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Web Inspector
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: ben_schwartz at apple.com
                CC: inspector-bugzilla-changes at group.apple.com,
                    mattwoodrow at apple.com,
                    webkit-bot-watchers-bugzilla at group.apple.com,
                    webkit-bug-importer at group.apple.com

The following API tests are constantly failing on macOS:

TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension
TestWebKitAPI.WKInspectorExtensionHost.UnegisterExtension

The following API tests are constantly timing out on macOS:

TestWebKitAPI.WKInspectorExtension.EvaluateScriptOnPage
TestWebKitAPI.WKInspectorExtension.ExtensionTabIsPersistent


ERROR LOG (for failures):

    TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension

        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:83
        Value of: error
          Actual: false
        Expected: true


        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:84
        Value of: !(extension)
          Actual: false
        Expected: true


        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:85
        Value of: [error.localizedFailureReason containsString:@"RegistrationFailed"]
          Actual: false
        Expected: true

    TestWebKitAPI.WKInspectorExtensionHost.UnregisterExtension

        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:155
        Value of: error
          Actual: false
        Expected: true


        /Volumes/Data/worker/Apple-Monterey-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/WKInspectorExtensionHost.mm:156
        Value of: [error.localizedFailureReason containsString:@"InvalidRequest"]
          Actual: false
        Expected: true

STDIO URL:

https://build.webkit.org/api/v2/logs/24835290/raw

REPRODUCIBILITY:

I was able to reproduce this issue on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-api-tests --verbose TestWebKitAPI.WKInspectorExtensionHost.RegisterExtension TestWebKitAPI.WKInspectorExtensionHost.UnregisterExtension TestWebKitAPI.WKInspectorExtension.EvaluateScriptOnPage TestWebKitAPI.WKInspectorExtension.ExtensionTabIsPersistent

REGRESSION:

The flakiness dashboard, bisection, and contextual information all indicate a likely regression point at 268166 at main.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20230920/6094d9a5/attachment.htm>


More information about the webkit-unassigned mailing list