[Webkit-unassigned] [Bug 281450] New: [EWS] API-Tests-iOS-Simulator-EWS: 11 tests in TestWebKitAPI.WebAuthenticationPanel are pre-existing API test failures

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Mon Oct 14 13:50:38 PDT 2024


https://bugs.webkit.org/show_bug.cgi?id=281450

            Bug ID: 281450
           Summary: [EWS] API-Tests-iOS-Simulator-EWS: 11 tests in
                    TestWebKitAPI.WebAuthenticationPanel are pre-existing
                    API test failures
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: darbinyan at apple.com

The following tests are failing in EWS as pre-existing API test failures. The tests are failing on EWS only. 

TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential
TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential
TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential
TestWebKitAPI.WebAuthenticationPanel.GetAllCredential
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName
TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName


Output logs:
Failed

    TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2411
        Expected equality of these values:
          [credentials count]
            Which is: 2
          0lu
            Which is: 0

    TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2341
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2342
        Expected equality of these values:
          [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAlternateAccessGroup] count]
            Which is: 1
          0lu
            Which is: 0



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2350
        Expected equality of these values:
          [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count]
            Which is: 2
          0lu
            Which is: 0



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2353
        Expected equality of these values:
          [[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0]
            Which is: "GB+ohyUvfbttigLbWCN9We8etUw="
          [credentialId base64EncodedStringWithOptions:0]
            Which is: ""



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2355
        Expected equality of these values:
          [[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count]
            Which is: 2
          0lu
            Which is: 0

    TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2369
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2380
        Expected equality of these values:
          [credentials count]
            Which is: 2
          1lu
            Which is: 1

    TestWebKitAPI.WebAuthenticationPanel.GetAllCredential

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2109
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2112
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "Something Different"
          "John"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2113
        Expected equality of these values:
          [[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0]
            Which is: "GB+ohyUvfbttigLbWCN9We8etUw="
          "SMSXHngF7hEOsElA73C3RY+8bR4="



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2115
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialRelyingPartyIDKey]
            Which is: "example2.com"
          "example.com"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2117
        Expected: ([[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:before.get()]) >= (0), actual: -1 vs 0



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2119
        Expected equality of these values:
          [[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentials firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]]
            Which is: 1
          0

    TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2203
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1

    TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2171
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2173
        Value of: addKeyToKeychain(testES256PrivateKeyBase64Alternate, "example2.com"_s, "o2JpZEoAAQIDBAUGBwgJZG5hbWVkSm9obmtkaXNwbGF5TmFtZWZKb2hubnk="_s)
          Actual: false
        Expected: true

    TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2134
        Expected equality of these values:
          [credentials count]
            Which is: 4
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2137
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialUserHandleKey]
            Which is: 0x600001e87000
          [NSNull null]
            Which is: 0x1076d0590

    TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2153
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2156
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "Something Different"
          "John"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2157
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]
            Which is: "Something Different"
          "Johnny"

    TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1935
        Expected equality of these values:
          [credentialsBefore count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1937
        Expected equality of these values:
          [[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]]
            Which is: 1
          0



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1938
        Expected: ([[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:beforeTime.get()]) >= (0), actual: -1 vs 0



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1956
        Expected equality of these values:
          [credentialsAfter count]
            Which is: 3
          1lu
            Which is: 1

    TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2266
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2269
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "Something Different"
          "John"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2270
        Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
          Actual: false
        Expected: true



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2276
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2279
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "Something Different"
          "John"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2286
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1

    TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName

        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2303
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2306
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "Something Different"
          "John"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2307
        Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
          Actual: false
        Expected: true



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2313
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2316
        Expected equality of these values:
          [credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
            Which is: "John"
          "Jill"



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2317
        Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
          Actual: false
        Expected: true



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2323
        Expected equality of these values:
          [credentials count]
            Which is: 3
          1lu
            Which is: 1



        /Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2327
        Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
          Actual: false
        Expected: true

Testing completed, Exit status: 3


Link: https://ews-build.webkit.org/#/builders/13/builds/64898

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20241014/8acce66a/attachment-0001.htm>


More information about the webkit-unassigned mailing list