[Webkit-unassigned] [Bug 281450] New: [EWS] API-Tests-iOS-Simulator-EWS: 11 tests in TestWebKitAPI.WebAuthenticationPanel are pre-existing API test failures
bugzilla-daemon at webkit.org
bugzilla-daemon at webkit.org
Mon Oct 14 13:50:38 PDT 2024
https://bugs.webkit.org/show_bug.cgi?id=281450
Bug ID: 281450
Summary: [EWS] API-Tests-iOS-Simulator-EWS: 11 tests in
TestWebKitAPI.WebAuthenticationPanel are pre-existing
API test failures
Product: WebKit
Version: WebKit Nightly Build
Hardware: Unspecified
OS: Unspecified
Status: NEW
Severity: Normal
Priority: P2
Component: New Bugs
Assignee: webkit-unassigned at lists.webkit.org
Reporter: darbinyan at apple.com
The following tests are failing in EWS as pre-existing API test failures. The tests are failing on EWS only.
TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential
TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential
TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential
TestWebKitAPI.WebAuthenticationPanel.GetAllCredential
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName
TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName
Output logs:
Failed
TestWebKitAPI.WebAuthenticationPanel.DeleteOneCredential
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2411
Expected equality of these values:
[credentials count]
Which is: 2
0lu
Which is: 0
TestWebKitAPI.WebAuthenticationPanel.ExportImportCredential
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2341
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2342
Expected equality of these values:
[[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAlternateAccessGroup] count]
Which is: 1
0lu
Which is: 0
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2350
Expected equality of these values:
[[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count]
Which is: 2
0lu
Which is: 0
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2353
Expected equality of these values:
[[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0]
Which is: "GB+ohyUvfbttigLbWCN9We8etUw="
[credentialId base64EncodedStringWithOptions:0]
Which is: ""
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2355
Expected equality of these values:
[[_WKWebAuthenticationPanel getAllLocalAuthenticatorCredentialsWithAccessGroup:testWebKitAPIAccessGroup] count]
Which is: 2
0lu
Which is: 0
TestWebKitAPI.WebAuthenticationPanel.ExportImportDuplicateCredential
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2369
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2380
Expected equality of these values:
[credentials count]
Which is: 2
1lu
Which is: 1
TestWebKitAPI.WebAuthenticationPanel.GetAllCredential
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2109
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2112
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "Something Different"
"John"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2113
Expected equality of these values:
[[credentials firstObject][_WKLocalAuthenticatorCredentialIDKey] base64EncodedStringWithOptions:0]
Which is: "GB+ohyUvfbttigLbWCN9We8etUw="
"SMSXHngF7hEOsElA73C3RY+8bR4="
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2115
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialRelyingPartyIDKey]
Which is: "example2.com"
"example.com"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2117
Expected: ([[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:before.get()]) >= (0), actual: -1 vs 0
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2119
Expected equality of these values:
[[credentials firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentials firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]]
Which is: 1
0
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByCredentialID
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2203
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialByRPID
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2171
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2173
Value of: addKeyToKeychain(testES256PrivateKeyBase64Alternate, "example2.com"_s, "o2JpZEoAAQIDBAUGBwgJZG5hbWVkSm9obmtkaXNwbGF5TmFtZWZKb2hubnk="_s)
Actual: false
Expected: true
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialNullUserHandle
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2134
Expected equality of these values:
[credentials count]
Which is: 4
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2137
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialUserHandleKey]
Which is: 0x600001e87000
[NSNull null]
Which is: 0x1076d0590
TestWebKitAPI.WebAuthenticationPanel.GetAllCredentialWithDisplayName
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2153
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2156
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "Something Different"
"John"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2157
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey]
Which is: "Something Different"
"Johnny"
TestWebKitAPI.WebAuthenticationPanel.GetAssertionLA
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1935
Expected equality of these values:
[credentialsBefore count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1937
Expected equality of these values:
[[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialCreationDateKey]]
Which is: 1
0
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1938
Expected: ([[credentialsBefore firstObject][_WKLocalAuthenticatorCredentialLastModificationDateKey] compare:beforeTime.get()]) >= (0), actual: -1 vs 0
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:1956
Expected equality of these values:
[credentialsAfter count]
Which is: 3
1lu
Which is: 1
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialDisplayName
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2266
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2269
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "Something Different"
"John"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2270
Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
Actual: false
Expected: true
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2276
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2279
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "Something Different"
"John"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2286
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
TestWebKitAPI.WebAuthenticationPanel.UpdateCredentialName
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2303
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2306
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "Something Different"
"John"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2307
Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
Actual: false
Expected: true
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2313
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2316
Expected equality of these values:
[credentials firstObject][_WKLocalAuthenticatorCredentialNameKey]
Which is: "John"
"Jill"
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2317
Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
Actual: false
Expected: true
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2323
Expected equality of these values:
[credentials count]
Which is: 3
1lu
Which is: 1
/Volumes/Data/worker/iOS-17-Simulator-Build-EWS/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/_WKWebAuthenticationPanel.mm:2327
Value of: !([credentials firstObject][_WKLocalAuthenticatorCredentialDisplayNameKey])
Actual: false
Expected: true
Testing completed, Exit status: 3
Link: https://ews-build.webkit.org/#/builders/13/builds/64898
--
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20241014/8acce66a/attachment-0001.htm>
More information about the webkit-unassigned
mailing list