[Webkit-unassigned] [Bug 198810] New: Layout Test http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html is flaky

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=198810

            Bug ID: 198810
           Summary: Layout Test
                    http/wpt/webauthn/public-key-credential-create-failure
                    -u2f-silent.https.html is flaky
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: russell_e at apple.com

The following layout test is flaky on Mac Debug WK2

http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html

Probable cause:

I believe this test has been failing since it was introduced.

I reproduced this by:

run-webkit-tests --iter 1000 http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https.html -f

Using spade 245262, where the test was introduced.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Fwpt%2Fwebauthn%2Fpublic-key-credential-create-failure-u2f-silent.https.html

Diff:

--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/http/wpt/webauthn/public-key-credential-create-failure-u2f-silent.https-actual.txt
@@ -3,7 +3,7 @@
 PASS PublicKeyCredential's [[create]] with malformed U2F register response in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with register command error in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with bogus command error in a mock hid authenticator. 
-PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. 
+FAIL PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. assert_throws: At least one credential matches an entry of the excludeCredentials list in the authenticator. function "function () { throw e }" threw object "NotAllowedError: Operation timed out." that is not a DOMException InvalidStateError: property "code" is equal to 0, expected 11
 PASS PublicKeyCredential's [[create]] with second exclude credential matched in a mock hid authenticator. 
 PASS PublicKeyCredential's [[create]] with first exclude credential matched in a mock hid authenticator. Test of user presence.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190612/adaa754a/attachment.html>