[Webkit-unassigned] [Bug 243690] New: REGRESSION (252960 at main): [ iOS ] Four imported/w3c/web-platform-tests/html/cross-origin-opener-policy tests are a consistent/flaky failure

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=243690

            Bug ID: 243690
           Summary: REGRESSION (252960 at main): [ iOS ] Four
                    imported/w3c/web-platform-tests/html/cross-origin-open
                    er-policy tests are a consistent/flaky failure
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: rackler at apple.com

Description:
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-unsafe-none-to-same-origin.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/javascript-url.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup-to-so.https.html

The most recent failure after a series of consistent passes for iOS that I see on the dashboard was on 7/29/2022 at 252966 at main.  The tests are constant failures on [ iOS Debug ] x86_64 and flaky failures on [ iOS Release ] x86_64.

REPRODUCTION STEPS
I can reproduce this on 252960 at main but cannot reproduce it on 252959 at main or earlier.

Command: 
run-webkit-tests --ios-simulator --debug --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 --no-retry imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html

Result: 
Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html [ Failure ]

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-unsafe-none-to-same-origin.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fjavascript-url.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup-to-so.https.html&limit=50000&platform=ios&architecture=x86_64

Diff:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-same-origin-allow-popups.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null

 PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, same origin popup with anchor
@@ -15,15 +18,15 @@
 PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, same site popup with anchor
 PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, same site popup with form
 PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with form
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with form
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with form
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with anchor Test timed out
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, same site popup with form
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with window_open
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with anchor
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same origin iframe, cross origin popup with form
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with window_open
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with anchor
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with same site iframe, cross origin popup with form
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with window_open
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with anchor
+NOTRUN COOP: same-origin-allow-popups to popup COOP: same-origin-allow-popups via an iframe, with cross origin iframe, cross origin popup with form

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220808/2963b885/attachment-0001.htm>