[Webkit-unassigned] [Bug 239990] New: [ iOS ][ macOS ] css3/calc/transitions-dependent.html is a flaky failure

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=239990

            Bug ID: 239990
           Summary: [ iOS ][ macOS ] css3/calc/transitions-dependent.html
                    is a flaky failure
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: rackler at apple.com

Description:
css3/calc/transitions-dependent.html

The iOS test on 1/11/2022 at r287874 improved the constant failure to passing on iOS until 3/21/2022 at r291584 where it becomes a flaky failure. 

The first failure that I saw on the dashboard for Big Sur was 2/15/2022 at r289815, but this does not appear relevant to causing this issue.  The first failure that I saw on the dashboard for Monterey was 2/15/2022 at r289815.

REPRODUCTION STEPS
I can reproduce this on Tot (r293682), but unable to reproduce to find the regression point.  Also, note you can run this without --iterations and it passes for iOS, but fails with the it.
i.e. 
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Passes
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

[iOS]
Command:
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

Result: 
[2/2] css3/calc/transitions-dependent.html failed unexpectedly (text diff)
Exiting early after 2 failures. 2 tests run.

0 tests ran as expected, 2 didn't:

Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ]

[macOS]
Command:
run-webkit-tests --root 293682 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry css3/calc/transitions-dependent.html

Result: 
8 tests ran as expected, 3 didn't (39 didn't run):


Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ] 

History:
https://results.webkit.org/?suite=layout-tests&test=css3%2Fcalc%2Ftransitions-dependent.html&platform=mac&platform=ios&limit=50000

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-actual.txt
@@ -1,12 +1,22 @@
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
 This tests that calc() expressions depending on transitioning elements behave correctly.
-PASS - "width" property for "inner" element at 0s was: 60
-PASS - "width" property for "inner" element at 0.25s was: 110
-PASS - "width" property for "inner" element at 0.5s was: 160
-PASS - "width" property for "inner" element at 0.75s was: 210
+FAIL - "width" property for "inner" element at 0s expected: 60 but saw: 260
+FAIL - "width" property for "inner" element at 0.25s expected: 110 but saw: 260
+FAIL - "width" property for "inner" element at 0.5s expected: 160 but saw: 260
+FAIL - "width" property for "inner" element at 0.75s expected: 210 but saw: 260
 PASS - "width" property for "inner" element at 1s was: 260
-PASS - "width" property for "innerTransition" element at 0s was: 60
-PASS - "width" property for "innerTransition" element at 0.25s was: 167.5
-PASS - "width" property for "innerTransition" element at 0.5s was: 275
-PASS - "width" property for "innerTransition" element at 0.75s was: 382.5
+FAIL - "width" property for "innerTransition" element at 0s expected: 60 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.25s expected: 167.5 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.5s expected: 275 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.75s expected: 382.5 but saw: 490
 PASS - "width" property for "innerTransition" element at 1s was: 490

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220502/654d074d/attachment-0001.htm>