[Webkit-unassigned] [Bug 197498] New: [GTK] Several animation related web-platform-tests are flaky

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Thu May 2 07:09:53 PDT 2019 

https://bugs.webkit.org/show_bug.cgi?id=197498

            Bug ID: 197498
           Summary: [GTK] Several animation related web-platform-tests are
                    flaky
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: WebKitGTK
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: magomez at igalia.com
                CC: bugs-noreply at webkitgtk.org

imported/w3c/web-platform-tests/web-animations/interfaces/Animation/finished.html [ Failure Pass ]
imported/w3c/web-platform-tests/web-animations/interfaces/Animation/onfinish.html [ Failure Pass ]
imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pause.html [ Failure Pass ]
imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pending.html [ Failure Pass ]
imported/w3c/web-platform-tests/web-animations/interfaces/Animation/ready.html [ Failure Pass ]
imported/w3c/web-platform-tests/web-animations/timing-model/timelines/update-and-send-events.html [ Failure Pass ]

These tests may fail on the first run and then pass, of fail on the second run as well. Their output suggest that they are timing out and that's why they fail. These are the diffs:

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/finished-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/finished-actual.txt
@@ -1,23 +1,25 @@
+
+Harness Error (TIMEOUT), message = null

 PASS Test pausing then playing does not change the finished promise 
 PASS Test restarting a finished animation 
 PASS Test restarting a reversed finished animation 
 PASS Test redundant finishing of animation 
-PASS Finished promise does not resolve when paused 
-PASS Finished promise does not resolve when pause-pending 
-PASS The finished promise is fulfilled with its Animation 
-PASS finished promise is rejected when an animation is canceled by calling cancel() 
-PASS canceling an already-finished animation replaces the finished promise 
-PASS Test finished promise changes for animation duration changes 
-PASS Test finished promise changes when playbackRate == 0 
-PASS Test finished promise resolves when reaching to the natural boundary. 
-PASS Test finished promise changes when a prior finished promise resolved and the animation falls out finished state 
+TIMEOUT Finished promise does not resolve when paused Test timed out
+NOTRUN Finished promise does not resolve when pause-pending 
+NOTRUN The finished promise is fulfilled with its Animation 
+NOTRUN finished promise is rejected when an animation is canceled by calling cancel() 
+NOTRUN canceling an already-finished animation replaces the finished promise 
+NOTRUN Test finished promise changes for animation duration changes 
+NOTRUN Test finished promise changes when playbackRate == 0 
+NOTRUN Test finished promise resolves when reaching to the natural boundary. 
+NOTRUN Test finished promise changes when a prior finished promise resolved and the animation falls out finished state 
 PASS Test no new finished promise generated when finished state is checked asynchronously 
 PASS Test new finished promise generated when finished state is checked synchronously 
-PASS Test synchronous finished promise resolved even if finished state is changed soon 
-PASS Test synchronous finished promise resolved even if asynchronous finished promise happens just before synchronous promise 
-PASS Test finished promise is not resolved when the animation falls out finished state immediately 
-PASS Test finished promise is not resolved once the animation falls out finished state even though the current finished promise is generated soon after animation state became finished 
-PASS Finished promise should be resolved after the ready promise is resolved 
-PASS Finished promise should be rejected after the ready promise is rejected 
+NOTRUN Test synchronous finished promise resolved even if finished state is changed soon 
+NOTRUN Test synchronous finished promise resolved even if asynchronous finished promise happens just before synchronous promise 
+NOTRUN Test finished promise is not resolved when the animation falls out finished state immediately 
+NOTRUN Test finished promise is not resolved once the animation falls out finished state even though the current finished promise is generated soon after animation state became finished 
+NOTRUN Finished promise should be resolved after the ready promise is resolved 
+NOTRUN Finished promise should be rejected after the ready promise is rejected 



--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/onfinish-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/onfinish-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null

 PASS onfinish event is fired when the currentTime < 0 and the playbackRate < 0 
 PASS onfinish event is fired when the currentTime > 0 and the playbackRate > 0 
 PASS onfinish event is fired when animation.finish() is called 
-PASS onfinish event is not fired when paused 
-PASS onfinish event is not fired when the playbackRate is zero 
-PASS onfinish event is not fired when the animation falls out finished state immediately 
+TIMEOUT onfinish event is not fired when paused Test timed out
+NOTRUN onfinish event is not fired when the playbackRate is zero 
+NOTRUN onfinish event is not fired when the animation falls out finished state immediately 



--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pause-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pause-actual.txt
@@ -1,7 +1,9 @@

-PASS pause() a running animation 
-PASS pause() from idle 
-PASS pause() from idle with a negative playbackRate 
+Harness Error (TIMEOUT), message = null
+
+TIMEOUT pause() a running animation Test timed out
+NOTRUN pause() from idle 
+NOTRUN pause() from idle with a negative playbackRate 
 PASS pause() from idle with a negative playbackRate and endless effect 
-PASS pause() on a finished animation 
+NOTRUN pause() on a finished animation 



--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pending-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/pending-actual.txt
@@ -1,4 +1,6 @@
+
+Harness Error (TIMEOUT), message = null

 PASS reports true -> false when initially played 
-PASS reports true -> false when paused 
+TIMEOUT reports true -> false when paused Test timed out



--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/ready-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/interfaces/Animation/ready-actual.txt
@@ -1,5 +1,7 @@

-PASS A new ready promise is created when play()/pause() is called 
-PASS Redundant calls to play() do not generate new ready promise objects 
-PASS The ready promise is fulfilled with its Animation 
+Harness Error (TIMEOUT), message = null

+TIMEOUT A new ready promise is created when play()/pause() is called Test timed out
+NOTRUN Redundant calls to play() do not generate new ready promise objects 
+NOTRUN The ready promise is fulfilled with its Animation 
+


--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/timing-model/timelines/update-and-send-events-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/imported/w3c/web-platform-tests/web-animations/timing-model/timelines/update-and-send-events-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null

 PASS Fires cancel event before requestAnimationFrame 
-PASS Fires finish event before requestAnimationFrame 
-FAIL Sorts finish events by composite order assert_array_equals: finish events for various animation type should be sorted by composite order property 0, expected "CSSTransition:finish" but got "ScriptAnimation:finish"
-FAIL Sorts cancel events by composite order assert_array_equals: cancel events should be sorted by composite order lengths differ, expected 5 got 3
-FAIL Sorts events for the same transition assert_array_equals: Playback and CSS events for the same transition should be sorted by schedule event time and composite order lengths differ, expected 2 got 1
-PASS Playback events with the same timeline retain the order in which they arequeued 
+TIMEOUT Fires finish event before requestAnimationFrame Test timed out
+NOTRUN Sorts finish events by composite order 
+NOTRUN Sorts cancel events by composite order 
+NOTRUN Sorts events for the same transition 
+NOTRUN Playback events with the same timeline retain the order in which they arequeued

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190502/5e36f186/attachment.html>

More information about the webkit-unassigned mailing list