[Webkit-unassigned] [Bug 241048] New: [ iOS macOS ] two imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage tests are a consistent failure

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Fri May 27 15:36:46 PDT 2022


https://bugs.webkit.org/show_bug.cgi?id=241048

            Bug ID: 241048
           Summary: [ iOS macOS ] two
                    imported/w3c/web-platform-tests/html/canvas/element/ma
                    nual/wide-gamut-canvas/canvas-display-p3-drawImage
                    tests are a consistent failure
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: rackler at apple.com

Description:
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html 
imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html 

The first failure that I saw on the dashboard for Big Sur was on  2/15/2022 at r289815.  The first failure for Monterey was on 3/17/2022 at r291428. The first failure for iOS was on 12/21/2021 at r287308.   These tests have been flaky or consistent failures for their entire history on the dashboard.  iOS, Big Sur, and Monterey wk1 have been consistent failures.  Monterey wk1 is also a flaky timeout.  Monterey wk2 has been a flaky failure.  

REPRODUCTION STEPS
I can reproduce this on ToT.

Command: 
[ iOS ] consistent failure
ToT 294933
run-webkit-tests --ios-simulator --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 --no-retry --force --no-build imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html

[ Monterey wk1 ] consistent failure or timeout
ToT 294943
Regressions: Unexpected timeouts (1)
run-webkit-tests --root 294943 -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html

[ Monterey wk2 ] flaky failure
ToT 294943
run-webkit-tests --root 294943 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html

Result: 
[ iOS ] consistent failure
ToT 294933
Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video.html [ Failure ]

[ Monterey wk1 ] consistent failure or timeout
ToT 294943
Regressions: Unexpected timeouts (1)
  imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html [ Timeout ]

[ Monterey wk2 ] flaky failure
ToT 294943
Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video.html [ Failure ]

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fwide-gamut-canvas%2Fcanvas-display-p3-drawImage-video.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcanvas%2Felement%2Fmanual%2Fwide-gamut-canvas%2Fcanvas-draw-high-bit-depth-images.html&limit=50000&platform=ios&platform=mac

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-ImageBitmap-video-actual.txt
@@ -1,19 +1,22 @@
+
+
+Harness Error (TIMEOUT), message = null

 PASS sRGB-FF0100, Context srgb, ImageData srgb, cropSource=false
-PASS sRGB-FF0100, Context srgb, ImageData srgb, cropSource=true
+TIMEOUT sRGB-FF0100, Context srgb, ImageData srgb, cropSource=true Test timed out
 PASS sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=false
-PASS sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=true
-PASS sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=false
+TIMEOUT sRGB-FF0100, Context srgb, ImageData display-p3, cropSource=true Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=false Test timed out
 PASS sRGB-FF0100, Context display-p3, ImageData srgb, cropSource=true
-PASS sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=false
-PASS sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=true
-PASS sRGB-BB0000, Context srgb, ImageData srgb, cropSource=false
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=false Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, cropSource=true Test timed out
+TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, cropSource=false Test timed out
 PASS sRGB-BB0000, Context srgb, ImageData srgb, cropSource=true
 PASS sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=false
-PASS sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=true
+TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, cropSource=true Test timed out
 PASS sRGB-BB0000, Context display-p3, ImageData srgb, cropSource=false
 PASS sRGB-BB0000, Context display-p3, ImageData srgb, cropSource=true
-PASS sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=false
+TIMEOUT sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=false Test timed out
 PASS sRGB-BB0000, Context display-p3, ImageData display-p3, cropSource=true
 PASS Rec2020-3FF000000, Context srgb, ImageData srgb, cropSource=false
 PASS Rec2020-3FF000000, Context srgb, ImageData srgb, cropSource=true

--- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/canvas/element/manual/wide-gamut-canvas/canvas-display-p3-drawImage-video-actual.txt
@@ -1,20 +1,23 @@

-PASS sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=false
+
+Harness Error (TIMEOUT), message = null
+
+TIMEOUT sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=false Test timed out
 PASS sRGB-FF0100, Context srgb, ImageData srgb, scaleImage=true
 PASS sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=false
-PASS sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=true
-PASS sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=false
-PASS sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=true
-PASS sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=false
-PASS sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=true
-PASS sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=false
-PASS sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=true
-PASS sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=false
-PASS sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=true
-PASS sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=false
+TIMEOUT sRGB-FF0100, Context srgb, ImageData display-p3, scaleImage=true Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=false Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData srgb, scaleImage=true Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=false Test timed out
+TIMEOUT sRGB-FF0100, Context display-p3, ImageData display-p3, scaleImage=true Test timed out
+TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=false Test timed out
+TIMEOUT sRGB-BB0000, Context srgb, ImageData srgb, scaleImage=true Test timed out
+TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=false Test timed out
+TIMEOUT sRGB-BB0000, Context srgb, ImageData display-p3, scaleImage=true Test timed out
+TIMEOUT sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=false Test timed out
 PASS sRGB-BB0000, Context display-p3, ImageData srgb, scaleImage=true
 PASS sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=false
-PASS sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=true
+TIMEOUT sRGB-BB0000, Context display-p3, ImageData display-p3, scaleImage=true Test timed out
 PASS Rec2020-3FF000000, Context srgb, ImageData srgb, scaleImage=false
 PASS Rec2020-3FF000000, Context srgb, ImageData srgb, scaleImage=true
 PASS Rec2020-3FF000000, Context srgb, ImageData display-p3, scaleImage=false

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220527/5e7345b1/attachment.htm>


More information about the webkit-unassigned mailing list