[Webkit-unassigned] [Bug 235733] [ BigSur+ Release wk1 arm64 ] Bots are flaky exiting testing after 500 layout-test failures

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=235733

--- Comment #6 from Robert Jenner <Jenner at apple.com> ---
(In reply to Truitt Savell from comment #4)
> To me, it looks like this is an issue with the webkit test runner. many of
> these diffs have - lines that do not match at all to the + lines in theme
> and expectation. It appears to me that the runner is comparing a tests
> results to another tests expected output.

To Truitt's point, we are seeing a lot of the failures where it looks like there's something going on with the referencing of the test results. Here are a few example diffs:

editing/execCommand/primitive-value-cleanup-minimal.html:
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk1/build/layout-test-results/editing/execCommand/primitive-value-cleanup-minimal-actual.txt
@@ -1,2 +1 @@
-This test checks passes if there if no crash observed.


editing/execCommand/remove-formatting-from-iframe-in-button.html:
-PASSED - this test didn't fire ASSERT, bug 121791.
+EDITING DELEGATE: shouldBeginEditingInDOMRange:range from 0 of DIV > BODY > HTML > #document to 2 of DIV > BODY > HTML > #document
+EDITING DELEGATE: webViewDidBeginEditing:WebViewDidBeginEditingNotification
+EDITING DELEGATE: webViewDidChangeSelection:WebViewDidChangeSelectionNotification
+EDITING DELEGATE: webViewDidChangeSelection:WebViewDidChangeSelectionNotification
+EDITING DELEGATE: shouldChangeSelectedDOMRange:range from 4 of #text > DIV > BODY > HTML > #document to 4 of #text > DIV > BODY > HTML > #document toDOMRange:range from 0 of #text > DIV > BODY > HTML > #document to 4 of #text > DIV > BODY > HTML > #document affinity:NSSelectionAffinityDownstream stillSelecting:FALSE
+EDITING DELEGATE: webViewDidChangeSelection:WebViewDidChangeSelectionNotification
+EDITING DELEGATE: webViewDidChange:WebViewDidChangeNotification
+EDITING DELEGATE: webViewDidEndEditing:WebViewDidEndEditingNotification
+This tests that RemoveFormat not only removes style from the selected part of the DOM, but that it also applies the document default style to the selection if that's necessary in order to leave the selected text unstyled.
+| "<#selection-anchor>This<#selection-focus>"
+| " text should look the same as the text above."

fast/backgrounds/background-clip-text-on-body.html:
-Text should remain legible when window is resized. No background artifacts should appear.
+layer at (0,0) size 800x600
+  RenderView at (0,0) size 800x600
+layer at (0,0) size 800x334
+  RenderBlock {HTML} at (0,0) size 800x334
+    RenderBody {BODY} at (8,10) size 784x314
+layer at (18,10) size 502x152 clip at (19,11) size 500x150 scrollHeight 500
+  RenderBlock {DIV} at (10,0) size 502x152 [border: (1px solid #C0C0C0)]
+    RenderBlock {DIV} at (1,1) size 500x500
+layer at (18,172) size 502x152 clip at (19,173) size 500x150 scrollHeight 500
+  RenderBlock {DIV} at (10,162) size 502x152 [border: (1px solid #C0C0C0)]
+    RenderBlock {DIV} at (1,1) size 500x500



All of these test failures appear to have the correct result, but are missing just one single line that usually is just stating something to the effect of "This test passes if it doesn't crash or assert."

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220128/af39d914/attachment-0001.htm>