[Webkit-unassigned] [Bug 261306] New: REGRESSION(267516 at main): [ macOS ] 23 tests are constant failures following Sonoma OpenSource expectations migration.

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=261306

            Bug ID: 261306
           Summary: REGRESSION(267516 at main): [ macOS ] 23 tests are
                    constant failures following Sonoma OpenSource
                    expectations migration.
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: ben_schwartz at apple.com
                CC: Dawn_Flores at apple.com,
                    webkit-bot-watchers-bugzilla at group.apple.com,
                    webkit-bug-importer at group.apple.com

The following tests are consistent/constant failures on macOS Monterey (both wk1 and 2):

http/tests/appcache/fail-on-update-2.html

The following tests are constant failures on macOS Monterey+, wk1:

fast/scrolling/mac/scrollbars/scrollbar-state.html
fast/scrolling/mac/scrollbars/overlay-scrollbar-state.html

The following tests are constant failures on macOS Ventura, wk1:

editing/caret/insert-paragraph-does-not-paint-stale-carets.html
editing/input/editable-container-with-word-wrap-normal.html
editing/inserting/caret-position.html
editing/mac/input/caret-primary-bidi.html
editing/mac/input/firstrectforcharacterrange-plain.html
editing/mac/input/firstrectforcharacterrange-styled.html
editing/pasteboard/interchange-newline-2.html
editing/selection/5825350-2.html
editing/selection/block-cursor-overtype-mode.html
editing/selection/caret-in-empty-inline-1.html
editing/selection/caret-in-empty-inline-2.html
editing/selection/internal-caret-rect.html
editing/selection/mixed-editability-10.html
editing/selection/simple-line-layout-caret-is-gone.html
fast/forms/auto-fill-button/input-credit-card-auto-fill-button.html
imported/w3c/web-platform-tests/mathml/relations/css-styling/display-2.html
media/media-can-play-mpeg4-video.html 
imported/w3c/web-platform-tests/xhr/open-method-case-sensitive.htm
media/video-source-type-params.html

The following tests are constant failures on macOS Ventura (x86_64 only), wk2.

scrollingcoordinator/mac/fixed-backgrounds/fixed-background-in-overflow-in-iframe.html (x86_64 only)

HISTORY:

https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=editing%2Fcaret%2Finsert-paragraph-does-not-paint-stale-carets.html&test=editing%2Finput%2Feditable-container-with-word-wrap-normal.html&test=editing%2Finserting%2Fcaret-position.html&test=editing%2Fmac%2Finput%2Fcaret-primary-bidi.html&test=editing%2Fmac%2Finput%2Ffirstrectforcharacterrange-plain.html&test=editing%2Fmac%2Finput%2Ffirstrectforcharacterrange-styled.html&test=editing%2Fpasteboard%2Finterchange-newline-2.html&test=editing%2Fselection%2F5825350-2.html&test=editing%2Fselection%2Fblock-cursor-overtype-mode.html&test=editing%2Fselection%2Fcaret-in-empty-inline-1.html&test=editing%2Fselection%2Fcaret-in-empty-inline-2.html&test=editing%2Fselection%2Finternal-caret-rect.html&test=editing%2Fselection%2Fmixed-editability-10.html&test=editing%2Fselection%2Fsimple-line-layout-caret-is-gone.html&test=fast%2Fforms%2Fauto-fill-button%2Finput-credit-card-auto-fill-button.html&test=fast%2Fscrolling%2Fmac%2Fscrollbars%2Foverlay-scrollbar-state.html&test=fast%2Fscrolling%2Fmac%2Fscrollbars%2Fscrollbar-state.html&test=http%2Ftests%2Fappcache%2Ffail-on-update-2.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fmathml%2Frelations%2Fcss-styling%2Fdisplay-2.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fxhr%2Fopen-method-case-sensitive.htm&test=media%2Fmedia-can-play-mpeg4-video.html&test=media%2Fvideo-source-type-params.html&test=scrollingcoordinator%2Fmac%2Ffixed-backgrounds%2Ffixed-background-in-overflow-in-iframe.html&platform=mac

REPRODUCTION:

All tests can be reproduced on the reported platform by using the following command:

run-webkit-tests -1 --clobber-old-results --verbose --test-list run_tests.txt

...where run_tests.txt contains the affected tests listed above.

REGRESSION:

According to the flakiness dashboard and bisection workflow, these tests have a clear regression point at 267516 at main.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20230908/23fdb158/attachment.htm>