[Webkit-unassigned] [Bug 239634] New: [ macOS wk2 arm64 ] media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html is a flaky failure

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=239634

            Bug ID: 239634
           Summary: [ macOS wk2 arm64 ]
                    media/modern-media-controls/tracks-support/text-track-
                    selected-via-media-api.html is a flaky failure
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: rackler at apple.com

Description:
media/modern-media-controls/tracks-support/text-track-selected-via-media-api.html

The first failure that I saw on the dashboard was 3/18/2022 at r291467, with the next not until 3/28/2022 at r292014 on Big Sur.  
The first failure that I saw on the dashboard was 3/29/2022 at r292056 on Monterey. 

The regression point could possibly be 267467-267466, although I was unable to reproduce it.  The failures for Big Sur arm64 continue after that commit range and then continue with Monterey arm64.

The test was added 03/16/2021 at Canonical link: https://commits.webkit.org/235372@main | git-svn-id: https://svn.webkit.org/repository/webkit/trunk@274521 268f45cc-cd09-0410-ab3c-d52691b4dbfc

History:
https://results.webkit.org/?suite=layout-tests&test=media%2Fmodern-media-controls%2Ftracks-support%2Ftext-track-selected-via-media-api.html&platform=mac&limit=50000&architecture=arm64

Diff:
--- /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-expected.txt
+++ /Volumes/Data/worker/monterey-release-applesilicon-tests-wk2/build/layout-test-results/media/modern-media-controls/tracks-support/text-track-selected-via-media-api-actual.txt
@@ -7,14 +7,14 @@
 PASS shadowRoot.querySelector('button.tracks').getBoundingClientRect().width became different from 0
 Setting mode to 'showing' for 'English' text track via JavaScript...
 Tapping tracks button...
-PASS contextmenuItem('English').checked is true
-PASS contextmenuItem('French').checked is undefined.
+FAIL contextmenuItem('English').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 Selecting 'French' text track...
-PASS subtitleTrack('en').mode is 'disabled'
-PASS subtitleTrack('fr').mode is 'showing'
+FAIL subtitleTrack('en').mode should be disabled. Was showing.
+FAIL subtitleTrack('fr').mode should be showing. Was disabled.
 Tapping tracks button...
-PASS contextmenuItem('English').checked is undefined.
-PASS contextmenuItem('French').checked is true
+FAIL contextmenuItem('English').checked should be undefined. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('English').checked')
+FAIL contextmenuItem('French').checked should be true. Threw exception TypeError: undefined is not an object (evaluating 'contextmenuItem('French').checked')
 PASS successfullyParsed is true

 TEST COMPLETE

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220422/2c4ffbad/attachment.htm>