[Webkit-unassigned] [Bug 261041] New: REGRESSION(267516 at main): [ macOS wk2 ] accessibility/mac/basic-embed-pdf-accessibility.html is a constant failure.

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=261041

            Bug ID: 261041
           Summary: REGRESSION(267516 at main): [ macOS wk2 ]
                    accessibility/mac/basic-embed-pdf-accessibility.html
                    is a constant failure.
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Accessibility
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: ben_schwartz at apple.com
                CC: andresg_22 at apple.com, Dawn_Flores at apple.com,
                    webkit-bot-watchers-bugzilla at group.apple.com,
                    webkit-bug-importer at group.apple.com

accessibility/mac/basic-embed-pdf-accessibility.html

This test is a constant failure on all versions of macOS, wk2.

HISTORY:

https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Fbasic-embed-pdf-accessibility.html

TEXT DIFF:

 This test ensures PDFs loaded in embed tags are exposed in the accessibility tree.

-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
+PASS: pdfEmbedElement.domIdentifier === 'pdfEmbed'
+PASS: pdfEmbedElement.role === 'AXRole: AXGroup'
+PASS: pdfEmbedElement.subrole === 'AXSubrole: '
+PASS: pdfEmbedElement.childrenCount === 1
+PASS: pdfAxObject.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'
+PASS: pdfAxObject.childrenCount === 1
+PASS: pdfAxObject.parentElement().domIdentifier === 'pdfEmbed'
+PASS: pdfLayerController.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: pdfLayerController.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: hitTestResult.stringAttributeValue('AXRole') === 'AXGroup'
+PASS: hitTestResult.stringAttributeValue('AXDescription') === 'document'
+PASS: pdfTextNode.stringAttributeValue('AXRole') === 'AXStaticText'
+PASS: pdfTextNode.stringAttributeValue('AXValue').trimEnd() === 'Welcome to the website for the WebKit Open Source Project!'
+PASS: searchResultElement.stringAttributeValue('AXSubrole') === 'AXPDFPluginSubrole'

-
-PASS pdfEmbedElement.domIdentifier is 'pdfEmbed'
-PASS pdfEmbedElement.role is 'AXRole: AXGroup'
-PASS pdfEmbedElement.subrole is 'AXSubrole: '
-PASS pdfEmbedElement.childrenCount is 1
-PASS pdfAxObject.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
-PASS pdfAxObject.childrenCount is 1
-PASS pdfAxObject.parentElement().domIdentifier is 'pdfEmbed'
-PASS pdfLayerController.stringAttributeValue('AXRole') is 'AXGroup'
-PASS pdfLayerController.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS hitTestResult.stringAttributeValue('AXRole') is 'AXGroup'
-PASS hitTestResult.stringAttributeValue('AXDescription') is 'document'
-PASS pdfTextNode.stringAttributeValue('AXRole') is 'AXStaticText'
-FAIL pdfTextNode.stringAttributeValue('AXValue') should be Welcome to the website for the WebKit Open Source Project!. Was Welcome to the website for the WebKit Open Source Project!
-.
-PASS searchResultElement.stringAttributeValue('AXSubrole') is 'AXPDFPluginSubrole'
 PASS successfullyParsed is true
-Some tests failed.

 TEST COMPLETE

DIFF URL:

https://build.webkit.org/results/Apple-Ventura-Release-AppleSilicon-WK2-Tests/267553%40main%20(4741)/accessibility/mac/basic-embed-pdf-accessibility-pretty-diff.html

REPRODUCIBILITY:

I was able to reproduce this bug on macOS Ventura (13.5, 22G74/arm64) ToT using the following command:

run-webkit-tests --clobber-old-results --verbose accessibility/mac/basic-embed-pdf-accessibility.html

REGRESSION:

I was able to identify a clear regression point at 267516 at main, as the issue did not reproduce at 267515 at main and the test was constantly passing before this point.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20230901/46cc84aa/attachment.htm>