[Webkit-unassigned] [Bug 182761] New: REGRESSION(r228279): [GTK] Many aria tests are now flaky

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=182761

            Bug ID: 182761
           Summary: REGRESSION(r228279): [GTK] Many aria tests are now
                    flaky
           Product: WebKit
           Version: Other
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Accessibility
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: mcatanzaro at igalia.com
                CC: cfleizach at apple.com, jdiggs at igalia.com,
                    webkit-bug-importer at group.apple.com

r228279 "AX: Defer attribute computation until needed." has introduced a bunch of flakiness on the GTK release bot. The following tests are all alternating between pass and fail, except for the first one which is now consistently failing. I'm going to add flakiness expectations.

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-busy-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-busy-changed-notification-actual.txt
@@ -6,8 +6,6 @@
 Setting aria-busy to true on listbox.
 Setting aria-busy to false on listbox.
 AXElementBusyChanged: AXTitle:  AXRole: AXWebArea
-AXElementBusyChanged: AXTitle:  AXRole: AXListBox
-AXElementBusyChanged: AXTitle:  AXRole: AXListBox
 PASS successfullyParsed is true

 TEST COMPLETE

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-current-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-current-changed-notification-actual.txt
@@ -5,8 +5,6 @@

 Setting aria-current to false on item2.
 Setting aria-current to page on item3.
-ActiveStateChanged: AXTitle: 2 AXRole: AXListItem
-ActiveStateChanged: AXTitle: 3 AXRole: AXListItem
 PASS successfullyParsed is true

 TEST COMPLETE

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-disabled-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-disabled-changed-notification-actual.txt
@@ -5,10 +5,6 @@

 Setting aria-disabled to true on textbox1.
 Setting aria-disabled to false on textbox2.
-AXDisabledStateChanged true on textbox1
-AXSensitiveStateChanged false on textbox1
-AXDisabledStateChanged false on textbox2
-AXSensitiveStateChanged true on textbox2
 PASS successfullyParsed is true

 TEST COMPLETE

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-expanded-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-expanded-changed-notification-actual.txt
@@ -7,8 +7,6 @@
 Setting aria-expanded to false on combobox2.
 Setting aria-expanded to true on menu1.
 Setting aria-expanded to false on menu2.
-AXExpandedChanged true on combobox1
-AXExpandedChanged false on combobox2
 AXExpandedChanged true on menu1
 AXExpandedChanged false on menu2
 PASS successfullyParsed is true

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-pressed-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-pressed-changed-notification-actual.txt
@@ -5,8 +5,6 @@

 Setting aria-pressed to true on button1.
 Setting aria-pressed to false on button2.
-AXPressedStateChanged true on button1
-AXPressedStateChanged false on button2
 PASS successfullyParsed is true

 TEST COMPLETE

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-readonly-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-readonly-changed-notification-actual.txt
@@ -5,8 +5,6 @@

 Setting aria-readonly to true on textbox1.
 Setting aria-readonly to false on textbox2.
-AXReadOnlyStatusChanged true on textbox1
-AXReadOnlyStatusChanged false on textbox2
 PASS successfullyParsed is true

 TEST COMPLETE

--- /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-required-changed-notification-expected.txt
+++ /home/slave/webkitgtk/gtk-linux-64-release-tests/build/layout-test-results/accessibility/gtk/aria-required-changed-notification-actual.txt
@@ -5,8 +5,6 @@

 Setting aria-required to true on textbox1.
 Setting aria-required to false on textbox2.
-AXRequiredStatusChanged true on textbox1
-AXRequiredStatusChanged false on textbox2
 PASS successfullyParsed is true

 TEST COMPLETE

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20180214/e7cff4c0/attachment.html>