[Webkit-unassigned] [Bug 127323] New: platform/mac/accessibility/iframe-aria-hidden.html is flaky

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=127323

           Summary: platform/mac/accessibility/iframe-aria-hidden.html is
                    flaky
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Accessibility
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: ap at webkit.org
                CC: cfleizach at apple.com,
                    webkit-bug-importer at group.apple.com


platform/mac/accessibility/iframe-aria-hidden.html always fails on the first attempt on WebKit2 bots, and only passes on retry:

http://webkit-test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=platform%2Fmac%2Faccessibility%2Fiframe-aria-hidden.html

PASS body.childrenCount is 3
PASS body.childAtIndex(0).childrenCount is 0
PASS body.childrenCount is 4
FAIL body.childAtIndex(0).childAtIndex(0).childAtIndex(0).role should be AXRole: AXWebArea. Threw exception TypeError: null is not an object (evaluating 'body.childAtIndex(0).childAtIndex(0).childAtIndex(0).role')

When running locally, I see that it always fails on second try. The second attempt will fail:

run-webkit-tests -2 platform/mac/accessibility/iframe-aria-hidden.html --repeat 2 --no-retry-failures

Looking at the test, I think that it needs to be run in window.onload, because otherwise, there is a race with loading the iframe. But when I change it to run in onload, it starts to fail every time. For some reason, AXScrollArea doesn't have any child elements.

So it seems like there are at least two issues - one that the test should be made more robust by switching to onload, and another that it shouldn't fail.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.