[Webkit-unassigned] [Bug 241991] New: REGRESSION (251792 at main?): [ macOS ][ iOS ] TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture is a flaky failure and crash

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=241991

            Bug ID: 241991
           Summary: REGRESSION (251792 at main?): [ macOS ][ iOS ]
                    TestWebKitAPI.WKBackForwardList.BackForwardNavigationD
                    oesNotSkipItemsWithUserGesture is a flaky failure and
                    crash
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: New Bugs
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: rackler at apple.com

Description:
TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture

The first failure that I saw on the dashboard was on 6/23/2022 at 251792 at main.  The test is flaky crashing on iOS arm64 and failing on iOS X86_64.  The flaky crashing on iOS arm64 may be bot related because other test are failing similarly. The test is flaky failing on macOS. 
The flakiness dashboard indicates that 251792 at main may be the commit causing the issue.  There is a good possibility that the test landed this way and the bots did not show the results until later on the timeline.

REPRODUCTION STEPS
I can reproduce this on 251793 at main, but unable to reproduce it on 251789 at main or earlier but, I was not able to find a commit that seemed relevant; due to the lack of ability to test commits in that range, I cannot pinpoint what change could have caused this.  I was also able to reproduce on 251793 at main and ran again test again and it did not reproduce, which adds to the mystery.

Command: 
run-api-tests --debug --iterations 200 TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture

Result: 
Failed
    TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture

        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:405
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html"
          url1.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple.html"


        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:410
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html#a"
          url2.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html"


        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:415
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple.html"
          lastURL.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html#a"

History:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture&limit=50000

run-api-tests stdio: 
Failed
    TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture

        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:405
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html"
          url1.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple.html"


        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:410
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html#a"
          url2.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html"


        /Volumes/Data/worker/Apple-BigSur-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKit/WKBackForwardList.mm:415
        Expected equality of these values:
          [webView URL].absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple.html"
          lastURL.absoluteString.UTF8String
            Which is: "file:///Volumes/Data/worker/Apple-BigSur-Release-AppleSilicon-WK1-Tests/build/WebKitBuild/Release/TestWebKitAPI.resources/simple2.html#a"

iOS arm64 results: 
https://build.webkit.org/#/builders/529/builds/108
    TestWebKitAPI.WKBackForwardList.BackForwardNavigationDoesNotSkipItemsWithUserGesture
        An error was encountered processing the command (domain=NSMachErrorDomain, code=24):
        The operation couldn’t be completed. (Mach error 24 - (os/kern) memory data moved)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20220624/5e8275bb/attachment-0001.htm>