[Webkit-unassigned] [Bug 94505] New: Intermittenly, many WebKit2 tests have results from the wrong test compared to the test just run, giving false failures.

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=94505

           Summary: Intermittenly, many WebKit2 tests have results from
                    the wrong test compared to the test just run, giving
                    false failures.
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: beidson at apple.com
                CC: sam at webkit.org, dpranke at chromium.org


Intermittenly, many WebKit2 tests have results from the wrong test compared to the test just run, giving false failures.

This can easily be seen on the WK2 Lion bots, for example. where we bail early with 500+ failures.  If you dig in to the failures you see that in many cases the wrong results are being attributed to the test, therefore causing the failure.

If you're running locally and don't have the "abort after 500+ failures" flag, these tests are re-run as flakes and pass the 2nd time.

This is huge pain point in regression testing right now.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.