[Webkit-unassigned] [Bug 90892] New: results.html should handle flaky tests differently

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Tue Jul 10 10:00:47 PDT 2012


https://bugs.webkit.org/show_bug.cgi?id=90892

           Summary: results.html should handle flaky tests differently
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: ojan at chromium.org
                CC: abarth at webkit.org, simon.fraser at apple.com,
                    dpranke at chromium.org, rniwa at webkit.org,
                    kkristof at inf.u-szeged.hu


We should have two flaky lists.
1. Tests that fail the first run and pass the second.
2. Tests that fail both runs but in different ways.

List 1 should come after tests that timed out and tests with stderr output (before "expected to fail but passed"). List 2 should be where the flaky tests currently are. List 1 is consistently just noise that makes the page harder to make sense of. Also, I frequently want to flag the list of the reliable failures to rerun. It's annoying to have to tab through all the flaky passes to get the the timeouts.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.



More information about the webkit-unassigned mailing list