[Webkit-unassigned] [Bug 90892] New: results.html should handle flaky tests differently
bugzilla-daemon at webkit.org
bugzilla-daemon at webkit.org
Tue Jul 10 10:00:47 PDT 2012
https://bugs.webkit.org/show_bug.cgi?id=90892
Summary: results.html should handle flaky tests differently
Product: WebKit
Version: 528+ (Nightly build)
Platform: Unspecified
OS/Version: Unspecified
Status: NEW
Severity: Normal
Priority: P2
Component: Tools / Tests
AssignedTo: webkit-unassigned at lists.webkit.org
ReportedBy: ojan at chromium.org
CC: abarth at webkit.org, simon.fraser at apple.com,
dpranke at chromium.org, rniwa at webkit.org,
kkristof at inf.u-szeged.hu
We should have two flaky lists.
1. Tests that fail the first run and pass the second.
2. Tests that fail both runs but in different ways.
List 1 should come after tests that timed out and tests with stderr output (before "expected to fail but passed"). List 2 should be where the flaky tests currently are. List 1 is consistently just noise that makes the page harder to make sense of. Also, I frequently want to flag the list of the reliable failures to rerun. It's annoying to have to tab through all the flaky passes to get the the timeouts.
--
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
More information about the webkit-unassigned
mailing list