[Webkit-unassigned] [Bug 119749] New: Tests often incorrectly reported as passing

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=119749

           Summary: Tests often incorrectly reported as passing
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: eric.carlson at apple.com
                CC: rniwa at webkit.org


The build bots often incorrectly report tests as "expected to fail but passed". 

For example http/tests/navigation/back-twice-without-commit.html was marked as Timeout in Mac TestExpectations, and the MountainLion bot showed that it was passing unexpectedly: 

http://build.webkit.org/results/Apple%20MountainLion%20Debug%20WK2%20(Tests)/r153825%20(11521)/results.html

but the flakiness dashboard shows that it never passes:

http://webkit-test-results.appspot.com/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2Fnavigation%2Fback-twice-without-commit.html

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.