[Webkit-unassigned] [Bug 82799] New: If NRWT gets killed halfway through a run, it incorrectly reports tests that weren't run as passes

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=82799

           Summary: If NRWT gets killed halfway through a run, it
                    incorrectly reports tests that weren't run as passes
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: ojan at chromium.org
                CC: abarth at webkit.org, dglazkov at chromium.org,
                    dpranke at chromium.org


Created an attachment (id=134907)
 --> (https://bugs.webkit.org/attachment.cgi?id=134907&action=review)
screenshot of layout test dashboard

http://build.chromium.org/p/chromium.webkit/builders/Webkit%20Win7/builds/14713/steps/webkit_tests/logs/stdio corresponds to the random green box all the way to the right in screenshot. The test wasn't run, but it shows up as a PASS on the test results dashboard. 

My guess is that summarize results doesn't handle tests that weren't run correctly. Although, now that I think about it, if the tests don't complete, we just shouldn't upload the results to appengine at all. Getting data for half a run is not very useful.

If we really wanted to upload the data, then I think we should treat tests that weren't run however we treat skipped tests.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.