[Webkit-unassigned] [Bug 198425] New: Request: Results from run-api-tests passing iterations show entire run results similar to run-webkit-tests

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=198425

            Bug ID: 198425
           Summary: Request: Results from run-api-tests passing iterations
                    show entire run results similar to run-webkit-tests
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Enhancement
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: sroberts at apple.com

Currently when using run-api-tests with --iterations it will run each iteration but at the end of the run just display "All tests successfully passed!". However if there was a failure/crash/timeout anywhere in the run, unless it was the most recent iteration it always displays this message. Causing you to have to scroll back through your run and see the results line by line, rather than getting the results at the end.

i.e. run-api-tests TestWebKitAPI.WKWebView.LocalStorageProcessCrashes --debug --iter 50 

Test will run and show results each Iteration.

Iteration 49
Sharding tests ...

    _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Timeout
worker/0 exiting

Iteration 50
Sharding tests ...

    _RegisterApplication(), FAILED TO establish the default connection to the WindowServer, _CGSDefaultConnection() is NULL.
TestWebKitAPI.WKWebView.LocalStorageProcessCrashes Passed

Ran 1 tests of 1 with 1 successful
------------------------------
All tests successfully passed!

I think it would be helpful if it displayed results similar to run-webkit-tests with iterations.  Which will show results for all 50 iterations in one line. i.e. All 50 tests ran as expected, or x passes, x failures, x timeouts, etc.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190531/12d822f5/attachment.html>