[Webkit-unassigned] [Bug 196403] New: [ Mac WK2 iOS Sim ] Layout Test imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html is a flaky failure

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=196403

            Bug ID: 196403
           Summary: [ Mac WK2 iOS Sim ] Layout Test
                    imported/w3c/web-platform-tests/mediacapture-record/Me
                    diaRecorder-stop.html is a flaky failure
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: sroberts at apple.com
                CC: lforschler at apple.com

The following layout test is failing on Mac WK2 Release and Debug, iOS Simulator Release and Debug

imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html

Probable cause:

Test has been flaky its entire history on the dashboard. Local testing fails on on various versions from when the test was imported in https://trac.webkit.org/changeset/237311/webkit and reported flaky then.

Test was modified and fixed in https://trac.webkit.org/changeset/237642/webkit and reported flaky then as well.

Test recently started showing up in iOS queue's, but testing with older revisions for iOS up until r237642 fail as well.

Fails on average 2 times in 500 iterations.

Reproduced with :

run-webkit-tests imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html --iterations 500 -f

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-stop.html

Diff:

--- /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-expected.txt
+++ /Volumes/Data/slave/ios-simulator-12-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-actual.txt
@@ -1,4 +1,6 @@
+
+Harness Error (TIMEOUT), message = null

 PASS MediaRecorder will stop recording and fire a stop event when all tracks are ended 
-PASS MediaRecorder will stop recording and fire a stop event when stop() is called 
+TIMEOUT MediaRecorder will stop recording and fire a stop event when stop() is called Test timed out

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190329/894f6f60/attachment-0001.html>