[Webkit-unassigned] [Bug 191278] New: Layout Test imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription-tracks.https.html is flaky

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=191278

            Bug ID: 191278
           Summary: Layout Test
                    imported/w3c/web-platform-tests/webrtc/RTCPeerConnecti
                    on-setRemoteDescription-tracks.https.html is flaky
           Product: WebKit
           Version: Other
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: WebRTC
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: ryanhaddad at apple.com
                CC: youennf at gmail.com

The following layout test is flaky on macOS and iOS:

imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription-tracks.https.html

Probable cause:

This test has been flaky since it was imported with https://trac.webkit.org/changeset/237773/webkit.

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-setRemoteDescription-tracks.https.html

Here is the text diff which shows an unexpected "PASS" message:

--- /Volumes/Data/slave/sierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription-tracks.https-expected.txt
+++ /Volumes/Data/slave/sierra-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-setRemoteDescription-tracks.https-actual.txt
@@ -4,7 +4,7 @@
 PASS addTrack() with a track and no stream makes ontrack fire with a track and no stream. 
 PASS addTrack() with a track and a stream makes ontrack fire with a track and a stream. 
 PASS ontrack fires before setRemoteDescription resolves. 
-FAIL addTrack() with two tracks and one stream makes ontrack fire twice with the tracks and shared stream. assert_array_equals: The remote stream == [first track, second track]. property 0, expected object "[object MediaStreamTrack]" but got object "[object MediaStreamTrack]"
+PASS addTrack() with two tracks and one stream makes ontrack fire twice with the tracks and shared stream. 
 PASS addTrack() for an existing stream makes stream.onaddtrack fire. 
 PASS stream.onaddtrack fires before setRemoteDescription resolves. 
 PASS addTrack() with a track and two streams makes ontrack fire with a track and two streams.

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20181105/ee123a0f/attachment.html>