[Webkit-unassigned] [Bug 196269] New: [ Mac WK2 iOS Sim] Layout Test http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-w* are flaky timeouts

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Tue Mar 26 13:29:07 PDT 2019


https://bugs.webkit.org/show_bug.cgi?id=196269

            Bug ID: 196269
           Summary: [ Mac WK2 iOS Sim] Layout Test
                    http/tests/resourceLoadStatistics/capped-lifetime-for-
                    cookie-set-in-js-w* are flaky timeouts
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: sroberts at apple.com
                CC: lforschler at apple.com

The following layout tests are flaky on Mac WK2 & iOS Sim

http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-with-link-fragment-from-prevalent-resource.html 
http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-with-link-query-and-fragment-from-prevalent-resource.html 
http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-with-link-query-from-prevalent-resource.html 
http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-without-link-decoration-from-prevalent-resource.html

Probable cause:

It appears 4 of the 5 tests introduced in https://trac.webkit.org/changeset/242288/webkit are flaky failures on the Bots, and most are reproducible locally. Tests were modified in https://trac.webkit.org/changeset/243181/webkit , but flakiness occurred before that change. Though dashboard shows a lot of flakiness on iOS Sim Debug bots, it doesn't time out that often locally for me.

I can reproduce the Mac WK2 Release timeouts locally with : On average only 1 time out in 500 iterations. 

run-webkit-tests http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-without-link-decoration-from-prevalent-resource.html --iterations 500 --child-process 1

I can reproduce the iOS Sim Debug failures using : On average about 3 failures out of 500 iterations.

run-webkit-tests http/tests/resourceLoadStatistics/capped-lifetime-for-cookie-set-in-js-with-link-query-and-fragment-from-prevalent-resource.html --iterations 500 --child-process 1 --debug --ios-simulator

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=http%2Ftests%2FresourceLoadStatistics%2Fcapped-lifetime-for-cookie-set-in-js-with-link-decoration-same-site.html%20%20http%2Ftests%2FresourceLoadStatistics%2Fcapped-lifetime-for-cookie-set-in-js-with-link-fragment-from-prevalent-resource.html%20http%2Ftests%2FresourceLoadStatistics%2Fcapped-lifetime-for-cookie-set-in-js-with-link-query-and-fragment-from-prevalent-resource.html%20http%2Ftests%2FresourceLoadStatistics%2Fcapped-lifetime-for-cookie-set-in-js-with-link-query-from-prevalent-resource.html%20http%2Ftests%2FresourceLoadStatistics%2Fcapped-lifetime-for-cookie-set-in-js-without-link-decoration-from-prevalent-resource.html

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190326/22960c49/attachment-0001.html>


More information about the webkit-unassigned mailing list