[Webkit-unassigned] [Bug 198085] New: REGRESSION (r244848-244849) [iOS] Several sizing , css and rendering tests are flakily failing in tandem on testers

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=198085

            Bug ID: 198085
           Summary: REGRESSION (r244848-244849) [iOS] Several sizing , css
                    and rendering tests are flakily failing in tandem on
                    testers
           Product: WebKit
           Version: WebKit Nightly Build
          Hardware: Unspecified
                OS: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: sroberts at apple.com

Created attachment 370344

  --> https://bugs.webkit.org/attachment.cgi?id=370344&action=review

Test List

The following issue is occurring only on iOS Simulator Release and Debug

Close to 100 tests can fail when run in a particular order. Most tests are css, sizing and rendering tests.

My notes will address the test case I am using to reproduce the failures

Probable cause:

After changes in either:

https://trac.webkit.org/changeset/244848/webkit
or
https://trac.webkit.org/changeset/244849/webkit

When you run the following test list on either iOS Simulator Release or Debug, 44 tests will fail at sizing differences, or image diffs there are what appears to be squares being drawn. The tests will fail/image only failure, then pass on retry.

Reproduced with:

run-webkit-tests --test-list=/tf --child-process 1 --ios-simulator

Link to an example run of this happening to see results.

https://build.webkit.org/results/Apple%20iOS%2012%20Simulator%20Debug%20WK2%20(Tests)/r245469%20(3751)/results.html

The reproduction I linked with the test list will cause all 44 of those tests to fail when they are run after: 
fast/viewport/ios/minimum-scale-after-changing-view-scale.html
ietestcenter/css3/bordersbackgrounds/border-radius-sum-of-radii-002.htm

All of the ietestcenter tests will fail, and create an expected image result for themselves. Then subsequent runs fail, and pass on retry. 

Test case failed in spade of r244850, passed in r244840. There are no revisions to test with in between. 

Flakiness Dashboard:

https://webkit-test-results.webkit.org/dashboards/flakiness_dashboard.html#showAllRuns=true&tests=ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-radius-with-three-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-radius-with-two-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-002.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-003.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-left-radius-values-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fborder-top-right-radius-values-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-001.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-002.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-003.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fbox-shadow-004.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fcolor-behind-images.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Fnone-as-image-layer.htm%20ietestcenter%2Fcss3%2Fbordersbackgrounds%2Forder-of-images.htm%20imported%2Fblink%2Fcompositing%2Fwill-change%2Fstacking-context-creation.html%20imported%2Fblink%2Ffast%2Fclip%2Fnested-rounded-rect.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-break.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-content-break.html%20imported%2Fblink%2Ffast%2Fmulticol%2Fvertical-lr%2Ffloat-edge.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-aspectparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-transformparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-viewboxparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-viewtargetparams.html%20imported%2Fblink%2Fsvg%2Fdom%2Fviewspec-zoomandpanparams.html%20imported%2Fblink%2Ftransforms%2Finline-transform-and-clipping-roots.html%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-block--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-inline--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--display-inline-block--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--float-left--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--float-right--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--position-absolute--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsizing%2Finline--position-relative--01.xhtml%20imported%2Fmozilla%2Fsvg%2Fsmil%2Ftransform%2Fset-transform-1.svg%20imported%2Fmozilla%2Fsvg%2Fsmil%2Ftransform%2Ftranslate-clipPath-1.svg%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-namespace.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-rule.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-host-with-before-after.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-invisible-slot.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-nested-slot-display-override.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-display-override.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-fallback.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot-style.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slot.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fcss-scoping-shadow-slotted-nested.html%20imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scoping%2Fshadow-host-with-before-after.html

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-unassigned/attachments/20190521/84c12abe/attachment-0001.html>