[Webkit-unassigned] [Bug 94277] REGRESSION(when?) WK2 tests have 500+ failures causing an early exit

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=94277


Dirk Pranke <dpranke at chromium.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |kbalazs at webkit.org,
                   |                            |tony at chromium.org




--- Comment #1 from Dirk Pranke <dpranke at chromium.org>  2012-08-16 18:03:10 PST ---
to add more context from the #webkit discussion

it looks like all the wk2 bots are failing fairly reliably (though not always) with 500+ failures. the wk1 bots seem happy.

it looks like things prior to the time of ~r124581 (where we changed to passing --pixel-tests per-test for reftests to work) were pretty happy.

A partial revert of that change, however, did not seem to fix things.

In r124958, I changed errors from ImageDiff to be treated as test failures (previously we would ignore the failure and treat things as if tests were passing, e.g., false positives).

As reported in https://bugs.webkit.org/show_bug.cgi?id=81962, I get lots of ImageDiff warnings *only when running wk2* (don't know why yet), and so I'm suspecting that the change in r124958 has pushed the problems over the edge. i.e., r124958 has made the bug 81962 a lot more serious (arguably, as it should be).

I am continuing to do more testing.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.