[webkit-dev] Closing the loop on flaky tests (was Re: Flaky test hit list)

[Eric Seidel]

webkit-patch find-flaky-tests can also show you what tests are
recently flaky, but its not as nice as the dashboard.

-eric

On Tue, Oct 19, 2010 at 12:06 PM, Ojan Vafai <ojan at chromium.org> wrote:
> On Tue, Oct 19, 2010 at 11:44 AM, Alexey Proskuryakov <ap at webkit.org> wrote:
>>
>> I agree that raising awareness of which tests or code areas are flaky
>> seems useful. One problem I personally had was with digging up data on
>> flakiness. The link for a dashboard that I found was
>> <http://test-results.appspot.com/dashboards/flakiness_dashboard.html> - the
>> URL was freezing my browser for several minutes on each move, and I couldn't
>> make sense of what it was telling me UI-wise quickly enough. I'm not even
>> sure how it's related to flakiness seen by commit queue, as it seems to be
>> about chromium.
>
> That dashboard currently only supports the Chromium bots. If other bots
> successfully switch over to new-run-webkit-tests, we'll be able to easily
> add them to that dashboard.
> The freezing issue is a recent one I plan on looking into soon. WebKit is
> ridiculously slow at rendering this HTML for some reason (it's a single
> large table).
> The UI is very dense and confusing, but it gives you quite a bit of useful
> information. Here's some limited documentation on making sense of the
> dashboard
> UI: http://sites.google.com/a/chromium.org/dev/developers/testing/flakiness-dashboard
> Ojan
> _______________________________________________
> webkit-dev mailing list
> webkit-dev at lists.webkit.org
> http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev
>
>