[Webkit-unassigned] [Bug 37396] new-run-webkit-tests should log the order tests are run in

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=37396





--- Comment #3 from Eric Seidel <eric at webkit.org>  2010-04-10 17:40:19 PST ---
Historically, the major source of flakiness has simply been test order.

Why I think that the list of previous tests is sufficient:

1.  You only need to know the tests since the last restart.  DRT currently
restarts every 1000 tests in run-webkit-tests, you need to know when the last
restart was because some state only gets cleared on restarts.
2.  Each DRT is separate, including caches.  So unless the problem is
contention of httpd or disk access, a per-thread list should be sufficient.

Currently you can sorta get an order from "run-webkit-tests --verbose", the
problem is it doesn't tell you when DRT restarts, so it's hard to reconstruct
the previous test list w/o knowing where it should start.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.