[Webkit-unassigned] [Bug 32954] have run-webkit-tests output the JSON files for tracking layout test flakiness

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=32954





--- Comment #6 from Ojan Vafai <ojan at chromium.org>  2011-03-23 15:18:15 PST ---
The idea to reuse code like this is great. I was a little loathe to have two implementations that would need to be kept in sync. 

I think it's only the test runtimes that can't be retrieved later. That means the flakiness dashboard can't show test runtimes, but that doesn't seem like it justifies completely rewriting the code.

For the sake of the treemap dashboard though, we'll need full_results.json with test runtimes. Luckily, that's a much simpler format and is the one we were intending to use for the dynamic results.html page. I think it would be fine to have old-run-webkit-tests output full_results.json and have a webkit-patch command for outputting incremental_results.json and expectations.json.

FYI, incremental_results.json has a bunch of metadata (e.g. builder name, build number, etc) that we'll need to pass as arguments to the webkit-patch command.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.