[Webkit-unassigned] [Bug 75473] Would like a way to generate JUnit-style XML files for run-webkit-tests results

bugzilla-daemon at webkit.org bugzilla-daemon at webkit.org
Wed Jan 4 15:50:31 PST 2012


https://bugs.webkit.org/show_bug.cgi?id=75473





--- Comment #6 from Dirk Pranke <dpranke at chromium.org>  2012-01-04 15:50:31 PST ---
(In reply to comment #4)
> (In reply to comment #3)
> > Lastly, I suppose it depends on how big the patch ends up being, but I'd rather not have to support two styles of output in NRWT directly; if it makes more sense to add the skipped files to full_results.json I'd probably rather do that.
> > 
> > Ojan, WDYT?
> 
> I'd like to keep full_results.json small. Adding skipped files makes it considerably larger. I don't really see giving a second type of output to be a maintenance problem. Are there other issues you envision with it?

I was roughly imagining a command line flag to --include-skips-in-results or something like that. However, from looking at the comments in the wiki page below, it seems like if we were to adopt the junit-style file, we might not need the flakiness dashboard at all? (Of course, the junit-style xml file is going to be substantially larger than the json file, regardless of including skipped files or not).

The code is certainly structured well enough to support either mode of result formats easily enough, it's just feature creep that I'm thinking of.

(In reply to comment #5)
> (In reply to comment #3)
> > I'm a bit puzzled by why we'd want to support integration w/ Jenkins, given that it does roughly the same thing buildbot does? Are there ports that are interested in running Jenkins servers as well? (I'm guessing the answer is yes?)
> 
> I've been experimenting with Jenkins as a replacement for Buildbot. Some of the motivations are listed here: <http://trac.webkit.org/wiki/AdvantagesOfJenkinsOverBuildbot>.
> 

Those do seem like good wins. 

> > Also, I'm not sure how you're imagining the layout tests gets mapped onto that style of output ... do we generate one XML file per directory? one file per test? one per worker? one file in total?
> 
> I think we can do it however we'd like.

Sure. I was wondering if you had any leanings.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.



More information about the webkit-unassigned mailing list