[Webkit-unassigned] [Bug 49465] Enabling test expectations analyzer

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=49465





--- Comment #8 from imasaki at chromium.org  2010-11-28 16:32:46 PST ---
Hi, David,

I am sorry about I did not put enough information about this bug is all about. I am working on sorting out test expectation file entries. My goal is to understand and analyze test expectation entries for media related test cases in automatic way. So, I developed scripts called test expectations analyzer. 
Here is the presentation link that I made recently about this analyzer.
https://docs.google.com/a/google.com/present/edit?id=0AbFh834-Y6t5ZGM5Ym0yNm5fMGZ2NTdoY2dy&hl=en

This changes in this bug have the following objectives:
(1) assign test case to bug more specifically (Ideally, one to one for testcase failure to bug rather than one bug associated many test case failures)
(2) add tags (UNIMPLEMNTED, KNOWNISSUE, TESTISSUE) in comments portion of test analyzer to each test case 
(3) add more comments as result of my manual analysis https://spreadsheets0.google.com/a/google.com/ccc?key=t11rK9tFkyxtODpifbNNQFg&hl=en#gid=0 

As for 
http://www.corp.google.com/~imasaki/html/media_all_testcases.html

It shows the test expectation analyzer result. Here test case color according to the following criteria
GREEN: test case that pass
RED: test case that are identified as UNIMPLEMNTED or KNOWNISSUE or TESTISSUSE. In other words, test case should fail all the time. The change for this bug (adding meta data in comments) are needed to make test cases RED.
YELLOW: otherwise

The analyzer code itself is currently being polished for code review now. 

If you have any question, please let me know.

Thank you.
Kenji

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.