[webkit-dev] DOM L2 HTML self-hosted tests

26 Jun 2005

      Apparently, self-hosted tests for L2 HTML were not previously  
generated, or if they had been the build had been broken for a  
while.  I've worked a couple of days getting the build process  
working for them and will commit the changes to the W3C CVS likely  
tomorrow.

run-webkit-tests had problems with two classes of tests, the  
HTMLAppletElement tests would stall.  Likely dump render tree wasn't  
expecting to render something with a Java applet.  To work around the  
problem, I didn't put those tests in the layout-tests directory.    
Safari passed them all when run manually.  The second problem was a  
crash in HTMLDocument17, 19, 20 and 21 which was a regression from  
Safari 412 and logged as bug 3713.  I patched by local copy with a  
hack to suppress the crash and allow the tests to complete.

HTMLLabelElement01-expected.txt:                text run at (2,2)  
width 30: "error"
HTMLLabelElement01-expected.txt:                text run at (2,2)  
width 145: "TypeError - Null value"

Regression, logged as Bug 3714.  HTMLLabelElement.form is null when  
it shouldn't be.

HTMLObjectElement01-expected.txt:                text run at (2,2)  
width 30: "error"
HTMLObjectElement01-expected.txt:                text run at (2,2)  
width 145: "TypeError - Null value"

Related but not regression, logged as Bug 3715.   
HTMLObjectElement.form is null when it shouldn't be.

HTMLBodyElement09-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLBodyElement10-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLDocument24-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLDocument25-expected.txt:                text run at (2,2) width  
40: "failure"
hasFeature03-expected.txt:                text run at (2,2) width 40:  
"failure"
hasFeature04-expected.txt:                text run at (2,2) width 40:  
"failure"

Tests checking consistency of hasFeature("XHTML") and hasFeature("XML").
Also failed by Firefox, need to review the tests.

HTMLCollection07-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLCollection08-expected.txt:                text run at (2,2) width  
40: "failure"

HTMLTableElement.rows is in document order, HTMLRowElement.rowIndex  
by position.
In the test document, document order and position are not the same,  
Safari
misses something.  Passed by Firefox, IE and Opera.

HTMLDocument04-expected.txt:                text run at (2,2) width  
40: "failure"

Failed consistently by Firefox and Safari in self-hosted, but passed  
in JSUnit.
Looks like self-hosted rendering error.  Will review.

HTMLElement113-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement114-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement142-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement143-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement26-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement27-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement55-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement56-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement84-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLElement85-expected.txt:                text run at (2,2) width  
40: "failure"
HTMLInputElement21-expected.txt:                text run at (2,2)  
width 40: "failure"

All look like legitimate Safari problems, all tests passed by Firefox  
and IE.

HTMLIsIndexElement01-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLIsIndexElement02-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLIsIndexElement03-expected.txt:                text run at (2,2)  
width 40: "failure"

All passed by Firefox, IE fails all three.  Opera first two.  Needs  
more investigation.

HTMLScriptElement01-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement02-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement03-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement04-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement05-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement06-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLScriptElement07-expected.txt:                text run at (2,2)  
width 40: "failure"

All appear to be production problems with self-hosted tests.  Firefox  
passes them
in JSUnit, fails them self-hosted.  Understandable since "self- 
hosting" injects new
script elements into test documents which would likely disrupt  
finding the script
element under test.

HTMLSelectElement20-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLTableColElement04-expected.txt:                text run at (2,2)  
width 40: "failure"
HTMLTableColElement06-expected.txt:                text run at (2,2)  
width 40: "failure"

Likely legitimate Safari problems.  Passed by Firefox and Opera.   
Failed by IE.

HTMLTableElement39-expected.txt:                text run at (2,2)  
width 40: "failure"

Failed by Firefox, IE and Safari.  Passed by Opera.  Will need to  
review.

[webkit-dev] DOM L2 HTML self-hosted tests

Curt Arnold