[webkit-dev] Acid3 status

Wed Jan 30 00:56:56 PST 2008

Hi Eric,

On Jan 29, 2008, at 4:34 PM, Eric Seidel wrote:

> Hixie is nearly done with his Acid3 test.  He's said he has space  
> for 2 more tests, but is otherwise "ready".
>
> Acid3 has certainly found some bugs in WebKit.  WebKit has also  
> found bugs in Acid3 (I'm sure we'll find more).

Thanks for classifying the failures. This is really useful! Standards  
compliance and long-term interoperability are important to the WebKit  
project. Acid tests are a fun and productive way to update corners of  
our web standards support that might otherwise not get enough love,  
with some confidence that other browsers will also improve.

Working on Acid3 fixes is a great thing to do, and a fun way to get  
into WebKit hacking for those who have been thinking about dipping  
their toes in.

  - Maciej

>
> Here is a list of all of the failures we currently have, and their  
> associated Bugzilla bugs:
>
> Failed 35 tests.
> Test 0: expected: pre-wrap, got: normal - found unexpected computed  
> style
> 4812 - :last-child bug
> Test 1: method [object NodeIterator].nextNode() didn't forward  
> exception
> 4714 - NodeIterator forwarding exceptions
> Test 2: expected: [object HTMLElement], got: null - expectation 13  
> failed
> Test 4: expected: null, got: [object HTMLIFrameElement] -  
> expectation 21 failed
> Test 6: expected: [object HTMLTitleElement], got: null - failed to  
> handle regrafting correctly
> 3492 - TreeWalker brokenness
> Test 8: Null value
> 16766 - Range doesn't update on tree modifications
> Test 11: when trying to surround two halves of comment: wrong  
> exception raised; code = 3
> 16749 - Range.surroundContents throws wrong exception
> Test 13: collapsed is wrong after deletion
> 16766 - Range doesn't update on tree modifications
> Test 18: expected: 10, got: 8 - DOCTYPE nodeType wrong
> 12751 - DocType nodes aren't part of the document
> Test 23: no exception for createElementNS('null', ':div')
> 16833 - createElementNS doesn't throw enough exceptions
> Test 25: failed to raise exception
> 16693 - createDocumentType does not throw enough exceptions
> Test 26: e1 - parent element doesn't exist after looping
> Test 27: e1 - parent element doesn't exist after waiting
> 17076 - Document tree does not survive long enough
> Test 35: expected: 0, got: 1 - :first-child still applies to element  
> that was previously a first child
> Test 36: expected: 1, got: 0 - last child did not match :last-child
> Test 37: expected: 1, got: 0 - :only-child did not match only child
> 5468 - broken :first-child, :last-child, :only-child selectors
> Test 38: expected: 0, got: 1 - removing all children didn't make the  
> element match :empty
> 11387 - :empty applies to all elements
> Test 39: expected: 1, got: 0 - :nth-child(odd) failed with child 0
> 6248 - implement :nth-child selectors
> Test 40: expected: 1, got: 0 - part 2:7
> 5468 - broken :first-child, :last-child, :only-child selectors
> Test 42: expected: 1, got: 0 - rule did not start matching after  
> change
> 11384 - CSS2/3 child selectors aren't dynamic
> Test 44: expected: 0, got: 1 - misparsed selectors
> 16751 - html* .test {} is parsed as html .test
> Test 59: expected: submit, got:  - <button> doesn't have type=submit
> 16798 - HTMLButtonElement.type should default to "submit"
> Test 64: expected: ./test.html, got: test.html - object elements  
> didn't resolve URIs correctly
> 16799 - HTMLObjectElement.data should cannonicalize urls
> Test 66: expected: null, got: #text - wrong localName
> 17060 - Text.localName should be null
> Test 69: expected: 33, got: 0 - SVGSVGTextElement.getNumberOfChars()  
> incorrect
> 17062 - SVGTextElement.getNumberOfChars returns incorrect value
> Test 71: UTF-8 encoded XML document with invalid character did not  
> have a well-formedness error
> 17079 - XML document sent with wrong encoding should fail
> Test 72: expected: TITLE (first test), got: TITLE - undefined
> 17080 - WebKit fails Acid3 HTML parsing test
> Test 73: Undefined value
> 17082 - WebKit fails Acid3 modification of style text block test
> Test 74: expected: 10, got: 1 - click event handler called the wrong  
> number of times
> 17083 - Acid3 expects nested event dispatch support
> Test 75: getSVGDocument failed for <iframe> referencing an svg  
> document.
> 17061 - HTMLIFrameElement should have a getSVGDocument() method
> Test 76: Value undefined (result of expression anim.beginElement) is  
> not object.
> Test 77: expected: 0, got: 100 - Incorrect animVal value after svg  
> animation.
> 17077 - SVG Animation is broken (and thus turned off)
> Test 78: expected: 4776, got: 5550 - getComputedTextLength failed.
> 17078 - SVGTextElement.getComputedTextLength does not work as expected
> Test 86: calling setMilliseconds() with no arguments didn't result  
> in NaN
> 16753 - Date.set* methods with no arguments should result in NaN
> Test 92: Function object's prototype's constructor was ReadOnly
> 15003 - Function object's prototype's constructor should not be  
> ReadOnly
> Elapsed time: 4.03s (debug build)
>
> There are also some visual failures:
> 16760 - HTML Object elements should not render 404 content
> 16770 - Acid3 expects :visited styles to update after iframe load
> 17085 - Acid3 Ahem test font no longer loads properly
> 17086 - Positioned X is a few pixels off
>
> Bugs discovered during testing, but not required to pass Acid3:
> 8961 - document.write() does not flush plain text (shift-click on  
> the A to see failure)
> 14256 - Inspector hits assertion while inspecting image in Acid3
> 17004 - Assertion clicking on n/100 in Acid3 results
>
>
> This is certainly not a full list of all the bugs which will need to  
> be fixed before Acid3 will pass 100% in WebKit-based browsers.   
> However, this is all the bugs that I know to be visible at this time.
>
> All Acid3 bugs have Acid3 in the title, you can find them using this  
> query:
> http://bugs.webkit.org/buglist.cgi?bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&field0-0-0=product&type0-0-0=substring&value0-0-0=acid3&field0-0-1=component&type0-0-1=substring&value0-0-1=acid3&field0-0-2=short_desc&type0-0-2=substring&value0-0-2=acid3&field0-0-3=status_whiteboard&type0-0-3=substring&value0-0-3=acid3
>
> Your comments (and help fixing them) are certainly appreciated.
>
> Thanks,
> Eric
>
> _______________________________________________
> webkit-dev mailing list
> webkit-dev at lists.webkit.org
> http://lists.webkit.org/mailman/listinfo/webkit-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.webkit.org/pipermail/webkit-dev/attachments/20080130/78fd5dbe/attachment.html