[Webkit-unassigned] [Bug 98913] Change transformation precision from double to float

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=98913


Brent Fulgham <bfulgham at webkit.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |bfulgham at webkit.org




--- Comment #3 from Brent Fulgham <bfulgham at webkit.org>  2012-10-10 20:27:13 PST ---
One thing we should be careful of is propagation of rounding errors.  For WebKit's purposes, it may not matter as the various floating point operations eventually convert into whole pixel values, but I have seen cases in scientific computing where the vagaries of floating point/double conversion lead to difficult to debug problems.

If we aren't doing much math where floating point values are being raised to large powers, or trigonometric functions results are being chained together there may be little downside.

I guess the layout tests will show whether this change has any correctness implications.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.