[Webkit-unassigned] [Bug 96139] New: Change FractionalLayoutUnit denominator to 64 to reduce precision loss when converting to floating point

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=96139

           Summary: Change FractionalLayoutUnit denominator to 64 to
                    reduce precision loss when converting to floating
                    point
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Layout and Rendering
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: eae at chromium.org


We currently use a denominator of 60 in FractionalLayoutUnit, this causes a loss of precision when converting to floating point.
By changing the denominator to 64 the values can better be represented as floating point (without loosing any precision for many values), this in turn allows us to remove the tolerance hack in the line break logic and avoids problems caused by this precision for web sites that do their own layout based on element measurements.

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.