[Webkit-unassigned] [Bug 9496] New: Pixel tests failing on BuildBot

bugzilla-daemon at opendarwin.org bugzilla-daemon at opendarwin.org
Sun Jun 18 10:03:38 PDT 2006 

http://bugzilla.opendarwin.org/show_bug.cgi?id=9496

           Summary: Pixel tests failing on BuildBot
           Product: WebKit
           Version: 420+ (nightly)
          Platform: Macintosh
        OS/Version: Mac OS X 10.4
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Tools
        AssignedTo: webkit-unassigned at opendarwin.org
        ReportedBy: opendarwin.org at mitzpettel.com
                CC: darin at apple.com


142 pixel tests are reported as failing on BuildBot, which makes it hard to
notice real regressions. The failures consist of:

1. Minor discrepancies due to color matching, image decoding or other graphics
APIs (some of these pass locally, some fail differently):

css1/box_properties/float_elements_in_series
editing/selection/iframe
editing/selection/inline-table
fast/css/first-letter-detach
fast/css/imageTileOpacity
fast/selectors/159
tables/mozilla/bugs/bug5797
tables/mozilla/bugs/bug10565
tables/mozilla/bugs/bug11026
tables/mozilla/bugs/bug12908-1
tables/mozilla/bugs/bug12908-2
tables/mozilla/bugs/bug12910-2
tables/mozilla/bugs/bug13169
tables/mozilla/bugs/bug15544
tables/mozilla/bugs/bug17138
tables/mozilla/bugs/bug29314
tables/mozilla/bugs/bug82946-2
tables/mozilla/bugs/bug120107
tables/mozilla/bugs/bug196870
tables/mozilla/bugs/bug1271
tables/mozilla/bugs/bug25074
tables/mozilla/bugs/bug625
tables/mozilla/bugs/bug1188
tables/mozilla/bugs/bug1296
tables/mozilla/bugs/bug1430
tables/mozilla/bugs/bug2981-2
tables/mozilla/bugs/bug4093
tables/mozilla/bugs/bug4284
tables/mozilla/bugs/bug4427
tables/mozilla/bugs/bug4523
tables/mozilla/bugs/bug6404
tables/mozilla/bugs/bug50695-2
tables/mozilla/bugs/bug56563
tables/mozilla/core/bloomberg
tables/mozilla/core/col_widths_auto_autoFix
tables/mozilla/core/misc
tables/mozilla/marvin/tbody_valign_baseline
tables/mozilla/marvin/tbody_valign_bottom
tables/mozilla/marvin/tbody_valign_middle
tables/mozilla/marvin/tbody_valign_top
tables/mozilla/marvin/td_valign_baseline
tables/mozilla/marvin/td_valign_bottom
tables/mozilla/marvin/td_valign_middle
tables/mozilla/marvin/td_valign_top
tables/mozilla/marvin/tfoot_valign_baseline
tables/mozilla/marvin/tfoot_valign_bottom
tables/mozilla/marvin/tfoot_valign_middle
tables/mozilla/marvin/tfoot_valign_top
tables/mozilla/marvin/th_valign_baseline
tables/mozilla/marvin/th_valign_bottom
tables/mozilla/marvin/th_valign_middle
tables/mozilla/marvin/th_valign_top
tables/mozilla/marvin/thead_valign_baseline
tables/mozilla/marvin/thead_valign_bottom
tables/mozilla/marvin/thead_valign_middle
tables/mozilla/marvin/thead_valign_top
tables/mozilla/marvin/tr_valign_baseline
tables/mozilla/marvin/tr_valign_bottom
tables/mozilla/marvin/tr_valign_middle
tables/mozilla/marvin/tr_valign_top
tables/mozilla/other/cell_widths
tables/mozilla_expected_failures/bugs/bug6933
tables/mozilla_expected_failures/bugs/bug85016
tables/mozilla_expected_failures/bugs/bug101674
css2.1/t0804-c5510-padn-00-b-ag
css2.1/t100801-c544-valgn-02-d-agi
css2.1/t100801-c544-valgn-03-d-agi
css2.1/t100801-c544-valgn-04-d-agi
fast/backgrounds/size/backgroundSize10
fast/backgrounds/size/backgroundSize12
fast/backgrounds/size/backgroundSize18
fast/backgrounds/size/backgroundSize19
fast/box-sizing/percentage-height
fast/replaced/image-sizing
fast/replaced/maxheight-percent
fast/replaced/maxheight-pxs
fast/replaced/maxwidth-percent
fast/replaced/maxwidth-pxs
tables/mozilla/bugs/bug14929
tables/mozilla/bugs/bug16252
tables/mozilla/bugs/bug97383

2. Pixel results not updated after fixing bug 3297:

editing/selection/3690719
fast/invalid/018
fast/table/colspanMinWidth
tables/mozilla/bugs/bug6304
tables/mozilla/bugs/bug25086
tables/mozilla/bugs/bug28928
tables/mozilla/bugs/bug44523
tables/mozilla/bugs/bug97138
tables/mozilla/core/col_widths_fix_auto
tables/mozilla/core/row_span
tables/mozilla_expected_failures/bugs/bug1262
tables/mozilla_expected_failures/bugs/bug11945
tables/mozilla_expected_failures/bugs/bug23847
tables/mozilla_expected_failures/bugs/bug32205-1
tables/mozilla_expected_failures/marvin/backgr_border-table-cell
tables/mozilla_expected_failures/marvin/backgr_border-table-column-group
tables/mozilla_expected_failures/marvin/backgr_border-table
fast/encoding/utf-16-big-endian
fast/encoding/utf-16-little-endian
fast/table/cell-absolute-child

3. Pixel results not updated for r13868:

fast/css/word-space-extra
fast/overflow/image-selection-highlight

4. A possible regression:

editing/style/smoosh-styles-003

5. Expected results generated with a debug build, bot running a release build:

tables/mozilla_expected_failures/bugs/bug178855

6. SVG failures:

svg/W3C-SVG-1.1/coords-units-01-b
svg/W3C-SVG-1.1/coords-viewattr-02-b
svg/W3C-SVG-1.1/filters-blend-01-b
svg/W3C-SVG-1.1/filters-color-01-b
svg/W3C-SVG-1.1/filters-composite-02-b
svg/W3C-SVG-1.1/filters-comptran-01-b
svg/W3C-SVG-1.1/filters-diffuse-01-f
svg/W3C-SVG-1.1/filters-displace-01-f
svg/W3C-SVG-1.1/filters-example-01-b
svg/W3C-SVG-1.1/filters-gauss-01-b
svg/W3C-SVG-1.1/filters-image-01-b
svg/W3C-SVG-1.1/filters-light-01-f
svg/W3C-SVG-1.1/filters-offset-01-b
svg/W3C-SVG-1.1/filters-specular-01-f
svg/W3C-SVG-1.1/paths-data-04-t
svg/W3C-SVG-1.1/pservers-grad-02-b
svg/W3C-SVG-1.1/pservers-grad-04-b
svg/W3C-SVG-1.1/pservers-grad-05-b
svg/W3C-SVG-1.1/pservers-grad-06-b
svg/W3C-SVG-1.1/pservers-grad-11-b
svg/W3C-SVG-1.1/pservers-grad-12-b
svg/W3C-SVG-1.1/render-groups-01-b
svg/W3C-SVG-1.1/render-groups-03-t
svg/W3C-SVG-1.1/struct-image-01-t
svg/W3C-SVG-1.1/struct-image-02-b
svg/W3C-SVG-1.1/struct-image-04-t
svg/W3C-SVG-1.1/styling-inherit-01-b
svg/custom/feComponentTransfer-Discrete
svg/custom/feComponentTransfer-Gamma
svg/custom/feComponentTransfer-Linear
svg/custom/feComponentTransfer-Table
svg/custom/feDisplacementMap-01
svg/custom/filter-source-alpha
svg/custom/image-with-transform-clip-filter
svg/custom/invalid-css
svg/custom/text-filter
svg/custom/text-image-opacity

With the exception of 4., I think the bot's current results should be checked
in as the expected results. The tricky part is that if you run the tests on
your machines, some of your results may differ from the bot's (due to different
architectures, OS build or graphics hardware or color profiles), so perhaps
somebody with access to the build slaves can run the tests on one of them and
pull the results from it.


-- 
Configure bugmail: http://bugzilla.opendarwin.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.

More information about the webkit-unassigned mailing list