[Webkit-unassigned] [Bug 153941] New: [GTK] visible-control-characters tests should not be passing

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=153941

            Bug ID: 153941
           Summary: [GTK] visible-control-characters tests should not be
                    passing
    Classification: Unclassified
           Product: WebKit
           Version: Other
          Hardware: PC
                OS: Linux
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: WebKit Gtk
          Assignee: webkit-unassigned at lists.webkit.org
          Reporter: mcatanzaro at igalia.com
                CC: bugs-noreply at webkitgtk.org

The following tests are sometimes passing for the last couple of months:

  fast/text/control-characters/visible-control-characters-1.html
  fast/text/control-characters/visible-control-characters-2.html
  fast/text/control-characters/visible-control-characters-2.xhtml
  fast/text/control-characters/visible-control-characters-3.html
  fast/text/control-characters/visible-control-characters-3.xhtml

It's bad because these are expected mismatch tests, they should never pass.

The first pass (known bad commit) is r192730, but that commit is probably not to blame. Then there are many flaky runs. Then r192779 is the last known bad commit, and then test consistently fails (good) for a while, so it was fixed for a range of commits. The next known pass (bad) is r193641, and it's flaky from then on.

So we know:

* Tests broken shortly before r192730, probably exclusive
* Tests fixed shortly after r192779, exclusive
* Tests broken again sometimes before r193642, exclusive

Unfortunately there was some problem with the bot, and the last results we have before r193641 are for r193617, which is a rather big range of commits.

Since the tests were broken, fixed, then broken again, I at first suspected r192727, shortly before r192730. However that was rolled out quickly in r192731, but the tests continued to pass (bad) for some time after that, which doesn't match up. Still, it seems quite possible I broke it with theme changes.

(visible-control-characters-1 seems to have a few additional rare, flaky failures outside of those ranges.)

-- 
You are receiving this mail because:
You are the assignee for the bug.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.webkit.org/pipermail/webkit-unassigned/attachments/20160206/5ad619a6/attachment-0001.html>