<html>
    <head>
      <base href="https://bugs.webkit.org/" />
    </head>
    <body><table border="1" cellspacing="0" cellpadding="8">
        <tr>
          <th>Bug ID</th>
          <td><a class="bz_bug_link 
          bz_status_NEW "
   title="NEW - &quot;ref test hashes didn't match but diff passed&quot; is useless, should not be logged"
   href="https://bugs.webkit.org/show_bug.cgi?id=153951">153951</a>
          </td>
        </tr>

        <tr>
          <th>Summary</th>
          <td>&quot;ref test hashes didn't match but diff passed&quot; is useless, should not be logged
          </td>
        </tr>

        <tr>
          <th>Classification</th>
          <td>Unclassified
          </td>
        </tr>

        <tr>
          <th>Product</th>
          <td>WebKit
          </td>
        </tr>

        <tr>
          <th>Version</th>
          <td>WebKit Local Build
          </td>
        </tr>

        <tr>
          <th>Hardware</th>
          <td>Unspecified
          </td>
        </tr>

        <tr>
          <th>OS</th>
          <td>Unspecified
          </td>
        </tr>

        <tr>
          <th>Status</th>
          <td>NEW
          </td>
        </tr>

        <tr>
          <th>Severity</th>
          <td>Normal
          </td>
        </tr>

        <tr>
          <th>Priority</th>
          <td>P2
          </td>
        </tr>

        <tr>
          <th>Component</th>
          <td>Tools / Tests
          </td>
        </tr>

        <tr>
          <th>Assignee</th>
          <td>webkit-unassigned&#64;lists.webkit.org
          </td>
        </tr>

        <tr>
          <th>Reporter</th>
          <td>darin&#64;apple.com
          </td>
        </tr>

        <tr>
          <th>CC</th>
          <td>lforschler&#64;apple.com
          </td>
        </tr></table>
      <p>
        <div>
        <pre>When I run tests, I see output like this:

  compositing/hidpi-compositing-vs-non-compositing-check-on-testing-framework.html -&gt; ref test hashes didn't match but diff passed
  compositing/masks/compositing-clip-path.html -&gt; ref test hashes didn't match but diff passed
  compositing/overlap-blending/children-opacity-huge.html -&gt; ref test hashes didn't match but diff passed
  compositing/overlap-blending/children-opacity-no-overlap.html -&gt; ref test hashes didn't match but diff passed
  compositing/overlap-blending/nested-non-overlap-clipping.html -&gt; ref test hashes didn't match but diff passed
  compositing/transitions/transform-on-large-layer.html -&gt; ref test hashes didn't match but diff passed  
  compositing/video/poster.html -&gt; ref test hashes didn't match but diff passed 
  fast/borders/border-image-fill-no-border.html -&gt; ref test hashes didn't match but diff passed                              
  fast/css/object-fit/object-fit-canvas.html -&gt; ref test hashes didn't match but diff passed                                    
  fast/css/sticky/sticky-left-percentage.html -&gt; ref test hashes didn't match but diff passed
  fast/images/animated-gif-no-layout.html -&gt; ref test hashes didn't match but diff passed
  fast/images/gif-loop-count.html -&gt; ref test hashes didn't match but diff passed 
  fast/images/pdf-as-image-crop-box.html -&gt; ref test hashes didn't match but diff passed        
  fast/regions/overflow/overflow-size-change-with-stacking-context-rtl.html -&gt; ref test hashes didn't match but diff passed
  imported/w3c/css/css-color-3/t424-hsl-basic-a.xht -&gt; ref test hashes didn't match but diff passed                                       
  imported/w3c/css/css-color-3/t424-hsl-parsing-f.xht -&gt; ref test hashes didn't match but diff passed
  imported/w3c/css/css-color-3/t425-hsla-parsing-f.xht -&gt; ref test hashes didn't match but diff passed                               
  imported/mozilla/svg/text/textpath-selection.svg -&gt; ref test hashes didn't match but diff passed
  svg/canvas/canvas-global-alpha-svg.html -&gt; ref test hashes didn't match but diff passed
  svg/repaint/buffered-rendering-static-image.html -&gt; ref test hashes didn't match but diff passed                                          

This information is all useless to me, and to anyone, I think.

If these were pixel tests, then I suppose someone might want to know that the tests are matching on disk, but the hash isn’t matching, so they can regenerate images with correct hashes for faster test running in the future. But for a reference test, who is this message for? What is the action needed here?

We should not contaminate the output with these logs, unless there is some real world project we will do that makes use of them.</pre>
        </div>
      </p>
      <hr>
      <span>You are receiving this mail because:</span>
      
      <ul>
          <li>You are the assignee for the bug.</li>
      </ul>
    </body>
</html>