<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN"
"http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head><meta http-equiv="content-type" content="text/html; charset=utf-8" />
<title>[191380] trunk</title>
</head>
<body>

<style type="text/css"><!--
#msg dl.meta { border: 1px #006 solid; background: #369; padding: 6px; color: #fff; }
#msg dl.meta dt { float: left; width: 6em; font-weight: bold; }
#msg dt:after { content:':';}
#msg dl, #msg dt, #msg ul, #msg li, #header, #footer, #logmsg { font-family: verdana,arial,helvetica,sans-serif; font-size: 10pt;  }
#msg dl a { font-weight: bold}
#msg dl a:link    { color:#fc3; }
#msg dl a:active  { color:#ff0; }
#msg dl a:visited { color:#cc6; }
h3 { font-family: verdana,arial,helvetica,sans-serif; font-size: 10pt; font-weight: bold; }
#msg pre { overflow: auto; background: #ffc; border: 1px #fa0 solid; padding: 6px; }
#logmsg { background: #ffc; border: 1px #fa0 solid; padding: 1em 1em 0 1em; }
#logmsg p, #logmsg pre, #logmsg blockquote { margin: 0 0 1em 0; }
#logmsg p, #logmsg li, #logmsg dt, #logmsg dd { line-height: 14pt; }
#logmsg h1, #logmsg h2, #logmsg h3, #logmsg h4, #logmsg h5, #logmsg h6 { margin: .5em 0; }
#logmsg h1:first-child, #logmsg h2:first-child, #logmsg h3:first-child, #logmsg h4:first-child, #logmsg h5:first-child, #logmsg h6:first-child { margin-top: 0; }
#logmsg ul, #logmsg ol { padding: 0; list-style-position: inside; margin: 0 0 0 1em; }
#logmsg ul { text-indent: -1em; padding-left: 1em; }#logmsg ol { text-indent: -1.5em; padding-left: 1.5em; }
#logmsg > ul, #logmsg > ol { margin: 0 0 1em 0; }
#logmsg pre { background: #eee; padding: 1em; }
#logmsg blockquote { border: 1px solid #fa0; border-left-width: 10px; padding: 1em 1em 0 1em; background: white;}
#logmsg dl { margin: 0; }
#logmsg dt { font-weight: bold; }
#logmsg dd { margin: 0; padding: 0 0 0.5em 0; }
#logmsg dd:before { content:'\00bb';}
#logmsg table { border-spacing: 0px; border-collapse: collapse; border-top: 4px solid #fa0; border-bottom: 1px solid #fa0; background: #fff; }
#logmsg table th { text-align: left; font-weight: normal; padding: 0.2em 0.5em; border-top: 1px dotted #fa0; }
#logmsg table td { text-align: right; border-top: 1px dotted #fa0; padding: 0.2em 0.5em; }
#logmsg table thead th { text-align: center; border-bottom: 1px solid #fa0; }
#logmsg table th.Corner { text-align: left; }
#logmsg hr { border: none 0; border-top: 2px dashed #fa0; height: 1px; }
#header, #footer { color: #fff; background: #636; border: 1px #300 solid; padding: 6px; }
#patch { width: 100%; }
#patch h4 {font-family: verdana,arial,helvetica,sans-serif;font-size:10pt;padding:8px;background:#369;color:#fff;margin:0;}
#patch .propset h4, #patch .binary h4 {margin:0;}
#patch pre {padding:0;line-height:1.2em;margin:0;}
#patch .diff {width:100%;background:#eee;padding: 0 0 10px 0;overflow:auto;}
#patch .propset .diff, #patch .binary .diff  {padding:10px 0;}
#patch span {display:block;padding:0 10px;}
#patch .modfile, #patch .addfile, #patch .delfile, #patch .propset, #patch .binary, #patch .copfile {border:1px solid #ccc;margin:10px 0;}
#patch ins {background:#dfd;text-decoration:none;display:block;padding:0 10px;}
#patch del {background:#fdd;text-decoration:none;display:block;padding:0 10px;}
#patch .lines, .info {color:#888;background:#fff;}
--></style>
<div id="msg">
<dl class="meta">
<dt>Revision</dt> <dd><a href="http://trac.webkit.org/projects/webkit/changeset/191380">191380</a></dd>
<dt>Author</dt> <dd>youenn.fablet@crf.canon.fr</dd>
<dt>Date</dt> <dd>2015-10-21 00:53:37 -0700 (Wed, 21 Oct 2015)</dd>
</dl>

<h3>Log Message</h3>
<pre>W3C test importer should not import reference files as regular tests
https://bugs.webkit.org/show_bug.cgi?id=150331

Reviewed by Darin Adler.

LayoutTests/imported/w3c:

* resources/ImportExpectations: Removed some Skip expectations as test importer no longer will handle these files as tests, but as reference files.

Tools:

Updated test_parser to return information that a file can be a referencefile or a manual test.
Updated test importer to skip those files.
Updated/Added test parser unit tests accordingly.

Updated test importer to import all not-test files, as they are usually used by tests and lead to test failing or timing out.
Updated test importer to log these 'resource' files that are not in a resources folder, and suggest to import script user
to mark these files as Skip, since they are not direct tests.

* Scripts/webkitpy/w3c/test_importer.py:
(TestImporter.__init__):
(TestImporter.find_importable_tests):
(TestImporter.import_tests):
* Scripts/webkitpy/w3c/test_parser.py:
(TestParser.analyze_test):
* Scripts/webkitpy/w3c/test_parser_unittest.py:
(test_analyze_non_html_file):
(test_reference_test):

LayoutTests:

* TestExpectations: Adding Skip expectations for web-platform-test resource files (currently commented out as not all are yet imported).</pre>

<h3>Modified Paths</h3>
<ul>
<li><a href="#trunkLayoutTestsChangeLog">trunk/LayoutTests/ChangeLog</a></li>
<li><a href="#trunkLayoutTestsTestExpectations">trunk/LayoutTests/TestExpectations</a></li>
<li><a href="#trunkLayoutTestsimportedw3cChangeLog">trunk/LayoutTests/imported/w3c/ChangeLog</a></li>
<li><a href="#trunkLayoutTestsimportedw3cresourcesImportExpectations">trunk/LayoutTests/imported/w3c/resources/ImportExpectations</a></li>
<li><a href="#trunkToolsChangeLog">trunk/Tools/ChangeLog</a></li>
<li><a href="#trunkToolsScriptswebkitpyw3ctest_importerpy">trunk/Tools/Scripts/webkitpy/w3c/test_importer.py</a></li>
<li><a href="#trunkToolsScriptswebkitpyw3ctest_parserpy">trunk/Tools/Scripts/webkitpy/w3c/test_parser.py</a></li>
<li><a href="#trunkToolsScriptswebkitpyw3ctest_parser_unittestpy">trunk/Tools/Scripts/webkitpy/w3c/test_parser_unittest.py</a></li>
</ul>

</div>
<div id="patch">
<h3>Diff</h3>
<a id="trunkLayoutTestsChangeLog"></a>
<div class="modfile"><h4>Modified: trunk/LayoutTests/ChangeLog (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/LayoutTests/ChangeLog        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/LayoutTests/ChangeLog        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -1,5 +1,14 @@
</span><span class="cx"> 2015-10-21  Youenn Fablet  &lt;youenn.fablet@crf.canon.fr&gt;
</span><span class="cx"> 
</span><ins>+        W3C test importer should not import reference files as regular tests
+        https://bugs.webkit.org/show_bug.cgi?id=150331
+
+        Reviewed by Darin Adler.
+
+        * TestExpectations: Adding Skip expectations for web-platform-test resource files (currently commented out as not all are yet imported).
+
+2015-10-21  Youenn Fablet  &lt;youenn.fablet@crf.canon.fr&gt;
+
</ins><span class="cx">         Update web-platform-tests tests to the same revision as tools
</span><span class="cx">         https://bugs.webkit.org/show_bug.cgi?id=149656
</span><span class="cx"> 
</span></span></pre></div>
<a id="trunkLayoutTestsTestExpectations"></a>
<div class="modfile"><h4>Modified: trunk/LayoutTests/TestExpectations (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/LayoutTests/TestExpectations        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/LayoutTests/TestExpectations        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -266,6 +266,68 @@
</span><span class="cx"> imported/w3c/web-platform-tests/html/semantics/grouping-content/the-ol-element/reversed-1c.html [ Skip ]
</span><span class="cx"> imported/w3c/web-platform-tests/html/semantics/selectors/pseudo-classes/focus-iframe.html [ Skip ]
</span><span class="cx"> 
</span><ins>+# Resource files not in resources folder
+#imported/w3c/web-platform-tests/common/blank.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_mathml.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_mathml.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_mathml.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_svg.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_svg.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_svg.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_xhtml.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_xhtml.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/bare_xhtml.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/empty.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/empty.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/empty.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/mathml.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/mathml.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/mathml.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/minimal_html.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/minimal_html.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/minimal_html.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/svg.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/svg.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/svg.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_changed.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_changed.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_changed.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_removed.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_removed.xhtml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Document-createElement-namespace-tests/xhtml_ns_removed.xml [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/Node-parentNode-iframe.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All-content.html [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/ParentNode-querySelector-All-content.xht [ Skip ]
+#imported/w3c/web-platform-tests/dom/nodes/getElementsByClassNameFrame.htm [ Skip ]
+#imported/w3c/web-platform-tests/dom/ranges/Range-test-iframe.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/document-write/nested-document-write-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/document-write/nested-document-write-2.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/004-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/010-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/010-2.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/011-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/012-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/013-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/014-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/015-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/016-1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/document.open-03-frame.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/document-metadata/the-base-element/example.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/document-metadata/the-base-element/example2.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/embedded-content/the-img-element/environment-changes/iframed.sub.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/embedded-content/the-img-element/sizes/sizes-iframed.sub.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/embedded-content/the-object-element/test0.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/embedded-content/the-object-element/test1.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/embedded-content/the-object-element/test2.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/forms/attributes-common-to-form-controls/dirname-ltr-iframe.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/grouping-content/the-ol-element/reversed-1a.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/grouping-content/the-ol-element/reversed-1b.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/grouping-content/the-ol-element/reversed-1c.html [ Skip ]
+#imported/w3c/web-platform-tests/html/semantics/selectors/pseudo-classes/focus-iframe.html [ Skip ]
+
</ins><span class="cx"> # Skip W3C tests that are too slow in debug builds.
</span><span class="cx"> webkit.org/b/148546 [ Debug ] imported/w3c/web-platform-tests/dom/interfaces.html [ Skip ]
</span><span class="cx"> webkit.org/b/148546 [ Debug ] imported/w3c/web-platform-tests/dom/ranges/Range-compareBoundaryPoints.html [ Skip ]
</span></span></pre></div>
<a id="trunkLayoutTestsimportedw3cChangeLog"></a>
<div class="modfile"><h4>Modified: trunk/LayoutTests/imported/w3c/ChangeLog (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/LayoutTests/imported/w3c/ChangeLog        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/LayoutTests/imported/w3c/ChangeLog        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -1,5 +1,14 @@
</span><span class="cx"> 2015-10-21  Youenn Fablet  &lt;youenn.fablet@crf.canon.fr&gt;
</span><span class="cx"> 
</span><ins>+        W3C test importer should not import reference files as regular tests
+        https://bugs.webkit.org/show_bug.cgi?id=150331
+
+        Reviewed by Darin Adler.
+
+        * resources/ImportExpectations: Removed some Skip expectations as test importer no longer will handle these files as tests, but as reference files.
+
+2015-10-21  Youenn Fablet  &lt;youenn.fablet@crf.canon.fr&gt;
+
</ins><span class="cx">         Update web-platform-tests tests to the same revision as tools
</span><span class="cx">         https://bugs.webkit.org/show_bug.cgi?id=149656
</span><span class="cx"> 
</span></span></pre></div>
<a id="trunkLayoutTestsimportedw3cresourcesImportExpectations"></a>
<div class="modfile"><h4>Modified: trunk/LayoutTests/imported/w3c/resources/ImportExpectations (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/LayoutTests/imported/w3c/resources/ImportExpectations        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/LayoutTests/imported/w3c/resources/ImportExpectations        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -61,7 +61,6 @@
</span><span class="cx"> web-platform-tests/custom-elements [ Skip ]
</span><span class="cx"> #web-platform-tests/dom [ Pass ]
</span><span class="cx"> web-platform-tests/dom/events/Event-dispatch-propagation-stopped.html [ Skip ]
</span><del>-web-platform-tests/dom/nodes/Document-createElement-namespace-tests [ Skip ]
</del><span class="cx"> web-platform-tests/dom/nodes/Document-createProcessingInstruction.xhtml [ Skip ]
</span><span class="cx"> web-platform-tests/dom/nodes/Document-getElementsByTagName.xhtml [ Skip ]
</span><span class="cx"> web-platform-tests/dom/nodes/Element-childElement-null.svg [ Skip ]
</span><span class="lines">@@ -102,99 +101,13 @@
</span><span class="cx"> #web-platform-tests/html [ Pass ]
</span><span class="cx"> web-platform-tests/html/browsers [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/documents/dom-tree-accessors/Document.currentScript.sub.html [ Skip ]
</span><del>-web-platform-tests/html/dom/dynamic-markup-insertion/opening-the-input-stream/010.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-EN-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-N-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-bdi-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-bdi-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-bdi-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-bdi-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir_auto-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir_auto-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir_auto-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-dir_auto-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-script-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-script-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-script-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-script-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-style-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-style-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-style-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-style-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-textarea-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-textarea-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-textarea-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-contained-textarea-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-EN-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-N-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-EN-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-L-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-L-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-N-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-R-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-input-script-R-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-isolate-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-isolate-ref.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-textarea-script-N-between-Rs-ref-expected.html [ Skip ]
-web-platform-tests/html/dom/elements/global-attributes/dir_auto-textarea-script-N-between-Rs-ref.html [ Skip ]
</del><span class="cx"> web-platform-tests/html/dom/reflection-embedded.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-forms.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-grouping.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-metadata.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-misc.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-obsolete.html [ Skip ]
</span><ins>+web-platform-tests/html/dom/reflection-original.html [ Skip ]
</ins><span class="cx"> web-platform-tests/html/dom/reflection-sections.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-tabular.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/dom/reflection-text.html [ Skip ]
</span><span class="lines">@@ -203,50 +116,15 @@
</span><span class="cx"> web-platform-tests/html/infrastructure [ Skip ]
</span><span class="cx"> web-platform-tests/html/obsolete [ Skip ]
</span><span class="cx"> web-platform-tests/html/rendering [ Skip ]
</span><ins>+
</ins><span class="cx"> web-platform-tests/html/semantics/document-metadata/styling/LinkStyle.html [ Skip ]
</span><ins>+web-platform-tests/html/semantics/embedded-content/media-elements/error-codes [ Skip ]
+web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource [ Skip ]
+web-platform-tests/html/semantics/embedded-content/the-iframe-element [ Skip ]
+web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/cors [ Skip ]
+web-platform-tests/html/semantics/embedded-content/the-embed-element/embed-represent-nothing-04.html [ Skip ]
</ins><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/audio_loop_base.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/error-codes [ Skip ]
</span><del>-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/autoplay-overrides-preload.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/load-events-networkState.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/load-removes-queued-error-event.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-candidate-insert-before.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-candidate-moved.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-candidate-remove-addEventListener.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-candidate-remove-no-listener.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-candidate-remove-onerror.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-audio-constructor-no-src.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-audio-constructor.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-in-sync-event.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-fragment-into-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-into-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-into-iframe.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-parent-into-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-source-in-div.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-source-in-namespace.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-source-networkState.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-source-not-in-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-insert-source.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-load.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-pause-networkState.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-pause.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-play.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-remove-from-document-networkState.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-remove-from-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-remove-src.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-set-src-in-namespace.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-set-src-networkState.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-set-src-not-in-document.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-invoke-set-src.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-insert-br.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-insert-source.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-insert-text.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-remove-source-after.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-remove-source.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-remove-text.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-remove-source.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-remove-src.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-source-media.html [ Skip ]
</del><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/location-of-the-media-resource/currentSrc.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/networkState_during_progress.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/offsets-into-the-media-resource/currentTime.html [ Skip ]
</span><span class="lines">@@ -260,8 +138,8 @@
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/cloneNode.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/track/track-element/cors [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/media-elements/video_loop_base.html [ Skip ]
</span><del>-web-platform-tests/html/semantics/embedded-content/the-embed-element/embed-represent-nothing-04-expected.html [ Skip ]
-web-platform-tests/html/semantics/embedded-content/the-embed-element/embed-represent-nothing-04.html [ Skip ]
</del><ins>+web-platform-tests/html/semantics/embedded-content/the-area-element/area_nohref.xhtml [ Skip ]
+web-platform-tests/html/semantics/embedded-content/the-area-element/test-area.xhtml [ Skip ]
</ins><span class="cx"> web-platform-tests/html/semantics/embedded-content/the-img-element/relevant-mutations.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/embedded-content/the-object-element/object-events.html [ Skip ]
</span><span class="cx"> web-platform-tests/html/semantics/forms/textfieldselection/select-event.html [ Skip ]
</span><span class="lines">@@ -330,3 +208,5 @@
</span><span class="cx"> web-platform-tests/webstorage [ Skip ]
</span><span class="cx"> web-platform-tests/webvtt [ Skip ]
</span><span class="cx"> web-platform-tests/workers [ Skip ]
</span><ins>+
+web-platform-tests/testharness_runner.html [ Skip ]
</ins></span></pre></div>
<a id="trunkToolsChangeLog"></a>
<div class="modfile"><h4>Modified: trunk/Tools/ChangeLog (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Tools/ChangeLog        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/Tools/ChangeLog        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -1,3 +1,28 @@
</span><ins>+2015-10-21  Youenn Fablet  &lt;youenn.fablet@crf.canon.fr&gt;
+
+        W3C test importer should not import reference files as regular tests
+        https://bugs.webkit.org/show_bug.cgi?id=150331
+
+        Reviewed by Darin Adler.
+
+        Updated test_parser to return information that a file can be a referencefile or a manual test.
+        Updated test importer to skip those files.
+        Updated/Added test parser unit tests accordingly.
+
+        Updated test importer to import all not-test files, as they are usually used by tests and lead to test failing or timing out.
+        Updated test importer to log these 'resource' files that are not in a resources folder, and suggest to import script user
+        to mark these files as Skip, since they are not direct tests. 
+
+        * Scripts/webkitpy/w3c/test_importer.py:
+        (TestImporter.__init__):
+        (TestImporter.find_importable_tests):
+        (TestImporter.import_tests):
+        * Scripts/webkitpy/w3c/test_parser.py:
+        (TestParser.analyze_test):
+        * Scripts/webkitpy/w3c/test_parser_unittest.py:
+        (test_analyze_non_html_file):
+        (test_reference_test):
+
</ins><span class="cx"> 2015-10-20  Aakash Jain  &lt;aakash_jain@apple.com&gt;
</span><span class="cx"> 
</span><span class="cx">         run-webkit-tests does not copy all crash logs for layout test failures on iOS
</span></span></pre></div>
<a id="trunkToolsScriptswebkitpyw3ctest_importerpy"></a>
<div class="modfile"><h4>Modified: trunk/Tools/Scripts/webkitpy/w3c/test_importer.py (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Tools/Scripts/webkitpy/w3c/test_importer.py        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/Tools/Scripts/webkitpy/w3c/test_importer.py        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -166,11 +166,14 @@
</span><span class="cx">         self._webkit_root = webkit_finder.webkit_base()
</span><span class="cx"> 
</span><span class="cx">         self.destination_directory = webkit_finder.path_from_webkit_base(&quot;LayoutTests&quot;, options.destination)
</span><del>-        self.layout_tests_w3c_path = webkit_finder.path_from_webkit_base('LayoutTests', 'imported', 'w3c')
</del><ins>+        self.tests_w3c_relative_path = self.filesystem.join('imported', 'w3c')
+        self.layout_tests_w3c_path = webkit_finder.path_from_webkit_base('LayoutTests', self.tests_w3c_relative_path)
</ins><span class="cx">         self.tests_download_path = webkit_finder.path_from_webkit_base('WebKitBuild', 'w3c-tests')
</span><span class="cx"> 
</span><span class="cx">         self._test_downloader = None
</span><span class="cx"> 
</span><ins>+        self._potential_test_resource_files = []
+
</ins><span class="cx">         self.import_list = []
</span><span class="cx">         self._importing_downloaded_tests = source_directory is None
</span><span class="cx"> 
</span><span class="lines">@@ -253,11 +256,19 @@
</span><span class="cx">                 test_parser = TestParser(vars(self.options), filename=fullpath, host=self.host)
</span><span class="cx">                 test_info = test_parser.analyze_test()
</span><span class="cx">                 if test_info is None:
</span><del>-                    # If html file is in a &quot;resources&quot; folder, it should be copied anyway
-                    if self.filesystem.basename(self.filesystem.dirname(fullpath)) == &quot;resources&quot;:
-                        copy_list.append({'src': fullpath, 'dest': filename})
</del><ins>+                    # This is probably a resource file.
+                    if self.filesystem.basename(self.filesystem.dirname(fullpath)) != &quot;resources&quot;:
+                        self._potential_test_resource_files.append({'src': fullpath, 'dest': filename})
+                    copy_list.append({'src': fullpath, 'dest': filename})
</ins><span class="cx">                     continue
</span><span class="cx"> 
</span><ins>+                if 'manualtest' in test_info.keys():
+                    continue
+
+                if 'referencefile' in test_info.keys():
+                    # Skip it since, the corresponding reference test should have a link to this file
+                    continue
+
</ins><span class="cx">                 if 'reference' in test_info.keys():
</span><span class="cx">                     reftests += 1
</span><span class="cx">                     total_tests += 1
</span><span class="lines">@@ -413,6 +424,11 @@
</span><span class="cx">         for prefixed_value in sorted(total_prefixed_property_values, key=lambda p: total_prefixed_property_values[p]):
</span><span class="cx">             _log.info('  %s: %s', prefixed_value, total_prefixed_property_values[prefixed_value])
</span><span class="cx"> 
</span><ins>+        if self._potential_test_resource_files:
+            _log.info('The following files may be resource files and should be marked as skipped in the TestExpectations:')
+            for filename in sorted([test['src'] for test in self._potential_test_resource_files]):
+                _log.info(filename.replace(self.source_directory, self.tests_w3c_relative_path) + ' [ Skip ]')
+
</ins><span class="cx">     def remove_deleted_files(self, import_directory, new_file_list):
</span><span class="cx">         &quot;&quot;&quot; Reads an import log in |import_directory|, compares it to the |new_file_list|, and removes files not in the new list.&quot;&quot;&quot;
</span><span class="cx"> 
</span></span></pre></div>
<a id="trunkToolsScriptswebkitpyw3ctest_parserpy"></a>
<div class="modfile"><h4>Modified: trunk/Tools/Scripts/webkitpy/w3c/test_parser.py (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Tools/Scripts/webkitpy/w3c/test_parser.py        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/Tools/Scripts/webkitpy/w3c/test_parser.py        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -95,6 +95,9 @@
</span><span class="cx">                 _log.error('%s has a reference link but is missing the &quot;href&quot;', self.filesystem)
</span><span class="cx">                 return None
</span><span class="cx"> 
</span><ins>+            if (ref_file == self.filename):
+                return {'referencefile': self.filename}
+
</ins><span class="cx">             if self.ref_doc is None:
</span><span class="cx">                 self.load_file(ref_file, True)
</span><span class="cx"> 
</span><span class="lines">@@ -114,10 +117,12 @@
</span><span class="cx">             test_info['reference_support_info'] = {}
</span><span class="cx">         # we check for wpt manual test before checking for jstest, as some WPT manual tests can be classified as CSS JS tests
</span><span class="cx">         elif self.is_wpt_manualtest():
</span><del>-            test_info = None
</del><ins>+            test_info = {'test': self.filename, 'manualtest': True}
</ins><span class="cx">         elif self.is_jstest():
</span><span class="cx">             test_info = {'test': self.filename, 'jstest': True}
</span><del>-        elif self.options['all'] is True and not('-ref' in self.filename) and not('reference' in self.filename):
</del><ins>+        elif '-ref' in self.filename or 'reference' in self.filename:
+            test_info = {'referencefile': self.filename}
+        elif self.options['all'] is True:
</ins><span class="cx">             test_info = {'test': self.filename}
</span><span class="cx"> 
</span><span class="cx">         return test_info
</span></span></pre></div>
<a id="trunkToolsScriptswebkitpyw3ctest_parser_unittestpy"></a>
<div class="modfile"><h4>Modified: trunk/Tools/Scripts/webkitpy/w3c/test_parser_unittest.py (191379 => 191380)</h4>
<pre class="diff"><span>
<span class="info">--- trunk/Tools/Scripts/webkitpy/w3c/test_parser_unittest.py        2015-10-21 07:44:33 UTC (rev 191379)
+++ trunk/Tools/Scripts/webkitpy/w3c/test_parser_unittest.py        2015-10-21 07:53:37 UTC (rev 191380)
</span><span class="lines">@@ -166,7 +166,7 @@
</span><span class="cx">         parser = TestParser(options, os.path.join(test_path, 'somefile-manual.html'))
</span><span class="cx">         test_info = parser.analyze_test(test_contents=test_html)
</span><span class="cx"> 
</span><del>-        self.assertEqual(test_info, None, 'test_info is None')
</del><ins>+        self.assertTrue(test_info['manualtest'], 'test_info is None')
</ins><span class="cx"> 
</span><span class="cx">     def test_analyze_pixel_test_all_true(self):
</span><span class="cx">         &quot;&quot;&quot; Tests analyze_test() using a test that is neither a reftest or jstest with all=False &quot;&quot;&quot;
</span><span class="lines">@@ -228,3 +228,26 @@
</span><span class="cx">         parser = TestParser(options, os.path.join(os.path.dirname(__file__), 'test_parser.py'))
</span><span class="cx">         test_info = parser.analyze_test()
</span><span class="cx">         self.assertEqual(test_info, None, 'no tests should have been found in this file')
</span><ins>+
+    def test_reference_test(self):
+        &quot;&quot;&quot; Tests analyze_test() using a test that is a reference file having a &lt;link rel=&quot;match&quot;&gt; tag&quot;&quot;&quot;
+
+        test_html = &quot;&quot;&quot;&lt;html&gt;
+&lt;head&gt;
+&lt;title&gt;CSS Test: DESCRIPTION OF TEST&lt;/title&gt;
+&lt;link rel=&quot;match&quot; href=&quot;test-ref.html&quot; /&gt;
+&lt;link rel=&quot;author&quot; title=&quot;NAME_OF_AUTHOR&quot; /&gt;
+&lt;style type=&quot;text/css&quot;&gt;&lt;![CDATA[
+CSS FOR TEST
+]]&gt;&lt;/style&gt;
+&lt;/head&gt;
+&lt;body&gt;
+CONTENT OF TEST
+&lt;/body&gt;
+&lt;/html&gt;
+&quot;&quot;&quot;
+        test_path = os.path.join(os.path.sep, 'some', 'madeup', 'path')
+        parser = TestParser(options, os.path.join(test_path, 'test-ref.html'))
+        test_info = parser.analyze_test(test_contents=test_html)
+
+        self.assertTrue('referencefile' in test_info, 'test should be detected as reference file')
</ins></span></pre>
</div>
</div>

</body>
</html>