On Fri, Oct 26, 2012 at 11:43 AM, Dirk Pranke <span dir="ltr"><<a href="mailto:dpranke@chromium.org" target="_blank">dpranke@chromium.org</a>></span> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="HOEnZb"><div class="h5">On Fri, Oct 26, 2012 at 11:38 AM, Ryosuke Niwa <<a href="mailto:rniwa@webkit.org">rniwa@webkit.org</a>> wrote:<br>
> On Fri, Oct 26, 2012 at 11:33 AM, Elliott Sprehn <<a href="mailto:esprehn@chromium.org">esprehn@chromium.org</a>><br>
> wrote:<br>
>><br>
>> On Fri, Oct 26, 2012 at 11:17 AM, Ryosuke Niwa <<a href="mailto:rniwa@webkit.org">rniwa@webkit.org</a>> wrote:<br>
>> > ...<br>
>> ><br>
>> > I agree this is a good change but it appears that we should add more<br>
>> > cache/loader tests before changing DRT's behavior given that there are<br>
>> > active contributors who rely on the current DRT behaviors to detect<br>
>> > regressions.<br>
>> ><br>
>><br>
>> Can we add a flag to control this behavior? Then Antti could run the<br>
>> tests without cache clearing when modifying things possibly related to<br>
>> the cache code. We could even run a separate cr-linux bot like we do<br>
>> for debug builds.<br>
><br>
><br>
> I think having a set of tests that tests loaders/caches explicitly is more<br>
> useful.<br>
><br>
<br>
</div></div>I think having a set of tests for loaders and caches would be more<br>
useful as well, but I don't think it's fair to make that a requirement<br>
to changing the default behavior here, especially since it's not clear<br>
who all would be best suited to writing those tests or what the extent<br>
of that work is.<br></blockquote><div><br></div><div>I’m sure Antti, Alexey, and others who have worked on the loader and other parts of WebKit are happy to write those tests or list the kind of things they want to test. Heck, I don’t mind writing those tests if someone could make a list.</div>
<div><br></div><div>I totally sympathize with the sentiment to reduce the test flakiness but loader and cache code have historically been under-tested, and we’ve had a number of bugs detected only by running non-loader tests consecutively.</div>
<div><br></div><div>On the contrary, we’ve had this DRT behavior for ages. Is there any reason we can’t wait for another couple of weeks or months until we add more loader & cache tests before making the behavior change?</div>
<div><br></div><div>- Ryosuke</div><div><br></div></div>