[webkit-efl] Changing the test expectations lookup sequence

[Gyuyoung Kim]

I don't object to do that. BTW, it looks efl/TestExepectations doesn't need
to be kept after doing that anymore. So, it seems we can move the tests of
efl/TestExpectations to efl-wk1/TestExpectations.

Gyuyoung

On Thu, Mar 7, 2013 at 7:20 PM, Kenneth Rohde Christiansen <
kenneth.christiansen at gmail.com> wrote:

> I am fine with that.
>
> Kenneth
>
> On Thu, Mar 7, 2013 at 11:10 AM, Thiago Marcos P. Santos
> <tmpsantos at gmail.com> wrote:
> > Hi EWebkitters,
> >
> > Currently on the EFL WK2 port, the lookup sequence for test
> > expectations is "efl-wk2 -> wk2 -> efl -> generic".
> >
> > The "efl" part of this sequence is shared between EFL WebKit1 and EFL
> WebKit2.
> >
> > I'm currently facing some challenges when gardening because of:
> >
> > 1. Currently we have some tests skipped (~90) on the "wk2"
> > expectations that have different expectations on "efl". It gives you
> > the impression that the test is running (because is marked as [
> > Failure ] when in fact is being skipped because "wk2" has precedence.
> > The flakiness dashboard also gets confused about it and gives a false
> > positive.
> >
> > 2. Removing or adding a file to the shared expectation requires
> > testing on both ports, which IMO is a heavy burden.
> >
> > 3. I'm trying to remove from the flaky list some tests that are now
> > considered stable (no failures on the past 100 runs). Because of the
> > shared expectations, I will have to analyse the results of one extra
> > bot, even though I have no intentions of doing gardening for WebKit1.
> >
> > I would like to suggest changing the lookup sequence to "efl-wk2 ->
> > wk2 -> generic", so we can make EFL WK2 port completely independent.
> >
> > Cheers,
> > _______________________________________________
> > webkit-efl mailing list
> > webkit-efl at lists.webkit.org
> > https://lists.webkit.org/mailman/listinfo/webkit-efl
>
>
>
> --
> Kenneth Rohde Christiansen
> Senior Engineer, WebKit, Qt, EFL
> Phone  +45 4294 9458 / E-mail kenneth at webkit.org
>
> ﹆﹆﹆
> _______________________________________________
> webkit-efl mailing list
> webkit-efl at lists.webkit.org
> https://lists.webkit.org/mailman/listinfo/webkit-efl
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-efl/attachments/20130307/b2413313/attachment.html>