[webkit-efl] Changing the test expectations lookup sequence
gyuyoung.kim at webkit.org
Thu Mar 7 02:40:23 PST 2013
I don't object to do that. BTW, it looks efl/TestExepectations doesn't need
to be kept after doing that anymore. So, it seems we can move the tests of
efl/TestExpectations to efl-wk1/TestExpectations.
On Thu, Mar 7, 2013 at 7:20 PM, Kenneth Rohde Christiansen <
kenneth.christiansen at gmail.com> wrote:
> I am fine with that.
> On Thu, Mar 7, 2013 at 11:10 AM, Thiago Marcos P. Santos
> <tmpsantos at gmail.com> wrote:
> > Hi EWebkitters,
> > Currently on the EFL WK2 port, the lookup sequence for test
> > expectations is "efl-wk2 -> wk2 -> efl -> generic".
> > The "efl" part of this sequence is shared between EFL WebKit1 and EFL
> > I'm currently facing some challenges when gardening because of:
> > 1. Currently we have some tests skipped (~90) on the "wk2"
> > expectations that have different expectations on "efl". It gives you
> > the impression that the test is running (because is marked as [
> > Failure ] when in fact is being skipped because "wk2" has precedence.
> > The flakiness dashboard also gets confused about it and gives a false
> > positive.
> > 2. Removing or adding a file to the shared expectation requires
> > testing on both ports, which IMO is a heavy burden.
> > 3. I'm trying to remove from the flaky list some tests that are now
> > considered stable (no failures on the past 100 runs). Because of the
> > shared expectations, I will have to analyse the results of one extra
> > bot, even though I have no intentions of doing gardening for WebKit1.
> > I would like to suggest changing the lookup sequence to "efl-wk2 ->
> > wk2 -> generic", so we can make EFL WK2 port completely independent.
> > Cheers,
> > _______________________________________________
> > webkit-efl mailing list
> > webkit-efl at lists.webkit.org
> > https://lists.webkit.org/mailman/listinfo/webkit-efl
> Kenneth Rohde Christiansen
> Senior Engineer, WebKit, Qt, EFL
> Phone +45 4294 9458 / E-mail kenneth at webkit.org
> webkit-efl mailing list
> webkit-efl at lists.webkit.org
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the webkit-efl