[webkit-efl] Changing the test expectations lookup sequence

[Kangil Han]

Hi Thiago!
 
I am fine too. J
 
Kind regards,
Kangil
 
From: webkit-efl-bounces at lists.webkit.org [mailto:webkit-efl-bounces at lists.webkit.org] On Behalf Of Gyuyoung Kim
Sent: Thursday, March 07, 2013 7:40 PM
To: Thiago Marcos P. Santos
Cc: webkit-efl at lists.webkit.org
Subject: Re: [webkit-efl] Changing the test expectations lookup sequence
 
I don't object to do that. BTW, it looks efl/TestExepectations doesn't need to be kept after doing that anymore. So, it seems we can move the tests of efl/TestExpectations to efl-wk1/TestExpectations.
 
Gyuyoung
On Thu, Mar 7, 2013 at 7:20 PM, Kenneth Rohde Christiansen <kenneth.christiansen at gmail.com> wrote:
I am fine with that.

Kenneth

On Thu, Mar 7, 2013 at 11:10 AM, Thiago Marcos P. Santos
<tmpsantos at gmail.com> wrote:
> Hi EWebkitters,
>
> Currently on the EFL WK2 port, the lookup sequence for test
> expectations is "efl-wk2 -> wk2 -> efl -> generic".
>
> The "efl" part of this sequence is shared between EFL WebKit1 and EFL WebKit2.
>
> I'm currently facing some challenges when gardening because of:
>
> 1. Currently we have some tests skipped (~90) on the "wk2"
> expectations that have different expectations on "efl". It gives you
> the impression that the test is running (because is marked as [
> Failure ] when in fact is being skipped because "wk2" has precedence.
> The flakiness dashboard also gets confused about it and gives a false
> positive.
>
> 2. Removing or adding a file to the shared expectation requires
> testing on both ports, which IMO is a heavy burden.
>
> 3. I'm trying to remove from the flaky list some tests that are now
> considered stable (no failures on the past 100 runs). Because of the
> shared expectations, I will have to analyse the results of one extra
> bot, even though I have no intentions of doing gardening for WebKit1.
>
> I would like to suggest changing the lookup sequence to "efl-wk2 ->
> wk2 -> generic", so we can make EFL WK2 port completely independent.
>
> Cheers,
> _______________________________________________
> webkit-efl mailing list
> webkit-efl at lists.webkit.org
> https://lists.webkit.org/mailman/listinfo/webkit-efl



--
Kenneth Rohde Christiansen
Senior Engineer, WebKit, Qt, EFL
Phone  +45 4294 9458 / E-mail kenneth at webkit.org

﹆﹆﹆
_______________________________________________
webkit-efl mailing list
webkit-efl at lists.webkit.org
https://lists.webkit.org/mailman/listinfo/webkit-efl
 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.webkit.org/pipermail/webkit-efl/attachments/20130307/6c458b71/attachment-0001.html>