[Webkit-unassigned] [Bug 118294] New: Let EWS bots run only touched tests

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=118294

           Summary: Let EWS bots run only touched tests
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: ossy at webkit.org
                CC: jbadics at inf.u-szeged.hu
            Blocks: 117831,118293


Now only Apple Mac WK1, Apple Mac WK2 and Apple Windows EWS bots run layout tests. 
Other EWS bots  (GTK-WK1, GTK-WK2, EFL-WK1, EFL-WK2, Qt-WK1, Qt-WK2) don't run tests.
Running all tests on them isn't possible now because of some reason:
- it would extremely slow down patch the processing time
- we needed more and more hardware
- parallel test running is unstable/flakey on Qt (runtime is 25 mins on WK1, 35 mins on WK2)

The idea is that Apple Mac EWS bots could guarantee the general test coverage,
and we could run only touched tests on the other EWS bots to help rebasing
ahead of time. 

https://bugs.webkit.org/show_bug.cgi?id=118293 is going to add a new run-tests-touched-by-attachment
command for webkit-patch which download the given attachment from bugzilla, apply the patch,
build with the patch, determine which tests or expected files are touched by the attachment 
on any platform, run only these tests.

See the main bug for more information: https://bugs.webkit.org/show_bug.cgi?id=117831

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.