[Webkit-unassigned] [Bug 90191] New: rebaselining requires a bot for each platform directory under LayoutTests

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=90191

           Summary: rebaselining requires a bot for each platform
                    directory under LayoutTests
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: Unspecified
        OS/Version: Unspecified
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: ojan at chromium.org
                CC: tony at chromium.org, abarth at webkit.org,
                    simon.fraser at apple.com, ossy at webkit.org,
                    dglazkov at chromium.org


Once 90186 is resolved, rebaseline-test, rebaseline-expectations and the rebaseline button in garden-o-matic will all work like the following:
1. Grab the results from each bot and put it in the most specific platform directory.
2. Merge results that are equal into the parent's (in fallback order) directory.

This means that if a port does not have a bot that runs the test for each platform directory, then the merging is extremely sub-optimal (leaves copies of the file in platform directories where they could be merged and put next to the file or in the platform/mac directory).

At a quick glance, Chromium, EFL and GTK have bots for all their platform directories. Apple and Qt do not.

What's the best way to address this? We could have the Apple/Qt bots put the results in a less specific directory, but that would mean that rebaseline would do the wrong thing in some cases (e.g. where Apple's SnowLeopard and Lion ports give different results).

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.