[Webkit-unassigned] [Bug 58554] New: All slaves for a particular builder should be identical (or at least have the same software installed)

[bugzilla-daemon at webkit.org]

https://bugs.webkit.org/show_bug.cgi?id=58554

           Summary: All slaves for a particular builder should be
                    identical (or at least have the same software
                    installed)
           Product: WebKit
           Version: 528+ (Nightly build)
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: Normal
          Priority: P2
         Component: Tools / Tests
        AssignedTo: webkit-unassigned at lists.webkit.org
        ReportedBy: aroben at apple.com
                CC: sfalken at apple.com, lforschler at apple.com


All slaves for a particular builder should be identical, or at least have the same software installed. Without this, tests might fail on one slave and not another, which falsely makes the test look flaky.

For example, in bug 58545, a test always fails on apple-windows-13 but not on the other two slaves that are part of the Windows XP Debug (Tests) builder. This makes it look like the test is flaky, when in fact it always fails when run with Python 2.5 (which apple-windows-13 has but the other two slaves do not).

I think it would be great to have all slaves on a particular builder use the same VM image or something. And somehow we'd want to apply software updates to them all at the same time, etc. (Ideally they'd have the same hardware, too, but that is less often an issue.)

-- 
Configure bugmail: https://bugs.webkit.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.