[webkit-reviews] review requested: [Bug 196004] [ews-build] Retry API test in case of failures : [Attachment 365345] WIP

[bugzilla-daemon at webkit.org]

Aakash Jain <aakash_jain at apple.com> has asked  for review:
Bug 196004: [ews-build] Retry API test in case of failures
https://bugs.webkit.org/show_bug.cgi?id=196004

Attachment 365345: WIP

https://bugs.webkit.org/attachment.cgi?id=365345&action=review




--- Comment #1 from Aakash Jain <aakash_jain at apple.com> ---
Created attachment 365345

  --> https://bugs.webkit.org/attachment.cgi?id=365345&action=review

WIP

Sample runs:

Handling pre-existing failure in trunk: 
https://ews-build.webkit-uat.org/#/builders/19/builds/2259
https://ews-build.webkit-uat.org/#/builders/19/builds/2253

Handling pre-existing failure in trunk as well as flaky tests:
https://ews-build.webkit-uat.org/#/builders/19/builds/2256
https://ews-build.webkit-uat.org/#/builders/19/builds/2242

Flaky failure in first run with no failures in second run:
https://ews-build.webkit-uat.org/#/builders/20/builds/2040
https://ews-build.webkit-uat.org/#/builders/20/builds/2039

No failures: 
https://ews-build.webkit-uat.org/#/builders/20/builds/2045
https://ews-build.webkit-uat.org/#/builders/20/builds/2041