[webkit-changes] [WebKit/WebKit] 75a3eb: [GTK][WPE] Address bots for TestWebsiteData/cache ...
Amanda Falke
noreply at github.com
Thu Aug 10 16:13:55 PDT 2023
Branch: refs/heads/main
Home: https://github.com/WebKit/WebKit
Commit: 75a3eb3a5fe3dce1867d880faf785137963b234a
https://github.com/WebKit/WebKit/commit/75a3eb3a5fe3dce1867d880faf785137963b234a
Author: Amanda Falke <afalke at igalia.com>
Date: 2023-08-10 (Thu, 10 Aug 2023)
Changed paths:
M Tools/TestWebKitAPI/Tests/WebKitGLib/TestWebsiteData.cpp
M Tools/TestWebKitAPI/glib/TestExpectations.json
Log Message:
-----------
[GTK][WPE] Address bots for TestWebsiteData/cache flakiness
https://bugs.webkit.org/show_bug.cgi?id=259991
Reviewed by Michael Catanzaro.
This is a test that succeeds locally but fails intermittently in bots per
history below, and in `wk-bot-digest` over time.
In 2018 in `webkit.org/b/188113`, we determined that this test was flaky
in GTK, and in 2019 in that bug we also thought possibly that the 1-second wait
was not long enough in this test, and perhaps we should increase the wait
to 2s. In 2022, we determined in that bug that test had been consistently
passing in GTK/WPE for a long time "Sometimes fails consistently, but due
to regressions." We then removed the `"all"` pass/fail flakes in that commit
`246255 at main` in January 2022. Since that time the bots tend to look like
this, despite succeeding locally for GTK|WPE:
```
/path/to/wk-bot-digest-results/last-3000 $ ag /webkit/WebKitWebsiteData/cache | sort | grep PASS | wc -l
2066
/path/to/wk-bot-digest-results/last-3000 $ ag /webkit/WebKitWebsiteData/cache | sort | grep FAIL | wc -l
75
```
In March 2022 a few months ago we re-added the failing/flaky expectation
for GTK in `webkit.org/b/254002`, so this test's failing/flaky expectations
have been continually added and removed over time.
Per comment in b/188113, adding a slightly higher wait for bots.
Removing failing expectations.
* Tools/TestWebKitAPI/Tests/WebKitGLib/TestWebsiteData.cpp:
(testWebsiteDataCache):
* Tools/TestWebKitAPI/glib/TestExpectations.json:
Canonical link: https://commits.webkit.org/266790@main
More information about the webkit-changes
mailing list