You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Intermittent timeouts downlaoding and unpacking cache #1121
On pyca/cryptography we use actions/cache to cache approximately 200MB (compressed) of data. For an extended period of time (months) we've seen intermittent timeouts (2 minutes) while downloading unpacking the cache. 4 days ago we started to quantify this, in which time we've seen 15 of these failures: pyca/cryptography#8315 contains links to each of them.
These are primarily on Windows builders, with one of two of them being on macOS and Linux.
I do not know if this is best understood as an actions/cache issue, an issue with the server-side cache components, or with the runners themselves, but hopefully we've collected enough distinct logs of this issue to enable some debugging.
On Thu, Feb 23, 2023 at 2:13 AM Sankalp Kotewar ***@***.***> wrote:
Thanks @alex for bringing this up to us.
These are primarily on Windows builders
By this do you mean windows runners are facing this issue more than linux / macOS runners?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.Message ID: ***@***.***>
--
All that is necessary for evil to succeed is for good people to do nothing.
I see that you have set a timeout of 2 minutes for this action. Windows download & decompression is generally slower than others. Is it possible to increase the time out and try?
If you continue to face the issue, can you please enable debug logging and run these workflows?
2 minutes is already fairly high IMO -- it suggests processing of well under 5MB/s. Already the typical run finishes in under 30 seconds, meaning these timeouts are more than 4x slower. I'm concerned that simply raising the timeout will produce slower runs (possibly causing it to hit the overall timeout), but not help us to debug the underlying problem.
Is there a way to enable debug logging for in the workflow file for just this step? Re-running a job usually fixes it, so debugging only on the re-runs (via the re-run UI) won't help I don't think.
@pallavx I would second this issue being a thing. I'm seeing it maybe once a week as a user of actions/setup-go, which seems to use actions/cache. IMO 5 minutes, my current timeout configuration, is already a huge timeout limit when the total operations times on a successful run average ~50 seconds. More info below.
Example config:
name: Timeout Example
on: [push]
jobs:
build:
name: Build Go Stuff
runs-on: ubuntu-latest
timeout-minutes: 5
steps:
- uses: actions/checkout@v3
- uses: actions/setup-go@v4
with:
go-version-file: go.mod
... nominal go build step ...
Example (occasional) failure output:
Run actions/setup-go@v4
Setup go version spec 1.19
Found in cache @ /opt/hostedtoolcache/go/1.19.6/x64
Added go to the path
Successfully set up Go version 1.19
/opt/hostedtoolcache/go/1.19.6/x64/bin/go env GOMODCACHE
/opt/hostedtoolcache/go/1.19.6/x64/bin/go env GOCACHE
/home/runner/go/pkg/mod
/home/runner/.cache/go-build
Received 0 of 238574975 (0.0%), 0.0 MBs/sec
Received 0 of 238574975 (0.0%), 0.0 MBs/sec
Received 20971520 of 238574975 (8.8%), 6.7 MBs/sec
Received 41943040 of 238574975 (17.6%), 10.0 MBs/sec
Received 58720256 of 238574975 (24.6%), 11.2 MBs/sec
Received 75497472 of 238574975 (31.6%), 12.0 MBs/sec
Received 83886080 of 238574975 (35.2%), 11.4 MBs/sec
Received 104857600 of 238574975 (44.0%), 12.5 MBs/sec
Received 113246208 of 238574975 (47.5%), 12.0 MBs/sec
Received 130023424 of 238574975 (54.5%), 12.4 MBs/sec
Received 146800640 of 238574975 (61.5%), 12.7 MBs/sec
Received 150994944 of 238574975 (63.3%), 12.0 MBs/sec
Received 171966464 of 238574975 (72.1%), 12.6 MBs/sec
Received 176160768 of 238574975 (73.8%), 12.0 MBs/sec
Received 184549376 of 238574975 (77.4%), 11.7 MBs/sec
Received 205520896 of 238574975 (86.1%), 12.2 MBs/sec
Received 209715200 of 238574975 (87.9%), 11.8 MBs/sec
Received 225992063 of 238574975 (94.7%), 12.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 11.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 11.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 10.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 10.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 9.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 9.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 8.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 8.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 8.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 8.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 7.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 7.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 7.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 7.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 6.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 6.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 6.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 6.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 6.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 5.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 4.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 3.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 2.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.7 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.6 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.5 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.4 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.3 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.2 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.1 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 1.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.9 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Received 234380671 of 238574975 (98.2%), 0.8 MBs/sec
Error: The operation was canceled.
Example success output:
Run actions/setup-go@v4
Setup go version spec 1.19
Found in cache @ /opt/hostedtoolcache/go/1.19.6/x64
Added go to the path
Successfully set up Go version 1.19
/opt/hostedtoolcache/go/1.19.6/x64/bin/go env GOMODCACHE
/opt/hostedtoolcache/go/1.19.6/x64/bin/go env GOCACHE
/home/runner/go/pkg/mod
/home/runner/.cache/go-build
Received 0 of 238574975 (0.0%), 0.0 MBs/sec
Received 0 of 238574975 (0.0%), 0.0 MBs/sec
Received 8388608 of 238574975 (3.5%), 2.7 MBs/sec
Received 37748736 of 238574975 (15.8%), 9.0 MBs/sec
Received 67108864 of 238574975 (28.1%), 12.8 MBs/sec
Received 92274688 of 238574975 (38.7%), 14.7 MBs/sec
Received 121634816 of 238574975 (51.0%), 16.6 MBs/sec
Received 142606336 of 238574975 (59.8%), 17.0 MBs/sec
Received 167772160 of 238574975 (70.3%), 17.8 MBs/sec
Received 188743680 of 238574975 (79.1%), 18.0 MBs/sec
Received 201326592 of 238574975 (84.4%), 17.4 MBs/sec
Received 226492416 of 238574975 (94.9%), 18.0 MBs/sec
Received 234380671 of 238574975 (98.2%), 17.2 MBs/sec
Received 238574975 of 238574975 (100.0%), 17.2 MBs/sec
Cache Size: ~228 MB (238574975 B)
... nominal go build step output ...
On pyca/cryptography we use actions/cache to cache approximately 200MB
(compressed) of data. For an extended period of time (months) we've seen
intermittent timeouts (2 minutes) while downloading unpacking the cache. 4
days ago we started to quantify this, in which time we've seen 15 of these
failures: pyca/cryptography#8315
<pyca/cryptography#8315> contains links to each
of them.
These are primarily on Windows builders, with one of two of them being on
macOS and Linux.
I do not know if this is best understood as an actions/cache issue, an
issue with the server-side cache components, or with the runners
themselves, but hopefully we've collected enough distinct logs of this
issue to enable some debugging.
—
Reply to this email directly, view it on GitHub
<#1121>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AZUNEUIM6GZ7UPU7ANVLJJDWYVMB7ANCNFSM6AAAAAAVDVQF2E>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
I'm Adam, co-founder of BuildJet. Our customers often complain about reliability and speed issues like the one reported here. Today, we launched BuildJet Cache, a GitHub Cache alternative thats reliable, fast and free.
It’s fully compatible with GitHub’s Cache, all you need to do is replace action/cache with buildjet/cache. It works on any runner - be it official, self-hosted, or BuildJet. Whichever runner you choose, BuildJet Cache doubles your free storage, offering a generous 20 GB/repo/week storage space at no cost.
I am seeing a similar issue consistently in a private repo, only on windows and only if run with a non-standard larger runner. If run with the standard runner, this never occurs. It's especially odd in that looks like the full cache has been downloaded and the hang occurs after that:
Run actions/cache/restore@v4
with:
path: ./*
key: node-Windows-[2](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:2)0-cffdd87a2f9ae6a26eab7e55a5d6[3](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:3)f9597e85e1e
enableCrossOsArchive: false
fail-on-cache-miss: false
lookup-only: false
env:
HUSKY: 0
NPM_VERSION: 9
Cache Size: ~98 MB (1032[4](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:4)9742 B)
"C:\Program Files\Git\usr\bin\tar.exe" -xf C:/a/_temp/abcb62[5](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:5)8-5beb-4b65-b902-d4166e9d3f47/cache.tzst -P -C C:/a/node-mono/node-mono --force-local --use-compress-program "zstd -d"
Received 103249[7](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:7)42 of 103249742 (100.0%), [9](https://github.com/Contrast-Security-Inc/node-mono/actions/runs/10115254189/job/27975665889#step:6:9)7.3 MBs/sec
Error: The action 'Restore cache' has timed out after 2 minutes.
Activity
kotewar commentedon Feb 23, 2023
Thanks @alex for bringing this up to us.
By this do you mean windows runners are facing this issue more than linux / macOS runners?
alex commentedon Feb 23, 2023
arkq commentedon Feb 23, 2023
In the project-chip/connectedhomeip repo we also have a lots of timeouts when downloading cache. I'm not sure whether that's the same issues, though. See this for example:
https://github.com/project-chip/connectedhomeip/actions/runs/4249449305/jobs/7389614754
https://github.com/project-chip/connectedhomeip/actions/runs/4249449313/jobs/7389614432
pallavx commentedon Feb 24, 2023
Hi @alex,
I see that you have set a timeout of 2 minutes for this action. Windows download & decompression is generally slower than others. Is it possible to increase the time out and try?
If you continue to face the issue, can you please enable debug logging and run these workflows?
alex commentedon Feb 24, 2023
2 minutes is already fairly high IMO -- it suggests processing of well under 5MB/s. Already the typical run finishes in under 30 seconds, meaning these timeouts are more than 4x slower. I'm concerned that simply raising the timeout will produce slower runs (possibly causing it to hit the overall timeout), but not help us to debug the underlying problem.
Is there a way to enable debug logging for in the workflow file for just this step? Re-running a job usually fixes it, so debugging only on the re-runs (via the re-run UI) won't help I don't think.
iamnande commentedon Apr 18, 2023
@pallavx I would second this issue being a thing. I'm seeing it maybe once a week as a user of
actions/setup-go, which seems to useactions/cache. IMO 5 minutes, my current timeout configuration, is already a huge timeout limit when the total operations times on a successful run average ~50 seconds. More info below.Example config:
Example (occasional) failure output:
Example success output:
Aiasp1985P commentedon Apr 19, 2023
thinkafterbefore commentedon May 25, 2023
Hey everyone,
I'm Adam, co-founder of BuildJet. Our customers often complain about reliability and speed issues like the one reported here. Today, we launched BuildJet Cache, a GitHub Cache alternative thats reliable, fast and free.
It’s fully compatible with GitHub’s Cache, all you need to do is replace
action/cachewithbuildjet/cache. It works on any runner - be it official, self-hosted, or BuildJet. Whichever runner you choose, BuildJet Cache doubles your free storage, offering a generous 20 GB/repo/week storage space at no cost.Head over to our launch post for more details: https://buildjet.com/for-github-actions/blog/launch-buildjet-cache
github-actions commentedon Dec 12, 2023
This issue is stale because it has been open for 200 days with no activity. Leave a comment to avoid closing this issue in 5 days.
github-actions commentedon Dec 18, 2023
This issue was closed because it has been inactive for 5 days since being marked as stale.
bmacnaughton commentedon Jul 26, 2024
I am seeing a similar issue consistently in a private repo, only on windows and only if run with a non-standard larger runner. If run with the standard runner, this never occurs. It's especially odd in that looks like the full cache has been downloaded and the hang occurs after that: