Add support for cache evicition retries with fixed invocation ID

Failed in 29m 28s
:pipeline:
:fedora: Fedora 39 (OpenJDK 17, gcc 13.1.1)
Clang on :ubuntu: Ubuntu 20.04 LTS
Windows (arm64) on :windows: Windows
RBE on :ubuntu: Ubuntu 20.04 LTS
Docs on :ubuntu: Ubuntu 20.04 LTS

This run only contains test targets that have been changed since e7ede429848744b5c3799ce748e4a0d3e34f5e59 due to the USE_BAZEL_DIFF env variable

2/4
:centos: CentOS 7 (shard 2)curl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739877242 -o bazelci.py && python3.6 bazelci.py runner --task=centos7 --file_config=.bazelci/presubmit.yml
Waited 4s
·
Ran in 16m 54s
2/4
:ubuntu: Ubuntu 22.04 LTS (shard 2)curl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739877242 -o bazelci.py && python3 bazelci.py runner --task=ubuntu2204 --file_config=.bazelci/presubmit.yml
Waited 7s
·
Ran in 16m 25s
2/4
:ubuntu: Ubuntu 20.04 LTS (shard 2)curl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739877242 -o bazelci.py && python3.8 bazelci.py runner --task=ubuntu2004 --file_config=.bazelci/presubmit.yml
Waited 5s
·
Ran in 17m 14s
9/10
:mac: macOS arm64 (shard 9)curl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739877242 -o bazelci.py && python3 bazelci.py runner --task=macos_arm64 --file_config=.bazelci/presubmit.yml
Waited 6s
·
Ran in 15m 15s
RBE on :ubuntu: Ubuntu 20.04 LTScurl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739877242 -o bazelci.py && python3.8 bazelci.py runner --task=rbe_ubuntu2004 --file_config=.bazelci/presubmit.yml
Waited 9s
·
Ran in 11m 13s
Total Job Run Time: 11h 18m