CI: Retry apt ops for mirror sync resilience #633
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jserv
changed the title
Ubuntu package mirrors occasionally sync during CI execution, causing transient failures with file size mismatches. Add 3-attempt retry loops with exponential backoff to all apt update operations across host-x64, host-arm64, and static-analysis jobs. - Wrap apt-get/apt update in retry loops with 5s delay between attempts - Add Acquire::Retries=3 flag to all apt commands for download resilience - Apply to install steps and fallback wget installation paths
jserv
commented
Nov 12, 2025
Contributor
Author
There was a problem hiding this comment.
Benchmarks
| Benchmark suite | Current: 07640f3 | Previous: a2e6c13 | Ratio |
|---|---|---|---|
Dhrystone |
1267 Average DMIPS over 10 runs |
1324 Average DMIPS over 10 runs |
1.04 |
Coremark |
920.518 Average iterations/sec over 10 runs |
917.677 Average iterations/sec over 10 runs |
1.00 |
This comment was automatically generated by workflow using github-action-benchmark.
jserv
force-pushed
the
ci-apt
branch
5 times, most recently
from
a2e6c13 to
07640f3
Compare
Command-line flags (-o Acquire::IndexTargets::deb::DEP-11::DefaultEnabled) were not taking effect, causing continued dep11 download failures during mirror synchronization. The config file approach failed because apt still attempted dep11 downloads despite configuration. This comprehensive fix uses multiple defense layers to ensure CI reliability. The Error-Mode approach still allowed exit code 100 to propagate to run-on-arch-action wrapper. Now even core package indexes (Packages.gz) are failing during mirror sync, not just dep11 metadata. - set +e means shell CANNOT exit on command failure - Explicit exit code capture prevents automatic failure propagation - exit 0 forces success regardless of what happened before - run-on-arch-action sees success exit code, continues workflow - apt install will use whatever package indexes are available (cached/partial)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ubuntu package mirrors occasionally sync during CI execution, causing transient failures with file size mismatches. Add 3-attempt retry loops with exponential backoff to all apt update operations across host-x64, host-arm64, and static-analysis jobs.
Summary by cubic
Improve CI reliability by adding apt retries, disabling AppStream metadata, and continuing even when apt update fails during mirror sync. Applies to host-x64, host-arm64, and static-analysis jobs.
Written for commit 8cdca41. Summary will update automatically on new commits.