Parallelize builds across OS and architecture
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 48/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Quiet
- Tech stack
- github-actions
- Domain
- ci-cd
Research direction
Start by reading the comments on this issue for the full design, then inspect bakery-build-native.yml and bakery-build-pr.yml. Trace how builds currently cover OS and architecture combinations across the three product repositories; done means each combination runs as its own parallel job for version builds and pull requests.
Written by the indexing model from the issue text.
Description
Problem
One build-test job builds every OS and architecture for a version. As we add more operating systems, this job needs more disk space and more time.
Workbench hit this limit when we added Ubuntu 26.04. We increased the runner size as a temporary fix.
This problem will return. RHEL 10 support is planned for Workbench and other products. Each new OS adds more work to the same job.
- https://github.com/posit-dev/images-workbench/issues/175
- https://github.com/posit-dev/images-workbench/issues/176
- https://github.com/posit-dev/images-shared/issues/575
- https://github.com/posit-dev/images-shared/issues/698
Scope
This affects two shared workflows: bakery-build-native.yml and bakery-build-pr.yml. All three product repos use these workflows — images-connect, images-package-manager, and images-workbench — including every pull request build.
Goal
Run each OS and architecture combination as its own parallel job, instead of building all of them in one job per version.
See the comments below for the full design. Each comment covers one part.
- Dominant language
- Python
- Stars
- 2
- Forks
- 0
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 23
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from posit-dev/images-shared
-
Add max-parallel input to bakery-build-native.yml to cap matrix build concurrencyPossibly taken A pull request linked to this issue is open or already merged. Opencvp:0 docker tdp:1
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
posit-dev/images-shared#757 · 2 comments ·
Maintainers usually reply within 1 day
-
slack-build-notify: no persisted alert state — causes suppressed repeat-failure and recovery alertsOpenbug cicd cvp:0 docker needs discussion observability tdp:2
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
posit-dev/images-shared#677 ·
Maintainers usually reply within 1 day
-
cicd docker enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
posit-dev/images-shared#857 · 1 comment ·
Maintainers usually reply within 1 day
-
lualatex fails for non-root users: shared TinyTeX in `/opt/.TinyTeX` has no writable `TEXMFVAR`Opendocker
Difficulty 3/5 1-2 days Newbie friendliness 72/100
posit-dev/images-shared#855 ·
Maintainers usually reply within 1 day
-
Schedule a monthly cache-refresh rebuild so weekly builds pick up OS updatesPossibly taken A pull request linked to this issue is open or already merged. Opencicd docker security
Difficulty 4/5 3-5 days Newbie friendliness 42/100
posit-dev/images-shared#852 ·
Maintainers usually reply within 1 day
All issues in posit-dev/images-shared
Similar issues
-
Link Checker ReportOpenautomated issue linkchecker report
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
QuantEcon/lecture-python.myst#1098 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
podly-pure-podcasts/podly_pure_podcasts#279 ·
Maintainers usually reply within 1 day
-
template-proposal
Difficulty 1/5 Under an hour Newbie friendliness 78/100
-
Difficulty 1/5 Under an hour Newbie friendliness 82/100
OpenShot/openshot-qt#6230 ·
Maintainers usually reply within 1 day