Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 951342 - sys-apps/portage: Distributed builds?
Summary: sys-apps/portage: Distributed builds?
Status: UNCONFIRMED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Enhancement/Feature Requests (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2025-03-14 14:00 UTC by Stuart Shelton
Modified: 2025-03-14 14:00 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Stuart Shelton 2025-03-14 14:00:38 UTC
So far as I'm aware, support for distributed builds in portage comes down to enabling `distcc` support - this this isn't entirely trivial and can have unexpected side-effects on non-identical host machines.

What might be a valuable half-way towards this level of parallelisation, especially with reasonably affordable SBC systems being available, would be for portage - when building binary packages - to only use a single host for any given package, but to distribute the build of dependencies across all available machines.

If the dependency graph was:

$ emerge --tree pkg-a
[ebuild  N     ] cat/pkg-a
[ebuild  N     ]  cat/pkg-b
[ebuild  N     ]  cat/pkg-c
[ebuild  N     ]  cat/pkg-d
[ebuild  N     ]   cat/pkg-e

… then in innovation, one host could build `pkg-e` and as soon as the binary-package is committed three hosts could build `pkg-b`, `pkg-c`, and `pkg-d` in parallel, and then finally one host builds `pkg-a` once everything else is complete.

Even better, this could potentially be managed entirely by binhost lock-files on a shared filesystem, removing the need for a network layer to be added - although the keyword/mask/USE flag state from the originating system would also likely have to be shared in order to reach a consistent state.