Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 737098 - It would be useful that portage to skip parallel build on some big packages when --jobs greater than one is used
Summary: It would be useful that portage to skip parallel build on some big packages w...
Status: UNCONFIRMED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Enhancement/Feature Requests (show other bugs)
Hardware: All Linux
: Normal normal with 1 vote (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
: 822846 (view as bug list)
Depends on:
Blocks: 184128
  Show dependency tree
 
Reported: 2020-08-14 09:02 UTC by Cănărău Constantin
Modified: 2022-12-06 22:55 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Cănărău Constantin 2020-08-14 09:02:07 UTC
It would be useful if emerge will automatically build some big packages alone.
For example, firefox and thunderbird are released simultaneous and emerge try to compile them in paralel, as requested by jobs option. With lto this put stress on system, possible out of memory scenario.
I think about an option/variable in ebuild like BIG_COMPILE=true and, for those packages, the build process to be forced to --jobs=1.

Thank you!

Reproducible: Always



Expected Results:  
When, for example, firefox/thunderbird/libreoffice/gcc/llvm/clang/samba/openjdk/openjfx/etc is already started to emerge, no others package are allowed to start to build.
Comment 1 Zac Medico gentoo-dev 2020-08-14 17:54:16 UTC
The best solution that is currently available is to use --load-average LOAD in MAKEOPTS and also in EMERGE_DEFAULT_OPTS, in order to prevent overloading.
Comment 2 Cănărău Constantin 2020-08-14 20:30:23 UTC
(In reply to Zac Medico from comment #1)
> The best solution that is currently available is to use --load-average LOAD
> in MAKEOPTS and also in EMERGE_DEFAULT_OPTS, in order to prevent overloading.

Yes, but unfortunately, --load-average is futile when two big -flto=8 start to optimize and link.
For a very long time now, I was using --ask or --pretend and emerge them separately, manually, when necessary. So a working solution exists. 
All I say, it would be nice some auto-mode regarding this issue, but only if the work involved is reasonable and helps more users, obviously.
Comment 3 Pacho Ramos gentoo-dev 2020-08-15 09:47:37 UTC
(In reply to Zac Medico from comment #1)
> The best solution that is currently available is to use --load-average LOAD
> in MAKEOPTS and also in EMERGE_DEFAULT_OPTS, in order to prevent overloading.

I have seen that man page suggests some values for MAKEOPTS but not for --load-average... maybe some suggestions could be suggested there too and, that way, more people would try to use it. For now I have seen https://wiki.gentoo.org/wiki/EMERGE_DEFAULT_OPTS#Parallel_builds
Comment 4 Zac Medico gentoo-dev 2021-11-10 22:59:44 UTC
*** Bug 822846 has been marked as a duplicate of this bug. ***