Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 947930 - www-client/chromium-132.0.6834.83 build.log grows to 22GB (or infinity)
Summary: www-client/chromium-132.0.6834.83 build.log grows to 22GB (or infinity)
Status: RESOLVED WORKSFORME
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Chromium Project
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2025-01-12 02:39 UTC by Jan Psota
Modified: 2025-02-24 22:16 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build.log - last 1000 lines (screen hardcopy) (build.log,60.90 KB, text/plain)
2025-01-12 13:06 UTC, Jan Psota
Details
first 1024 lines (build.log,673.79 KB, text/plain)
2025-01-14 23:01 UTC, Jan Psota
Details
first 1024 lines of build.log without ncurses colors (build.log.txt,665.51 KB, text/plain)
2025-01-14 23:03 UTC, Jan Psota
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jan Psota 2025-01-12 02:39:30 UTC
On my system with 32GB for /var/tmp/portage chromium refused to build after build.log have grown to 22GB and caused disk space outage. An option to make build.log a FIFO of some maximal length (in MB) would resolve this problem (to set in make.conf)
Comment 1 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-12 09:15:40 UTC
I'm suspicious of the claim that the build.log *itself* was that large, but even then, we certainly don't want to be truncating it or anything like that as it would make bug reports very challenging.

If it *is* that large, that implies something is going wrong with e.g. tonnes of warnings or similar that we should look at suppressing.

Seeing a sample of it would help.
Comment 2 Jan Psota 2025-01-12 13:06:23 UTC
Created attachment 916384 [details]
build.log - last 1000 lines (screen hardcopy)
Comment 3 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-12 13:14:13 UTC
emerge --info too please?
Comment 4 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-12 13:15:41 UTC
Are you doing something like passing flags to enable extra warnings?
Comment 5 Jan Psota 2025-01-12 13:23:22 UTC
> Are you doing something like passing flags to enable extra warnings?

No. But I've just realized, what I was doing wrong: I switched to clang and chromium does not like it... Changed to gcc in package.env and will let you know.
Comment 6 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-12 13:25:13 UTC
The ebuild forces using Clang these days (transparently) because can't be built with GCC, but it's possible there was some error in how you were trying to make it use Clang, maybe?
Comment 7 Jan Psota 2025-01-12 18:39:52 UTC
13% lines of build log is:
warning: this style of line directive is a GNU extension [-Wgnu-line-marker]
Comment 8 Jan Psota 2025-01-12 18:44:51 UTC
And the rest looks like:

   18 | # 1 "../../v8/include/v8-context.h" 1
      |     ^
In file included from ../../v8/src/maglev/maglev-regalloc.cc:5:
In file included from ../../v8/src/maglev/maglev-regalloc.h:9:
In file included from ../../v8/src/compiler/backend/instruction.h:19:
In file included from ../../v8/src/compiler/common-operator.h:14:
In file included from ../../v8/src/compiler/feedback-source.h:8:
In file included from ../../v8/src/compiler/heap-refs.h:11:
In file included from ../../v8/src/ic/call-optimization.h:10:
In file included from ../../v8/src/api/api-arguments.h:9:
In file included from ../../v8/src/builtins/builtins-utils.h:10:
In file included from ../../v8/src/execution/arguments.h:10:
In file included from ../../v8/src/logging/runtime-call-stats-scope.h:10:
In file included from ../../v8/src/execution/isolate.h:18:
../../v8/include/v8-context.h:1:6: warning: this style of line directive is a GNU extension [-Wgnu-line-marker]
Comment 9 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-14 04:31:11 UTC
Can you show me the first 1000 lines or so of the build.log? I still don't get where that's coming from.
Comment 10 Jan Psota 2025-01-14 23:00:38 UTC
(In reply to Sam James from comment #9)
> Can you show me the first 1000 lines or so of the build.log? I still don't
> get where that's coming from.

Changes in make.conf for clang:
CC=clang
CXX=clang++
AR=llvm-ar
NM=llvm-nm
RANLIB=llvm-ranlib
LDFLAGS="-Wl,-O1 -Wl,--as-needed -fuse-ld=lld"
# ^^^ chromium did not link with mold

I use distcc and ccache.

USE="X cups custom-cflags gtk4 hangouts proprietary-codecs pulseaudio screencast system-harfbuzz system-zstd vaapi wayland widevine"

build.log - I will attach 1024 lines to make it easier :-D
Comment 11 Jan Psota 2025-01-14 23:01:51 UTC
Created attachment 916551 [details]
first 1024 lines
Comment 12 Jan Psota 2025-01-14 23:03:17 UTC
Created attachment 916552 [details]
first 1024 lines of build.log without ncurses colors
Comment 13 Matt Jolly gentoo-dev 2025-01-15 08:25:56 UTC
Well that _is_ odd.

As Sam mentioned, the Chromium ebuild forces Clang 19 at the moment. It _should_ work with CC=clang though, we don't do anything fancy, just set CC and friends to variations on `CC="${CHOST}-clang-${LLVM_SLOT}"`

I build on a 32G ramdisk and haven't hit this issue (yet), but I'll keep an eye out.

You don't have `-pedantic` in CFLAGS or something?
Comment 14 Jan Psota 2025-01-15 19:08:47 UTC
> You don't have `-pedantic` in CFLAGS or something?
Quite the opposite... :-D -fpermissive sometimes, but in make.conf
only "-pipe -O2 -march=nocona" (no SIGILL on AMD nor Intel ;-))
Comment 15 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-15 19:14:37 UTC
Can we see both emerge --info and the environment file for chromium (it's in temp/ in the builddir)?
Comment 16 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2025-01-15 19:16:06 UTC
I think it might be being caused by distcc.
Comment 17 Jan Psota 2025-01-15 20:03:52 UTC
> I think it might be being caused by distcc.
I underestimated you :-D It is! No distcc -- no warnings :-D
Comment 18 Morton Pellung 2025-01-19 18:25:05 UTC
I have the same problem, building chromium with distcc floods build.log with warnings and disk runs out of space.

Although "don't use distcc, works for me" is for many a solution, I have an old laptop where chromium build takes over a full day without distcc.

chromium 131 worked fine, 132 no longer works
Any hint how to suppress this log spam appreciated... what changed?

Thank you!
Comment 19 Jan Psota 2025-01-19 18:54:26 UTC
> Although "don't use distcc, works for me" is for many a solution [...]
Sorry. I found no good reason, and "worksforme" just sounds funny.
Who thinks it is a distcc problem?
Comment 20 Morton Pellung 2025-01-22 20:02:15 UTC
[many, many hours later]

Chromium 132 takes ~16.5G /var/tmp/portage space to build normally.

However, it takes ~54.5G to build with distcc (a 2 workers on LAN), of which just build.log takes up ~37G and has ~433 millions lines of text. Also, at the end between "Final size" and "QA Notice" something takes a VERY long time with one core maxed, unfortunately losing a lot of time gained by distcc compilation.

As Sam suggested, I compared "environment" with and without distcc - no noteworthy difference. I also tried to compare compile calls itself, I see no difference or -pendantic flag either.

No idea why distcc builds blow up like that :-/
Comment 21 Jörn Valentin 2025-01-27 09:19:00 UTC
Last build took >40GB build.log and does'nt finish due to out of space.

most log lines are from -Wgnu-line-marker warnings, so I added an env file for www-client/chromium in /etc/portage/package.env 

in that environment are additional CFLAGS and CXXFLAGS:

 -Wno-gnu-line-marker 

this lets it build using distcc again without that huge build.log
Comment 22 Jan Psota 2025-01-27 10:47:54 UTC
>  -Wno-gnu-line-marker 
Great job!
Comment 23 Morton Pellung 2025-02-07 21:05:43 UTC
>  -Wno-gnu-line-marker

Thank you for your detective work!

Unfortunately, I cannot retest with 133 due to https://bugs.gentoo.org/948384
... :-/
Comment 24 Morton Pellung 2025-02-16 20:59:52 UTC
Tried 133.xxx.98

With a distcc build /tmp goes to ~78G, of which ~65G is solely build.log. And it hangs for a VERY long time at the end for some reason.

1) I have not figured out how to do the package.env workaround, yet.
2) Or better fix this in chromium.ebuild directly?
3) Maybe try distcc 3.4-r6 unstable instead of current 3.4-r4 stable?
Comment 25 Jan Psota 2025-02-17 01:51:27 UTC
> 1) I have not figured out how to do the package.env workaround, yet.
Jörn Valentin described it in comment 21.

Create a file /etc/portage/env/nognu (for example) with:
CFLAGS="$CFLAGS -Wno-gnu-line-marker"
CXXFLAGS="$CXXFLAGS -Wno-gnu-line-marker"

and add:
www-client/chromium nognu
to your package.env

> 3) Maybe try distcc 3.4-r6 unstable instead of current 3.4-r4 stable?
I use newest - no difference.
Comment 26 Morton Pellung 2025-02-24 22:16:16 UTC
Thank you Jan for the idiot(=me)-proof description.

I can report I was able to build chromium 133.xx.126 with distcc, sane build time and tmp space size again.