Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 811063 - media-gfx/blender-2.93.2 failing on volume.cpp.o and openvdb_level_set.cc.o
Summary: media-gfx/blender-2.93.2 failing on volume.cpp.o and openvdb_level_set.cc.o
Status: RESOLVED INVALID
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: Normal normal
Assignee: Gentoo Linux bug wranglers
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2021-08-30 00:39 UTC by Austin Kilgore
Modified: 2021-09-02 18:56 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build logs (blender-build-logs.zip,129.44 KB, application/zip)
2021-08-30 00:40 UTC, Austin Kilgore
Details
build.log (blender-2.93.2-build.zip,65.59 KB, application/zip)
2021-09-01 12:48 UTC, Austin Kilgore
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Austin Kilgore 2021-08-30 00:39:30 UTC
I have been experiencing multiple issues with getting both opencl and cuda support fully setup on my new laptop that has both an amdgpu and nvidia graphics card.

So far most stuff requiring either opencl or cuda has failed in some way or another. I can't find a root cause, I've used gentoo for nearly a year now and to my knowledge my process ha always worked so these conflicts and fails and really odd.

First emerge of blender was with cycles,cuda,opencl,osl,openvdb
Second was without cycles,cuda,opencl,osl
Third was without cycles,cuda,opencl,osl,openvdb

And I gave up after that because I figured the issue had to be deeper than just the flags.

Reproducible: Always

Steps to Reproduce:
emerge blender
Actual Results:  
failed 3 times on me with fewer and fewer flags each time I tried.

Expected Results:  
shouldn't be failing like this

Portage 3.0.22 (python 3.9.6-final-0, default/linux/amd64/17.1/no-multilib, gcc-11.2.0, glibc-2.33-r7, 5.13.13-gentoo-dist x86_64)
=================================================================
System uname: Linux-5.13.13-gentoo-dist-x86_64-AMD_Ryzen_9_5900HS_with_Radeon_Graphics-with-glibc2.33
KiB Mem:    15778264 total,  10644092 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Sun, 29 Aug 2021 20:21:22 +0000
Head commit of repository gentoo: a3e895448e101efdb10cddeda369dbf2faebdbee

sh bash 5.1_p8
ld GNU ld (Gentoo 2.37_p1 p0) 2.37
app-shells/bash:          5.1_p8::gentoo
dev-lang/perl:            5.34.0-r2::gentoo
dev-lang/python:          2.7.18_p11::gentoo, 3.9.6_p1::gentoo, 3.10.0_rc1_p1::gentoo
dev-lang/rust:            1.54.0::gentoo
dev-util/cmake:           3.21.2::gentoo
sys-apps/baselayout:      2.7-r3::gentoo
sys-apps/openrc:          0.43.5::gentoo
sys-apps/sandbox:         2.24::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.71-r1::gentoo
sys-devel/automake:       1.16.4::gentoo
sys-devel/binutils:       2.37_p1::gentoo
sys-devel/gcc:            11.2.0::gentoo
sys-devel/gcc-config:     2.4::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.13::gentoo (virtual/os-headers)
sys-libs/glibc:           2.33-r7::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoo
    priority: -1000
    sync-git-verify-commit-signature: true

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=native -O3 -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-march=native -O3 -pipe"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS=" --with-bdeps y --complete-graph y"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-march=native -O3 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs candy config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-march=native -O3 -pipe"
GENTOO_MIRRORS="https://gentoo.osuosl.org/"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j16"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="10bit 12bit 24-bit-color 24bpp 256-color 7z 7za 7zip 8bit X a52 aac aacplus aacs acl acpi activities airdrop-ng airgraph-ng airplay airspy alsa alsa-plugin amd64 androiddump aptx archive asm aspell async async-connect asyncns atm audio backend-X backend-fbcon backend-gtk3 backend-sdl bash bash-completion bdplus bluetooth bluetooth-sound bluez bluray bmp boot branding brightness-control brotli browser browser-integration bzip2 cairo ccdda cdaudio cdda cddb cdio cdr cdrom cjk cli color-management color-output colord colordiff compression crypt css cuda cudnn cue cups curl cursor cursors dav1d dbus dds declarative display-manager dmenu dri dri3 drm dts dvb dvd dvda dvdarchive dvdr elogind emboss encode eselect evdev exif faudio ffmpegsource ffmpegthumbnailer flac fluidsynth fontconfig fontforge fonts fortran freetype frei0r gdbm gif git github gles2 gles3 glide gold gpm gtk gui haptic hires iconv icu ipv6 jpeg kde kipi kwallet ladspa lame lcms libglvnd libnotify libtirpc lm-sensors lto lz4 lzma lzo macosx-notifications mad mng mp3 mp4 mpd mpeg mpg123 ncurses networkmanager nls nptl nvdec nvenc nvidia nvme ogg openal opencl opencv opengl openh264 openimageio openmp pam pango parallel-compiler passthrough pci pcre pda pdf pgo phonon plasma plugins png policykit ppds progress-meter pthread pthreaded-ubik pulseaudio qemu qml qt5 readline sdl seccomp semantic-desktop spell spice split-usr ssl startup-notification svg tcpd threads tiff truetype udev udisks unicode unzip upower usb usbredir v4l v4l2 v4lutils vaapi vainfo vbox vboxwebsrv vbr vdpau vector-icons vhost-net vhost-user-fs video video-glide64mk2 video-rice video-thumbnails vim vim-syntax virgl virt-network virtfs virtual-io virtualbox virtualkeyboard visualizer vkd3d vlc vmware vnc vocoder voice vorbis vulkan vulkan-overlay wallpaper wallpapers wav wavpack wayland wayland-compositor webp widgets wifi wiimote wireless wireshark-plugins wxwidgets x11-backend x11vnc x264 x265 xattr xcb xcomposite xdg xen xml xrandr xrender xspice xv xvid xwayland zfs zink zip zip-encryption zlib zsh-completion zstd" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="AMDGPU NVPTX X86" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-3 php7-4" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9" QEMU_SOFTMMU_TARGETS="arm x86_64 i386 aarch64" QEMU_USER_TARGETS="x86_64" RUBY_TARGETS="ruby26" USERLAND="GNU" VIDEO_CARDS="amdgpu radeonsi radeon nvidia qxl virgl virtualbox vmware" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RUSTFLAGS
Comment 1 Austin Kilgore 2021-08-30 00:40:40 UTC
Created attachment 736747 [details]
build logs
Comment 2 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2021-08-30 00:44:26 UTC
Your first log at least has you running out of RAM:

{standard input}: Assembler messages:
{standard input}:366893: Warning: end of file not at end of a line; newline inserted
{standard input}:367728: Error: expected comma after name `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size directive
x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program cc1plus
compilation terminated.

Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.
Comment 3 Austin Kilgore 2021-08-30 03:00:49 UTC
(In reply to Sam James from comment #2)
> Your first log at least has you running out of RAM:
> 
> {standard input}: Assembler messages:
> {standard input}:366893: Warning: end of file not at end of a line; newline
> inserted
> {standard input}:367728: Error: expected comma after name
> `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS
> 1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4
> EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_
> 10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size
> directive
> x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program
> cc1plus
> compilation terminated.
> 
> Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.

So with cycles,cuda,opencl,osl,openvdb use flags restricted it does build at -j14 but I can't test with the flags because opensubdiv is preventing me from emerging updates and rebuilds, if I exclude it I get a slot conflict on yaml-cpp...

I feel like these errors are all related to one another.
Comment 4 Austin Kilgore 2021-08-30 03:03:52 UTC
Here's the primary issue that I believe is causing Blender to not work later down the chain: https://bugs.gentoo.org/811054
Comment 5 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2021-08-30 03:04:51 UTC
(In reply to Austin Kilgore from comment #3)
> (In reply to Sam James from comment #2)
> > Your first log at least has you running out of RAM:
> > 
> > {standard input}: Assembler messages:
> > {standard input}:366893: Warning: end of file not at end of a line; newline
> > inserted
> > {standard input}:367728: Error: expected comma after name
> > `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS
> > 1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4
> > EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_
> > 10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size
> > directive
> > x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program
> > cc1plus
> > compilation terminated.
> > 
> > Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.
> 
> So with cycles,cuda,opencl,osl,openvdb use flags restricted it does build at
> -j14 but I can't test with the flags because opensubdiv is preventing me
> from emerging updates and rebuilds, if I exclude it I get a slot conflict on
> yaml-cpp...
> 
> I feel like these errors are all related to one another.

Note that _in general_, it's pretty risky to build with anything more than -j8 given compiling C++ can take up to 2GB per job.

I've checked the other build logs you attached to this and it's the same issue there.

I'd need to see the slot conflict to help you there, but everything so far in this bug is running out of RAM.

(Another note: usually, turning off lots of USE flags/deviating from the defaults isn't more likely to make things build, because it's going to be less tested. Still valid bugs, of course.)
Comment 6 Austin Kilgore 2021-09-01 12:48:48 UTC
Created attachment 737053 [details]
build.log
Comment 7 Austin Kilgore 2021-09-01 12:49:22 UTC
Updated the build.log now that the other package problems have been resolved.
Comment 8 Austin Kilgore 2021-09-02 14:37:56 UTC
I'm seeing two potential errors causing this to fail.

[31mFAILED: [0mintern/cycles/render/CMakeFiles/cycles_render.dir/volume.cpp.o 

and

[31mFAILED: [0mintern/openvdb/CMakeFiles/bf_intern_openvdb.dir/intern/openvdb_level_set.cc.o
Comment 9 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2021-09-02 17:02:20 UTC
(In reply to Sam James from comment #2)
> Your first log at least has you running out of RAM:
> 
> {standard input}: Assembler messages:
> {standard input}:366893: Warning: end of file not at end of a line; newline
> inserted
> {standard input}:367728: Error: expected comma after name
> `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS
> 1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4
> EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_
> 10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size
> directive
> x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program
> cc1plus
> compilation terminated.
> 
> Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.

If it fails with reduced MAKEOPTS, then please try compiling with -O2 (and disabling LTO if you have it). You may need to compile dependencies with it too.
Comment 10 Austin Kilgore 2021-09-02 18:25:24 UTC
(In reply to Sam James from comment #9)
> (In reply to Sam James from comment #2)
> > Your first log at least has you running out of RAM:
> > 
> > {standard input}: Assembler messages:
> > {standard input}:366893: Warning: end of file not at end of a line; newline
> > inserted
> > {standard input}:367728: Error: expected comma after name
> > `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS
> > 1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4
> > EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_
> > 10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size
> > directive
> > x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program
> > cc1plus
> > compilation terminated.
> > 
> > Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.
> 
> If it fails with reduced MAKEOPTS, then please try compiling with -O2 (and
> disabling LTO if you have it). You may need to compile dependencies with it
> too.

So I watched it closely but it never ran out of memory. Plus I have zram setup so even if it did it should fall back to that.

But just to be thorough I built it at -j8 and that actually worked. But I don't understand why.

Is there something fundamental I keep missing when I read through my build.logs? I never can find useful information for some reason.
Comment 11 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2021-09-02 18:56:33 UTC
(In reply to Austin Kilgore from comment #10)
> (In reply to Sam James from comment #9)
> > (In reply to Sam James from comment #2)
> > > Your first log at least has you running out of RAM:
> > > 
> > > {standard input}: Assembler messages:
> > > {standard input}:366893: Warning: end of file not at end of a line; newline
> > > inserted
> > > {standard input}:367728: Error: expected comma after name
> > > `_ZN7openvdb4v8_04tree12IterListItemINS2_INS1_16LeafIteratorBaseINS1_4TreeINS
> > > 1_8RootNodeINS1_12InternalNodeINS6_INS1_8LeafNodeINS0_4math4Vec4IfEELj3EEELj4
> > > EEELj5EEEEEEENSE_9ChildIterISE_St17_Rb_tree_iteratorISt4pairIKNS8_5CoordENSE_
> > > 10NodeStructEEENSE_11ChildOnPredESD_EEE8PrevItemENS0_8TypeListIJS' in .size
> > > directive
> > > x86_64-pc-linux-gnu-g++: fatal error: Killed signal terminated program
> > > cc1plus
> > > compilation terminated.
> > > 
> > > Try reducing your MAKEOPTS to -j8 given you have 16GB of RAM.
> > 
> > If it fails with reduced MAKEOPTS, then please try compiling with -O2 (and
> > disabling LTO if you have it). You may need to compile dependencies with it
> > too.
> 
> So I watched it closely but it never ran out of memory. Plus I have zram
> setup so even if it did it should fall back to that.
> 

The problem is that GCC has a tendency to do this sort of thing when it's.. going to run out of memory(?). I've hit it plenty of times where I haven't _actually_ run out and the build dies. The general rule still applies anyway though.

> But just to be thorough I built it at -j8 and that actually worked. But I
> don't understand why.
> 
> Is there something fundamental I keep missing when I read through my
> build.logs? I never can find useful information for some reason.

Usually grepping for "error:" helps and look at the lines above/below too.