Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 762733 - sci-libs/tensorflow-2.4.0: fail to emerge, saying crosstool_wrapper_driver_is_not_gcc
Summary: sci-libs/tensorflow-2.4.0: fail to emerge, saying crosstool_wrapper_driver_is...
Status: RESOLVED TEST-REQUEST
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: AMD64 Linux
: High major
Assignee: Gentoo Linux bug wranglers
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2020-12-31 05:49 UTC by Lin Jian
Modified: 2020-12-31 22:44 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build log (build.log.xz,310.54 KB, application/x-xz)
2020-12-31 05:49 UTC, Lin Jian
Details
USE for tensorflow (useflags,1.42 KB, text/plain)
2020-12-31 05:57 UTC, Lin Jian
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Lin Jian 2020-12-31 05:49:03 UTC
Created attachment 680365 [details]
build log

sci-libs/tensorflow-2.4.0 fails to emerge. I tried to emerge it three times, all failed.
Comment 1 Lin Jian 2020-12-31 05:51:15 UTC
Portage 3.0.9 (python 3.8.6-final-0, default/linux/amd64/17.1/systemd, gcc-10.2.0, glibc-2.32-r6, 5.10.3-gentoo x86_64)
=================================================================
System uname: Linux-5.10.3-gentoo-x86_64-Intel-R-_Core-TM-_i7-9850H_CPU_@_2.60GHz-with-glibc2.2.5
KiB Mem:    32560428 total,  30531420 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Wed, 30 Dec 2020 11:35:17 +0000
Head commit of repository gentoo: ff3551f54e99f9aca67d46db907c3ca9820359bb

Timestamp of repository 4nykey: Mon, 28 Dec 2020 23:05:21 +0000
Head commit of repository 4nykey: 80e6c5341dc036c303277a9c43a4c2ce80bf036f

Timestamp of repository bobwya: Tue, 29 Dec 2020 23:05:17 +0000
Head commit of repository bobwya: ed09d3992f68e439bc1042b727fc927edac18d60

Timestamp of repository gentoo-zh: Tue, 29 Dec 2020 18:05:16 +0000
Head commit of repository gentoo-zh: 2464ee53c54820dc34005df22f7947482a8923d4

Timestamp of repository gentoobr: Tue, 29 Dec 2020 19:05:07 +0000
Head commit of repository gentoobr: db0c7237d641f22ee67afaff21ea930b8ec58b1b

Timestamp of repository lto-overlay: Mon, 28 Dec 2020 10:28:19 +0000
Head commit of repository lto-overlay: b4c217b72948a0162c4052550c65d03165fe59bf

Timestamp of repository menelkir: Mon, 28 Dec 2020 23:05:26 +0000
Head commit of repository menelkir: 328bc6c1a59813c3190d98265e29b089039f7739

Timestamp of repository mv: Mon, 28 Dec 2020 10:27:35 +0000
Head commit of repository mv: e3d9afd19235e9bd35a257b4e0a56713cc500bd8

Timestamp of repository science: Wed, 30 Dec 2020 13:35:06 +0000
Head commit of repository science: 7f8ada3edf53cb00d6d3ffe0814192e9d517cf7b

Timestamp of repository steam-overlay: Mon, 28 Dec 2020 10:27:44 +0000
Head commit of repository steam-overlay: 9adf6273bedb2dd25d80b943c70e640dbacb48dc

Timestamp of repository thegreatmcpain: Tue, 29 Dec 2020 08:15:51 +0000
Head commit of repository thegreatmcpain: 0e5ffcebe9fcdcde713c8f33d3922a17d15f99cb

Timestamp of repository guru: Wed, 30 Dec 2020 11:05:08 +0000
Head commit of repository guru: cc3865caf8f19f5d6a4388967b7d6860ea2385e1

sh bash 5.0_p18
ld GNU ld (Gentoo 2.35.1 p2) 2.35.1
app-shells/bash:          5.0_p18::gentoo
dev-java/java-config:     2.3.1::gentoo
dev-lang/perl:            5.30.3::gentoo
dev-lang/python:          3.8.6::gentoo, 3.9.0::gentoo
dev-util/cmake:           3.17.4-r1::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/sandbox:         2.20::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r5::gentoo
sys-devel/automake:       1.16.2-r1::gentoo
sys-devel/binutils:       2.35.1-r1::gentoo
sys-devel/gcc:            10.2.0-r4::gentoo
sys-devel/gcc-config:     2.3.2-r1::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.3::gentoo
sys-kernel/linux-headers: 5.10::gentoo (virtual/os-headers)
sys-libs/glibc:           2.32-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: git
    sync-uri: https://mirrors.bfsu.edu.cn/git/gentoo-portage.git
    priority: -1000
    sync-git-verify-commit-signature: yes

4nykey
    location: /var/db/repos/4nykey
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/4nykey.git
    masters: gentoo

bobwya
    location: /var/db/repos/bobwya
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/bobwya.git
    masters: gentoo

gentoo-zh
    location: /var/db/repos/gentoo-zh
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoo-zh.git
    masters: gentoo

gentoobr
    location: /var/db/repos/gentoobr
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/gentoobr.git
    masters: gentoo

local_test_overlay
    location: /var/db/repos/local_test_overlay
    masters: gentoo
    priority: 0

lto-overlay
    location: /var/db/repos/lto-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/lto-overlay.git
    masters: gentoo mv

menelkir
    location: /var/db/repos/menelkir
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/menelkir.git
    masters: gentoo

mv
    location: /var/db/repos/mv
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/mv.git
    masters: gentoo

science
    location: /var/db/repos/science
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/science.git
    masters: gentoo

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo

thegreatmcpain
    location: /var/db/repos/thegreatmcpain
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/thegreatmcpain.git
    masters: gentoo bobwya

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    priority: 1

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O3 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=12 -fuse-linker-plugin -pipe -march=native -falign-functions=32"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O3 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=12 -fuse-linker-plugin -pipe -march=native -falign-functions=32"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--autounmask --autounmask-write --jobs=12  --load-average=12"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O3 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=12 -fuse-linker-plugin -pipe -march=native -falign-functions=32"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O3 -fgraphite-identity -floop-nest-optimize -fdevirtualize-at-ltrans -fipa-pta -fno-semantic-interposition -flto=12 -fuse-linker-plugin -pipe -march=native -falign-functions=32"
GENTOO_MIRRORS="https://mirrors.bfsu.edu.cn/gentoo"
LANG="zh_CN.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j12 -l12"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X acl amd64 berkdb bzip2 cjk cli crypt dri fontconfig fortran gdbm iconv ipv6 libglvnd libtirpc lm-sensors lto multilib ncurses networkmanager nls nptl nvidia openmp pam pcre pgo pulseaudio readline seccomp split-usr ssl systemd tcpd truetype udev unicode vaapi vdpau vulkan xattr xinerama zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" L10N="zh-CN zh en-US en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LLVM_TARGETS="X86" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2 php7-3 php7-4" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_8" PYTHON_TARGETS="python2_7 python3_8" RUBY_TARGETS="ruby26" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 2 Lin Jian 2020-12-31 05:57:28 UTC
Created attachment 680368 [details]
USE for tensorflow

I have this in package.use: sci-libs/tensorflow cuda xla
Comment 3 Lin Jian 2020-12-31 06:01:01 UTC
I'm using gentooLTO: https://github.com/InBetweenNames/gentooLTO.

gentooLTO uses this workaround for tensorflow: 
  sci-libs/tensorflow *FLAGS-=-flto* # Issue #432 tensorflow-estimator fails with missing symbol __cpu_model
Comment 4 Ionen Wolkens gentoo-dev 2020-12-31 22:44:32 UTC
"fatal error: Killed signal terminated program cc1plus"

Looks like the compiler was killed by the Out-of-Memory (OOM) killer, you may have a note about this near the end of `dmesg` output. Depending on settings this has potential to happen even with 32GB ram.

May want to try a lower MAKEOPTS=-jN value, add a some swap, or if you were using tmpfs for /var/tmp I'd suggest not to (that would fill up ~10GB ram on its own).

I would also recommend to test more normal C(XX)FLAGS (e.g. -march=native -O2) when reporting issues rather than GentooLTO's