When emerging a package with distcc that uses autoconf and DISTCC_VERBOSE=1, generally get error like: /usr/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../x86_64-pc-linux-gnu/bin/ld: mpn/.libs/modexact_1c_odd.o: warning: relocation against `__gmp_modlimb_invert_table' in read-only section `.text' /usr/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../x86_64-pc-linux-gnu/bin/ld: mpn/.libs/modexact_1c_odd.o: relocation R_X86_64_PC32 against symbol `__gmp_modlimb_invert_table' can not be used when making a shared object; recompile with -fPIC List of packages concerned I found: dev-libs/libtommath dev-python/subunit dev-libs/libxml2 dev-db/sqlite media-libs/libzmf dev-libs/libixion dev-libs/liborcus dev-util/pkgconf x11-libs/libX11 media-libs/freetype x11-base/xorg-server x11-drivers/xf86-input-evdev x11-drivers/xf86-input-wacom net-dns/avahi app-i18n/ibus dev-libs/ell media-libs/libogg media-libs/opus media-libs/fdk-aac media-libs/libdvdcss dev-libs/jansson dev-libs/oniguruma media-libs/libdvbpsi app-text/libnumbertext dev-util/cppunit sys-devel/ucpp dev-libs/libpipeline app-admin/sysklogd media-libs/libmms dev-libs/libburn net-libs/libtirpc dev-libs/libunistring dev-libs/boehm-gc net-libs/libnsl sys-apps/sandbox app-text/mythes app-text/enchant dev-libs/kpathsea net-libs/nghttp2 dev-libs/ptexenc app-text/libodfgen dev-libs/libpcre sys-apps/file dev-libs/expat dev-libs/gmp sys-devel/gettext dev-libs/libisofs net-dns/libidn sys-libs/cracklib dev-db/unixODBC dev-libs/libnl sys-libs/gdbm sci-libs/fftw dev-libs/libgpg-error dev-libs/libksba dev-libs/libgcrypt dev-libs/xmlsec sys-apps/kmod dev-libs/libtasn1 dev-scheme/guile net-libs/gnutls dev-libs/libfilezilla media-libs/jbig2dec net-firewall/iptables media-libs/alsa-lib media-libs/libdvdread media-libs/a52dec sys-libs/libunwind app-text/aspell sci-libs/gsl media-libs/faad2 media-libs/libsndfile sci-libs/camd dev-libs/protobuf dev-libs/libuv media-libs/speex media-libs/libdvdnav media-libs/portaudio media-libs/speexdsp app-text/teckit net-dns/c-ares dev-libs/libudfread media-libs/faac media-libs/libsoundtouch dev-libs/libsass app-misc/jq media-libs/libuninameslist sci-libs/mpir sys-libs/db dev-libs/libev net-analyzer/net-snmp dev-libs/log4cpp dev-libs/libverto app-text/libmwaw dev-util/colm sys-libs/pam net-misc/curl app-text/qpdf media-libs/tiff media-libs/libv4l media-libs/libraw media-libs/libmng app-text/libetonyek dev-libs/redland dev-libs/ocl-icd x11-libs/libXfixes x11-libs/libXtst media-libs/gd net-mail/mailutils sys-apps/man-db dev-libs/libusb dev-libs/libusb-compat media-libs/libmtp app-crypt/gpgme media-libs/libgphoto2 dev-libs/hidapi media-libs/libwebp x11-libs/libva sci-mathematics/octave x11-libs/libXt media-gfx/graphicsmagick x11-libs/libXaw net-misc/nx net-libs/libndp dev-libs/libgee dev-lang/vala sys-apps/util-linux dev-libs/apr sys-fs/ntfs3g app-arch/libarchive dev-util/ragel media-libs/libbluray sys-process/procps sys-apps/dbus sys-block/parted app-crypt/p11-kit dev-libs/dbus-glib app-admin/syslog-ng sys-fs/cryptsetup #dev-libs/apr-util dev-libs/libbsd sys-libs/libblockdev dev-cpp/libxmlpp net-libs/libmbim dev-libs/libofx net-libs/libqmi media-gfx/imagemagick net-libs/telepathy-glib sys-apps/shadow sys-auth/polkit gnome-base/gnome-keyring net-wireless/bluez app-text/ghostscript-gpl net-misc/modemmanager sys-fs/udisks app-text/gspell dev-vcs/subversion media-gfx/sane-backends gnome-base/gconf gui-libs/amtk app-arch/rpm net-print/cups-filters xfce-base/exo gnome-extra/yelp media-tv/v4l-utils app-admin/sudo dev-lang/php net-voip/telepathy-gabble net-libs/farstream x11-libs/gtk+ net-misc/networkmanager xfce-base/xfce4-panel net-im/telepathy-mission-control media-sound/pulseaudio media-libs/libsdl2 media-libs/libsdl media-sound/mpg123 media-libs/libmpeg2 media-libs/smpeg2 app-text/texlive-core media-video/guvcview net-ftp/filezilla media-libs/sdl2-mixer dev-lang/julia net-libs/gnome-online-accounts net-libs/libgfbgraph net-misc/gnome-online-miners media-gfx/gimp xfce-base/thunar app-cdr/brasero Reproducible: Always Steps to Reproduce: 1. install and configure distcc 2. sudo distcc-config --set-env DISTCC_VERBOSE 1 3. emerge one of the above packages Actual Results: Emerge fail with an error about relocation R_X86_64_* Expected Results: Complete emerge emerge --info Portage 3.0.20 (python 3.9.6-final-0, default/linux/amd64/17.1/desktop/gnome/systemd, gcc-9.3.0, glibc-2.33-r1, 5.4.72-gentoo x86_64) ================================================================= System uname: Linux-5.4.72-gentoo-x86_64-Intel-R-_Core-TM-_i5-7300U_CPU_@_2.60GHz-with-glibc2.33 KiB Mem: 16261892 total, 10226708 free KiB Swap: 18874364 total, 18874364 free Timestamp of repository gentoo: Fri, 01 Oct 2021 13:15:01 +0000 Head commit of repository gentoo: 465c6e9dd5f49c568f08f3a0824e70b3ae8f6a4d sh bash 5.1_p8 ld GNU ld (Gentoo 2.34 p6) 2.34.0 distcc 3.4 x86_64-pc-linux-gnu [enabled] app-shells/bash: 5.1_p8::gentoo dev-java/java-config: 2.3.1::gentoo dev-lang/perl: 5.34.0-r2::gentoo dev-lang/python: 2.7.18_p13::gentoo, 3.7.9::gentoo, 3.8.12::gentoo, 3.9.6_p2::gentoo dev-lang/rust: 1.53.0::gentoo dev-util/cmake: 3.20.5::gentoo sys-apps/baselayout: 2.7::gentoo sys-apps/sandbox: 2.24::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r5::gentoo sys-devel/automake: 1.13.4-r2::gentoo, 1.16.4::gentoo sys-devel/binutils: 2.34-r2::gentoo, 2.37_p1::gentoo sys-devel/gcc: 9.3.0-r1::gentoo, 10.3.0-r2::gentoo sys-devel/gcc-config: 2.4::gentoo sys-devel/libtool: 2.4.6-r6::gentoo sys-devel/make: 4.3::gentoo sys-kernel/linux-headers: 5.10::gentoo (virtual/os-headers) sys-libs/glibc: 2.33-r1::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.fr.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 sync-rsync-verify-metamanifest: yes sync-rsync-extra-opts: localrepo location: /var/db/repos/localrepo masters: gentoo x-portage location: /usr/local/portage masters: gentoo priority: 0 crossdev location: /usr/local/portage-crossdev masters: gentoo priority: 10 gnome location: /var/lib/layman/gnome sync-type: laymansync sync-uri: https://anongit.gentoo.org/git/proj/gnome.git masters: gentoo priority: 50 jorgicio location: /var/lib/layman/jorgicio sync-type: laymansync sync-uri: https://github.com/jorgicio/jorgicio-gentoo.git masters: gentoo priority: 50 ppfeufer-gentoo-overlay location: /var/lib/layman/ppfeufer-gentoo-overlay sync-type: laymansync sync-uri: https://github.com/ppfeufer/gentoo-overlay.git masters: gentoo priority: 50 raiagent location: /var/lib/layman/raiagent sync-type: laymansync sync-uri: https://github.com/leycec/raiagent masters: gentoo priority: 50 robert7k location: /var/lib/layman/robert7k sync-type: laymansync sync-uri: https://github.com/robert7k/gentoo-overlay.git masters: gentoo priority: 50 stefantalpalaru location: /var/lib/layman/stefantalpalaru sync-type: laymansync sync-uri: https://github.com/stefantalpalaru/gentoo-overlay.git masters: gentoo priority: 50 stuff location: /var/lib/layman/stuff sync-type: laymansync sync-uri: https://github.com/istitov/stuff.git masters: gentoo priority: 50 waebbl location: /var/lib/layman/waebbl sync-type: laymansync sync-uri: https://github.com/waebbl/waebbl-gentoo.git masters: gentoo priority: 50 wichtounet location: /var/lib/layman/wichtounet sync-type: laymansync sync-uri: https://github.com/wichtounet/wichtounet-overlay.git masters: gentoo priority: 50 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="@FREE no-source-code freedist" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=skylake -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.4/ext-active/ /etc/php/apache2-php8.0/ext-active/ /etc/php/cgi-php7.4/ext-active/ /etc/php/cgi-php8.0/ext-active/ /etc/php/cli-php7.4/ext-active/ /etc/php/cli-php8.0/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=skylake -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--jobs=8 --load-average=8" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-march=skylake -O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distcc distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms split-elog strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-march=skylake -O2 -pipe" GENTOO_MIRRORS="ftp://ftp.free.fr/mirrors/ftp.gentoo.org/ http://gentoo.mirrors.ovh.net/gentoo-distfiles/ ftp://mirrors.soeasyto.com/distfiles.gentoo.org/ http://mirrors.soeasyto.com/distfiles.gentoo.org/" LANG="fr_FR.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j36 -l36" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi alsa amd64 bluetooth branding bzip2 cairo cdda cdr cli colord crypt cups dbus dri dts dvd dvdr eds emboss encode evo exif flac fortran gdbm gif gnome gnome-keyring gnome-online-accounts gpm gstreamer gtk gui guile iconv icu introspection ipv6 jpeg lcms libglvnd libnotify libsecret libtirpc mad mng mp3 mp4 mpeg multilib nautilus ncurses networkmanager nls nptl ogg opengl openmp pam pango pcre pdf php png policykit ppds pulseaudio qt5 readline sdl seccomp spell split-usr ssl startup-notification svg sysprof systemd tcpd tiff tracker truetype udev udisks unicode upower usb vorbis wayland wxwidgets x264 xattr xcb xml xv xvid zlib" ABI_X86="64" ADA_TARGET="gnat_2019" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 fma3 mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3 f16c" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="emu efi-32 efi-64 pc" INPUT_DEVICES="evdev synaptics wacom" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_9" PYTHON_TARGETS="python3_9" QEMU_SOFTMMU_TARGETS="arm x86_64" QEMU_USER_TARGETS="x86_64" RUBY_TARGETS="ruby26" SANE_BACKENDS="hp plustek" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RUSTFLAGS
After digging I found that a quick solution is to force -fPIC for the packages with problem with CFLAGS="${CFLAGS} -fPIC" CXXFLAGS="${CXXFLAGS} -fPIC" But for some packages it is not enought, I have to emerge without distcc. By digging further, I found that configure does not find -fPIC is working. Extract of configure output: checking for x86_64-pc-linux-gnu-gcc option to produce PIC... -fPIC -DPIC checking if x86_64-pc-linux-gnu-gcc PIC flag -fPIC -DPIC works... no checking if x86_64-pc-linux-gnu-gcc static flag -static works... no checking if x86_64-pc-linux-gnu-gcc supports -c -o file.o... no checking if x86_64-pc-linux-gnu-gcc supports -c -o file.o... (cached) no Looking in the configure script, I found that it is due to distcc output in verbose mode that perturbs configure script. configure interpret differences between 2 compilations outputs as due to errors. But outputs of distcc in verbose mode are different between several runs, as can be seen below. First distcc output used in configure as reference : distcc[12000] (dcc_trace_version) distcc 3.4 x86_64-pc-linux-gnu; built Oct 13 2021 16:15:47 distcc[12000] (dcc_recursion_safeguard) safeguard level=0 distcc[12000] (main) compiler name is "x86_64-pc-linux-gnu-g++" distcc[12000] (dcc_set_path) setting PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr/lib64/opencascade-7.5.2/bin:/usr/lib/llvm/12/bin:/usr/lib/llvm/11/bin:/usr/lib/llvm/10/bin distcc[12000] (dcc_scan_args) scanning arguments: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 conftest.cpp distcc[12000] (dcc_scan_args) found input file "conftest.cpp" distcc[12000] (dcc_source_needs_local) autoconf tests are run locally: conftest.cpp distcc[12000] (dcc_get_hostlist) not reading /home/sylvain/.distcc/hosts: No such file or directory distcc[12000] (dcc_parse_hosts_file) load hosts from /etc/distcc/hosts distcc[12000] (dcc_parse_hosts) found tcp token "10.42.0.2/24,cpp,lzo" distcc[12000] (dcc_parse_options) got CPP option distcc[12000] (dcc_parse_options) got LZO option distcc[12000] (dcc_parse_hosts) found tcp token "10.42.0.1/12,cpp,lzo" distcc[12000] (dcc_parse_options) got CPP option distcc[12000] (dcc_parse_options) got LZO option distcc[12000] (dcc_lock_host) got cpu lock on localhost slot 0 as fd3 distcc[12000] exec on localhost: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 conftest.cpp distcc[12000] (dcc_note_state) note state 5, file "conftest.cpp", host "localhost" distcc[12000] (dcc_spawn_child) forking to execute: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 conftest.cpp distcc[12000] (dcc_spawn_child) child started as pid12001 distcc[12001] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1 distcc[12000] (dcc_collect_child) cc child 12001 terminated with status 0 distcc[12000] (dcc_collect_child) cc times: user 0.000000s, system 0.000000s, 0 minflt, 0 majflt distcc[12000] compile conftest.cpp on localhost completed ok distcc[12000] (dcc_unlock) release lock fd3 distcc[12000] elapsed compilation time 0.009451s distcc[12000] (dcc_exit) exit: code 0; self: 0.000721 user 0.000000 sys; children: 0.007215 user 0.002086 sys distcc[12000] (dcc_cleanup_tempfiles_inner) deleted 0 temporary files Second output of distcc in configure to test -fPIC: distcc[12114] (dcc_trace_version) distcc 3.4 x86_64-pc-linux-gnu; built Oct 13 2021 16:15:47 distcc[12114] (dcc_recursion_safeguard) safeguard level=0 distcc[12114] (main) compiler name is "x86_64-pc-linux-gnu-g++" distcc[12114] (dcc_set_path) setting PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr/lib64/opencascade-7.5.2/bin:/usr/lib/llvm/12/bin:/usr/lib/llvm/11/bin:/usr/lib/llvm/10/bin distcc[12114] (dcc_scan_args) scanning arguments: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 -fPIC -DPIC -DPIC conftest.cpp distcc[12114] (dcc_scan_args) found input file "conftest.cpp" distcc[12114] (dcc_source_needs_local) autoconf tests are run locally: conftest.cpp distcc[12114] (dcc_get_hostlist) not reading /home/sylvain/.distcc/hosts: No such file or directory distcc[12114] (dcc_parse_hosts_file) load hosts from /etc/distcc/hosts distcc[12114] (dcc_parse_hosts) found tcp token "10.42.0.2/24,cpp,lzo" distcc[12114] (dcc_parse_options) got CPP option distcc[12114] (dcc_parse_options) got LZO option distcc[12114] (dcc_parse_hosts) found tcp token "10.42.0.1/12,cpp,lzo" distcc[12114] (dcc_parse_options) got CPP option distcc[12114] (dcc_parse_options) got LZO option distcc[12114] (dcc_lock_host) got cpu lock on localhost slot 0 as fd3 distcc[12114] exec on localhost: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 -fPIC -DPIC -DPIC conftest.cpp distcc[12114] (dcc_note_state) note state 5, file "conftest.cpp", host "localhost" distcc[12114] (dcc_spawn_child) forking to execute: x86_64-pc-linux-gnu-g++ -c -m64 -O2 -march=k8 -mtune=k8 -fPIC -DPIC -DPIC conftest.cpp distcc[12114] (dcc_spawn_child) child started as pid12115 distcc[12115] (dcc_increment_safeguard) setting safeguard: _DISTCC_SAFEGUARD=1 distcc[12114] (dcc_collect_child) cc child 12115 terminated with status 0 distcc[12114] (dcc_collect_child) cc times: user 0.000000s, system 0.000000s, 0 minflt, 0 majflt distcc[12114] compile conftest.cpp on localhost completed ok distcc[12114] (dcc_unlock) release lock fd3 distcc[12114] elapsed compilation time 0.010154s distcc[12114] (dcc_exit) exit: code 0; self: 0.000000 user 0.000742 sys; children: 0.005493 user 0.003699 sys distcc[12114] (dcc_cleanup_tempfiles_inner) deleted 0 temporary files Solving cleanly this bug is out of my knowledge. I do not know if it is - distcc that must change where to output verbose information (if possible). - autoconf that must adapt to this distcc output - gentoo that can prevent the use of DISTCC_VERBOSE=1 when using distcc in portage (either in distcc or portage package) Setting DISTCC_VERBOSE=0 with sudo distcc-config --set-env DISTCC_VERBOSE 1 seems to solve the problem (I did not try to re-emerge all the concerned packages). I couldn't confirm if DISTCC_VERBOSE=1 is the default or not when installing distcc. As my understanding of the distcc ebuild it is default to 0, but it was set to 1 in /etc/env.d/02distcc, and I don't remember touching this file. I only modifyed /etc/systemd/system/distccd.service.d/00gentoo.conf that seems to be overriden by /etc/env.d/02distcc. In the meantime, it could be nice to prevent users in the wiki of distcc, as this problem concerns lots of packages. Best regards, Sylvain
I also opened a bug for distcc https://github.com/distcc/distcc/issues/441
Indeed it seems by default DISTCC_VERBOSE=0, and so no problem by default. I have changed it in /etc/env.d/02distcc I do not remember how and when. But current bug is still annoying if ones add DISTCC_VERBOSE=1 to see what happens when setting up distcc. Bug I reported in distcc have been closed as not seeing it as a bug of distcc. Conclusion I see is DISTCC_VERBOSE=1 should not be set for usual use of distcc with emerge. Only in case of distcc problems.
It sounds like you misconfigured your system, so closing this as invalid.