Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 892956 - sys-libs/glibc[static-libs] (and probably virtual/libc[static-libs]) should provide enough libraries to make simple static linking work
Summary: sys-libs/glibc[static-libs] (and probably virtual/libc[static-libs]) should p...
Status: CONFIRMED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo Toolchain Maintainers
URL:
Whiteboard:
Keywords:
: 893132 (view as bug list)
Depends on:
Blocks: 893932
  Show dependency tree
 
Reported: 2023-02-02 18:52 UTC by Sergei Trofimovich
Modified: 2023-03-05 04:15 UTC (History)
3 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Sergei Trofimovich 2023-02-02 18:52:05 UTC
Initially the bug is reported by Sora Lee at https://github.com/trofi/nix-guix-gentoo/issues/28 where LDFLAGS=-static does not work as is even for simple binaries and requires pulling in `llvm-libunwind? ( sys-libs/llvm-libunwind[static-libs] )` or the equivalent.

The gist of the issue:

On a system with sys-libs/glibc[static-libs] I would expect the both following commands to succeed:

    $ printf "int main(){}" | gcc -x c - -o a -static && ./a

    $ printf "int main(){}" | clang -x c - -o a -static && ./a
    ld.lld: error: unable to find library -l:libunwind.a
    clang-15: error: linker command failed with exit code 1 (use -v to see invocation)

The second fails on `default/linux/amd64/17.1/systemd/clang/merged-usr` profile.

While I can add `llvm-libunwind? ( sys-libs/llvm-libunwind[static-libs] )` (and other runtime details) to the dependencies I think it's a too low level implementation detail to copy into rebuilds with static linking.

I would suggest adding this RDEPEND to sys-libs/glibc[static-libs] and to virtual/libc[static-libs].

Then ebulds that can't live without static linking could signal it with just a DEPEND="virtual/libc[static-libs]" and expect simple programs to link.

The in-tree example with the same problem is sys-apps/busybox:

    # USE='static -pam' emerge -v1 busybox
    ...
    ld.lld: error: unable to find library -l:libunwind.a
    clang-15: error: linker command failed with exit code 1 (use -v to see invocation)

$ emerge --info

Portage 3.0.44 (python 3.10.9-final-0, default/linux/amd64/17.1/systemd/clang/merged-usr, gcc-12, glibc-2.36-r7, 6.1.8 x86_64)
=================================================================
System uname: Linux-6.1.8-x86_64-AMD_Ryzen_9_5950X_16-Core_Processor-with-glibc2.36
KiB Mem:   131862460 total,  43728548 free
KiB Swap:  197793688 total, 197058456 free
Timestamp of repository gentoo: Sun, 29 Jan 2023 21:30:01 +0000
Head commit of repository gentoo: c8bdd9aa2e808211185025407c08335f523c9775
sh bash 5.2_p15-r1
ld GNU ld (Gentoo 2.39 p5) 2.39.0
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p15-r1::gentoo
dev-lang/perl:             5.36.0-r2::gentoo
dev-lang/python:           3.10.9-r1::gentoo, 3.11.1-r1::gentoo
dev-lang/rust:             1.67.0::gentoo
dev-util/cmake:            3.25.2::gentoo
dev-util/meson:            1.0.0::gentoo
sys-apps/baselayout:       2.13-r1::gentoo
sys-apps/sandbox:          2.30-r1::gentoo
sys-apps/systemd:          252.4-r1::gentoo
sys-devel/autoconf:        2.71-r5::gentoo
sys-devel/automake:        1.16.5::gentoo
sys-devel/binutils:        2.39-r4::gentoo, 2.40::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           15.0.7-r1::gentoo
sys-devel/gcc:             12.2.1_p20230121-r1::gentoo
sys-devel/gcc-config:      2.10::gentoo
sys-devel/libtool:         2.4.7-r1::gentoo
sys-devel/lld:             15.0.7::gentoo
sys-devel/llvm:            15.0.7::gentoo
sys-devel/make:            4.4::gentoo
sys-kernel/linux-headers:  6.1::gentoo (virtual/os-headers)
sys-libs/glibc:            2.36-r7::gentoo
Repositories:

gentoo
    location: /bound/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    volatile: True
    sync-rsync-verify-metamanifest: yes
    sync-rsync-verify-max-age: 24
    sync-rsync-verify-jobs: 1
    sync-rsync-extra-opts:

slyfox
    location: /bound/slyfox-gentoo
    masters: gentoo
    priority: 0
    volatile: True

nix-guix
    location: /bound/nix-guix-gentoo
    masters: gentoo
    priority: 1
    volatile: True

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="@FREE"
ADDR2LINE="llvm-addr2line"
AR="llvm-ar"
AS="clang -c"
CBUILD="x86_64-pc-linux-gnu"
CC="clang"
CFLAGS="-O2 -pipe -fdiagnostics-show-option -frecord-gcc-switches"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/sandbox.d"
CPP="clang-cpp"
CXX="clang++"
CXXFLAGS="-O2 -pipe"
DISTDIR="/bound/distfiles"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fail-clean fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="C.UTF8"
LD="ld.lld"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -fuse-ld=lld -rtlib=compiler-rt -unwindlib=libunwind -Wl,--as-needed  -Wl,--hash-style=gnu"
LEX="flex"
MAKEOPTS="-j17 -l17"
NM="llvm-nm"
OBJCOPY="llvm-objcopy"
OBJDUMP="llvm-objdump"
PKGDIR="/var/cache/binpkgs"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/dev/shm"
RANLIB="llvm-ranlib"
READELF="llvm-readelf"
SHELL="/bin/bash"
STRINGS="llvm-strings"
STRIP="llvm-strip"
USE="acl amd64 bzip2 clang cli crypt dri fortran gdbm iconv ipv6 libglvnd libtirpc llvm-libunwind multilib ncurses nls nptl openmp pam pcre readline seccomp ssl systemd test-rust udev unicode xattr zlib" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-4 php8-0" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_10" PYTHON_TARGETS="python3_10" RUBY_TARGETS="ruby27 ruby30" USERLAND="GNU" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  ARFLAGS, ASFLAGS, CCLD, CONFIG_SHELL, CPPFLAGS, CTARGET, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAKEFLAGS, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RUSTFLAGS, SIZE, YACC, YFLAGS
Comment 1 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2023-02-03 06:40:29 UTC
FWIW the LLVM/Clang profiles are considered pretty experimental still.

For Clang, it's tricky because it depends on configuration and the (default) flags passed.

Ionen points out it should be harmless dep-wise (non-invasive to users, no need to then enable static-libs for its deps) to default to +static-libs on llvm-libunwind, which would cover most cases here. I think that generally makes sense.

I see three options:
1. Adding IUSE=llvm-libunwind to virtual/libc
2. Defaulting on (which doesn't feel like a full solution alone) +static-libs in llvm-libunwind
3. Making clang-common[default-compiler-rt] depend on libunwind[static-libs] (or correspondingly llvm-libunwind[static-libs] if USE=llvm-libunwind)

I think 2+3 is probably a good fit?
Comment 2 Andreas K. Hüttel archtester gentoo-dev 2023-02-04 10:59:18 UTC
> 
> I see three options:
> 1. Adding IUSE=llvm-libunwind to virtual/libc
> 2. Defaulting on (which doesn't feel like a full solution alone)
> +static-libs in llvm-libunwind
> 3. Making clang-common[default-compiler-rt] depend on libunwind[static-libs]
> (or correspondingly llvm-libunwind[static-libs] if USE=llvm-libunwind)
> 
> I think 2+3 is probably a good fit?

Yes. 

We need to keep in mind that there are other library candidates too (unfortunately). Things like libatomic for example ...
Comment 3 Mike Gilbert gentoo-dev 2023-02-04 19:47:14 UTC
*** Bug 893132 has been marked as a duplicate of this bug. ***
Comment 4 Larry the Git Cow gentoo-dev 2023-03-03 22:22:26 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=5618033009fedcbe3a0491552cf296faade27087

commit 5618033009fedcbe3a0491552cf296faade27087
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2023-03-03 22:21:49 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2023-03-03 22:21:49 +0000

    sys-devel/clang-common: require *unwind[static-libs] for USE=default-compiler-rt
    
    Builtins don't work correctly without this.
    
    Closes: https://bugs.gentoo.org/892956
    Signed-off-by: Sam James <sam@gentoo.org>

 .../{clang-common-15.0.7-r2.ebuild => clang-common-15.0.7-r3.ebuild}  | 4 ++--
 sys-devel/clang-common/clang-common-16.0.0.9999.ebuild                | 4 ++--
 ...ang-common-16.0.0_rc3.ebuild => clang-common-16.0.0_rc3-r1.ebuild} | 4 ++--
 sys-devel/clang-common/clang-common-17.0.0.9999.ebuild                | 4 ++--
 sys-devel/clang-common/clang-common-17.0.0_pre20230225.ebuild         | 4 ++--
 5 files changed, 10 insertions(+), 10 deletions(-)

Additionally, it has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=ec0857c1f4b448861a54ad185c79528c070776e2

commit ec0857c1f4b448861a54ad185c79528c070776e2
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2023-03-03 22:15:03 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2023-03-03 22:15:17 +0000

    profiles/features/llvm: default sys-libs/llvm-libunwind[static-libs] on
    
    Without this, statically linking even a basic example fails because
    we're using llvm-libunwind rather than GCC's internals.
    
    Quoting myself on the bug:
    """
    FWIW the LLVM/Clang profiles are considered pretty experimental still.
    
    For Clang, it's tricky because it depends on configuration and the (default) flags passed.
    
    Ionen points out it should be harmless dep-wise (non-invasive to users, no need to then
    enable static-libs for its deps) to default to +static-libs on llvm-libunwind,
    which would cover most cases here. I think that generally makes sense.
    
    I see three options:
    1. Adding IUSE=llvm-libunwind to virtual/libc
    2. Defaulting on (which doesn't feel like a full solution alone) +static-libs in llvm-libunwind
    3. Making clang-common[default-compiler-rt] depend on libunwind[static-libs]
    (or correspondingly llvm-libunwind[static-libs] if USE=llvm-libunwind)
    
    I think 2+3 is probably a good fit?
    """
    
    Bug: https://bugs.gentoo.org/892956
    Signed-off-by: Sam James <sam@gentoo.org>

 profiles/features/llvm/package.use | 3 +++
 1 file changed, 3 insertions(+)
Comment 5 Sergei Trofimovich 2023-03-04 09:29:40 UTC
It's not obvious from the closed bug. Is one expected to write

    DEPEND="
        elibc_glibc? ( sys-libs/glibc[static-libs(+)] )
    "
(and whatever is required for other libcs) to pull in static libraries enough for linking libc statically?

I don't think

    DEPEND="virtual/libc"

guarantees presence of enough static libraries.
Comment 6 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2023-03-05 04:14:20 UTC
I'll reopen so I don't forget to revisit.