Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 527504

Summary: media-sound/mumble: mumble-overlay wrapper crashes when sys-libs/glibc is built w/out SySV hashing (DT_HASH)
Product: Gentoo Linux Reporter: Daniel Scharrer <daniel>
Component: Current packagesAssignee: Lars Wendler (Polynomial-C) (RETIRED) <polynomial-c>
Status: RESOLVED FIXED    
Severity: normal CC: ionen, pravorskyi, sam
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
URL: https://github.com/mumble-voip/mumble/issues/1709
See Also: https://bugs.gentoo.org/show_bug.cgi?id=347761
https://bugs.gentoo.org/show_bug.cgi?id=864100
https://bugs.gentoo.org/show_bug.cgi?id=863863
Whiteboard:
Package list:
Runtime testing required: ---

Description Daniel Scharrer 2014-10-30 17:29:23 UTC
Using the mumble-overlay wrapper crashes any program on my system, even those that don't even use X11/OpenGL. The same happens when manually LD_PRELOADing /usr/lib/mumble/libmumble.so.1.

This is because libmumble overrides dlsym (in order to intercept glXSwapBuffers) but then fails to get the address of the original dlsym, which it needs to forward non-intercepted function lookups. The original dlsym is not found because libdl.so.2 does not have a DT_HASH entry.

There are a couple of things in play here:

1.) libmumble implements it's own symbol search on top of <link.h> [1]. Their implementation is a linear search over all symbols in libdl.so.2 but still needs the DT_HASH entry to get the number of items in the DT_SYMTAB table. They chose this approach in order to avoid linking to private glibc symbols such as __libc_dlsym [2,3].

2.) The sys-libs/glibc ebuild disables the upstream forced --hash-style=both flag because "We take care of patching our binutils to use both hash styles". [4]

3.) Starting with sys-devel/binutils-2.24, this is assumption is no longer true as the patch for binutils now enables only DT_GNU_HASH by default [5].

I'm unsure if this is an upstream mumble bug and/or a bug in the binutils/glibc ebuilds, so I'm reporting it here first.

On one side the symbol search hack in mumble doesn't seem more portable or future-proof than the more common [6] __libc_dlsym usage.

On the other hand:

- It works on other distributions - even when they use only DT_GNU_HASH for most libraries, DT_HASH is still enabled for libdl (see additional information).

- The comment in [4] suggests that the removal of DT_HASH from glibc was not intentional.

- It can be argued that the presence of DT_HASH is part of the library's ABI and thus should be retained for anything that needs a stable ABI. The dynamic linker exposes the ELF dynamic sections via dlinfo(handle, RTLD_DI_LINKMAP, p);

- The ELF specification [7] lists DT_HASH as mandatory.


[1] https://github.com/mumble-voip/mumble/blob/master/overlay_gl/overlay.c#L725
[2] http://sourceforge.net/p/mumble/bugs/225/
[3] https://github.com/mumble-voip/mumble/commit/5de1027072e1bc688edc357e6841b8b25c68ee86
[4] http://sources.gentoo.org/cgi-bin/viewvc.cgi/gentoo-x86/sys-libs/glibc/files/eblits/src_compile.eblit?r1=1.17&r2=1.18
[5] http://sources.gentoo.org/cgi-bin/viewvc.cgi/gentoo/src/patchsets/binutils/2.24/77_all_generate-gnu-hash.patch?revision=1.1&view=markup
[6] https://github.com/apitrace/apitrace/issues/258#issuecomment-44586084
[7] https://www.google.com/search?q=elf+specification&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a&channel=fflb


Reproducible: Always





$ emerge --info
Portage 2.2.14 (python 2.7.8-final-0, default/linux/amd64/13.0, gcc-4.8.3, glibc-2.19-r1, 3.17.1-gentoo-r1 x86_64)
=================================================================
System uname: Linux-3.17.1-gentoo-r1-x86_64-AMD_Phenom-tm-_9750_Quad-Core_Processor-with-gentoo-2.2
KiB Mem:     8180440 total,    556908 free
KiB Swap:          0 total,         0 free
Timestamp of tree: Tue, 28 Oct 2014 19:00:01 +0000
ld GNU ld (Gentoo 2.24 p1.4) 2.24
app-shells/bash:          4.3_p30
dev-java/java-config:     2.2.0
dev-lang/perl:            5.20.1-r2
dev-lang/python:          2.7.8, 3.3.5-r1, 3.4.2
dev-util/cmake:           2.8.12.2-r2
dev-util/pkgconfig:       0.28-r2
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.13.2
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.11.6, 1.14.1
sys-devel/binutils:       2.24-r3
sys-devel/gcc:            4.1.2::toolchain, 4.3.6-r1::toolchain, 4.4.7::toolchain, 4.5.4::toolchain, 4.6.4, 4.7.4, 4.8.3, 4.9.1, 4.10.0_pre9999::toolchain
sys-devel/gcc-config:     1.8
sys-devel/libtool:        2.4.3
sys-devel/make:           4.1-r1
sys-kernel/linux-headers: 3.17 (virtual/os-headers)
sys-libs/glibc:           2.19-r1
Repositories: gentoo local-repo kde gamerlay qt x11 toolchain arx-libertatis
Installed sets: @kdeadmin-4.14, @kdeartwork-4.14, @kdebase-4.14, @kdegames-4.14, @kdegraphics-4.14, @system
ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -O2 -march=amdfam10 -pipe -ggdb"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.0/conf /usr/share/themes/oxygen-gtk/gtk-3.0"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.4/ext-active/ /etc/php/apache2-php5.6/ext-active/ /etc/php/cgi-php5.4/ext-active/ /etc/php/cgi-php5.6/ext-active/ /etc/php/cli-php5.4/ext-active/ /etc/php/cli-php5.6/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -O2 -march=amdfam10 -pipe -ggdb"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS=" -j5"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/mnt/overflow/usr/portage"
PORTDIR_OVERLAY="/usr/local/portage /var/lib/layman/kde /var/lib/layman/gamerlay /var/lib/layman/qt /var/lib/layman/x11 /var/lib/layman/toolchain /home/dscharrer/pro/gentoo"
USE="3dnow 3dnowext X X11 acl alsa amd64 bash-completion berkdb bzip2 cli consolekit cracklib crypt cxx dbus dri fortran gdbm gles gles1 gles2 iconv ipv6 j2k jpeg2k kde kde4 lm_sensors mmx mmxext modules multilib ncurses nls nptl offensive openexr opengl openmp pam pch pcre pgo png poliicykit qt qt4 readline sdl semantic-desktop session sse sse2 sse3 ssl ssse3 tcpd threads truetype udev unicode v4l v4l2 vdpau x11 xgl xv xvmc zlib" ABI_X86="64 32" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="krita" CAMERAS="canon directory ptp2 template" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev keyboard mouse wacom joystick" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-4" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" QEMU_SOFTMMU_TARGETS="arm i386 x86_64" QEMU_USER_TARGETS="arm i386 x86_64" RUBY_TARGETS="ruby21" SANE_BACKENDS="hp*" USERLAND="GNU" VIDEO_CARDS="fglrx radeon radeonsi" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, SYNC, USE_PYTHON


DT_HASH / DT_GNU_HASH usage on various distributions:

[Gentoo amd64]

$ readelf -d /lib/libdl.so.2 | grep HASH
 0x0000000000000004 (HASH)               0x290
 0x000000006ffffef5 (GNU_HASH)           0x440
$ readelf -d /usr/lib/libpng.so | grep HASH
 0x0000000000000004 (HASH)               0x1c8
 0x000000006ffffef5 (GNU_HASH)           0xf30

[Gentoo ~amd64]

$ readelf -d /lib/libdl.so.2 | grep HASH
 0x000000006ffffef5 (GNU_HASH)           0x33e2a00290
$ readelf -d /usr/lib/libpng.so | grep HASH
 0x000000006ffffef5 (GNU_HASH)           0x3fa6e001c8

[Arch Linux]

$ readelf -d /lib/libdl.so.2 | grep HASH
 0x0000000000000004 (HASH)               0x1eb8
 0x000000006ffffef5 (GNU_HASH)           0x280
$ readelf -d /usr/lib/libpng.so | grep HASH
 0x000000006ffffef5 (GNU_HASH)           0x1f0

[Debian 6]

$ readelf -d /lib/libdl.so.2 | grep HASH
 0x00000004 (HASH)                       0x1a60
 0x6ffffef5 (GNU_HASH)                   0x178
$ readelf -d /lib/libpng12.so.0 | grep HASH
 0x00000004 (HASH)                       0xf8
 0x6ffffef5 (GNU_HASH)                   0x7d8

[Fedora 16]

$ readelf -d /lib/libdl.so.2 | grep HASH
 0x00000004 (HASH)                       0x203c
 0x6ffffef5 (GNU_HASH)                   0x198
$ readelf -d /usr/lib/libpng.so.3 | grep HASH
 0x6ffffef5 (GNU_HASH)                   0x138

[Ubuntu 14.04]

$ readelf -d /lib/x86_64-linux-gnu/libdl.so.2 | grep HASH
0x0000000000000004 (HASH) 0x1eb0
0x000000006ffffef5 (GNU_HASH) 0x280
$ readelf -d /usr/lib/x86_64-linux-gnu/libpng12.so.0 | grep HASH
0x000000006ffffef5 (GNU_HASH) 0x1f0
Comment 1 SpanKY gentoo-dev 2016-07-05 08:04:20 UTC
there's no need to walk the hash table directly.  use dlsym("dlsym", RTLD_NEXT) in order to find the original symbol.  i think that fix should go to the mumble guys.

on the toolchain side, this change might not have been intentional, but if this is the first problem we've seen in the ~2.5 years that this has been active, then let's just go with it.  having DT_HASH available when DT_GNU_HASH is usable is just a waste of disk/memory.
Comment 2 Daniel Scharrer 2016-07-05 15:22:22 UTC
> use dlsym("dlsym", RTLD_NEXT) in order to find the original symbol.

For that you need the original dlsym, which is exactly what they are trying to locate here.
Comment 3 Sergei Trofimovich (RETIRED) gentoo-dev 2019-01-27 22:15:15 UTC
Is there an upstream bug filed to understand DT_GNU_HASH sections?
Comment 4 Davide Beatrici 2020-10-14 20:39:26 UTC
Bug confirmed, thank you very much for the detailed report!

It's fixed in https://github.com/mumble-voip/mumble/pull/4534.

Sorry for the huge delay.
The issue was reported to us back in 2015 (https://github.com/mumble-voip/mumble/issues/1709) but it went unnoticed until this year.
Comment 5 Sergei Trofimovich (RETIRED) gentoo-dev 2020-10-14 21:56:46 UTC
Thank you!
Comment 6 Andreas K. Hüttel archtester gentoo-dev 2021-08-04 21:07:00 UTC
Fix was merged upstream a year ago.
Comment 7 Larry the Git Cow gentoo-dev 2022-04-19 22:09:00 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=e5afbd004d49ecaa3a05b192a8bb0c21ea9d2f0e

commit e5afbd004d49ecaa3a05b192a8bb0c21ea9d2f0e
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2022-04-19 22:08:23 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2022-04-19 22:08:23 +0000

    sys-libs/glibc: re-enable DT_HASH
    
    It ends up breaking applications in unexpected ways (and it's not
    obvious to the user what's happening), and after speaking to upstream,
    it's not really even on their agenda to remove DT_HASH right now.
    
    Bug: https://bugs.gentoo.org/347761
    Bug: https://bugs.gentoo.org/527504
    Signed-off-by: Sam James <sam@gentoo.org>

 sys-libs/glibc/glibc-9999.ebuild | 5 -----
 1 file changed, 5 deletions(-)
Comment 8 Larry the Git Cow gentoo-dev 2022-04-24 23:33:52 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=8afecc68b8d689dbfdbff3b16ca50be66deb3cce

commit 8afecc68b8d689dbfdbff3b16ca50be66deb3cce
Author:     Sam James <sam@gentoo.org>
AuthorDate: 2022-04-24 23:32:16 +0000
Commit:     Sam James <sam@gentoo.org>
CommitDate: 2022-04-24 23:32:43 +0000

    sys-libs/glibc: re-enable DT_HASH
    
    It ends up breaking applications in unexpected ways (and it's not
    obvious to the user what's happening), and after speaking to upstream,
    it's not really even on their agenda to remove DT_HASH right now.
    
    Given this seems to break not just some relatively niche (sorry!) things,
    but some prominent Steam games now too, let's accelerate plans to roll
    this out and do 2.34 (and 2.35, but that was more on the cards anyway)
    too.
    
    Bug: https://bugs.gentoo.org/347761
    Bug: https://bugs.gentoo.org/527504
    Bug: https://github.com/anyc/steam-overlay/issues/309
    See: e5afbd004d49ecaa3a05b192a8bb0c21ea9d2f0e
    Signed-off-by: Sam James <sam@gentoo.org>

 sys-libs/glibc/glibc-2.34-r12.ebuild | 1617 ++++++++++++++++++++++++++++++++++
 sys-libs/glibc/glibc-2.35-r4.ebuild  | 1596 +++++++++++++++++++++++++++++++++
 2 files changed, 3213 insertions(+)