Cannot mount a volume on ~amd64. # grep distfiles /etc/fstab server:/distfiles /usr/portage/distfiles glusterfs noauto 0 0 # mount /usr/portage/distfiles/ grep: warning: stray \ before - Fatal glibc error: malloc.c:2593 (sysmalloc): assertion failed: (old_top == initial_top (av) && old_size == 0) || ((unsigned long) (old_size) >= MINSIZE && prev_inuse (old_top) && ((unsigned long) old_end & (pagesize - 1)) == 0) /sbin/mount.glusterfs: line 125: 13019 Aborted (core dumped) $cmd_line Mounting glusterfs on /usr/portage/distfiles failed. # emerge --info glusterfs Portage 3.0.49 (python 3.11.4-final-0, default/linux/amd64/17.1, gcc-13, glibc-2.37-r4, 5.15.114-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-5.15.114-gentoo-x86_64-Intel-R-_Xeon-R-_CPU_E5-2620_v3_@_2.40GHz-with-glibc2.37 KiB Mem: 4903736 total, 2885740 free KiB Swap: 3071996 total, 3068156 free Timestamp of repository gentoo: Wed, 02 Aug 2023 00:15:01 +0000 Head commit of repository gentoo: d90c3cccf3e2cb6245a8b64f411ed85b6fc4d8c0 sh bash 5.2_p15-r6 ld GNU ld (Gentoo 2.40 p6) 2.40.0 app-misc/pax-utils: 1.3.7::gentoo app-shells/bash: 5.2_p15-r6::gentoo dev-lang/perl: 5.38.0-r1::gentoo dev-lang/python: 3.10.11::gentoo, 3.11.4::gentoo, 3.12.0_beta4_p1::gentoo dev-lang/rust: 1.69.0-r1::gentoo dev-util/cmake: 3.27.1::gentoo dev-util/meson: 1.2.0::gentoo sys-apps/baselayout: 2.14::gentoo sys-apps/openrc: 0.48::gentoo sys-apps/sandbox: 2.37::gentoo sys-devel/autoconf: 2.71-r7::gentoo sys-devel/automake: 1.16.5-r1::gentoo sys-devel/binutils: 2.40-r7::gentoo sys-devel/binutils-config: 5.5::gentoo sys-devel/gcc: 13.2.0::gentoo sys-devel/gcc-config: 2.11::gentoo sys-devel/libtool: 2.4.7-r1::gentoo sys-devel/make: 4.4.1-r1::gentoo sys-kernel/linux-headers: 6.4::gentoo (virtual/os-headers) sys-libs/glibc: 2.37-r4::gentoo ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-mtune=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-mtune=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HO ME" FCFLAGS="-mtune=native -O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preser ve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-mtune=native -O2 -pipe" LANG="en_US.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LEX="flex" MAKEOPTS="-j6" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.gi t" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/bash" USE="acl amd64 bzip2 cli crypt dri fortran gdbm iconv ipv6 libtirpc multilib ncurses nptl openmp pam pcre readline seccomp split-usr ssl test-rust unicode xattr zlib" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_c ore socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets word s" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx mmxext sse sse2 avx avx2 f16c fma3 pclmul popcnt rdrand sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv1 8 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput" KERNEL="linux" LCD_DEVICES="bayra d cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-1" POST GRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby31" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4opti ons ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq proto steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, LINGUAS, MAKE, MAK EFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS ================================================================= Package Settings ================================================================= sys-cluster/glusterfs-11.0::gentoo was built with the following: USE="fuse (libtirpc) uring -debug -emacs -georeplication -ipv6 -rsyslog (-selinux) -static-libs -tcmalloc -test -xml" ABI_X86="(64)" PYTHON_SINGLE_TARGET="python3_11 -python3_10 -python3_12" FEATURES="binpkg-dostrip sandbox sfperms qa-unresolved-soname-deps binpkg-logs unknown-features-warn usersync pid-sandbox multilib-strict buildpkg-live binpkg-docompress unmerge-logs assume-digests parallel-fetch news userpriv preserve-li bs userfetch protect-owned distlocks fixlafiles strict unmerge-orphans config-protect-if-modified usersandbox xattr ebuild-locks ipc-sandbox network-sandbox merge-sync"
Could you get a backtrace from https://wiki.gentoo.org/wiki/Debugging#Per-package then report it upstream? Asan and/or valgrind may help too
https://github.com/gluster/glusterfs/issues/4192 maybe?
Tomas, could you please check if it's possible to reproduce with USE=tcmalloc? Definitely need to report upstream. Please do tag me in the report.
# USE=tcmalloc emerge -av1 glusterfs # mount /usr/portage/distfiles/ grep: warning: stray \ before - # mount /usr/portage/packages/ grep: warning: stray \ before - Works fine now, thanks!
It works without USE=tcmalloc when using https://patch-diff.githubusercontent.com/raw/gluster/glusterfs/pull/4196.diff (https://github.com/gluster/glusterfs/pull/4196)
(In reply to Tomáš Mózes from comment #5) > It works without USE=tcmalloc when using > https://patch-diff.githubusercontent.com/raw/gluster/glusterfs/pull/4196. > diff (https://github.com/gluster/glusterfs/pull/4196) As per git log that's already applied in devel branch, and look like it's queued for glusterfs-11.0. Given that 11.0 was released on Feb 1st, 11.1 is due any day now actually, so I'm going to hold off until then if you're OK with that? You should (unless you have a specific problem) USE=tcmalloc in my opinion anyway (We've internally discussed and contemplated to even prior to execve'ing to /sbin/init in our initrd globally export a preload for tcmalloc - we've seen cases where it improves general performance of applications by an order of magnitude, and even prevent certain processes from arbitrarily growing in terms of RSS - presumably due to not fragmenting like glibc's malloc). I've only managed to construct one single pathological test case where tcmalloc performed worse than tcmalloc.
(In reply to Jaco Kroon from comment #6) > (In reply to Tomáš Mózes from comment #5) > > It works without USE=tcmalloc when using > > https://patch-diff.githubusercontent.com/raw/gluster/glusterfs/pull/4196. > > diff (https://github.com/gluster/glusterfs/pull/4196) > > As per git log that's already applied in devel branch, and look like it's > queued for glusterfs-11.0. Given that 11.0 was released on Feb 1st, 11.1 is > due any day now actually, so I'm going to hold off until then if you're OK > with that? I've opened a PR that should fix it for other users so they don't bump into a crash. Hopefully nobody is using it on ~arch in production, but if we know how to fix it and the fix is trivial, I suppose it's better to add a new revision with the tiny upstream fix. > > You should (unless you have a specific problem) USE=tcmalloc in my opinion > anyway (We've internally discussed and contemplated to even prior to > execve'ing to /sbin/init in our initrd globally export a preload for > tcmalloc - we've seen cases where it improves general performance of > applications by an order of magnitude, and even prevent certain processes > from arbitrarily growing in terms of RSS - presumably due to not fragmenting > like glibc's malloc). I've only managed to construct one single > pathological test case where tcmalloc performed worse than tcmalloc. Thanks for the tip, probably I'm just using the defaults as this gluster is for sharing distfiles/packages, so nothing critical.
I also don't see a reason to wait?
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=63d1454a8abf951e3fe74190c7b09e0de882dad1 commit 63d1454a8abf951e3fe74190c7b09e0de882dad1 Author: Tomáš Mózes <hydrapolic@gmail.com> AuthorDate: 2023-08-02 12:29:28 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-02 12:50:13 +0000 sys-cluster/glusterfs: fix crash without tcmalloc Closes: https://bugs.gentoo.org/911588 Signed-off-by: Tomáš Mózes <hydrapolic@gmail.com> Signed-off-by: Sam James <sam@gentoo.org> .../glusterfs/files/glusterfs-11.0-fix-crash.patch | 16 ++ sys-cluster/glusterfs/glusterfs-11.0-r1.ebuild | 215 +++++++++++++++++++++ 2 files changed, 231 insertions(+)
Thanks Tomáš!
