https://blogs.gentoo.org/ago/2020/07/04/gentoo-tinderbox/ Issue: dev-java/lz4-java-1.8.0-r4 fails tests. Discovered on: amd64 (internal ref: gcc14_tinderbox) System: GCC-14-SYSTEM (https://wiki.gentoo.org/wiki/Project:Tinderbox/Common_Issues_Helper#GCC-14) - openjdk-bin-24 Info about the issue: https://wiki.gentoo.org/wiki/Project:Tinderbox/Common_Issues_Helper#CF0015
Created attachment 898179 [details] build.log build log and emerge --info
Cannot reproduce this bug. Here tests get compiled and run without any problem with openjdk-bin:24 Can someone else reproduce it?
this seems to be an issue with not finding the method in the native library. i didn't test it, just reading the exception...
(In reply to Volkmar W. Pogatzki from comment #2) > Can someone else reproduce it? Happens to me with openjdk-21: >>> Test phase: dev-java/lz4-java-1.8.0-r4 javac -source 1.8 -target 1.8 -d target/test-classes -encoding UTF-8 -classpath target/test-classes:lz4-java.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/randomized-runner/lib/randomized-runner.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar @test_sources.lst warning: [options] bootstrap class path not set in conjunction with -source 8 warning: [options] source value 8 is obsolete and will be removed in a future release warning: [options] target value 8 is obsolete and will be removed in a future release warning: [options] To suppress warnings about obsolete options, use -Xlint:-options. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. 4 warnings * QA Notice: java-pkg_ensure-dep: The ebuild is attempting to use junit-4, which is not declared with a SLOT in [RP]DEPEND and --build-only wasn't given. JUnit version 4.13.3-SNAPSHOT Exception in thread "main" java.lang.UnsatisfiedLinkError: 'void net.jpountz.xxhash.XXHashJNI.init()' at net.jpountz.xxhash.XXHashJNI.init(Native Method) at net.jpountz.xxhash.XXHashJNI.<clinit>(XXHashJNI.java:28) at net.jpountz.xxhash.XXHash32JNI.hash(XXHash32JNI.java:32) at net.jpountz.xxhash.XXHashFactory.<init>(XXHashFactory.java:190) at net.jpountz.xxhash.XXHashFactory.instance(XXHashFactory.java:49) at net.jpountz.xxhash.XXHashFactory.nativeInstance(XXHashFactory.java:82) at net.jpountz.xxhash.XXHash32Test.<clinit>(XXHash32Test.java:78) at java.base/java.lang.Class.forName0(Native Method) at java.base/java.lang.Class.forName(Class.java:534) at java.base/java.lang.Class.forName(Class.java:513) at org.junit.internal.Classes.getClass(Classes.java:40) at org.junit.internal.Classes.getClass(Classes.java:26) at org.junit.runner.JUnitCommandLineParseResult.parseParameters(JUnitCommandLineParseResult.java:98) at org.junit.runner.JUnitCommandLineParseResult.parseArgs(JUnitCommandLineParseResult.java:50) at org.junit.runner.JUnitCommandLineParseResult.parse(JUnitCommandLineParseResult.java:44) at org.junit.runner.JUnitCore.runMain(JUnitCore.java:76) at org.junit.runner.JUnitCore.runMain(JUnitCore.java:40) at org.junit.runner.JUnitCore.main(JUnitCore.java:36) * ERROR: dev-java/lz4-java-1.8.0-r4::gentoo failed (test phase): * Running junit failed * * Call stack: * ebuild.sh, line 136: Called src_test * environment, line 3111: Called java-pkg-simple_src_test * environment, line 1487: Called ejunit4 '-classpath' 'target/test-classes:lz4-java.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/randomized-runner/lib/randomized-runner.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar' 'net.jpountz.lz4.LZ4BlockStreamingTest' 'net.jpountz.lz4.LZ4FactoryTest' 'net.jpountz.lz4.LZ4FrameIOStreamTest' 'net.jpountz.lz4.LZ4Test' 'net.jpountz.xxhash.XXHash32Test' 'net.jpountz.xxhash.XXHash64Test' 'net.jpountz.xxhash.XXHashFactoryTest' * environment, line 780: Called ejunit_ 'junit-4' '-classpath' 'target/test-classes:lz4-java.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/randomized-runner/lib/randomized-runner.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar' 'net.jpountz.lz4.LZ4BlockStreamingTest' 'net.jpountz.lz4.LZ4FactoryTest' 'net.jpountz.lz4.LZ4FrameIOStreamTest' 'net.jpountz.lz4.LZ4Test' 'net.jpountz.xxhash.XXHash32Test' 'net.jpountz.xxhash.XXHash64Test' 'net.jpountz.xxhash.XXHashFactoryTest' * environment, line 807: Called die * The specific snippet of code: * java "${args[@]}" || die "Running junit failed" * * If you need support, post the output of `emerge --info '=dev-java/lz4-java-1.8.0-r4::gentoo'`, * the complete build log and the output of `emerge -pqv '=dev-java/lz4-java-1.8.0-r4::gentoo'`. !!! When you file a bug report, please include the following information: GENTOO_VM=openjdk-21 CLASSPATH="" JAVA_HOME="/usr/lib64/openjdk-21" JAVACFLAGS="-source 1.8 -target 1.8" COMPILER="" and of course, the output of emerge --info =dev-java/lz4-java-1.8.0-r4 * The complete build log is located at '/var/tmp/portage/dev-java/lz4-java-1.8.0-r4/temp/build.log'. * The ebuild environment file is located at '/var/tmp/portage/dev-java/lz4-java-1.8.0-r4/temp/environment'. * Working directory: '/var/tmp/portage/dev-java/lz4-java-1.8.0-r4/work/lz4-java-1.8.0' * S: '/var/tmp/portage/dev-java/lz4-java-1.8.0-r4/work/lz4-java-1.8.0' # emerge --info =dev-java/lz4-java-1.8.0-r4 Portage 3.0.65 (python 3.12.4-final-0, default/linux/amd64/23.0/split-usr/no-multilib/hardened, gcc-14, glibc-2.39-r9, 6.10.0 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-6.10.0-x86_64-Intel-R-_Core-TM-_i7-4810MQ_CPU_@_2.80GHz-with-glibc2.39 KiB Mem: 16279896 total, 9471876 free KiB Swap: 20971516 total, 20971516 free Timestamp of repository gentoo: Tue, 23 Jul 2024 18:00:00 +0000 Head commit of repository gentoo: 9e282ccf63f8ffdbb11a2d4d7b476bc6434ef1a4 sh bash 5.2_p26-r8 ld GNU ld (Gentoo 2.42 p6) 2.42.0 app-misc/pax-utils: 1.3.7::gentoo app-shells/bash: 5.2_p26-r8::gentoo dev-build/autoconf: 2.13-r8::gentoo, 2.72-r1::gentoo dev-build/automake: 1.16.5-r2::gentoo, 1.17-r1::gentoo dev-build/cmake: 3.30.1::gentoo dev-build/libtool: 2.4.7-r4::gentoo dev-build/make: 4.4.1-r1::gentoo dev-build/meson: 1.5.0::gentoo dev-java/java-config: 2.3.4::gentoo dev-lang/perl: 5.40.0::gentoo dev-lang/python: 3.12.4_p2::gentoo, 3.13.0_beta3_p1::gentoo dev-lang/rust: 1.79.0::gentoo sys-apps/baselayout: 2.15::gentoo sys-apps/openrc: 0.54.2::gentoo sys-apps/sandbox: 2.39::gentoo sys-devel/binutils: 2.42-r2::gentoo sys-devel/binutils-config: 5.5::gentoo sys-devel/clang: 17.0.6::gentoo, 18.1.8::gentoo sys-devel/gcc: 14.1.1_p20240720::gentoo sys-devel/gcc-config: 2.11::gentoo sys-devel/lld: 17.0.6::gentoo, 18.1.8::gentoo sys-devel/llvm: 17.0.6-r2::gentoo, 18.1.8-r1::gentoo sys-kernel/linux-headers: 6.9::gentoo (virtual/os-headers) sys-libs/glibc: 2.39-r9::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 volatile: True sync-rsync-extra-opts: --new-compress sync-rsync-verify-metamanifest: yes sync-rsync-verify-max-age: 3 sync-rsync-verify-jobs: 1 local location: /var/lib/portage-local/local masters: gentoo priority: 0 volatile: True ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="@FREE" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -mtune=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -mtune=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps=y" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live collision-protect config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs -Wl,--hash-style=gnu" LEX="flex" LINGUAS="" MAKEOPTS="-j8" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS="--new-compress" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/bash" USE="X a52 acl acpi alsa amd64 avx bzip2 cairo caps cdda cddb cdparanoia crypt cups dbus dri dts dvd egl elogind fam ffmpeg fftw flac fontconfig gdbm gif gimp gles2 gmp gnutls gtk hardened iconv icu idn ipv6 jpeg lame lcms libnotify libtirpc lzma mad matroska mmap mmx mmxext mp3 mpeg ncurses networkmanager ogg opengl openmp pam pcre pic pie png policykit ppds readline sasl sdl seccomp split-usr sse sse2 sse3 sse4 sse4_1 sse4_2 ssl ssp ssse3 startup-notification svg test test-rust theora threads tiff truetype udev udisks unicode upower vaapi verify-sig vorbis wayland x264 xattr xcb xinerama xml xtpax xv xvid zlib" ABI_X86="64" ADA_TARGET="gcc_12" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_anon authn_dbm authn_file authz_dbm authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir env expires ext_filter file_cache filter headers include info log_config logio mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 f16c fma3 mmx mmxext pclmul popcnt rdrand sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 ntrip navcom oceanserver oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 tsip tripmate tnt ublox" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz glk hd44780 lb216 lcdm001 mtxorb text" LUA_SINGLE_TARGET="lua5-1" LUA_TARGETS="lua5-1" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres15" PYTHON_SINGLE_TARGET="python3_12" PYTHON_TARGETS="python3_12" RUBY_TARGETS="ruby31 ruby32" VIDEO_CARDS="crocus intel nouveau" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipp2p iface geoip fuzzy condition tarpit sysrq proto logmark ipmark dhcpmac delude chaos account" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LANG, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PYTHONPATH, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS ================================================================= Package Settings ================================================================= dev-java/lz4-java-1.8.0-r4::gentoo was built with the following: USE="test -doc -source" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live collision-protect config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
Is it broken with >=app-arch/lz4-1.10.0?
(In reply to Sam James from comment #5) > Is it broken with >=app-arch/lz4-1.10.0? If a new version of app-arch/lz4 breaks reverse dependencies, why isn't it slotted?
(In reply to Volkmar W. Pogatzki from comment #6) > (In reply to Sam James from comment #5) > > Is it broken with >=app-arch/lz4-1.10.0? > > If a new version of app-arch/lz4 breaks reverse dependencies, why isn't it > slotted? Well, it's not supposed to be broken. I'm asking if that's what is breaking it.
(In reply to Sam James from comment #7) > Well, it's not supposed to be broken. I'm asking if that's what is breaking > it. i.e. I was just putting a possible theory in here if nobody has any ideas. Someone needs to check. And _if_ it is that, it needs more investigation.
it seems lz4-java is not maintained recently. anyway, i have no idea why the linking fails, but i'm not very experienced with jni.
Here is a fork working on the update to 1.10.0: https://github.com/AGulev/lz4-java/
(In reply to Holger Hoffstätte from comment #10) > Here is a fork working on the update to 1.10.0: > https://github.com/AGulev/lz4-java/ This builds (with jdk-8) and passes all tests, incl. for the native code.
How to get a patch from the comparison? https://github.com/lz4/lz4-java/compare/master...AGulev:lz4-java:master
(In reply to Volkmar W. Pogatzki from comment #12) > How to get a patch from the comparison? > https://github.com/lz4/lz4-java/compare/master...AGulev:lz4-java:master https://github.com/lz4/lz4/compare/5ff839680134437dbf4678f3d0c7b371d84f4964...68959d27c3ec37b339b3b8ecfea155faf0ef94f2 but it looks like it's just changing bundled lz4/the submodule. The other commits also seem to just be adding binaries...
Ah, https://github.com/lz4/lz4/compare/5ff839680134437dbf4678f3d0c7b371d84f4964...68959d27c3ec37b339b3b8ecfea155faf0ef94f2.patch at least it doesn't seem to change any of the .java files
(In reply to Volkmar W. Pogatzki from comment #14) > Ah, > https://github.com/lz4/lz4/compare/5ff839680134437dbf4678f3d0c7b371d84f4964.. > .68959d27c3ec37b339b3b8ecfea155faf0ef94f2.patch > > at least it doesn't seem to change any of the .java files So far it just updated the bundled native lz4, it's obviously still WIP.
Guess all it needs is a patch for file(s) in https://github.com/lz4/lz4-java/tree/master/src/jni
Instead of diddling with patches from a WIP branch it's probably much easier to just pull in the lz4 source as build dependency und replace the contents of the lz4-java/src/lz4 directory, and then rebuild everything consistently.
D(In reply to Holger Hoffstätte from comment #17) > Instead of diddling with patches from a WIP branch it's probably much easier > to just pull in the lz4 source as build dependency und replace the contents > of the lz4-java/src/lz4 directory, and then rebuild everything consistently. Does it work with https://github.com/AGulev/lz4-java/tree/master/src/jni ?
(In reply to Volkmar W. Pogatzki from comment #18) > D(In reply to Holger Hoffstätte from comment #17) > > Instead of diddling with patches from a WIP branch it's probably much easier > > to just pull in the lz4 source as build dependency und replace the contents > > of the lz4-java/src/lz4 directory, and then rebuild everything consistently. > > Does it work with https://github.com/AGulev/lz4-java/tree/master/src/jni ? Those files are not changed from the mainline lz4-java repo, so why not just try and see? There is a warning in the JNI stub about the use of a deprecated lz4 function, but that can be fixed later. Also I don't even use any of this so I'm dropping out of here at this point.
(In reply to Holger Hoffstätte from comment #17) > Instead of diddling with patches from a WIP branch it's probably much easier > to just pull in the lz4 source as build dependency und replace the contents > of the lz4-java/src/lz4 directory, and then rebuild everything consistently. the lz4-java/src/lz4 directory is empty. would dropping stuff there change anything?
The only difference I can see in the fork https://github.com/AGulev/lz4-java/tree/ed5c7e650/src is lz4 pointing to lz4 @ 68959d2 Isn't that equivalent to app-arch/lz4-1.10.0? Is something wrong how "-llz4" is used in lz4-java-1.8.0-r4?
The problem is underlinking of the native library. It links against liblz4 but not against libxxhash. The linking is done in the ebuild and adding -lxxhash solves the issue. All tests pass on my machine after the change: --- a/lz4-java-1.8.0-r4.ebuild 2024-01-03 10:40:28.000000000 +0100 +++ b/lz4-java-1.8.0-r4.ebuild 2024-08-10 14:10:25.382318730 +0200 @@ -84,7 +84,7 @@ -Wl,-soname,liblz4-java.so \ -o liblz4-java.so \ build/objects/src/jni/net_jpountz_lz4_LZ4JNI.o \ - build/objects/src/jni/net_jpountz_xxhash_XXHashJNI.o -llz4 + build/objects/src/jni/net_jpountz_xxhash_XXHashJNI.o -llz4 -lxxhash } src_install() {
I haven't tested it, but this problem seems to be unrelated to the app-arch/lz4 version. Furthermore, the underlinked library will probably not only affect the tests but also the regular use of the installed version.
(In reply to tka from comment #23) > I haven't tested it, but this problem seems to be unrelated to the > app-arch/lz4 version. Furthermore, the underlinked library will probably not > only affect the tests but also the regular use of the installed version. just testing ...
(In reply to tka from comment #22) > [...] > - build/objects/src/jni/net_jpountz_xxhash_XXHashJNI.o -llz4 > + build/objects/src/jni/net_jpountz_xxhash_XXHashJNI.o -llz4 -lxxhash Thanks for pointing me there. I've tested and all tests pass. PR updated.
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=6100aff6a2842804a12f06c867ccc090281d7962 commit 6100aff6a2842804a12f06c867ccc090281d7962 Author: Volkmar W. Pogatzki <gentoo@pogatzki.net> AuthorDate: 2024-08-10 12:28:06 +0000 Commit: Miroslav Šulc <fordfrog@gentoo.org> CommitDate: 2024-08-11 12:10:55 +0000 dev-java/lz4-java: fix java.lang.UnsatisfiedLinkError #936533 Closes: https://bugs.gentoo.org/936533 Signed-off-by: Volkmar W. Pogatzki <gentoo@pogatzki.net> Closes: https://github.com/gentoo/gentoo/pull/37710 Signed-off-by: Miroslav Šulc <fordfrog@gentoo.org> .../lz4-java/{lz4-java-1.8.0-r4.ebuild => lz4-java-1.8.0-r5.ebuild} | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
