Since 3.5 update im getting following error on rspamd (re)start/log file: 2023-03-29 07:57:50 #5675(main) <1q8rec>; cfg; rspamd_init_lua_filters: init of /usr/share/rspamd/plugins/reputation.lua failed: unknown error; trace: [1]:{[C]:-1 - error [C]}; [2]:{/usr/share/rspamd/lualib/tableshape.lua:101 - <unknown> [Lua]}; [3]:{/usr/share/rspamd/lualib/tableshape.lua:1284 - _describe [Lua]}; [4]:{/usr/share/rspamd/lualib/tableshape.lua:905 - _describe [Lua]}; [5]:{/usr/share/rspamd/lualib/tableshape.lua:944 - _transform [Lua]}; [6]:{/usr/share/rspamd/lualib/tableshape.lua:930 - _transform [Lua]}; [7]:{/usr/share/rspamd/lualib/tableshape.lua:104 - <unknown> [Lua]}; [8]:{/usr/share/rspamd/lualib/tableshape.lua:105 - <unknown> [Lua]}; [9]:{/usr/share/rspamd/lualib/tableshape.lua:1079 - _transform [Lua]}; [10]:{/usr/share/rspamd/lualib/tableshape.lua:104 - <unknown> [Lua]}; [11]:{/usr/share/rspamd/lualib/tableshape.lua:955 - __init [Lua]}; [12]:{/usr/share/rspamd/lualib/tableshape.lua:984 - create [Lua]}; [13]:{/usr/share/rspamd/lualib/tableshape.lua:210 - one_of [Lua]}; [14]:{/usr/share/rspamd/plugins/reputation.lua:740 - <unknown> [main]}; i thought this might be issue for everyone, but there is no bug report on official rspamd bug tracker, so i guess its gentoo specific issue? Reproducible: Always mih /etc/rspamd/modules.d # emerge --info rspamd Portage 3.0.45.3 (python 3.11.2-final-0, default/linux/amd64/17.1, gcc-12, glibc-2.37-r1, 6.2.8-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-6.2.8-gentoo-x86_64-Intel-R-_Xeon-R-_CPU_X5670_@_2.93GHz-with-glibc2.37 KiB Mem: 12259908 total, 243836 free KiB Swap: 16777684 total, 16749012 free Timestamp of repository gentoo: Thu, 30 Mar 2023 13:17:01 +0000 Head commit of repository gentoo: c285c23c134457267444b685456ba15ce25c9a09 sh bash 5.2_p15-r2 ld GNU ld (Gentoo 2.40 p3) 2.40.0 app-misc/pax-utils: 1.3.7::gentoo app-shells/bash: 5.2_p15-r2::gentoo dev-lang/perl: 5.36.0-r2::gentoo dev-lang/python: 3.11.2_p2::gentoo dev-util/cmake: 3.26.1::gentoo dev-util/meson: 1.0.1::gentoo sys-apps/baselayout: 2.13-r1::gentoo sys-apps/openrc: 0.46::gentoo sys-apps/sandbox: 2.30-r1::gentoo sys-devel/autoconf: 2.71-r6::gentoo sys-devel/automake: 1.16.5-r1::gentoo sys-devel/binutils: 2.40-r3::gentoo sys-devel/binutils-config: 5.5::gentoo sys-devel/gcc: 12.2.1_p20230304::gentoo sys-devel/gcc-config: 2.10::gentoo sys-devel/libtool: 2.4.7-r1::gentoo sys-devel/make: 4.4.1::gentoo sys-kernel/linux-headers: 6.2::gentoo (virtual/os-headers) sys-libs/glibc: 2.37-r1::gentoo Repositories: gentoo location: /var/db/repos/gentoo sync-type: git sync-uri: https://github.com/gentoo-mirror/gentoo.git priority: -1000 volatile: False sync-git-clone-extra-opts: -b stable -c remote.origin.prune=true -c gc.pruneExpire=now -c gc.worktreePruneExpire=now -c gc.reflogExpire=now -c gc.reflogExpireUnreachable=now -c gc.rerereresolved=0 -c gc.rerereunresolved=0 sync-git-verify-commit-signature: true local location: /var/db/repos/local masters: gentoo volatile: False ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -pipe -O2 -fomit-frame-pointer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/bind" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php8.2/ext-active/ /etc/php/cgi-php8.2/ext-active/ /etc/php/cli-php8.2/ext-active/ /etc/php/fpm-php8.2/ext-active/ /etc/php/phpdbg-php8.2/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=native -pipe -O2 -fomit-frame-pointer" DISTDIR="/var/cache/distfiles" ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME" FCFLAGS="-march=native -pipe -O2 -fomit-frame-pointer" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg-live config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-march=native -pipe -O2 -fomit-frame-pointer" GENTOO_MIRRORS="https://gentoo.mirror.garr.it/ https://mirror.init7.net/gentoo/ https://mirror.netcologne.de/gentoo/ https://mirror.leaseweb.com/gentoo/" LANG="sl_SI.utf8" LDFLAGS="-Wl,-O2 -Wl,--as-needed -Wl,--sort-common -Wl,--hash-style=gnu" LEX="flex" LINGUAS="en sl" MAKEOPTS="-j12 -l12" PKGDIR="/var/cache/binpkgs" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" SHELL="/bin/bash" USE="acl acpi amd64 apache2 apng berkdb bittorrent btrfs bzip2 caps cgi change-password cli client corefonts crypt curl dhcp dlz doh dovecot-sasl dri eap exif expat experimental extraengine fontconfig fortran ftp gd gdbm glib gmp gssapi gzip hardened http2 iconv icu idn intl iptables ipv6 jpeg kerberos lcms libglvnd libtirpc lm-sensors lz4 lzma lzo managesieve mp3 multilib mysql mysqli ncurses nls nping nptl openmp openssl pam pci pcntl pcre pcre16 pcre32 pdo perl png posix python rar readline rpc rtmp samba seccomp server session sieve slang smtp soap sockets socks5 spell spf split-usr sqlite ssh ssl suexec test-rust threads tiff tracepath truetype udev unicode urandom usb vhosts webui x264 x265 xattr xml xmlreader xmlrpc xmlwriter xslt xvid xz zip zlib zstd" ABI_X86="64" ADA_TARGET="gnat_2021" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias authn_dbd authn_socache authz_dbd cache_socache dbd http2 proxy proxy_html proxy_http proxy_http2 proxy_wstunnel xml2enc" APACHE2_MPMS="event" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="libinput" KERNEL="linux" L10N="en sl" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LUA_SINGLE_TARGET="lua5-4" LUA_TARGETS="lua5-4" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php8-2" POSTGRES_TARGETS="postgres12 postgres13" PYTHON_SINGLE_TARGET="python3_11" PYTHON_TARGETS="python3_11" RUBY_TARGETS="ruby30" USERLAND="GNU" VIDEO_CARDS="amdgpu fbdev intel nouveau radeon radeonsi vesa dummy v4l" XTABLES_ADDONS="geoip" Unset: ADDR2LINE, AR, ARFLAGS, AS, ASFLAGS, CC, CCLD, CONFIG_SHELL, CPP, CPPFLAGS, CTARGET, CXX, CXXFILT, ELFEDIT, EMERGE_DEFAULT_OPTS, EXTRA_ECONF, F77FLAGS, FC, GCOV, GPROF, INSTALL_MASK, LC_ALL, LD, LFLAGS, LIBTOOL, MAKE, MAKEFLAGS, NM, OBJCOPY, OBJDUMP, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, RANLIB, READELF, RUSTFLAGS, SIZE, STRINGS, STRIP, YACC, YFLAGS ================================================================= Package Settings ================================================================= mail-filter/rspamd-3.5::gentoo was built with the following: USE="jit -blas (-jemalloc) (-selinux) -test" ABI_X86="(64)" CPU_FLAGS_X86="ssse3" LUA_SINGLE_TARGET="lua5-4 -lua5-1 -lua5-3 -luajit" FEATURES="config-protect-if-modified userfetch news merge-sync sandbox parallel-fetch binpkg-multi-instance binpkg-logs binpkg-docompress qa-unresolved-soname-deps usersandbox binpkg-dostrip assume-digests unmerge-logs buildpkg-live pid-sandbox distlocks ebuild-locks xattr ipc-sandbox preserve-libs userpriv parallel-install strict protect-owned sfperms multilib-strict network-sandbox fixlafiles unknown-features-warn unmerge-orphans usersync"
I can confirm it. But it only happens with LUA_SINGLE_TARGET set to lua5-3 or lua5-4. This issue does not happen with lua5-1 nor with luajit. I don't think this is a Gentoo specific issue.
I have git bisected this problem to the commit 884b11488ebc ("[Project] Add schema for external maps") introduced as part of PR https://github.com/rspamd/rspamd/pull/4324.
Upstream fixed the issue in commit https://github.com/rspamd/rspamd/commit/e24c536e5989e2b6d46cd8fb35667c860a175324.
I have same problem
I believe the best will be to disable lua5-{3,4} support in this version or do you have any need for those versions with respect to rspamd?
Well considering rspamd is only package that needs lua i personally moved to luajit, so i personally am not bothered by this.
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=23ab69bb2f0a819c26f9559d28a40aa97f8c7510 commit 23ab69bb2f0a819c26f9559d28a40aa97f8c7510 Author: Petr Vaněk <arkamar@atlas.cz> AuthorDate: 2023-05-25 08:40:14 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-05-26 10:58:45 +0000 mail-filter/rspamd: disable lua5-3, lua5-4 The support for lua5-{3,4} is being temporarily disabled in this version, as the bug fix patch is too large for backporting. Closes: https://bugs.gentoo.org/903577 Upstream-issue: https://github.com/rspamd/rspamd/issues/4455 Signed-off-by: Petr Vaněk <arkamar@atlas.cz> Closes: https://github.com/gentoo/gentoo/pull/31156 Signed-off-by: Sam James <sam@gentoo.org> mail-filter/rspamd/rspamd-3.5-r1.ebuild | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-)
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=0f736635e014f88ede09af2be9f4c06601fe5b75 commit 0f736635e014f88ede09af2be9f4c06601fe5b75 Author: Petr Vaněk <arkamar@atlas.cz> AuthorDate: 2023-08-03 15:36:16 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-08-07 05:35:45 +0000 mail-filter/rspamd: add 3.6 - It was necessary to rebase all patches because upstream changed coding style - New patch was taken from upstream in order to fix tests [1] broken by linter - This version seems to work with libfmt-10 [2], see bug #906068 - Restoring lua5-{3..4} support, see bug #903577 [1] https://github.com/rspamd/rspamd/pull/4560 [2] https://github.com/rspamd/rspamd/issues/4482 Bug: https://bugs.gentoo.org/903577 Bug: https://bugs.gentoo.org/906068 Signed-off-by: Petr Vaněk <arkamar@atlas.cz> Signed-off-by: Sam James <sam@gentoo.org> mail-filter/rspamd/Manifest | 1 + .../files/rspamd-3.6-cmake-lua-version.patch | 64 +++++++++ .../rspamd/files/rspamd-3.6-fix-tests.patch | 23 ++++ .../rspamd/files/rspamd-3.6-unbundle-lua.patch | 61 +++++++++ .../files/rspamd-3.6-unbundle-snowball.patch | 20 +++ mail-filter/rspamd/rspamd-3.6.ebuild | 150 +++++++++++++++++++++ 6 files changed, 319 insertions(+)
