| Summary: | dev-db/sqlite[icu] with C / POSIX locale (LC_MESSAGES) fails test fts3expr4-1.8 | ||
|---|---|---|---|
| Product: | Gentoo Linux | Reporter: | Paolo Pedroni <paolo.pedroni> |
| Component: | Current packages | Assignee: | Arfrever Frehtes Taifersar Arahesis <arfrever.fta> |
| Status: | RESOLVED FIXED | ||
| Severity: | normal | CC: | floppym, leio, toralf |
| Priority: | Normal | ||
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Package list: | Runtime testing required: | --- | |
| Bug Depends on: | |||
| Bug Blocks: | 649954 | ||
| Attachments: |
sqlite-3.16.2:20170223-094556.log.gz
sqlite-3.20.0:20170816-143902.log.gz |
||
|
Description
Paolo Pedroni
2017-02-23 10:08:06 UTC
Failure in at least fts4unicode-6.icu.16 is due to newer ICU and is worked around in SQLite 3.20.0. https://groups.google.com/forum/#!topic/sqlite-dev/PdeL8KDkuZ4 https://sqlite.org/src/info/69ae688982d6cb9f SQLite 3.20.0 is now in the tree. Created attachment 489278 [details]
sqlite-3.20.0:20170816-143902.log.gz
# emerge --info =dev-db/sqlite-3.20.0
Portage 2.3.6 (python 3.5.3-final-0, default/linux/amd64/13.0/desktop/plasma/systemd, gcc-6.4.0, glibc-2.23-r4, 4.11.9-gentoo x86_64)
=================================================================
System Settings
=================================================================
System uname: Linux-4.11.9-gentoo-x86_64-Intel-R-_Core-TM-_i7-2600_CPU_@_3.40GHz-with-gentoo-2.3
KiB Mem: 15864400 total, 4677816 free
KiB Swap: 8171516 total, 8171516 free
Timestamp of repository gentoo: Wed, 16 Aug 2017 06:15:01 +0000
sh dash 0.5.8.2
ld GNU gold (Gentoo 2.28 p1.2 2.28) 1.14
distcc 3.2rc1 x86_64-pc-linux-gnu [enabled]
ccache version 3.3.4 [disabled]
app-shells/bash: 4.3_p48-r1::gentoo
dev-java/java-config: 2.2.0-r3::gentoo
dev-lang/perl: 5.24.1-r2::gentoo
dev-lang/python: 2.7.13::gentoo, 3.5.3::gentoo
dev-util/ccache: 3.3.4::gentoo
dev-util/cmake: 3.7.2::gentoo
dev-util/pkgconfig: 0.28-r2::gentoo
sys-apps/baselayout: 2.3::gentoo
sys-apps/sandbox: 2.10-r3::gentoo
sys-devel/autoconf: 2.13::gentoo, 2.69::gentoo
sys-devel/automake: 1.11.6-r1::gentoo, 1.15-r2::gentoo
sys-devel/binutils: 2.28-r2::gentoo
sys-devel/gcc: 6.4.0::gentoo
sys-devel/gcc-config: 1.8-r1::gentoo
sys-devel/libtool: 2.4.6-r3::gentoo
sys-devel/make: 4.2.1::gentoo
sys-kernel/linux-headers: 4.10::gentoo (virtual/os-headers)
sys-libs/glibc: 2.23-r4::gentoo
Repositories:
gentoo
location: /usr/portage
sync-type: rsync
sync-uri: rsync://rsync.europe.gentoo.org/gentoo-portage
priority: -1000
x-portage
location: /usr/local/portage
masters: gentoo
priority: 0
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=sandybridge -msahf --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=8192 -flto=8 -fuse-linker-plugin -floop-nest-optimize -ftree-loop-distribution -fgraphite-identity -ftree-vectorize"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php7.0/ext-active/ /etc/php/cgi-php7.0/ext-active/ /etc/php/cli-php7.0/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -pipe -march=sandybridge -msahf --param l1-cache-size=32 --param l1-cache-line-size=64 --param l2-cache-size=8192 -flto=8 -fuse-linker-plugin -floop-nest-optimize -ftree-loop-distribution -fgraphite-identity -ftree-vectorize"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going y --with-bdeps y"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs cgroup compress-build-logs config-protect-if-modified distcc distlocks ebuild-locks ipc-sandbox merge-sync news parallel-fetch protect-owned sandbox sfperms split-elog split-log strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://tux.rainside.sk/gentoo/ http://mirror.leaseweb.com/gentoo/ http://ftp.uni-erlangen.de/pub/mirrors/gentoo http://ftp.spline.inf.fu-berlin.de/mirrors/gentoo/"
LANG="it_IT.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu -Wl,--sort-common -flto=8 -fuse-linker-plugin -floop-nest-optimize -ftree-loop-distribution -fgraphite-identity -ftree-vectorize"
MAKEOPTS="-j11 -l8"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac aalib acl acpi activities adns alsa amd64 ao audiofile bash-completion bluetooth branding bzip2 cairo caps cdda cddb cdparanoia cdr cli cracklib crypt css cups curl cxx dbus declarative dga djvu dri dts dvd dvdr emboss encode exif expat fbcon ffmpeg fftw firefox flac fontconfig foomaticdb fortran ftp gd gdbm geoip gif gimp glamor gmp gnutls gphoto2 gpm graphviz gtk handbook iconv icu idn imagemagick imlib ipv6 java javascript jbig jpeg jpeg2k kde kipi kwallet lame lcms libass libcaca libnotify libsamplerate lm_sensors lua lzma lzo mad mmap mng modules mp3 mp4 mpeg mplayer multilib musicbrainz ncurses nls nptl nsplugin offensive ogg openal openexr opengl openmp pam pango pcre pdf phonon plasma png policykit postscript ppds pulseaudio qml qt3support qt4 qt5 rdesktop readline recode samba sctp sdl seccomp session sndfile sockets speex spell sqlite ssl startup-notification subversion svg symlink syslog systemd sysvipc taglib theora threads tidy tiff truetype udev udisks unicode upower usb vaapi vcd vim-syntax vnc vorbis wayland widgets win32codecs wmf wxwidgets x264 xattr xcb xcomposite xine xinerama xml xpm xscreensaver xv xvid yahoo zlib" ABI_X86="64" ALSA_CARDS="hda-intel virmidi" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="kodak ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="libinput" KERNEL="linux" L10N="it en" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="nlpsolver" LINGUAS="it it_IT" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" POSTGRES_TARGETS="postgres9_5" PYTHON_TARGETS="python2_7 python3_5 pypy pypy3" RUBY_TARGETS="ruby22" USERLAND="GNU" VIDEO_CARDS="intel i965" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON
# emerge -1pqv =dev-db/sqlite-3.20.0
[ebuild U ] dev-db/sqlite-3.20.0 [3.19.3] USE="icu readline {test*} -debug -doc -secure-delete -static-libs -tcl -tools" ABI_X86="(64) -32 (-x32)"
Tests pass for me and I am unable to help. Please report problem to SQLite upstream. *** Bug 639342 has been marked as a duplicate of this bug. *** Still fails:
! fts3expr4-1.8 expected: [PHRASE 3 0 d:word]
! fts3expr4-1.8 got: [AND {AND {PHRASE 3 0 d} {PHRASE 3 0 :}} {PHRASE 3 0 word}]
This was for the following USE flag combination:
[ebuild U ~] dev-db/sqlite-3.22.0:3::gentoo [3.21.0:3::gentoo] USE="icu* readline tcl* {test} tools* -debug (-doc) -secure-delete -static-libs" 0 KiB
emerge --info:
Portage 2.3.24 (python 2.7.14-final-0, default/linux/arm64/17.0, gcc-6.4.0, glibc-2.25-r11, 4.9.0-4-arm64 aarch64)
=================================================================
System Settings
=================================================================
System uname: Linux-4.9.0-4-arm64-aarch64-with-gentoo-2.4.1
KiB Mem: 131544964 total, 57588132 free
KiB Swap: 3321056 total, 3321056 free
Timestamp of repository gentoo: Sun, 08 Apr 2018 09:30:01 +0000
Head commit of repository gentoo: 9bf21f522c4732fd1dc466c7e52166e5dec6a3ef
sh bash 4.3_p48-r1
ld GNU ld (Gentoo 2.29.1 p3) 2.29.1
app-shells/bash: 4.3_p48-r1::gentoo
dev-lang/perl: 5.24.3::gentoo
dev-lang/python: 2.7.14-r1::gentoo, 3.5.4-r1::gentoo
dev-util/cmake: 3.9.6::gentoo
dev-util/pkgconfig: 0.29.2::gentoo
sys-apps/baselayout: 2.4.1-r2::gentoo
sys-apps/openrc: 0.34.11::gentoo
sys-apps/sandbox: 2.12::gentoo
sys-devel/autoconf: 2.69-r4::gentoo
sys-devel/automake: 1.9.6-r5::gentoo, 1.12.6-r2::gentoo, 1.15.1-r2::gentoo
sys-devel/binutils: 2.29.1-r1::gentoo
sys-devel/gcc: 6.4.0-r1::gentoo
sys-devel/gcc-config: 1.8-r1::gentoo
sys-devel/libtool: 2.4.6-r3::gentoo
sys-devel/make: 4.1-r1::gentoo
sys-kernel/linux-headers: 4.13::gentoo (virtual/os-headers)
sys-libs/glibc: 2.25-r11::gentoo
Repositories:
gentoo
location: /usr/portage
sync-type: rsync
sync-uri: rsync://rsync.gentoo.org/gentoo-portage
priority: -1000
sync-rsync-verify-metamanifest: no
sync-rsync-extra-opts:
ACCEPT_KEYWORDS="arm64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="aarch64-unknown-linux-gnu"
CFLAGS="-O2 -pipe"
CHOST="aarch64-unknown-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2"
DISTDIR="/usr/portage/distfiles"
FCFLAGS="-O2"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news parallel-fetch preserve-libs protect-owned sandbox sfperms strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2"
GENTOO_MIRRORS="http://gentoo.osuosl.org/"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j99"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="acl arm64 berkdb bzip2 cli crypt cxx dri fortran gdbm iconv icu ipv6 modules multilib ncurses nls nptl openmp pam pcre readline seccomp ssl tcl tcpd tools unicode xattr zlib" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_ARM="edsp neon thumb thumb2 v4 v5 v6 v7 v8 vfp vfp-d32 vfpv3 vfpv4" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-0" POSTGRES_TARGETS="postgres9_5" PYTHON_SINGLE_TARGET="python3_5" PYTHON_TARGETS="python2_7 python3_5" RUBY_TARGETS="ruby21 ruby22 ruby23" USERLAND="GNU" VIDEO_CARDS="fbdev dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset: CC, CPPFLAGS, CTARGET, CXX, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
3.21 had passed tests on this system, thus likely USE=icu and/or USE=tcl specific from the USE flag changes seen in my previous comment. Please try to reproduce with those USE flags. Maintainer: please also take care of any necessary upstream interaction, if needed request me information they ask and you can't provide yourself. I don't want to go search, create accounts and monitor upstream communication replies for every test failure I hit with arch team work, with no specific interest otherwise. I wonder if maybe fts3expr4-1.8 randomly fails or passes. Could you try test suite several times for the same version of SQLite? Failed again last night. Now another test run started for the night. Would be much faster with more parallel running, so I wouldn't just re-run when I remember once a day for this testing :) almost 99% of the machine is idle... ;) That other run failed, and two more after that. I'm willing to conclude that it's not a failure based on "luck". The expected->got seems to suggest this as well, as it appears to be a pretty clear different expression that's always the same that's gotten (instead of the supposedly expected one). *** Bug 629916 has been marked as a duplicate of this bug. *** test/fts3expr4.test contains:
ifcapable !fts3||!icu {
finish_test
return
}
Test suite of dev-db/sqlite-3.23.1[icu] fully passed for me.
Please check if this problem still occurs for you in dev-db/sqlite-3.23.1[icu].
(In reply to Arfrever Frehtes Taifersar Arahesis from comment #14) > Test suite of dev-db/sqlite-3.23.1[icu] fully passed for me. > Please check if this problem still occurs for you in > dev-db/sqlite-3.23.1[icu]. The problem still occurs... SQLite 2018-04-10 17:39:29 4bb2294022060e61de7da5c227a69ccd846ba330e31626ebcd59a94efd14alt1 2 errors out of 189661 tests on paolop Linux 64-bit little-endian !Failures on these tests: fts3expr4-1.8 zipfile2-2.0 All memory allocations freed - no leaks Maximum memory usage: 9300608 bytes Current memory usage: 0 bytes Number of malloc() : -1 calls make: *** [Makefile:1186: tcltest] Error 1 With 3.23.1:
! fts3expr4-1.8 expected: [PHRASE 3 0 d:word]
! fts3expr4-1.8 got: [AND {AND {PHRASE 3 0 d} {PHRASE 3 0 :}} {PHRASE 3 0 word}]
Time: fts3expr4.test 32 ms
...
SQLite 2018-04-10 17:39:29 4bb2294022060e61de7da5c227a69ccd846ba330e31626ebcd59a94efd14alt1
1 errors out of 189672 tests on arm64-build.packet.gentoo.org Linux 64-bit little-endian
!Failures on these tests: fts3expr4-1.8
All memory allocations freed - no leaks
Maximum memory usage: 9300656 bytes
Current memory usage: 0 bytes
Number of malloc() : -1 calls
Makefile:1186: recipe for target 'tcltest' failed
make: *** [tcltest] Error 1
* ERROR: dev-db/sqlite-3.23.1::gentoo failed (test phase):
zipfile2-2.0 problem -> bug #653450 in case this got lost from IRC: both my amd64 and arm64 tested systems which fail the test have icu-60.2 I can reproduce this problem with C / POSIX locale. In case LC_ALL is not used, the relevant more specific category is LC_MESSAGES. It fails with en_US.UTF-8 set in /etc/env.d/02locale just as well. BUT that's probably because current stages come with this in /etc/portage/make.conf: # This sets the language of build output to English. # Please keep this setting intact when reporting bugs. LC_MESSAGES=C (In reply to Mart Raudsepp from comment #20) > It fails with en_US.UTF-8 set in /etc/env.d/02locale just as well. BUT > that's probably because current stages come with this in > /etc/portage/make.conf: > > # This sets the language of build output to English. > # Please keep this setting intact when reporting bugs. > LC_MESSAGES=C Though after commenting it out, it seems to still fail. Could use an echoing out of that value in the test perhaps to be sure what's up; how do I do that in there (tcl I think?)? The base profile sets LC_MESSAGES="C". https://gitweb.gentoo.org/repo/gentoo/historical.git/commit/?id=8147a11286e3c Perhaps Arfrever is not using standard Gentoo profiles on his system. My make.conf simply sets custom LC_MESSAGES. The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=21b024cfc0d3b573f6cae50b1ac047eddcbc09aa commit 21b024cfc0d3b573f6cae50b1ac047eddcbc09aa Author: Arfrever Frehtes Taifersar Arahesis <Arfrever@Apache.Org> AuthorDate: 2018-04-30 13:41:36 +0000 Commit: Mike Gilbert <floppym@gentoo.org> CommitDate: 2018-04-30 15:39:46 +0000 dev-db/sqlite: Fix test fts3expr4-1.8 with C / POSIX locale (LC_MESSAGES). Closes: https://bugs.gentoo.org/610666 .../files/sqlite-3.23.1-full_archive-tests.patch | 197 +++++++++++++++++++++ 1 file changed, 197 insertions(+) |
