Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 613532 - dev-haskell/zlib-0.6.1.2 fails tests - *** Failed! Exception: 'user error (Codec.Compression.Zlib: stream error)'
Summary: dev-haskell/zlib-0.6.1.2 fails tests - *** Failed! Exception: 'user error (Co...
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Gentoo's Haskell Language team
URL: https://github.com/haskell/zlib/issue...
Whiteboard:
Keywords: TESTFAILURE
Depends on:
Blocks:
 
Reported: 2017-03-22 12:10 UTC by eroen
Modified: 2017-03-31 20:39 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments
dev-haskell/zlib-0.6.1.2:20170322-120737.log (zlib-0.6.1.2:20170322-120737.log,10.12 KB, text/plain)
2017-03-22 12:10 UTC, eroen
Details
zlib-0.6.1.2-tests.log (zlib-0.6.1.2-tests.log,3.25 KB, text/plain)
2017-03-22 12:11 UTC, eroen
Details

Note You need to log in before you can comment on or make changes to this bug.
Description eroen 2017-03-22 12:10:17 UTC
Created attachment 467890 [details]
dev-haskell/zlib-0.6.1.2:20170322-120737.log

I have Haskle overlay enabled, but this happens with both zlib package from the overlay and from Gentoo.


>>> Test phase: dev-haskell/zlib-0.6.1.2
 * >>> Test phase [cabal test]: dev-haskell/zlib-0.6.1.2
./setup test --show-details=streaming
Running 1 test suites...
Test suite tests: RUNNING...
zlib tests
  property tests
    decompress . compress = id (standard):            FAIL (0.29s)
      *** Failed! Exception: 'user error (Codec.Compression.Zlib: stream error)' (after 1 test): 
      GZip
      CompressParams {compressLevel = CompressionLevel 4, compressMethod = Deflated, compressWindowBits = WindowBits 8, compressMemoryLevel = MemoryLevel 5, compressStrategy = DefaultStrategy, compressBufferSize = 121850, compressDictionary = Nothing}
      DecompressParams {decompressWindowBits = WindowBits 12, decompressBufferSize = 44823, decompressDictionary = Nothing, decompressAllMembers = False}
      ""
      Use --quickcheck-replay '0 TFGenR 000013DCC9212C1D000000001DCD6500000000000000E1EA00000003B9ACA000 0 1 1 0' to reproduce.
    decompress . compress = id (Zlib -> GZipOrZLib):  OK (0.80s)
      +++ OK, passed 100 tests.
    decompress . compress = id (GZip -> GZipOrZlib):  FAIL (0.02s)
      *** Failed! Exception: 'user error (Codec.Compression.Zlib: stream error)' (after 6 tests and 1 shrink): 
      CompressParams {compressLevel = CompressionLevel 6, compressMethod = Deflated, compressWindowBits = WindowBits 8, compressMemoryLevel = MemoryLevel 8, compressStrategy = DefaultStrategy, compressBufferSize = 102786, compressDictionary = Nothing}
      DecompressParams {decompressWindowBits = WindowBits 11, decompressBufferSize = 51348, decompressDictionary = Nothing, decompressAllMembers = True}
      ""
      Use --quickcheck-replay '5 TFGenR 000013DCC9212C1D000000001DCD6500000000000000E1EA00000003B9ACA000 0 508 9 0' to reproduce.
    concatenated gzip members:                        FAIL
      *** Failed! Exception: 'user error (Codec.Compression.Zlib: stream error)' (after 3 tests): 
      CompressParams {compressLevel = CompressionLevel 7, compressMethod = Deflated, compressWindowBits = WindowBits 8, compressMemoryLevel = MemoryLevel 8, compressStrategy = Filtered, compressBufferSize = 719992, compressDictionary = Nothing}
      DecompressParams {decompressWindowBits = WindowBits 13, decompressBufferSize = 40222, decompressDictionary = Nothing, decompressAllMembers = True}
      ""
      Use --quickcheck-replay '2 TFGenR 000013DCC9212C1D000000001DCD6500000000000000E1EA00000003B9ACA000 0 56 6 0' to reproduce.
    multiple gzip members, boundaries (all 2-chunks): OK (0.07s)
      +++ OK, passed 100 tests.
    multiple gzip members, boundaries (all 3-chunks): OK (0.76s)
      +++ OK, passed 100 tests.
    prefixes of valid stream detected as truncated:   OK (0.04s)
      +++ OK, passed 100 tests.
  unit tests
    simple gzip case:                                 OK
    detect bad crc:                                   OK
    detect non-gzip:                                  OK
    detect custom dictionary:                         OK
    dectect inflate with wrong dict:                  OK
    dectect inflate with right dict:                  OK
    handle trailing data:                             OK
    multiple gzip members:                            OK
    check small input chunks:                         OK
    check empty input:                                OK
    check exception raised:                           OK

3 out of 18 tests failed (2.01s)
Test suite tests: FAIL
Test suite logged to: dist/test/zlib-0.6.1.2-tests.log
0 of 1 test suites (0 of 1 test cases) passed.
 * ERROR: dev-haskell/zlib-0.6.1.2::gentoo failed (test phase):
 *   cabal test failed
 * 
 * Call stack:
 *     ebuild.sh, line  115:  Called src_test
 *   environment, line 2962:  Called haskell-cabal_src_test
 *   environment, line 2066:  Called die
 * The specific snippet of code:
 *           ./setup "$@" || die "cabal test failed";
Comment 1 eroen 2017-03-22 12:11:45 UTC
Created attachment 467892 [details]
zlib-0.6.1.2-tests.log
Comment 2 eroen 2017-03-22 12:12:56 UTC
occam ~ # emerge --info '=dev-haskell/zlib-0.6.1.2::gentoo'
Error during set creation: Could not import 'smartliverebuild.sets.SmartLiveRebuildSet' for section 'smart-live-rebuild'
Portage 2.3.5 (python 3.6.0-final-0, hardened/linux/amd64, gcc-6.3.0, glibc-2.23-r3, 4.9.15-hardened-o1 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.9.15-hardened-o1-x86_64-Intel-R-_Core-TM-_i5-2520M_CPU_@_2.50GHz-with-gentoo-2.3
KiB Mem:     8000768 total,    130400 free
KiB Swap:   16777212 total,  14621472 free
Timestamp of repository gentoo: Wed, 22 Mar 2017 07:00:01 +0000
Timestamp of repository eroen: Sun, 30 Oct 2016 21:58:42 +0000
sh bash 4.4_p12
ld GNU ld (Gentoo 2.27 p1.0) 2.27
ccache version 3.3.4 [disabled]
app-shells/bash:          4.4_p12::gentoo
dev-java/java-config:     2.2.0-r3::gentoo
dev-lang/perl:            5.24.1-r1::gentoo
dev-lang/python:          2.7.13::gentoo, 3.4.6::gentoo, 3.5.3::gentoo, 3.6.0::gentoo
dev-util/ccache:          3.3.4::gentoo
dev-util/cmake:           3.7.2::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.3::gentoo
sys-apps/openrc:          0.24.1::gentoo
sys-apps/sandbox:         2.10-r4::gentoo
sys-devel/autoconf:       2.13::gentoo, 2.69-r2::gentoo
sys-devel/automake:       1.11.6-r2::gentoo, 1.12.6-r1::gentoo, 1.14.1-r1::gentoo, 1.15-r2::gentoo
sys-devel/binutils:       2.27::gentoo
sys-devel/gcc:            4.9.3::gentoo, 5.3.0::gentoo, 5.4.0-r2::gentoo, 6.3.0::gentoo
sys-devel/gcc-config:     1.8-r1::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1::gentoo
sys-kernel/linux-headers: 4.10::gentoo (virtual/os-headers)
sys-libs/glibc:           2.23-r3::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-extra-opts: --exclude ChangeLog* --exclude /metadata/cache/ --stats --delay-updates -c

eroen
    location: /usr/local/portage
    masters: gentoo
    priority: 0

sapher
    location: /var/lib/overlays/sapher
    sync-type: git
    sync-uri: https://github.com/apinsard/sapher-overlay.git
    masters: gentoo

wiktorb
    location: /var/lib/overlays/wiktorb
    sync-type: git
    sync-uri: https://github.com/wiktor-b/overlay.git
    masters: gentoo

enlightenment
    location: /var/lib/layman/enlightenment
    masters: gentoo
    priority: 50

flora
    location: /var/lib/layman/flora
    masters: gentoo
    priority: 50

gamerlay
    location: /var/lib/layman/gamerlay
    masters: gentoo
    priority: 50

glc
    location: /var/lib/layman/glc
    masters: gentoo
    priority: 50

hardened-development
    location: /var/lib/layman/hardened-development
    masters: gentoo
    priority: 50

haskell
    location: /var/lib/layman/haskell
    masters: gentoo
    priority: 50

hasufell
    location: /var/lib/layman/hasufell
    masters: gentoo
    priority: 50

java
    location: /var/lib/layman/java
    masters: gentoo
    priority: 50

laurentb
    location: /var/lib/layman/laurentb
    masters: gentoo
    priority: 50

roslin
    location: /var/lib/layman/roslin
    masters: gentoo
    priority: 50

science
    location: /var/lib/layman/science
    masters: gentoo
    priority: 50

stuff
    location: /var/lib/layman/stuff
    sync-type: git
    sync-uri: https://github.com/istitov/stuff.git
    masters: gentoo
    priority: 50

sunrise
    location: /var/lib/layman/sunrise
    masters: gentoo
    priority: 50

toolchain
    location: /var/lib/layman/toolchain
    masters: gentoo
    priority: 50

v-fox
    location: /var/lib/layman/v-fox
    masters: gentoo
    priority: 50

wine-a-holics
    location: /var/lib/layman/wine-a-holics
    masters: gentoo
    priority: 50

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-march=corei7-avx -pipe -Og -g -gdwarf-4"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/easy-rsa /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=corei7-avx -pipe -Og -g -gdwarf-4"
DISTDIR="/var/distfiles"
EMERGE_DEFAULT_OPTS="--jobs=4 --autounmask --quiet-build --nospinner --verbose-conflicts --verbose-slot-rebuilds"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs binpkg-multi-instance cgroup collision-protect compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles installsources ipc-sandbox merge-sync network-sandbox news parallel-fetch parallel-install preserve-libs protect-owned sandbox sfperms split-log splitdebug strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS=""
LANG="en_GB.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
MAKEOPTS="-j4 -l10"
PKGDIR="/var/packages"
PORTAGE_COMPRESS="xz"
PORTAGE_COMPRESS_FLAGS="-9"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--exclude ChangeLog* --exclude /metadata/cache/ --stats --delay-updates -c"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl alsa amd64 apng audio audiofile avresample avx bash-completion bdf berkdb bluray bzip2 cairo caps cb cdda cdparanoia cdr cjk cli corefonts cracklib crypt cups curl cxx ddate declarative detex device-mapper dga dia djvu dmapi dri dts dvd dvi2tty dvipdfm ebook egl exif fam ffmpeg fftw fits flac fontconfig g3dvl gallium gbm gcrypt gdbm gif gimp git glamor glib glibc-omitfp gmp gnuplot gnutls gold gpm graphics graphviz gs gstreamer gtk gtk3 hardened highlight hscolour iconv icu id3tag idn imagemagick imlib inotify iproute2 ipv6 jbig jpeg jpeg2k jpg json justify kde kde4 kpathsea latex lcms libffi libssh2 libv4l luatex lvm lvm2 lzma lzo man metric mikmod mkv mms mmx mng modules mp3 mpeg mpg123 multilib multimedia musepack ncurses netlink nptl nut ocr odbc offensive ogg opengl openmp openvg optimization optimized-qmake opus pam pango pax_kernel pcre pdf pgf phonon pie png postscript private-headers pstricks pth publishers python3 qt3support qt4 raw readline samba sbsms scanner science sdl seccomp session smp sna sndfile speex spell sqlite sse sse2 sse3 sse4 sse41 sse4_1 sse4_2 ssh ssl ssp ssse3 svg t1lib tcpd tesseract theora threads tiff tls truetype udev unicode urandom usb v4l v4l2 vaapi video vorbis vpx webp wmf x264 xanim xattr xcb xcomposite xetex xfs xft xinerama xkb xml xmlpatterns xorg xosd xpm xrandr xtpax xv xvid xvmc xz zlib zsh-completion" ABI_X86="32 64" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="mmx sse sse2 avx sse3 ssse3 sse4_1 aes avx mmxext popcnt sse3 sse4_1 sse4_2 ssse3" CURL_SSL="openssl" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64" INPUT_DEVICES="mouse keyboard evdev synaptics wacom" KERNEL="linux" L10N="en en-US en-GB eng" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en gb us en_US en_GB eng jbo no nb nn no_NO nb_NO nn_NO nor" LLVM_TARGETS="BPF X86" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-3" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4 python3_5 python3_6" QEMU_SOFTMMU_TARGETS="x86_64 i386" RUBY_TARGETS="ruby21" SANE_BACKENDS="plustek" USERLAND="GNU" VIDEO_CARDS="intel i965 ilo" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
USE_PYTHON="2.7 3.3 3.4"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND

occam ~ # emerge -pqv '=dev-haskell/zlib-0.6.1.2::gentoo'
Error during set creation: Could not import 'smartliverebuild.sets.SmartLiveRebuildSet' for section 'smart-live-rebuild'
[ebuild  r  U ] dev-haskell/zlib-0.6.1.2 [0.6.1.1] USE="hscolour {test*} -doc -non-blocking-ffi% (-profile)" 
[ebuild  rR   ] dev-haskell/streaming-commons-0.1.17  USE="hscolour {test} -doc -hoogle (-profile)" 
[ebuild  rR   ] dev-haskell/happstack-server-7.4.6.2  USE="hscolour network-uri template_haskell {test} -doc -hoogle (-profile)" 
[ebuild  rR   ] dev-haskell/juicypixels-3.2.8.1  USE="hscolour -doc -hoogle -mmap (-profile)" 
[ebuild  rR   ] dev-haskell/zip-archive-0.3.0.5  USE="hscolour {test} -doc -executable -hoogle (-profile)" 
[ebuild  rR   ] app-text/pandoc-1.19.2.1-r2  USE="hscolour https network-uri {test} -doc -embed_data_files -hoogle (-profile) -trypandoc -weigh-pandoc" 
[ebuild  rR   ] www-apps/gitit-0.12.2.1  USE="hscolour network-uri plugins -doc -hoogle (-profile)" 

The following packages are causing rebuilds:

  (dev-haskell/zlib-0.6.1.2:0/0.6.1.2::gentoo, ebuild scheduled for merge) causes rebuilds for:
    (dev-haskell/juicypixels-3.2.8.1:0/3.2.8.1::haskell, ebuild scheduled for merge)
    (www-apps/gitit-0.12.2.1:0/0.12.2.1::haskell, ebuild scheduled for merge)
    (dev-haskell/zip-archive-0.3.0.5:0/0.3.0.5::haskell, ebuild scheduled for merge)
    (dev-haskell/happstack-server-7.4.6.2:0/7.4.6.2::haskell, ebuild scheduled for merge)
    (app-text/pandoc-1.19.2.1-r2:0/1.19.2.1::haskell, ebuild scheduled for merge)
    (dev-haskell/streaming-commons-0.1.17:0/0.1.17::haskell, ebuild scheduled for merge)
Comment 3 Sergei Trofimovich (RETIRED) gentoo-dev 2017-03-28 20:53:18 UTC
My guess would be that it started failing with sys-libs/zlib-1.2.11 upgrade.
Comment 4 Sergei Trofimovich (RETIRED) gentoo-dev 2017-03-28 20:57:21 UTC
Filed issue upstream as https://github.com/haskell/zlib/issues/11
Comment 5 Sergei Trofimovich (RETIRED) gentoo-dev 2017-03-31 20:39:59 UTC
I've poked test failures a bit more in upstream bug: https://github.com/haskell/zlib/issues/11

TL;DR is: sys-libs/zlib poorly handles 8-bit compression window. zlib-1.2.11
officially confirmed it and now rejects to perform compression with:
    https://github.com/madler/zlib/commit/049578f0a1849f502834167e233f4c1d52ddcbcc

dev-haskell/zlib's quickcheck tests rediscovered it on their own.

While upstream ponders on cleaner way to remove this case from tess I've
filtered out 8-bit window compression attempts in a crude way with the
following commit:
    https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=550762d9c6c54ae40e01e0cb5396e08843edb64b

Thanks for the report!