Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 658806 - sys-apps/portage-2.3.40-r1: EOFError: Compressed file ended before the end-of-stream marker was reached
Summary: sys-apps/portage-2.3.40-r1: EOFError: Compressed file ended before the end-of...
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Core (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS
Depends on:
Blocks: 659322
  Show dependency tree
 
Reported: 2018-06-23 08:54 UTC by Pacho Ramos
Modified: 2020-03-01 19:22 UTC (History)
0 users

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Pacho Ramos gentoo-dev 2018-06-23 08:54:26 UTC
I have just seen this error (after that it seems that portage has hung)
>>> Emerging (4 of 4) app-emulation/crossover-bin-17.5.0::gentoo
 * install-crossover-17.5.0.bin BLAKE2B SHA512 size ;-) ...                                                                                                                                                 [ ok ]
>>> Unpacking source...
>>> Unpacking install-crossover-17.5.0.bin to /var/tmp/portage/app-emulation/crossover-bin-17.5.0/work
warning [/var/tmp/portage/app-emulation/crossover-bin-17.5.0/distdir/install-crossover-17.5.0.bin]:  867913 extra bytes at beginning or within zipfile
  (attempting to process anyway)
>>> Source unpacked in /var/tmp/portage/app-emulation/crossover-bin-17.5.0/work
>>> Preparing source in /var/tmp/portage/app-emulation/crossover-bin-17.5.0/work ...
 * Fixing shebang in ./bin/cxtie.
 * Fixing shebang in ./bin/cxrun.
 * Fixing shebang in ./bin/cxmessage.
 * Fixing shebang in ./bin/cxregister.
 * Fixing shebang in ./bin/cxupdatecheck.
 * Fixing shebang in ./bin/cxprefs.
 * Fixing shebang in ./bin/crossover.
 * Fixing shebang in ./bin/cxinstaller.
 * Fixing shebang in ./bin/cxreset.
 * Fixing shebang in ./bin/cxfix.
 * Fixing shebang in ./bin/cxwait.
>>> Source prepared.
>>> Configuring source in /var/tmp/portage/app-emulation/crossover-bin-17.5.0/work ...
>>> Source configured.
>>> Compiling source in /var/tmp/portage/app-emulation/crossover-bin-17.5.0/work ...
>>> Source compiled.
 * Skipping make test/check due to ebuild restriction.
>>> Test phase [disabled because of RESTRICT=test]: app-emulation/crossover-bin-17.5.0

>>> Install crossover-bin-17.5.0 into /var/tmp/portage/app-emulation/crossover-bin-17.5.0/image/ category app-emulation
>>> Completed installing crossover-bin-17.5.0 into /var/tmp/portage/app-emulation/crossover-bin-17.5.0/image/

 * Final size of build directory: 495516 KiB (483.9 MiB)
 * Final size of installed tree:  495684 KiB (484.0 MiB)

Exception in callback AsynchronousTask.wait()
handle: <Handle AsynchronousTask.wait()>
Traceback (most recent call last):
  File "/usr/lib64/python3.6/asyncio/events.py", line 145, in _run
    self._callback(*self._args)
  File "/usr/lib64/python3.6/site-packages/_emerge/AsynchronousTask.py", line 84, in wait
    self._wait_hook()
  File "/usr/lib64/python3.6/site-packages/_emerge/AsynchronousTask.py", line 195, in _wait_hook
    self._exit_listener_stack.pop()(self)
  File "/usr/lib64/python3.6/site-packages/_emerge/EbuildPhase.py", line 205, in _ebuild_exit
    self._ebuild_exit_unlocked(ebuild_process)
  File "/usr/lib64/python3.6/site-packages/_emerge/EbuildPhase.py", line 244, in _ebuild_exit_unlocked
    _check_build_log(self.settings, out=out)
  File "/usr/lib64/python3.6/site-packages/portage/package/ebuild/doebuild.py", line 1863, in _check_build_log
    for line in f:
  File "/usr/lib64/python3.6/gzip.py", line 374, in readline
    return self._buffer.readline(size)
  File "/usr/lib64/python3.6/_compression.py", line 68, in readinto
    data = self.read(len(byte_view))
  File "/usr/lib64/python3.6/gzip.py", line 482, in read
    raise EOFError("Compressed file ended before the "
EOFError: Compressed file ended before the end-of-stream marker was reached
7


^C

Exiting on signal 2
^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C^C
Comment 1 Pacho Ramos gentoo-dev 2018-06-23 08:54:37 UTC
Portage 2.3.40 (python 3.6.5-final-0, default/linux/amd64/17.0/desktop/gnome/systemd, gcc-7.3.0, glibc-2.26-r7, 4.14.48-gentoo x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-4.14.48-gentoo-x86_64-Intel-R-_Core-TM-_i7-7700HQ_CPU_@_2.80GHz-with-gentoo-2.4.1
KiB Mem:    16132568 total,   5410384 free
KiB Swap:    5240828 total,   5240316 free
Timestamp of repository gentoo: Wed, 20 Jun 2018 19:30:01 +0000
Head commit of repository gentoo: 67cbdcd922d5bcf8defcfee8b760cc998a3b280d
sh bash 4.4_p12
ld GNU ld (Gentoo 2.30 p2) 2.30.0
ccache version 3.3.4 [enabled]
app-shells/bash:          4.4_p12::gentoo
dev-java/java-config:     2.2.0-r4::gentoo
dev-lang/perl:            5.24.3-r1::gentoo
dev-lang/python:          2.7.14-r1::gentoo, 3.5.5-r1::gentoo, 3.6.5-r1::gentoo
dev-util/ccache:          3.3.4-r1::gentoo
dev-util/cmake:           3.9.6::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.4.1-r2::gentoo
sys-apps/openrc:          0.34.11::gentoo
sys-apps/sandbox:         2.13::gentoo
sys-devel/autoconf:       2.13::gentoo, 2.69-r4::gentoo
sys-devel/automake:       1.11.6-r3::gentoo, 1.15.1-r2::gentoo
sys-devel/binutils:       2.30-r2::gentoo
sys-devel/gcc:            7.3.0-r3::gentoo
sys-devel/gcc-config:     1.8-r1::gentoo
sys-devel/libtool:        2.4.6-r3::gentoo
sys-devel/make:           4.2.1::gentoo
sys-kernel/linux-headers: 4.13::gentoo (virtual/os-headers)
sys-libs/glibc:           2.26-r7::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: rsync://rsync.gentoo.org/gentoo-portage
    priority: -1000
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: no
    sync-rsync-verify-max-age: 24
    sync-rsync-extra-opts: 

x-portage
    location: /usr/local/portage
    masters: gentoo
    priority: 0

ago
    location: /hdd/portage/local/layman/ago
    masters: gentoo
    priority: 50

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="*"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=native -fno-stack-protector"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=native -fno-stack-protector"
DISTDIR="/hdd/distfiles"
EMERGE_DEFAULT_OPTS="--quiet-build=n --autounmask-write --keep-going"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs ccache cgroup compress-build-logs compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync multilib-strict news parallel-fetch parallel-install preserve-libs protect-owned sandbox sfperms sign split-log strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="ftp://ftp.free.fr/mirrors/ftp.gentoo.org/"
LANG="es_ES.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
LINGUAS="es es_ES en en_US fr fr_FR"
MAKEOPTS="-j9"
PKGDIR="/hdd/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac acl acpi alsa amd64 applet avahi avx avx256 bash-completion berkdb bluetooth branding bzip2 cairo ccache cdda cddb cdr chm chromecast cli colord crypt cups cvs cxx dbus djvu dri dts dvd dvdr dvi ebook eds emboss enchant encode evo exif fam fat ffmpeg flac fortran fuse gdbm gif git glamor gnome gnome-keyring gnome-online-accounts google googledrive gphoto2 gpm gromacs gstreamer gtk gtk3 gtkstyle hfs http iconv infinality introspection ios irc jabber jpeg kpathsea latex lcms ldap libass libnotify libsecret libtirpc libvisual lyx mad microdns mms mmx mmxext mng mobi modules monolithic-build mp3 mp4 mpeg mtp multilib musicbrainz nautilus ncurses network-cron networkmanager nls nptl ntfs ntp numa nvidia offensive ogg opengl openmp optimized-qmake pam pango pch pdf pdfimport png policykit ppds pulseaudio qt3support qt5 readline reiserfs scanner sdl seccomp sendto smp sna snmp spell squashfs sse sse2 sse3 sse4 sse4_1 ssl ssse3 startup-notification svg systemd t1lib tcpd test theora threads tiff tracker truetype udev udisks unicode upnp upnp-av upower usb v4l vaapi vala vcd vdpau vlc vorbis wifi wxwidgets x264 x265 xattr xcb xfs xml xmpp xv xvid youtube zeroconf zlib" ABI_X86="64" ALSA_CARDS="hda-intel" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon plan sheets stage words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 fma3 mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="libinput keyboard mouse" KERNEL="linux" L10N="es es-ES en en-US fr fr-FR" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-0" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_5 python3_6" RUBY_TARGETS="ruby23" USERLAND="GNU" VIDEO_CARDS="fbdev vesa intel i965 nouveau" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS

=================================================================
                        Package Settings
=================================================================

sys-apps/portage-2.3.40-r1::gentoo was built with the following:
USE="doc (ipc) native-extensions xattr -build -epydoc -gentoo-dev -rsync-verify (-selinux)" ABI_X86="(64)" PYTHON_TARGETS="python2_7 python3_5 python3_6 -pypy -python3_4"
Comment 2 Zac Medico gentoo-dev 2018-06-23 11:25:13 UTC
This might be an indication of disk or filesystem trouble where the build logs are stored. Bug 658684 addresses the hang.
Comment 3 Pacho Ramos gentoo-dev 2018-06-23 18:28:12 UTC
Ah, but for now, at least from SMART, all looks normal... and only that ebuild is failing, all the others seem to work ok :/
Comment 4 Larry the Git Cow gentoo-dev 2018-06-23 22:15:23 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/proj/portage.git/commit/?id=a9a62e57194ccefce1ecabb9df761993f35f53be

commit a9a62e57194ccefce1ecabb9df761993f35f53be
Author:     Zac Medico <zmedico@gentoo.org>
AuthorDate: 2018-06-23 22:03:35 +0000
Commit:     Zac Medico <zmedico@gentoo.org>
CommitDate: 2018-06-23 22:15:13 +0000

    SpawnProcess._unregister: cancel PipeLogger (bug 658806)
    
    If the PipeLogger has not closed itself before the _unregister
    method has been called, then it must be cancelled so that it
    will close the log immediately. This fixes the case reported
    in bug 658806, where an unclosed PipeLogger instance left the
    log file with a temporarily incomplete gzip stream.
    
    Bug: https://bugs.gentoo.org/658806

 pym/_emerge/SpawnProcess.py | 3 +++
 1 file changed, 3 insertions(+)
Comment 5 Zac Medico gentoo-dev 2018-06-23 22:17:08 UTC
(In reply to Pacho Ramos from comment #3)
> Ah, but for now, at least from SMART, all looks normal... and only that
> ebuild is failing, all the others seem to work ok :/

Yeah, I was able to reproduce the issue with crossover-bin-17.5.0. It was a kind of race condition.
Comment 6 Pacho Ramos gentoo-dev 2018-06-24 09:10:31 UTC
Wow, thanks a lot for fixing the issue so fast =)