| Summary: | While performing global updates, emerge --sync crashes with "Compressed file ended before..." | ||
|---|---|---|---|
| Product: | Portage Development | Reporter: | igel <mathiaswe> |
| Component: | Binary packages support | Assignee: | Portage team <dev-portage> |
| Status: | RESOLVED FIXED | ||
| Severity: | normal | CC: | syu.os |
| Priority: | Normal | Keywords: | InVCS |
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Package list: | Runtime testing required: | --- | |
| Bug Depends on: | 891001 | ||
| Bug Blocks: | |||
| Attachments: | emerge --info | ||
|
Description
igel
2023-02-08 19:00:17 UTC
Created attachment 850236 [details]
emerge --info
my emerge --info
Is there any chance the binary package is broken / incomplete? Hi, what binary package are you talking about? Oh I suppose you mean /usr/portage/profiles/updates/1Q-2023 # cat /usr/portage/profiles/updates/1Q-2023 move net-im/discord-bin net-im/discord move dev-python/python-recurring-ical-events dev-python/recurring-ical-events move dev-python/snappy dev-python/python-snappy move dev-python/pkgcraft-python dev-python/pkgcraft move dev-python/python-nbxmpp dev-python/nbxmpp Is there some way to do these moves by hand instead? (In reply to igel from comment #4) > Oh I suppose you mean > /usr/portage/profiles/updates/1Q-2023 > > # cat /usr/portage/profiles/updates/1Q-2023 > move net-im/discord-bin net-im/discord > move dev-python/python-recurring-ical-events dev-python/recurring-ical-events > move dev-python/snappy dev-python/python-snappy > move dev-python/pkgcraft-python dev-python/pkgcraft > move dev-python/python-nbxmpp dev-python/nbxmpp > > Is there some way to do these moves by hand instead? So the way this works is basically: These are package moves (renames!) We need to 'move' the binary packages. The update code is trying to do this for you. Here its trying to open a binary package (to do the update); the binary package is compressed, and we are failing to decompress it. Its likely a few things need improvement here: - The error doesn't really tell you which binary package is busted; we should fix that in portage. - Its likely moving the binary package out of the binpkg repo will 'fix' your updates. - We sort of want to know why one of your binary packages is corrupted; mostly so we can try to prevent corruption; or do something else when packages are corrupted. (In reply to igel from comment #3) > Hi, what binary package are you talking about? Are you using binpkgs/binary packages with Portage? Is there anything in /var/cache/binpkgs or /usr/portage/packages? Yes, I'm using quickpkg (I think) to backup my enlightenment & efl before I update them usually. Also, I run thunderbird-bin cause I really don't want to compile that. # find /var/cache/binpkgs /var/cache/binpkgs /var/cache/binpkgs/Packages /var/cache/binpkgs/mail-client /var/cache/binpkgs/mail-client/thunderbird-bin-78.10.1.tbz2 /var/cache/binpkgs/qpkg.ZwPDxe /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 /var/cache/binpkgs/qpkg.ZwPDxe/filelist /var/cache/binpkgs/dev-libs /var/cache/binpkgs/dev-libs/efl-1.25.1-r10.tbz2 /var/cache/binpkgs/x11-wm /var/cache/binpkgs/x11-wm/enlightenment-0.24.2.tbz2 A-ha! # bzip2 --test /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 bzip2: /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2: file ends unexpectedly You can use the `bzip2recover' program to attempt to recover data from undamaged sections of corrupted files. I have no idea what this "bin.tbz2" is and why it's there, but the "filelist" file shows a whole lot of stuff related to enlightenment oO I suspect that removing this ominous "qpkg.ZwPDxe" will fix my issue and I'd do that unless you want me to do more debugging/testing before... (In reply to igel from comment #7) > Yes, I'm using quickpkg (I think) to backup my enlightenment & efl before I > update them usually. Also, I run thunderbird-bin cause I really don't want > to compile that. > > # find /var/cache/binpkgs > /var/cache/binpkgs > /var/cache/binpkgs/Packages > /var/cache/binpkgs/mail-client > /var/cache/binpkgs/mail-client/thunderbird-bin-78.10.1.tbz2 > /var/cache/binpkgs/qpkg.ZwPDxe > /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 > /var/cache/binpkgs/qpkg.ZwPDxe/filelist > /var/cache/binpkgs/dev-libs > /var/cache/binpkgs/dev-libs/efl-1.25.1-r10.tbz2 > /var/cache/binpkgs/x11-wm > /var/cache/binpkgs/x11-wm/enlightenment-0.24.2.tbz2 > > A-ha! > # bzip2 --test /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 > bzip2: /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2: file ends unexpectedly > > You can use the `bzip2recover' program to attempt to recover > data from undamaged sections of corrupted files. > > I have no idea what this "bin.tbz2" is and why it's there, but the > "filelist" file shows a whole lot of stuff related to enlightenment oO My guess is you ran `quickpkg <some-enlightenment-pkg>` and it crashed, or you hit ctrl+C or something. Quickpkg was in the middle of making your pkg and failed to cleanup properly. > > I suspect that removing this ominous "qpkg.ZwPDxe" will fix my issue and I'd > do that unless you want me to do more debugging/testing before... I still think portage should, if it encounters a problem doing a pkgmove, print the problematic package name ;) -A (In reply to Alec Warner from comment #8) > (In reply to igel from comment #7) > > Yes, I'm using quickpkg (I think) to backup my enlightenment & efl before I > > update them usually. Also, I run thunderbird-bin cause I really don't want > > to compile that. > > > > # find /var/cache/binpkgs > > /var/cache/binpkgs > > /var/cache/binpkgs/Packages > > /var/cache/binpkgs/mail-client > > /var/cache/binpkgs/mail-client/thunderbird-bin-78.10.1.tbz2 > > /var/cache/binpkgs/qpkg.ZwPDxe > > /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 > > /var/cache/binpkgs/qpkg.ZwPDxe/filelist > > /var/cache/binpkgs/dev-libs > > /var/cache/binpkgs/dev-libs/efl-1.25.1-r10.tbz2 > > /var/cache/binpkgs/x11-wm > > /var/cache/binpkgs/x11-wm/enlightenment-0.24.2.tbz2 > > > > A-ha! > > # bzip2 --test /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2 > > bzip2: /var/cache/binpkgs/qpkg.ZwPDxe/bin.tbz2: file ends unexpectedly > > > > You can use the `bzip2recover' program to attempt to recover > > data from undamaged sections of corrupted files. > > > > I have no idea what this "bin.tbz2" is and why it's there, but the > > "filelist" file shows a whole lot of stuff related to enlightenment oO > > My guess is you ran `quickpkg <some-enlightenment-pkg>` and it crashed, or > you hit ctrl+C or something. Quickpkg was in the middle of making your pkg > and failed to cleanup properly. > > > > > I suspect that removing this ominous "qpkg.ZwPDxe" will fix my issue and I'd > > do that unless you want me to do more debugging/testing before... > > I still think portage should, if it encounters a problem doing a pkgmove, > print the problematic package name ;) > > -A It is supposed to do that, but I didn't catch that category errors. Patch incoming. The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage.git/commit/?id=6e1c42a89fe1ae7a5915c6eb8e3e27b47aecf93c commit 6e1c42a89fe1ae7a5915c6eb8e3e27b47aecf93c Author: Sheng Yu <syu.os@protonmail.com> AuthorDate: 2023-02-10 07:34:49 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-02-17 01:23:14 +0000 Catch all Exceptions in binpkg identify We got many different exceptions here, so have to catch all. Bug: https://bugs.gentoo.org/893638 Signed-off-by: Sheng Yu <syu.os@protonmail.com> Signed-off-by: Sam James <sam@gentoo.org> lib/portage/binpkg.py | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=cd8ade10313d72cb0e3dd2229df02e0ea8681daa commit cd8ade10313d72cb0e3dd2229df02e0ea8681daa Author: Sam James <sam@gentoo.org> AuthorDate: 2023-02-26 22:01:01 +0000 Commit: Sam James <sam@gentoo.org> CommitDate: 2023-02-26 22:01:10 +0000 sys-apps/portage: add 3.0.45 Bug: https://bugs.gentoo.org/891001 Bug: https://bugs.gentoo.org/889330 Bug: https://bugs.gentoo.org/890777 Bug: https://bugs.gentoo.org/891391 Bug: https://bugs.gentoo.org/893638 Bug: https://bugs.gentoo.org/795825 Bug: https://bugs.gentoo.org/884869 Bug: https://bugs.gentoo.org/888585 Bug: https://bugs.gentoo.org/892651 Bug: https://bugs.gentoo.org/895526 Signed-off-by: Sam James <sam@gentoo.org> sys-apps/portage/Manifest | 1 + sys-apps/portage/portage-3.0.45.ebuild | 288 +++++++++++++++++++++++++++++++++ 2 files changed, 289 insertions(+) |
