Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 939299 - Portage 3.0.65: KeyError in self.prepos[repo_name]
Summary: Portage 3.0.65: KeyError in self.prepos[repo_name]
Status: IN_PROGRESS
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Binary packages support (show other bugs)
Hardware: All Linux
: Normal normal
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS, REGRESSION
Depends on: 939444
Blocks:
  Show dependency tree
 
Reported: 2024-09-07 16:33 UTC by pva
Modified: 2024-10-27 23:14 UTC (History)
2 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
emerge --info from my laptop where installation failed (emerge--info.txt,8.21 KB, text/plain)
2024-09-07 16:33 UTC, pva
Details
emerge --info from host to build binaries (emerge--info-binary.txt,9.79 KB, text/plain)
2024-09-07 16:34 UTC, pva
Details

Note You need to log in before you can comment on or make changes to this bug.
Description pva 2024-09-07 16:33:14 UTC
Emerge of binary package on my system fails with the following error:

======================================================================
>>> Running pre-merge checks for dev-lang/rust-1.80.1
[ERROR] Exception in callback AsynchronousTask._exit_listener_cb(<bound method...7fc1b5b2be20>>)
handle: <Handle AsynchronousTask._exit_listener_cb(<bound method...7fc1b5b2be20>>)>
Traceback (most recent call last):
  File "/usr/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/lib/python3.10/site-packages/_emerge/AsynchronousTask.py", line 209, in _exit_listener_cb
    listener(self)
  File "/usr/lib/python3.10/site-packages/_emerge/BinpkgPrefetcher.py", line 62, in _verifier_exit
    injected_pkg = self._bintree.inject(
  File "/usr/lib/python3.10/site-packages/portage/dbapi/bintree.py", line 1808, in inject
    self._inject_repo_revisions(pkgindex.header, repo_revisions)
  File "/usr/lib/python3.10/site-packages/portage/dbapi/bintree.py", line 1949, in _inject_repo_revisions
    [self.settings.repositories[repo_name] for repo_name in repo_revisions],
  File "/usr/lib/python3.10/site-packages/portage/dbapi/bintree.py", line 1949, in <listcomp>
    [self.settings.repositories[repo_name] for repo_name in repo_revisions],
  File "/usr/lib/python3.10/site-packages/portage/repository/config.py", line 1234, in __getitem__
    return self.prepos[repo_name]
KeyError: 'steam-overlay'
Finished
======================================================================

steam-overlay is, obviously, name of overlay, that's absent on my laptop, where I use binary packages. That's emerge --info from my laptop:

===================================================================================================
x1 ~ # emerge --info ## Full in attachment
Portage 3.0.65 (python 3.10.14-final-0, default/linux/amd64/23.0/split-usr/desktop, gcc-14, glibc-2.39-r6, 6.10.4-gentoo-dist x86_64)
=================================================================
System uname: Linux-6.10.4-gentoo-dist-x86_64-Intel-R-_Core-TM-_i7-10510U_CPU_@_1.80GHz-with-glibc2.39
Timestamp of repository gentoo: Wed, 28 Aug 2024 09:15:00 +0000
Head commit of repository gentoo: 1ee2c1c0f8d547cc37e145753f2e3c1f5281b042
Timestamp of repository guru: Tue, 03 Sep 2024 09:48:58 +0000
Head commit of repository guru: 11d50bf1296a7a4ba600454d06ff24eff752e91a

Head commit of repository pouch: a7e7210b9de87efcb1b999db73d771231d99388e

Head commit of repository sheep-box: c8cfd86ff7cfe8ac87f94876f3d8381da55ee6fb

sh bash 5.2_p26-r6
ld GNU ld (Gentoo 2.43 p2) 2.43.1
ccache version 4.10.2 [disabled]
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p26-r6::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.71-r7::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.28.5::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.5.1::gentoo
dev-java/java-config:      2.3.4::gentoo
dev-lang/perl:             5.38.2-r3::gentoo
dev-lang/python:           3.10.14_p1-r1::gentoo, 3.11.9-r1::gentoo, 3.12.3-r1::gentoo
dev-lang/rust:             1.79.0::gentoo
dev-util/ccache:           4.10.2::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-apps/systemd:          254.16::gentoo
sys-devel/binutils:        2.43-r1::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           18.1.8::gentoo
sys-devel/gcc:             14.2.1_p20240817::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/lld:             18.1.8::gentoo
sys-devel/llvm:            18.1.8-r4::gentoo
sys-kernel/linux-headers:  6.10::gentoo (virtual/os-headers)
sys-libs/glibc:            2.39-r6::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: rsync
    sync-uri: ssh://185.198.112.84/var/db/repos/gentoo
    priority: -1000
    volatile: True
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-max-age: 3
    sync-rsync-extra-opts: 
    sync-rsync-verify-metamanifest: yes

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

pouch
    location: /portage/overlays/pouch
    sync-type: git
    sync-uri: https://github.com/pva/pouch
    masters: gentoo
    volatile: True

sheep-box
    location: /usr/local/sheep-box
    sync-type: git
    sync-uri: ssh://git@dev.tightvideo.com:22222/sheep-box.git
    masters: gentoo
    volatile: True

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -pipe -march=native -mtune=native -ggdb"
CHOST="x86_64-pc-linux-gnu"
CXXFLAGS="-O2 -pipe -pipe -march=native -mtune=native -ggdb"
DISTDIR="/usr/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going --jobs=10 --rebuilt-binaries=y --autounmask=n -gk --binpkg-changed-deps=n"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg buildpkg-live candy compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms sign splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://distfiles.gentoo.org"
LANG="ru_RU.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="ru en en_GB en_US"
MAKEOPTS="-j1"
PKGDIR="/var/cache/binpkgs"
PORTAGE_BINHOST="ssh://binpkguser@185.198.XXX.XXX:22203/var/cache/binpkgs"
[cut]

===================================================================================================


I think it's worth to add emerge --info from a binary host, where I've built rust binary:

===================================================================================================
b612-dev3-desktop ~ # emerge --info dev-lang/rust ## Full in attachment
Portage 3.0.65 (python 3.11.9-final-0, default/linux/amd64/23.0/split-usr/desktop, gcc-14, glibc-2.39-r6, 6.1.69 x86_64)
=================================================================
                         System Settings
=================================================================
System uname: Linux-6.1.69-x86_64-Intel-R-_Xeon-R-_CPU_E5-2680_v3_@_2.50GHz-with-glibc2.39
KiB Mem:   131880644 total,  11891612 free
KiB Swap:          0 total,         0 free
Timestamp of repository gentoo: Wed, 28 Aug 2024 09:15:00 +0000
Head commit of repository gentoo: 1ee2c1c0f8d547cc37e145753f2e3c1f5281b042
Timestamp of repository guru: Tue, 27 Aug 2024 10:04:04 +0000
Head commit of repository guru: 20fa21e872c38b129aa0d61a7ec82aac1996c349

Timestamp of repository mrpenguin: Mon, 19 Aug 2024 06:22:54 +0000
Head commit of repository mrpenguin: f10325c0635f35631da54919b137ccbd9b8fd453

Timestamp of repository plex-overlay: Thu, 22 Aug 2024 16:33:56 +0000
Head commit of repository plex-overlay: 3265a81fd62942fb3212f136de0a4b186d926b55

Head commit of repository pouch: a7e7210b9de87efcb1b999db73d771231d99388e

Timestamp of repository steam-overlay: Fri, 23 Aug 2024 21:33:51 +0000
Head commit of repository steam-overlay: 1057828cc4261082ad3faf418c27176e0282557b

sh bash 5.2_p26-r6
ld GNU ld (Gentoo 2.43 p2) 2.43.1
ccache version 4.10.2 [disabled]
app-misc/pax-utils:        1.3.7::gentoo
app-shells/bash:           5.2_p26-r6::gentoo
dev-build/autoconf:        2.13-r8::gentoo, 2.71-r7::gentoo
dev-build/automake:        1.16.5-r2::gentoo
dev-build/cmake:           3.28.5::gentoo
dev-build/libtool:         2.4.7-r4::gentoo
dev-build/make:            4.4.1-r1::gentoo
dev-build/meson:           1.5.1::gentoo
dev-java/java-config:      2.3.4::gentoo
dev-lang/perl:             5.38.2-r3::gentoo
dev-lang/python:           3.10.14_p1-r1::gentoo, 3.11.9_p2::gentoo, 3.12.3-r1::gentoo
dev-lang/rust:             1.80.1::gentoo
dev-util/ccache:           4.10.2::gentoo
sys-apps/baselayout:       2.15::gentoo
sys-apps/sandbox:          2.38::gentoo
sys-apps/systemd:          254.16::gentoo
sys-devel/binutils:        2.43-r1::gentoo
sys-devel/binutils-config: 5.5::gentoo
sys-devel/clang:           18.1.8::gentoo
sys-devel/gcc:             14.2.1_p20240817::gentoo
sys-devel/gcc-config:      2.11::gentoo
sys-devel/lld:             18.1.8::gentoo
sys-devel/llvm:            18.1.8-r4::gentoo
sys-kernel/linux-headers:  6.10::gentoo (virtual/os-headers)
sys-libs/glibc:            2.39-r6::gentoo
Repositories:

gentoo
    location: /var/db/repos/gentoo
    sync-type: rsync
    sync-uri: rsync://rsync.ru.gentoo.org/gentoo-portage/
    priority: -1000
    volatile: True
    sync-rsync-extra-opts: 
    sync-rsync-verify-max-age: 3
    sync-rsync-verify-jobs: 1
    sync-rsync-verify-metamanifest: yes

guru
    location: /var/db/repos/guru
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/guru.git
    masters: gentoo
    volatile: False

mrpenguin
    location: /var/db/repos/mrpenguin
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/mrpenguin.git
    masters: gentoo
    volatile: False

plex-overlay
    location: /var/db/repos/plex-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/plex-overlay.git
    masters: gentoo
    volatile: False

pouch
    location: /portage/overlays/pouch
    sync-type: git
    sync-uri: https://github.com/pva/pouch
    masters: gentoo
    volatile: True

steam-overlay
    location: /var/db/repos/steam-overlay
    sync-type: git
    sync-uri: https://github.com/gentoo-mirror/steam-overlay.git
    masters: gentoo
    volatile: False

sheep-box
    location: /usr/local/sheep-box
    masters: gentoo
    priority: 50
    volatile: True

ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="@FREE"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=haswell -mtune=skylake"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /opt/cxoffice/etc/cxoffice.conf /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/easy-rsa /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.9/conf"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -pipe -march=haswell -mtune=skylake"
DISTDIR="/var/cache/distfiles"
EMERGE_DEFAULT_OPTS="--keep-going --jobs=2 --with-bdeps=y --autounmask=n --read-news=n 	--verbose-slot-rebuilds --verbose-conflicts"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GDK_PIXBUF_MODULE_FILE GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR XDG_STATE_HOME"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg buildpkg-live candy compressdebug config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync merge-wait multilib-strict network-sandbox news parallel-fetch pid-sandbox pkgdir-index-trusted preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms sign splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://gentoo.bloodhost.ru/"
LANG="POSIX"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,-z,pack-relative-relocs"
LEX="flex"
LINGUAS="ru en en_GB en_US"
MAKEOPTS="-j40"
[cut]

=================================================================
                        Package Settings
=================================================================

dev-lang/rust-1.80.1::gentoo was built with the following:
USE="clippy doc lto profiler rust-src rustfmt system-llvm (-big-endian) -debug -dist (-llvm-libunwind) (-miri) -nightly (-parallel-compiler) -rust-analyzer -system-bootstrap -test -verify-sig -wasm" ABI_X86="32 (64) (-x32)" CPU_FLAGS_X86="sse2" LLVM_TARGETS="(X86) -AArch64 -AMDGPU -ARC -ARM -AVR -BPF -CSKY -DirectX -Hexagon -Lanai -LoongArch -M68k -MSP430 -Mips -NVPTX -PowerPC -RISCV -SPIRV -Sparc -SystemZ -VE -WebAssembly -XCore -Xtensa"

===================================================================================================

After I've enabled and syncronized steam-overlay on my laptop all packages installed without problems. Also, rust was not the first package in list, many packages installed successfuly before it.
Comment 1 pva 2024-09-07 16:33:50 UTC
Created attachment 902302 [details]
emerge --info from my laptop where installation failed
Comment 2 pva 2024-09-07 16:34:12 UTC
Created attachment 902303 [details]
emerge --info from host to build binaries
Comment 3 Larry the Git Cow gentoo-dev 2024-10-27 23:13:56 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/proj/portage.git/commit/?id=cc6a6b08938809bcfa4a244ab5050fd3b496807f

commit cc6a6b08938809bcfa4a244ab5050fd3b496807f
Author:     Zac Medico <zmedico@gentoo.org>
AuthorDate: 2024-10-25 19:59:38 +0000
Commit:     Zac Medico <zmedico@gentoo.org>
CommitDate: 2024-10-27 23:13:09 +0000

    binarytree: Fix _inject_repo_revisions to ignore remote packages
    
    For remote packages that reference source repos which do not
    exist locally, do not inject repo revisions.
    
    Fixes: 5aed7289d516 ("bintree: Add REPO_REVISIONS to package index header")
    Bug: https://bugs.gentoo.org/939299
    Signed-off-by: Zac Medico <zmedico@gentoo.org>

 NEWS                         | 3 +++
 lib/portage/dbapi/bintree.py | 9 ++++++++-
 2 files changed, 11 insertions(+), 1 deletion(-)