Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 936289 - Inconsistency between Packages index and binpkg availability on at least one actual mirror
Summary: Inconsistency between Packages index and binpkg availability on at least one ...
Status: CONFIRMED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Binary packages support (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2024-07-19 08:16 UTC by Sam James
Modified: 2024-07-29 05:02 UTC (History)
5 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-07-19 08:16:40 UTC
```
>>> Running pre-merge checks for sys-apps/portage-3.0.65-r1
--2024-07-19 08:13:40--  https://mirror.bytemark.co.uk/gentoo/releases/amd64/binpackages/23.0/x86-64/sys-apps/portage/portage-3.0.65-r1-1.gpkg.tar
Resolving mirror.bytemark.co.uk... 2001:41c8:20:5fc::13, 2001:41c8:20:5e6::150, 212.110.163.13, ...
Connecting to mirror.bytemark.co.uk|2001:41c8:20:5fc::13|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2024-07-19 08:13:41 ERROR 404: Not Found.
```

But the Packages index _does_ have it:
```
$ wget -q https://mirror.bytemark.co.uk/gentoo/releases/amd64/binpackages/23.0/x86-64/Packages -O- | grep CPV.*sys-apps/portage -C 5
REPO: gentoo

BDEPEND: dev-lang/python:3.12[bzip2(+),threads(+)] >=app-arch/tar-1.27 >=dev-build/meson-1.2.1-r1 || ( >=dev-build/meson-1.3.0-r1 <dev-build/meson-1.3.0 ) dev-python/setuptools[python_targets_python3_12(-)] >=sys-apps/sed-4.0.5 sys-devel/patch dev-lang/python:3.12[ssl(+)] >=dev-build/meson-1.2.3 app-alternatives/ninja dev-build/meson-format-array
BUILD_ID: 1
BUILD_TIME: 1720343550
CPV: sys-apps/portage-3.0.65-r1
DEFINED_PHASES: compile configure install postinst preinst prepare pretend setup test
EAPI: 7
IUSE: apidoc build doc gentoo-dev +ipc +native-extensions +rsync-verify selinux test xattr python_targets_pypy3 python_targets_python3_10 python_targets_python3_11 python_targets_python3_12
KEYWORDS: ~alpha amd64 arm arm64 ~hppa ~ia64 ~loong ~m68k ~mips ppc ppc64 ~riscv ~s390 sparc x86
LICENSE: GPL-2
```

I think this might be distinct from bug 936288 (which I intended to be for bouncer/the gentoo infra CDN) and is instead either an issue in our binpkg syncing scripts or eclean-pkg/emaint binhost doing something wrong?
Comment 1 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-07-19 08:17:57 UTC
(I'm assuming here that bytemark is just one mirror and it's internally consistent.)
Comment 2 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-07-19 08:19:32 UTC
What I find really suspicious is, https://mirror.bytemark.co.uk/gentoo/releases/amd64/binpackages/23.0/x86-64/sys-apps/ has no portage *at all*.

So it can't even really be just a delay -- it has to be the upload script going wrong, or eclean-pkg going wrong.
Comment 3 Robin Johnson archtester Gentoo Infrastructure gentoo-dev Security 2024-07-19 14:46:49 UTC
Nope: bytemark's mirror is misconfigured.
It's excluding every directory named exactly "portage" in the ::gentoo mirror!

I compared it with a listing from another mirror - it applies to every binpackage profile
Comment 4 Sam James archtester Gentoo Infrastructure gentoo-dev Security 2024-07-20 03:52:23 UTC
(In reply to Robin Johnson from comment #3)

Thank you for investigating!
Comment 5 Robin Johnson archtester Gentoo Infrastructure gentoo-dev Security 2024-07-25 07:44:05 UTC
No response from sponsor so far
Comment 6 Zac Medico gentoo-dev 2024-07-29 05:01:13 UTC
As implied by bug 936287 comment 4, a useful mitigation is to set frozen = true in binrepos.conf just before you begin the bulk of your dependency calculations, but after a recent copy of the Packages index has been downloaded to /var/cache/edb/binhost/ using a command like `emerge -pG --nodeps portage`.