Summary: | snapshots/squashfs/sha512sum.txt not containing latest gentoo-current.xz.sqfs | ||
---|---|---|---|
Product: | Gentoo Infrastructure | Reporter: | Christian Nilsson <nikize> |
Component: | Other | Assignee: | Gentoo Infrastructure <infra-bugs> |
Status: | CONFIRMED --- | ||
Severity: | normal | CC: | nikize, releng, robbat2 |
Priority: | Normal | ||
Version: | unspecified | ||
Hardware: | All | ||
OS: | All | ||
Whiteboard: | |||
Package list: | Runtime testing required: | --- |
Description
Christian Nilsson
2024-08-14 07:01:22 UTC
The explanation is simple: distfiles.gentoo.org is a CDN - and objects may be evicted from the cache at different rates - leading to the checksum not matching. From the infrastructure perspective, I would like is to STOP distributing any binary artifacts that change, e.g. "gentoo-current.xz.sqfs" This would however break "easy" scripts that want a consistent URL direct to an artifact - they won't want to parse a textfile to identify the correct artifact to download. The issue DOES also exist, but is harder to catch in the underlying mirrors: gentoo.osuosl.org is the public origin used for the CDN - but the underlying private origin is the only place guaranteed to be consistent. The rsync from the private origin to the public origin still has brief periods where it's also inconsistent, because we don't have significant control that public origin. I wasn't aware it was full CDN these days, but checking the headers now it's clear. And seeing that, it all makes sense, thanks! In regards to the forum post, I would expect rsync source be more in sync, but maybe in that part my testing might be lacking. (commands at the end in this comment works fine) Having the same filename does simplify rsync updates, but I fully understand, and agree, with the stance of not having binary changes, and it is possible to handle this quite easily by grabbing the list, greping and sorting. I'm happy to have the answer as documentation, and resolve as "works as intended" For the sake of documentation tho, could we link to any resource showing script that does the update, I assume it is in some infra git repo, but not sure where to look? rsync -v --copy-links rsync://gentoo.osuosl.org/gentoo/snapshots/squashfs/gentoo-current.xz.sqfs rsync://gentoo.osuosl.org/gentoo/snapshots/squashfs/sha512sum.txt .; sha512sum -c sha512sum.txt |