!!! Digest verification failed: !!! /usr/portage/x11-libs/libX11/libX11-1.6.4.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 1619 !!! Expected: 1620 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXfixes/libXfixes-5.0.3.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 709 !!! Expected: 710 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXrender/libXrender-0.9.10.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 649 !!! Expected: 650 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXv/libXv-1.0.11.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 669 !!! Expected: 670 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXrandr/libXrandr-1.5.1.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 798 !!! Expected: 799 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXi/libXi-1.7.7.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 973 !!! Expected: 974 !!! Digest verification failed: !!! /usr/portage/x11-libs/libXvMC/libXvMC-1.0.10.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 680 !!! Expected: 681
Please show the emerge --sync log from before this emerge run or we won't know which mirror got it wrong and won't be able to check if it has since corrected itself. (The git repo is correct, so it can't be that.)
I'm getting this problem as well, with a few more packages as well. This is my mirror: # eix-sync * Running emerge --sync >>> Syncing repository 'gentoo' into '/usr/portage'... >>> Starting rsync with rsync://208.100.4.53/gentoo-portage... >>> Checking server timestamp ... Welcome! This is a gentoo-portage and CentOS mirror, hosted by Steadfast Networks! https://www.steadfast.net Hostname: mirror.steadfast.net & rsync11.us.gentoo.org IP Addresses: 208.100.4.53 & 2607:f128:1:3::2 Location: Chicago, IL, US Bandwidth: 1000 Mbps Hardware: Xeon X3450, 16 GB RAM User Limit: 40 If you experience any trouble with this mirror, please contact mirror@steadfast.net.
I see this exact same bug from: * Running emerge --sync >>> Syncing repository 'gentoo' into '/usr/portage'... >>> Starting rsync with rsync://156.56.247.193/gentoo-portage... --------------------------------------------------------- ___ ___ ___ ___ /\__\ /\ \ /\ \ /\ \ /:/ / /::\ \ /::\ \ /::\ \ /:/ / /:/\ \ \ /:/\ \ \ /:/\:\ \ /:/ / ___ _\:\~\ \ \ _\:\~\ \ \ /:/ \:\ \ /:/__/ /\__\ /\ \:\ \ \__\ /\ \:\ \ \__\ /:/__/_\:\__\ \:\ \ /:/ / \:\ \:\ \/__/ \:\ \:\ \/__/ \:\ /\ \/__/ \:\ /:/ / \:\ \:\__\ \:\ \:\__\ \:\ \:\__\ \:\/:/ / \:\/:/ / \:\/:/ / \:\/:/ / \::/ / \::/ / \::/ / \::/ / \/__/ \/__/ \/__/ \/__/ Indiana University Unix Systems Support Group ftp://ftp.ussg.iu.edu/ Located in Bloomington, Indiana AKA: rsync25.us.gentoo.org Questions and comments to: ussg@iu.edu !!!NOTICE!!! Maintenance window is every Tuesday beginning at 0900 (1400 GMT) --------------------------------------------------------- receiving incremental file list timestamp.chk
*** Bug 596464 has been marked as a duplicate of this bug. ***
(In reply to Jeroen Roovers from comment #1) > Please show the emerge --sync log from before this emerge run or we won't > know which mirror got it wrong and won't be able to check if it has since > corrected itself. (The git repo is correct, so it can't be that.) Ah, I see. I am sorry. Will keep this in mind for the next time. >>> Starting retry 1 of 13 with rsync://[2a00:1828:2000:128::10]/gentoo-portage >>> Starting rsync with rsync://[2a01:4f8:191:1056::2]/gentoo-portage... Both mirrors did not have the correct filesize. My mirror is not static, as I've defined: sync-uri = rsync://rsync.de.gentoo.org/gentoo-portage
My rsync: >>> Starting rsync with rsync://89.238.64.78/gentoo-portage...
(In reply to Kai Wüstermann from comment #6) > My rsync: > >>> Starting rsync with rsync://89.238.64.78/gentoo-portage... I hit this bug with the exact same server.
I am not sure which server I pulled from, but here are the packages with an ebuild file size mismatch. In all cases, the Manifest lists the size of the ebuild file as one byte larger than the actual ebuild file. ./x11-libs/libXv/Manifest ./x11-libs/libXvMC/Manifest ./x11-libs/libXrender/Manifest ./x11-libs/libXtst/Manifest ./x11-libs/libXi/Manifest ./x11-libs/libX11/Manifest ./x11-libs/libXfixes/Manifest ./x11-libs/libXrandr/Manifest ./net-analyzer/wireshark/Manifest ./net-wireless/hostapd/Manifest ./net-wireless/wpa_supplicant/Manifest ./dev-perl/XML-Encoding/Manifest ./dev-perl/XML-Catalog/Manifest ./dev-perl/XML-DT/Manifest ./sci-visualization/ggobi/Manifest ./dev-java/emma/Manifest ./dev-vcs/hg-fast-export/Manifest ./app-misc/mc/Manifest
*** Bug 596474 has been marked as a duplicate of this bug. ***
I'm seeing this from both the Georgia Tech and University of Northern Iowa mirrors.
Same here. Yandex mirror.
I'm not sure if this should be posted here, but net-wireless/wpa_supplicant-2.6 is affected by this (or similar) bug. The ebuild is 1 byte shorter than expected: !!! Digest verification failed: !!! /usr/portage/main/net-wireless/wpa_supplicant/wpa_supplicant-2.6.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 10295 !!! Expected: 10296 Tested on Yandex and Bloodhost mirrors. Both distribute broken files.
This is infected too: >>> Starting rsync with rsync://137.226.34.228/gentoo-portage... Welcome to rsync.informatik.rwth-aachen.de (137.226.34.228). This server is part of the SunSITE Central Europe and is located in Aachen, Germany (http://sunsite.informatik.rwth-aachen.de).
Seeing this on two different machines from the following mirrors: 1475911996: >>> Starting rsync with rsync://208.70.246.16/gentoo-portage and 1475903267: >>> Starting rsync with rsync://129.97.134.71/gentoo-portage
Same here, mirror: >>> Starting rsync with rsync://91.121.188.201/gentoo-portage... I don't think it's a slave mirror problem, as much of them seems affected.
Same problem using the following mirror >>> Starting rsync with rsync://129.21.171.72/gentoo-portage...
also >>> Starting rsync with rsync://46.105.42.9/gentoo-portage... Welcome to Gentoo rsync server hosted by Linuxant.fr
have same error with this mirror: >>> Syncing repository 'gentoo' into '/usr/portage'... >>> Starting rsync with rsync://37.139.54.5/gentoo-portage... >>> Checking server timestamp ... This is gentoo.bloodhost.ru Server Address : 37.139.54.5 Contact Name : Andrey Burov <burik666@gmail.com> Location : Russia, Saint-Petersburg Sponsor : BloodHost LLC (http://bloodhost.ru) NSP : Petersburg Internet Network Co. ltd (http://pinspb.ru)
I have seen the same off-by-one-byte issue with this mirror at 09 Oct 2016 06:15:01 +0000: --------------------------------------------------------------------------- F T P . S W I N . E D U . A U Swinburne University of Technology Information Technology Services --------------------------------------------------------------------------- rsync://ftp.swin.edu.au/ ftp://ftp.swin.edu.au/ http://ftp.swin.edu.au/ and this: newton ~ # emerge --info Portage 2.3.0 (python 2.7.10-final-0, default/linux/amd64/13.0/desktop/plasma, gcc-4.9.3, glibc-2.22-r4, 4.4.21-gentoo x86_64) ================================================================= System uname: Linux-4.4.21-gentoo-x86_64-Intel-R-_Core-TM-_i7-2600_CPU_@_3.40GHz-with-gentoo-2.2 KiB Mem: 16429292 total, 11797344 free KiB Swap: 995992 total, 995992 free Timestamp of repository gentoo: Sun, 09 Oct 2016 06:15:01 +0000 sh bash 4.3_p48 ld GNU ld (Gentoo 2.25.1 p1.1) 2.25.1 distcc 3.2rc1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.3_p48::gentoo dev-java/java-config: 2.2.0-r3::gentoo dev-lang/perl: 5.22.2::gentoo dev-lang/python: 2.7.10-r1::gentoo, 3.4.3-r1::gentoo dev-util/cmake: 3.5.2-r1::gentoo dev-util/pkgconfig: 0.28-r2::gentoo sys-apps/baselayout: 2.2::gentoo sys-apps/openrc: 0.21.7::gentoo sys-apps/sandbox: 2.10-r1::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69::gentoo sys-devel/automake: 1.11.6-r1::gentoo, 1.14.1::gentoo, 1.15::gentoo sys-devel/binutils: 2.25.1-r1::gentoo sys-devel/gcc: 4.9.3::gentoo sys-devel/gcc-config: 1.7.3::gentoo sys-devel/libtool: 2.4.6::gentoo sys-devel/make: 4.1-r1::gentoo sys-kernel/linux-headers: 4.3::gentoo (virtual/os-headers) sys-libs/glibc: 2.22-r4::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.au.gentoo.org/gentoo-portage priority: -1000 x-portage location: /usr/local/portage masters: gentoo priority: 0 ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA AdobeFlash-11.x" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=core2 -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.6/ext-active/ /etc/php/cgi-php5.6/ext-active/ /etc/php/cli-php5.6/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-march=core2 -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--jobs 8 --load-average 16 --keep-going" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="ftp://mirror.internode.on.net/pub/gentoo" LANG="en_AU.utf8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j8 -l16" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 aac acl acpi aes alsa amd64 apache2 apng avx berkdb branding bzip2 cairo cdda cdr cli consolekit cracklib crypt cups cxx dbus declarative device-mapper dmx dri dts dvb dvd dvdr emboss encode exif extras faac faad fam ffmpeg firefox flac fontconfig fortran gd gdbm gdu gif glamor gpm gtk iconv icu imagemagick ipv6 jpeg kde kipi lcms ldap libnotify mad mmx mmxext mng modules mp3 mp4 mpeg mplayer multilib mysql ncurses nfs nls nptl ogg opengl openmp pam pango pcre pdf phonon plasma png policykit popcnt ppds python qml qt3support qt4 qt5 readline samba sdl seccomp semantic-desktop session spell sqlite sse sse2 sse3 sse4_1 sse4_2 ssl ssse3 startup-notification svg tcpd theora tiff truetype udev udisks unicode upower usb vdpau vorbis widgets wmf wxwidgets x264 xattr xcb xcomposite xine xinerama xml xnest xscreensaver xv xvid zlib" ABI_X86="64 32" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_core authn_dbd authn_dbm authn_default authn_file authz_core authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif slotmem_shm so socache_shmcb speling status unique_id unixd userdir usertrack vhost_alias xvid" APACHE2_MPMS="itk" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LIRC_DEVICES="devinput" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_4" RUBY_TARGETS="ruby21" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" USE_PYTHON="2.7" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS Since I had just seen a Portage update to 2.3.0 from 2.2.28 I rolled back to that version. No joy. I tried the unstable Portage 2.3.1. No joy. Concentrating on /usr/portage/x11-libs/libX11/libX11-1.6.4.ebuild The 1619 byte file size matches that reported by git at: https://gitweb.gentoo.org/repo/gentoo.git/tree/x11-libs/libX11 The sha256sum of the local ebuild file is the same as a version downloaded directly from git (and not the same as the manifest) 705cbb071f2532fe96a73e457962819c4844cc50f4f130dd6a40102183fcb753 Seems that whatever generates the mirrored ebuild file digests, which are not in the git Manifest file, has an issue. The manifest matches the actual software package downloads, so as a workaround I executed; newton ~ # for I in /usr/portage/x11-libs/libX11/libX11-1.6.4.ebuild /usr/portage/x11-libs/libXrender/libXrender-0.9.10.ebuild /usr/portage/x11-libs/libXfixes/libXfixes-5.0.3.ebuild /usr/portage/x11-libs/libXv/libXv-1.0.11.ebuild /usr/portage/x11-libs/libXi/libXi-1.7.7.ebuild /usr/portage/x11-libs/libXrandr/libXrandr-1.5.1.ebuild /usr/portage/x11-libs/libXtst/libXtst-1.2.3.ebuild; do ebuild $I digest; done >>> Creating Manifest for /usr/portage/x11-libs/libX11 >>> Creating Manifest for /usr/portage/x11-libs/libXrender >>> Creating Manifest for /usr/portage/x11-libs/libXfixes >>> Creating Manifest for /usr/portage/x11-libs/libXv >>> Creating Manifest for /usr/portage/x11-libs/libXi >>> Creating Manifest for /usr/portage/x11-libs/libXrandr >>> Creating Manifest for /usr/portage/x11-libs/libXtst which allows the packages to be merged but obviously subverts the security.
For me net-wireless/wpa_supplicant-2.6 also got a bad Manifest
I'm seeing this on several mirrors. Can we flag it confirmed now?
The same issue in emerge-webrsync snapshot: # emerge-webrsync Fetching most recent snapshot ... Trying to retrieve 20161008 snapshot from ftp://xeon.gentoo.ru/mirrors/gentoo/distfiles ... Fetching file portage-20161008.tar.xz.md5sum ... Fetching file portage-20161008.tar.xz.gpgsig ... Fetching file portage-20161008.tar.xz ... Checking digest ... Getting snapshot timestamp ... Syncing local tree ...
*** Bug 596668 has been marked as a duplicate of this bug. ***
I've added a comment to the affected packages to try and force a manifest regeneration. https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=8e94cda97cc9af2a370470ae2067b50e9e2be242
I can't find any rsync server that doesn't have this error. Including: 129.21.171.72 128.61.111.7 128.61.111.10 216.165.129.134
I was getting this error also from multiple servers. the push from comment 24 seems have worked for most of the errors but seems it did not cover x11-libs/libXtst. Is there a way to test all of the manifests are valid? Comment 8 seems to have a longer list of errors.
same as comment 26 works works ok except for: x11-libs/libXtst-1.2.3 still >>> Fetching (1 of 1) x11-libs/libXtst-1.2.3::gentoo !!! Digest verification failed: !!! /portage/x11-libs/libXtst/libXtst-1.2.3.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 831 !!! Expected: 832 >>> Starting rsync with rsync://46.105.42.9/gentoo-portage... Welcome to Gentoo rsync server hosted by Linuxant.fr !!!
(In reply to James McMechan from comment #26) > I was getting this error also from multiple servers. > the push from comment 24 seems have worked for most of the errors > but seems it did not cover x11-libs/libXtst. > > Is there a way to test all of the manifests are valid? > Comment 8 seems to have a longer list of errors. I wrote a script to compare the length of every ebuild file in /usr/portage/ to the size listed in its Manifest. My list in #8 above should be comprehensive as of 8am Friday North America/Mountain time zone.
I just got: >>> Verifying ebuild manifests !!! Digest verification failed: !!! /usr/portage/net-misc/sshrc/metadata.xml !!! Reason: Filesize does not match recorded size !!! Got: 722 !!! Expected: 516
*** Bug 596766 has been marked as a duplicate of this bug. ***
Why is this bug even possible? I think the master portage repository should automatically check things like this and reject a commit if it doesn't add up (likewise with the hashes). Alternatively, the master portage repository could update this metadata itself on commit, whatever makes the most sense.
It's been something BIG.
finally got x11-libs/libXtst-1.2.3 to download http://91.121.124.139 http://gentoo.mirrors.ovh.net
For my package and mirror set (syncing from mirror.yandex.ru) issue seems to be fixed.
(In reply to Staffan Palmroos from comment #31) > Why is this bug even possible? I think the master portage repository should > automatically check things like this and reject a commit if it doesn't add > up (likewise with the hashes). Alternatively, the master portage repository > could update this metadata itself on commit, whatever makes the most sense. The invalid manifests aren't actually part of the repository - gentoo.git uses thin manifests, meaning git's own internal mechanisms are used to track repository files. The process for transforming this thin manifest into a thick one for distribution over rsync is tricky to get right - see bug #577722, bug #596934, and related for more info. Until a proper fix for this issue is applied, any developer can make a bogus commit to force a manifest regeneration on affected packages (such as I did in commetn #24). I'm not using rsync so don't encounter this issue myself, but I'm more than happy to "fix" any such packages that are currently broken.
net-wireless/hostapd/hostapd-2.6 is also having this issue: >>> Verifying ebuild manifests !!! Digest verification failed: !!! /usr/portage/net-wireless/hostapd/hostapd-2.6.ebuild !!! Reason: Filesize does not match recorded size !!! Got: 5409 !!! Expected: 5410 Thanks.
(In reply to rypervenche from comment #36) > net-wireless/hostapd/hostapd-2.6 is also having this issue: > > >>> Verifying ebuild manifests > > !!! Digest verification failed: > !!! /usr/portage/net-wireless/hostapd/hostapd-2.6.ebuild > !!! Reason: Filesize does not match recorded size > !!! Got: 5409 > !!! Expected: 5410 > > Thanks. Thanks - https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=10b642091f38189e426575e68b4c131e28c15087
