The manifests generated for sys-fs/fuse, dev-util/mercurial, net-mail/dovecot are broken. Reproducible: Always
Portage has similar problem: !!! Digest verification failed: !!! /usr/portage/sys-apps/portage/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: df1306ff16ed5d520335831523a7e5bcdd779ef1 !!! Expected: 2c3a714750ce48fe8d8102352386086a3abfb90a
Please post your `emerge --info'. Also include in your comment some information about the last rsync server[1] you visited. Then reopen this bug report. [1] Syncing the tree and retrying might actually solve your problem.
The issue persists after resyncing (actually I tried that yesterday already, but again today, just to be sure). Where do I find information about the last used rsync server? !!! Digest verification failed: !!! /var/cache/portage/gentoo/sys-fs/fuse/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: 4a0da453c8d74d46e98ed4a0c42b9a8e2be66852 !!! Expected: a942256001abfc87c87c82b1f16eec3fad471f1b !!! Digest verification failed: !!! /var/cache/portage/gentoo/dev-util/mercurial/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: bcd5fcbd61c03df37354e01bc2d540fdd4d55a25 !!! Expected: 6a7267bf45e77a805b84ea75a395313366d17ea5 !!! Digest verification failed: !!! /var/cache/portage/gentoo/net-mail/dovecot/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: db793813ce6142355e1b26824c1ca7aa7ed78577 !!! Expected: 09a2ed74c2bbf66dc2931dec32883c7754956607 Portage 2.2_rc61 (hardened/linux/ia64/10.0/server, gcc-4.4.2, glibc-2.10.1-r1, 2.6.32-hardened-r2 ia64) ================================================================= System uname: Linux-2.6.32-hardened-r2-ia64-31-with-gentoo-2.0.1 Timestamp of tree: Mon, 01 Feb 2010 07:45:01 +0000 app-shells/bash: 4.0_p35 dev-lang/python: 2.6.4, 3.1.1-r1 dev-python/pycrypto: 2.0.1-r8 dev-util/cmake: 2.6.4-r3 sys-apps/baselayout: 2.0.1 sys-apps/openrc: 0.6.0-r1 sys-apps/sandbox: 2.2 sys-devel/autoconf: 2.63-r1 sys-devel/automake: 1.7.9-r1, 1.9.6-r2, 1.10.2 sys-devel/binutils: 2.20 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.6b virtual/os-headers: 2.6.27-r2 ACCEPT_KEYWORDS="ia64" ACCEPT_LICENSE="* -@EULA" CBUILD="ia64-unknown-linux-gnu" CFLAGS="-pipe -mtune=mckinley -O2 -ftree-vectorize" CHOST="ia64-unknown-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/udev/rules.d" CXXFLAGS="-pipe -mtune=mckinley -O2 -ftree-vectorize" DISTDIR="/var/cache/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps y" FEATURES="assume-digests distlocks fixpackages metadata-transfer news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync" GENTOO_MIRRORS="http://ftp.spline.inf.fu-berlin.de/mirrors/gentoo/ http://ftp-stud.fht-esslingen.de/pub/Mirrors/gentoo/ http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo" LANG="en_GB.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed" MAKEOPTS="-j3" PKGDIR="/var/cache/portage/packages" PORTAGE_COMPRESS="xz" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_EXTRA_OPTS=" --include='/sci-libs/' --include='/sci-libs/gsl/' --exclude='/sci-libs/*/' --include='/x11-libs/' --include='/x11-libs/qt*/' --include='/x11-libs/cairo/' --include='/x11-libs/pango/' --include='/x11-libs/pixman/' --exclude='/x11-libs/*/' --include='/x11-misc/' --include='/x11-misc/util-macros/' --exclude='/x11-misc/*/' --exclude='/games*/' --exclude='/gnome*/' --exclude='/gnustep*/' --exclude='/gpe*/' --exclude='/kde*/' --exclude='/lxde*/' --exclude='/rox*/' --exclude='/sci*/' --exclude='/x11*/' --exclude='/xfce*/'" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/var/cache/portage/gentoo" PORTDIR_OVERLAY="/var/cache/portage/layman/hardened-development /var/cache/portage/layman/sunrise /var/cache/portage/local" SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" [...] Unset: CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, LC_ALL, LINGUAS, PORTAGE_COMPRESS_FLAGS
Checking /var/cache/portage/gentoo/dev-util/mercurial/ChangeLog I found an explanation for the failing digest: ^@^@^@^@谌^Olla-firefox-3.0.4.�^E^@^@dY^C^@a That's part of the contents of this changelog. One of your rsync servers must have sent broken data... Can I find out which one?
Deleting the offending ChangeLogs solved the issue for now. Of course there are still some rsync mirrors around which apparently send broken data now and then.
Thats quite bad. Infra can you guys kinda figure out whats going on?
(In reply to comment #6) > Thats quite bad. > Infra can you guys kinda figure out whats going on? > Zac is more likely to figure out what is going on.
more: >>> Verifying ebuild manifests !!! Digest verification failed: !!! /usr/portage/dev-libs/nspr/files/nspr-4.8-pkgconfig-gentoo-1.patch !!! Reason: Failed on RMD160 verification !!! Got: 6dce227a75ee0aac0e59bffdbdcb01dc9d221da8 !!! Expected: 5dd7066a06a1a0f1c239c6722acc5b00cbc3963b !!! Digest verification failed: !!! /usr/portage/perl-core/ExtUtils-ParseXS/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: c4fa2c59576b2123177960f16cb12de046d1ee5b !!! Expected: f91d8187f038f2b7e0837505030af378f16440cd !!! A file listed in the Manifest could not be found: /usr/portage/sys-devel/binutils/tsm-5.5.2.7.ebuild !!! Digest verification failed: !!! /usr/portage/dev-libs/glib/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: 72c4a5d8286ecfad26d15d54e88cd9461595d13b !!! Expected: 1b511ee9c95da78f5214aea4f5634d3c184d72b7 !!! Digest verification failed: !!! /usr/portage/sys-apps/man/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: 1344f17a28c543c41c64d604484cfa5748e13e0f !!! Expected: c1acc09b2493b1a1adf0afed749f5ea06c4399ea !!! A file is not listed in the Manifest: '/usr/portage/sys-apps/shadow/shadow-4.1.2.2.ebuild' !!! Digest verification failed: !!! /usr/portage/net-libs/xulrunner/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: da00cd2d7cc0ebb9d7418a4018d21c4264895dd0 !!! Expected: 6b6528ed845462ae3089bc4a3fc1d25f04873a2e !!! Digest verification failed: !!! /usr/portage/gnome-extra/yelp/ChangeLog !!! Reason: Failed on RMD160 verification !!! Got: 213893c4c52e32fe9386173512ffbaf022caef38 !!! Expected: 2c6ce5bb946fbf79d237dda67a1c651da260e8dd that tsm ebuild in binutils directory is especially funny emerge --info: badziew ~ # emerge --info Portage 2.2_rc62 (default/linux/amd64/10.0/no-multilib, gcc-4.4.2, glibc-2.11-r1, 2.6.32-zen1-ufoman x86_64) ================================================================= System uname: Linux-2.6.32-zen1-ufoman-x86_64-AMD_Athlon-tm-_II_X2_250_Processor-with-gentoo-2.0.1 Timestamp of tree: Wed, 03 Feb 2010 19:30:01 +0000 app-shells/bash: 4.0_p37 dev-java/java-config: 2.1.10 dev-lang/python: 2.5.4-r3, 2.6.4-r1, 3.1.1-r1 dev-util/cmake: 2.8.0-r1 sys-apps/baselayout: 2.0.1 sys-apps/openrc: 0.6.0-r1 sys-apps/sandbox: 2.2 sys-devel/autoconf: 2.13, 2.65 sys-devel/automake: 1.5, 1.7.9-r1, 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20 sys-devel/gcc: 4.3.3-r2, 4.4.2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.6b virtual/os-headers: 2.6.30-r1 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -march=amdfam10 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb /usr/share/config /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -march=amdfam10 -pipe" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests distlocks fixpackages news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://gentoo.po.opole.pl http://gentoo.prz.rzeszow.pl" LANG="pl_PL.UTF-8" LC_ALL="pl_PL.UTF-8" LDFLAGS="-Wl,-O1" LINGUAS="pl en" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage/layman/gnome /usr/local/portage/layman/zugaina /usr/local/portage/layman/sunrise /usr/local/portage/layman/desktop-effects /usr/local/portage/layman/kde-testing /usr/local/portage/layman/zen-sources /usr/local/portage/layman/x11 /usr/local/portage/layman/qting-edge" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="3dnow 3dnowext X acl alsa amd64 ao archive berkdb bluetooth bzip2 cairo cdr cleartype cli consolekit cracklib crypt cups cxx dbus dri dvdr exif expat ffmpeg fontforge fortran gdbm gnome gpm gstreamer gtk hal iconv ipv6 jpeg kde kpathsea libnotify lm_sensors mmap mmx mmxext modules mp3 mudflap ncurses nls nptl nptlonly ogg opengl openmp pam pcre perl png pppd python qt qt3support qt4 readline reflection samba semantic-desktop session spl sse sse2 sse3 sse4a ssl startup-notification svg sysfs tcpd threads thumbnail truetype unicode usb xcb xcomposite xinerama xorg xulrunner zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="pl en" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="radeon" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Trying to find common things here, I checked a random subset of mirrors, including the master mirror. No issues found. (In reply to comment #3) > SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" (In reply to comment #8) > SYNC="rsync://rsync.gentoo.org/gentoo-portage" These two rotations have mutually exclusive members, but they all sync from the same master mirror. So, if it *is* a mirroring problem, then it is quite big problem. At least it hit two separate mirrors and two users hit those mirrors as well.
(In reply to comment #9) > Trying to find common things here, I checked a random subset of mirrors, > including the master mirror. No issues found. Yeah, I just checked the master mirror myself and it was all good.
Zac, take a look at bug 303877. I don't see anything that may hint on the roots of this problem, but may be you'll see.
*** Bug 304109 has been marked as a duplicate of this bug. ***
*** Bug 303877 has been marked as a duplicate of this bug. ***
*** Bug 303879 has been marked as a duplicate of this bug. ***
*** Bug 305581 has been marked as a duplicate of this bug. ***
Asaf, btw what happens if you remove wireshark directory and run emerge --sync again? What files system you use for portage tree?
After removed wireshark directory and run emerge --sync, everything worked again. It solved the problem. It just took me about two weeks to realize that this is the simple work around :-) The file system I am using for the portage tree is ext3. I believe that there is a bug in portage as well or maybe the bug is in rsync itself, since even when I switched to the main rsync host which doesn't have issues, portage still failed to replace the corrupted files.
(In reply to comment #17) > I believe that there is a bug in portage as well or maybe the bug is in rsync > itself, since even when I switched to the main rsync host which doesn't have > issues, portage still failed to replace the corrupted files. Portage relies on rsync here, and rsync for performance reasons rsync does not do checksums and only compares file size and mtime.
So there is actually no other way around it...
If you still have the bad data, add --checksum to your rsync call and see if that affects matters. I don't recommend using it long term due to the additional load however. All the core rsync.g.o mirrors use --checksum, so we know that they are good.
*** Bug 305667 has been marked as a duplicate of this bug. ***
*** Bug 306299 has been marked as a duplicate of this bug. ***
*** Bug 312701 has been marked as a duplicate of this bug. ***
No activity in 3 months now. I don't know the problem and may never completely understand it (yet). Sorry for the trouble.. =/
Same problem here with "Failed on RMD160 verification" Most of the times it works after several downloads. so I need to delete failed downloads periodically with "rm /usr/portage/distfiles/*checksum*" But it's very annoying specially with packages like firefox, thunderbird, OO, etc. I recompiled the kernel (from 2.6.34 to 2.6.35, then back to 2.6.34), emerged again portage, rsync, wget, etc and no clue at all. I will try rsync with checksum Portage 2.1.8.3 (default/linux/x86/10.0, gcc-4.4.4, glibc-2.11.2-r3, 2.6.34-gentoo-r12-Hamlet i686) ================================================================= System uname: Linux-2.6.34-gentoo-r12-Hamlet-i686-Intel-R-_Pentium-R-_D_CPU_3.00GHz-with-gentoo-1.12.14 Timestamp of tree: Sat, 20 Nov 2010 01:30:01 +0000 app-shells/bash: 4.1_p7 dev-java/java-config: 2.1.11-r1 dev-lang/python: 2.6.5-r3, 3.1.2-r4 dev-util/cmake: 2.8.1-r2 sys-apps/baselayout: 1.12.14-r1 sys-apps/sandbox: 2.3-r1 sys-devel/autoconf: 2.13, 2.65-r1 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.20.1-r1 sys-devel/gcc: 4.4.4-r2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.10 sys-devel/make: 3.81-r2 virtual/os-headers: 2.6.30-r1 ACCEPT_KEYWORDS="x86" ACCEPT_LICENSE="* -@EULA" CBUILD="i686-pc-linux-gnu" CFLAGS="-O2 -march=native -pipe -floop-interchange -floop-strip-mine -floop-block" CHOST="i686-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/X11/xkb /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" CXXFLAGS="-O2 -march=native -pipe -floop-interchange -floop-strip-mine -floop-block" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests ccache distlocks fixpackages news parallel-fetch protect-owned sandbox sfperms strict unmerge-logs unmerge-orphans userfetch" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="en_US.UTF-8" LC_ALL="ko_KR.UTF-8" LDFLAGS="-Wl,--as-needed" LINGUAS="ko" MAKEOPTS="-j3" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="7zip X a52 aac accessibility acl acpi alsa ao berkdb bzip2 cairo cdr cjk cli cracklib cups cxx dbus dlloader dmi dri dts dvd dvdr dvdread encode firefox fontconfig fortran gdbm gif gnutls gpm graphite gtk gtk2 hal iconv ipv6 java java6 jpeg jpeg2k lirc lm_sensors lzo matroska mmx mmxext modules mp3 mp4 msn mudflap ncurses network nls nptl nptlonly nsplugin ogg opengl openmp pam pcre pdf perl png pppd python qq radio readline rtc samba session slang smp spell srt sse sse2 sse3 ssl svg sysfs tcpd tiff truetype type1 ucs2 unicode usb v4l2 vorbis win32codecs wma wmf x264 x86 xml xorg xosd xv xvid xvmc zapras zlib" ALSA_CARDS="hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="evdev keyboard mouse" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="ko" LIRC_DEVICES="devinput" PHP_TARGETS="php5-2" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY
Verified that Portage Manifesto is fine. I downloaded, for example, http://www.sfr-fresh.com/unix/misc/clamav-0.96.4.tar.gz with emerge -f, wget, curl and firefox. Every downloaded file had different checksum! Could it be related to a lower layer like sky2 kernel module?
(In reply to comment #26) > Every downloaded file had different checksum! > Could it be related to a lower layer like sky2 kernel module? It sounds like a hardware issue, maybe due to overheating or bad memory.
Is any one using Internet Connection Sharing of Windows Vista or 7? http://social.answers.microsoft.com/Forums/en-US/w7network/thread/0ecfe03c-cbd2-489c-a299-2ce022fd710e http://www.tomshardware.com/forum/235878-44-random-data-corruption