Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 158632 - masked by corruption (for no apparent reason)
Summary: masked by corruption (for no apparent reason)
Status: RESOLVED FIXED
Alias: None
Product: Portage Development
Classification: Unclassified
Component: Core - Interface (emerge) (show other bugs)
Hardware: All Linux
: High normal (vote)
Assignee: Portage team
URL:
Whiteboard:
Keywords: InVCS, REGRESSION
: 158575 158657 158676 (view as bug list)
Depends on:
Blocks: 147007
  Show dependency tree
 
Reported: 2006-12-20 03:57 UTC by Mike Auty (RETIRED)
Modified: 2013-02-15 21:19 UTC (History)
4 users (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
'Corrupted' /var/cache/edb file (mpc-0.12.0,566 bytes, text/plain)
2006-12-20 11:21 UTC, Mike Auty (RETIRED)
Details
patch for debugging purposes (debug.patch,476 bytes, patch)
2006-12-20 16:07 UTC, Zac Medico
Details | Diff
Small debug log from failed mpc installation attempt (small_debug.log,263.61 KB, text/plain)
2006-12-20 17:28 UTC, Mike Auty (RETIRED)
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Mike Auty (RETIRED) gentoo-dev 2006-12-20 03:57:19 UTC
Hi, well, I've tried most everything I know, and I'm a bit stumped.

I have two gentoo boxes.  Recently (in the past week or so), both have started offering my trouble over the mpc ebuilds.  One says that all mpc ebuilds are masked by corruption, the other says that only 0.12.0 is masked by corruption.

I've searched on the web and can't find any mention of masked: by corruption, other than a couple of people reporting it as an error message.  It's not in the MASKED PACKAGES section of man emerge either.

So I've tried:

emerge --sync
emerge --metadata
emerge --digest mpc
emerge --digest --debug mpc (no extra information)
emerge -C mpc && emerge mpc

None of the above had any effect.  It doesn't seem to be an actual problem with the ebuild, since running emerge mpc-0.12.0.ebuild (which I know isn't a good idea) in the mpc directory did indeed install it (after numerous warnings).

So I'm a little confused, especially as the mpc ebuilds, and the bash-completion eclass that they depend on haven't been changed in two months.  Since I don't even know if this is a portage bug or an mpc ebuild issue, I'm completely at a loss.  My emerge --info is below:

Portage 2.1.2_rc3-r7 (default-linux/x86/2006.0, gcc-4.1.1, glibc-2.5-r0, 2.6.19-gentoo-r1 i686)
=================================================================
System uname: 2.6.19-gentoo-r1 i686 AMD Athlon(tm) 64 Processor 3400+
Gentoo Base System version 1.13.0_alpha10
Last Sync: Tue, 19 Dec 2006 19:30:03 +0000
ccache version 2.4 [enabled]
dev-java/java-config: 1.3.7, 2.0.31
dev-lang/python:     2.5-r1
dev-python/pycrypto: 2.0.1-r5
dev-util/ccache:     2.4-r6
sys-apps/sandbox:    1.2.18.1
sys-devel/autoconf:  2.13, 2.61
sys-devel/automake:  1.4_p6, 1.5, 1.6.3, 1.7.9-r1, 1.8.5-r3, 1.9.6-r2, 1.10
sys-devel/binutils:  2.17
sys-devel/gcc-config: 1.3.14
sys-devel/libtool:   1.5.22
virtual/os-headers:  2.6.17-r2
ACCEPT_KEYWORDS="x86 ~x86"
AUTOCLEAN="yes"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -march=athlon-xp -fomit-frame-pointer -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/X11/xkb"
CONFIG_PROTECT_MASK="/etc/env.d /etc/env.d/java/ /etc/gconf /etc/java-config/vms/ /etc/revdep-rebuild /etc/terminfo /etc/texmf/web2c"
CXXFLAGS="-O2 -march=athlon-xp -fomit-frame-pointer -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="autoconfig ccache cvs distlocks metadata-transfer parallel-fetch sandbox sfperms sign splitdebug strict userpriv usersandbox"
GENTOO_MIRRORS="http://distfiles.gentoo.org http://distro.ibiblio.org/pub/linux/distributions/gentoo"
LDFLAGS="-Wl,--as-needed"
LINGUAS="en en_GB"
MAKEOPTS="-j1"
PKGDIR="/usr/portage/packages"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --delete-after --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/usr/local/overlays/personal /usr/local/overlays/portage-xgl /usr/local/overlays/vmware"
SYNC="rsync://rsync.gentoo.org/gentoo-portage"
USE="x86 3dnow X aac acl acpi aiglx alsa ao apache2 asf audiofile bash-completion berkdb bitmap-fonts boundschecking branding browserplugin bzip2 cairo cdr cjk cli client cracklib crypt cups dbus dlloader dpms dri dvb dvd dvdr dvi elibc_glibc emboss encode fam ffmpeg firefox flac foomaticdb ftp gif glade glitz gnome gnuplot gnutls graphviz gstreamer gtk gtk2 gtkhtml hal hardened httpd iconv imap input_devices_evdev input_devices_keyboard input_devices_mouse input_devices_wacom isdnlog java javascript jpeg kernel_linux ldap libg++ libnotify libsexy libwww linguas_en linguas_en_GB lzo mad maildir mbox mikmod mimeunicode mmap mmx mmxext mng modplug mono mozbranding moznopango mozsvg mp3 mpeg ncurses nls nntp no-seamonkey nogecko-sdk nptl nptlonly nsplugin nvidia ogg opengl pam pcre pdf perl pic png pppd python quicktime rdesktop readline real reflection sdl session skins snmp speex spell spl sse sse2 ssl stream svg t1lib tcpd theora truetype truetype-fonts type1-fonts udev unicode usb userland_GNU v4l v4l2 video_cards_nvidia vlm vnc vorbis win32codecs wma xcb xml xorg xrandr xscreensaver xv xvid zlib"
Unset:  CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LANG, LC_ALL, PORTAGE_RSYNC_EXTRA_OPTS
Comment 1 Mike Auty (RETIRED) gentoo-dev 2006-12-20 03:58:32 UTC
D'oh, sorry, I forgot to include the exact symptoms:

ikelos ~ # emerge -pv =mpc-0.12.0

These are the packages that would be merged, in order:

Calculating dependencies   
!!! All ebuilds that could satisfy "=mpc-0.12.0" have been masked.
!!! One of the following masked packages is required to complete your request:
- media-sound/mpc-0.12.0 (masked by: corruption)

For more information, see MASKED PACKAGES section in the emerge man page or 
refer to the Gentoo Handbook.

Comment 2 Jakub Moc (RETIRED) gentoo-dev 2006-12-20 04:03:05 UTC
Can't reproduce...

$ emerge -pv =mpc-0.12.0

These are the packages that would be merged, in order:

Calculating dependencies... done!
[ebuild  N    ] media-sound/mpc-0.12.0  USE="bash-completion nls" 0 kB 



 * checking ebuild checksums ;-) ...                                                                                                     [ ok ]
 * checking auxfile checksums ;-) ...                                                                                                    [ ok ]
 * checking miscfile checksums ;-) ...                                                                                                   [ ok ]
 * checking mpc-0.12.0.tar.bz2 ;-) ...                                                                                                   [ ok ]
>>> Unpacking source...
>>> Unpacking mpc-0.12.0.tar.bz2 to /var/tmp/portage/media-sound/mpc-0.12.0/work
>>> Source unpacked.
Comment 3 UncleOwen 2006-12-20 04:08:02 UTC
http://forums.gentoo.org/viewtopic-t-525908.html

Some more people with the same problem.
Comment 4 Mike Auty (RETIRED) gentoo-dev 2006-12-20 08:12:58 UTC
Hmm, the forums seem to suggest it's a corruption of files in the /var/cache/edb directory (which I think is the VDB?).  Is it worth attaching the contents of the files in there?  Also, is there a way to regenerate these without diving in and deleting files directly?  Seemingly a sync, and a metadata sync didn't recreate the data based on the ebuilds themselves, so I'm not sure how else to ask for the VDB to be ignored or recreated using portage.  If anyone has anything they'd like me test I'll leave one machine exhibiting the problem for a while...
Comment 5 Jakub Moc (RETIRED) gentoo-dev 2006-12-20 08:56:18 UTC
*** Bug 158575 has been marked as a duplicate of this bug. ***
Comment 6 Zac Medico gentoo-dev 2006-12-20 09:27:00 UTC
I think this may be related to disk/filesystem trouble.  If you're experiencing this, please try `rm -rf /var/cache/edb/dep && emerge --metadata` to see if that helps.
Comment 7 wsim 2006-12-20 09:31:46 UTC
Cleaning /var/cache/edb and running emerge --metadata does fix the problem, but I wouldn't point my finger at the filesystem.
Comment 8 Zac Medico gentoo-dev 2006-12-20 10:04:14 UTC
(In reply to comment #7)
> Cleaning /var/cache/edb and running emerge --metadata does fix the problem, but
> I wouldn't point my finger at the filesystem.

Maybe we just need to automatically delete a corrupt cache entry there.  I'll check the code.
Comment 9 Mike Auty (RETIRED) gentoo-dev 2006-12-20 11:21:12 UTC
Created attachment 104456 [details]
'Corrupted' /var/cache/edb file

Indeed, clearing out just the corrupted files from /var/cache/edb followed by a sync fixes the problem.  I also wouldn't have blamed the filesystem, since I haven't had any other difficulties.  Also, redigesting (--digest at least) doesn't seem to recreate the cache item.  I've attached the offended mpc-0.12.0 file from /var/cache/edb.  There were no disk or read errors when copying it, and nothing else that I could see about it that caused problems.  I can also provide more examples from the other machine, if they'd be of use?
Comment 10 Jakub Moc (RETIRED) gentoo-dev 2006-12-20 12:04:57 UTC
*** Bug 158676 has been marked as a duplicate of this bug. ***
Comment 11 Zac Medico gentoo-dev 2006-12-20 14:31:43 UTC
If someone is able to reproduce this problem, please create run the command with --debug and FEATURES=python-trace enabled.  For example:

env FEATURES=python-trace emerge --debug mpc >& debug.log
tail -n 2000 debug.log > small_debug.log

The tail of the log should allow me to see the nature of the exception that is occurring.
Comment 12 Zac Medico gentoo-dev 2006-12-20 15:22:55 UTC
If anyone experiencing this problem has something in /etc/portage/modules (a non-default cache module) then please be sure to mention that.
Comment 13 Zac Medico gentoo-dev 2006-12-20 16:07:51 UTC
Created attachment 104471 [details, diff]
patch for debugging purposes

If you can reproduce the problem with this patch then it should help me see when is causing this.  Either output with this patch or a debug log as described in Comment #11 would be quite helpful.
Comment 14 Mike Auty (RETIRED) gentoo-dev 2006-12-20 17:28:58 UTC
Created attachment 104477 [details]
Small debug log from failed mpc installation attempt

Ok, here's a small debugging log.  It was from the command:

FEATURES="python-trace" emerge --debug =mpc-0.12.0 >& debug.log
tail -n 2000 debug.log > small_debug.log

The emerge --info is the same as previously mentioned, and there are no modules in /etc/portage/, just sets, bin and postsync.d (which seem only to contain the expected files, nothing unusual in there).

As mentioned, I can still recreate this, so if you need me to apply the debugging patch, or you need any further output, just let me know (although it may take me a few days to get the output, my working hours are all over the place for the next day or two)...  5:)
Comment 15 Zac Medico gentoo-dev 2006-12-20 17:56:00 UTC
Thanks! (In reply to comment #14)
> Created an attachment (id=104477) [edit]
> Small debug log from failed mpc installation attempt
> 
> Ok, here's a small debugging log.  It was from the command:

Thanks, that was perfect.  It's fixed in svn r5342.
Comment 16 Zac Medico gentoo-dev 2006-12-20 19:18:24 UTC
This has been released in 2.1.2_rc3-r9.
Comment 17 Zac Medico gentoo-dev 2013-02-15 21:19:24 UTC
*** Bug 158657 has been marked as a duplicate of this bug. ***