When there are several versions of the same package, portage doesn't check for all of them (probably only for the latest one) if the USE flags have changed. Example: I've had a few versions of python (2.6, 2.7, 3.1). At some point I realized I need one extra flag enabled ('threads'), so I enabled it and ran 'emerge -avNDu world'. However, portage did not report 2.6 to have this flag missing (in other words - list it for re-compilation). See also Bug 354629. Reproducible: Always
Please paste the output of `emerge --info sys-apps/portage' in a comment.
(In reply to comment #0) > When there are several versions of the same package, portage doesn't check for > all of them (probably only for the latest one) if the USE flags have changed. Generally, this means that the older versions would be removed by emerge --depclean. Please check the output of emerge --pretend --depclean.
I should also note that in some cases you may need to use --with-bdeps=y, as stated in the faq: http://www.gentoo.org/proj/en/portage/doc/faq.xml
emerge --info sys-apps/portage Portage 2.1.9.39 (default/linux/amd64/10.0, gcc-4.4.5, glibc-2.13-r0, 2.6.37-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-2.6.37-gentoo-x86_64-AMD_Phenom-tm-_II_X6_1055T_Processor-with-gentoo-2.0.1 Timestamp of tree: Mon, 14 Feb 2011 21:15:01 +0000 app-shells/bash: 4.1_p9 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.6.6-r1, 2.7.1, 3.1.3 dev-util/cmake: 2.8.3-r1 sys-apps/baselayout: 2.0.1-r1 sys-apps/openrc: 0.7.0 sys-apps/sandbox: 2.4 sys-devel/autoconf: 2.13, 2.68 sys-devel/automake: 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.21 sys-devel/gcc: 4.4.5, 4.5.2 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82 virtual/os-headers: 2.6.36.1 (sys-kernel/linux-headers) ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA AdobeFlash-10.1 skype-eula dlj-1.1 PUEL" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=amdfam10 -funroll-loops -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=amdfam10 -funroll-loops -O2 -pipe" DISTDIR="/usr/portage/distfiles" FEATURES="assume-digests binpkg-logs distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch" FFLAGS="" GENTOO_MIRRORS="http://distfiles.gentoo.org" LANG="pl_PL.utf8" LDFLAGS="-Wl,-O1,--as-needed" LINGUAS="pl" MAKEOPTS="-j6" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/usr/local/portage" SYNC="rsync://rsync1.pl.gentoo.org/gentoo-portage" USE="3dnow 3dnowext X a52 aac acl acpi alsa amd64 bash-completion bzip2 cairo cdda cddax cddb cdio cdparanoia cdr chm cli consolekit cracklib crypt cups curl custom-cflags custom-cpuopts custom-optimization cxx dbus dirac directfb djavu dts dvd dvdr ebook enca encode exif fbcon fbcondecor ffmpeg firefox firefox3 flac fortran gadu gdbm gnutls gpm hal hddtemp iconv id3tag ieee1394 jabber jack java java6 javascript jingle jpeg kate kde laptop latex lcdfilter libass libnotify libtiger lm_sensors lzma matroska minimal mmx mmxext mng modules mp3 mp4 mpeg mtp mudflap multilib musepack mysql ncurses nls nptl nptlonly nsplugin ntp nvidia ogg opengl openmp pam pcre pdf perl plasma png policykit pppd pvr python qt-static qt3 qt3support qt4 rar rdp readline rtsp schroedinger session skype smp spell sse sse2 ssl ssse3 startup-notification svg sysfs syslog tcpd theora threads thumbnail tiff truetype twolame udev unicode upnp usb vaapi vcd vcdinfo vcdx vim-syntax vnc vorbis win64 wmf xcb xcomposite xine xinerama xorg xosd xulrunner xv xvid xvmc zip zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="pl" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="nvidia" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= sys-apps/portage-2.1.9.39 was built with the following: USE="(ipc) (multilib) -build -doc -epydoc -python2 -python3 (-selinux)" LINGUAS="pl"
> Generally, this means that the older versions would be removed by emerge > --depclean. Please check the output of emerge --pretend --depclean. > 'emerge --pretend --depclean' did not report any version of python to be removed.
Please attach the output of this command: emerge -pvNDu world --with-bdeps=y --backtrack=0 --debug &> debug.log
Created attachment 262755 [details] emerge -pvNDu world --with-bdeps=y --backtrack=0 --debug &> debug.log
Also, please post this output for comparision: emerge -pv --depclean --debug &> depclean.log
Actually, depclean output isn't necessary, since I see that you have dev-lang/python:2.6 in world. Maybe the python-2.6 rebuild didn't happen because it's masked somehow. Please post the output of the following command: emerge -pv dev-lang/python:2.6
(In reply to comment #9) > Please post the output of the following command: > > emerge -pv dev-lang/python:2.6 I'm curious to see if this will really show a change in USE=threads for that package. The debug output seems to indicate that there's no change there.
Not sure if you've noticed, but I eventually reinstalled explicitly the 2.6 version. # emerge -pv dev-lang/python:2.6 These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R ] dev-lang/python-2.6.6-r1 USE="gdbm ncurses readline ssl threads (wide-unicode) xml -berkdb -build -doc -examples -ipv6 -sqlite -tk -wininst" 0 kB Total: 1 package (1 reinstall), Size of downloads: 0 kB
Created attachment 262763 [details] emerge -pv --depclean --debug &> depclean.log
(In reply to comment #11) > Not sure if you've noticed, but I eventually reinstalled explicitly the 2.6 > version. I guess it got added to the world file when you did that, because the debug output shows the world file is the only thing pulling it into the dependency graph. That means emerge is working as intended. If you remove it from the world file, --depclean should show it as eligible for removal: emerge --deselect dev-lang/python:2.6 emerge -pv --depclean dev-lang/python:2.6
# emerge --deselect dev-lang/python:2.6 >>> Removing dev-lang/python:2.6 from "world" favorites file... # emerge -pv --depclean dev-lang/python:2.6 Calculating dependencies... done! >>> Calculating removal order... >>> These are the packages that would be unmerged: dev-lang/python selected: 2.6.6-r1 protected: none omitted: 2.7.1 3.1.3 All selected packages: dev-lang/python-2.6.6-r1 >>> 'Selected' packages are slated for removal. >>> 'Protected' and 'omitted' packages will not be removed. Packages installed: 1014 Packages in world: 193 Packages in system: 50 Required packages: 1013 Number to remove: 1
Essentially, the problem is that you need to run emerge --depclean after every update, in order to remove unnecessary packages (or let you know which ones you should add to your world file if you want to keep them).
It's quite common for people to be confused about this stuff, so I think we should incorporate the information from the faq into the emerge man page.
IMO from the perspective of a regular user, I think that this bug boils to an improper (IMHO) handling of emerge's -N paramater. Namely, having a few versions of python, I changed the USE flags, yet only the flags of the latest version were checked against the USE flags changes. I had to query emerge for information about each version of the package in order to be able to see if any of them needs to be re-installed.
(In reply to comment #17) > IMO from the perspective of a regular user, I think that this bug boils to an > improper (IMHO) handling of emerge's -N paramater. I see why you'd say that, but -N is a package selection parameter that can only have an affect for packages the are reachable from the package(s) given as arguments. The reason that dev-lang/python:2.6 wasn't pulled in was that it was not reachable (and was thus eligible for removal by --depclean). Generally, it's desired to leave such unreachable packages out of the dependency graph, since they are typically removed by --depclean and so there's no benefit from updating or rebuilding them. Also, such packages are left out of the dependency graph since sometimes it is necessary to uninstall them, in order to solve blockers.
I haven't updated the man page yet, but I've made emerge suggest to run --depclean after world updates: http://git.overlays.gentoo.org/gitweb/?p=proj/portage.git;a=commit;h=550795df709cfa9ec4a9502a4ad835319f778e95
The message looks like this: * After world updates, it is important to remove obsolete packages with * emerge --depclean. Refer to `man emerge` for more information.
The warning message is included in 2.1.9.41 and 2.2.0_alpha25, but I'll leave this bug open until the man page is also updated.
I guess it's a good solution and compromise. Thanks! Greetings.
