Looks like it shouldn't be looking in those files, maybe. elmer ~ # file /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: ELF 32-bit MSB shared object, PA-RISC (LP64) version 1 (GNU/Linux), dynamically linked, not stripped elmer ~ # grep scanelf `which python-updater` if ! type -P scanelf >/dev/null 2>&1; then ewarn "scanelf not found!" if ! type -P scanelf >/dev/null 2>&1; then ewarn "scanelf not found!" binaries="$(scanelf -qs +Py_Initialize < <(grep -E "^obj" "${content}" | cut -d" " -f2) | sed "s/.* //")" binaries="$(scanelf -qF "%F %n" < <(grep -E "^obj" "${content}" | cut -d" " -f2) | grep -E "( |,)$(get_OLD_PYTHON_SHARED_LIBRARIES_REGEX)(,|$)")" elmer ~ # scanelf -qF "%F %n" /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug elmer ~ # scanelf -qs +Py_Initialize /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/libfam.so.0.0.0.debug: corrupt ELF symbols Segmentation fault elmer ~ # Both app-misc/pax-utils-{0.1.19,0.2.1} respond this way. Tue Mar 9 04:55:54 CET 2010 Portage 2.1.8.2 (default/linux/hppa/10.0, gcc-4.2.4, glibc-2.10.1-r1, 2.6.32.7-JeR parisc) ================================================================= System uname: Linux-2.6.32.7-JeR-parisc-PA8700_-PCX-W2-with-gentoo-2.0.1 Timestamp of tree: Mon, 08 Mar 2010 16:45:01 +0000 distcc 3.1 hppa2.0-unknown-linux-gnu [enabled] app-shells/bash: 4.0_p35 dev-lang/python: 2.6.4-r1, 3.1.1-r1 dev-python/pycrypto: 2.1.0_beta1 dev-util/cmake: 2.6.4-r3 sys-apps/baselayout: 2.0.1 sys-apps/openrc: 0.6.0-r1 sys-apps/sandbox: 1.6-r2 sys-devel/autoconf: 2.13, 2.63-r1 sys-devel/automake: 1.4_p6-r1, 1.5-r1, 1.6.3-r1, 1.7.9-r2, 1.8.5-r4, 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.18-r3, 2.19.1-r1 sys-devel/gcc: 4.1.2, 4.2.4-r1, 4.3.4, 4.4.3 sys-devel/gcc-config: 1.4.1 sys-devel/libtool: 2.2.6b virtual/os-headers: 2.6.30-r1 ACCEPT_KEYWORDS="hppa" ACCEPT_LICENSE="* -@EULA" CBUILD="hppa2.0-unknown-linux-gnu" CFLAGS="-mschedule=8000 -march=2.0 -ggdb -pipe -Wall -O2" CHOST="hppa2.0-unknown-linux-gnu" CONFIG_PROTECT="/etc /usr/lib/fax /usr/share/X11/xkb /usr/share/config /var/bind /var/spool/fax/etc /var/spool/torque /var/www/localhost/htdocs/wordpress/wp-config.php" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5/ext-active/ /etc/php/cgi-php5/ext-active/ /etc/php/cli-php5/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /etc/udev/rules.d" CXXFLAGS="-mschedule=8000 -march=2.0 -ggdb -pipe -Wall -O2" DISTDIR="/newaches/gentoo/distfiles" FEATURES="assume-digests autoaddcvs buildpkg cvs distcc distlocks fixpackages news notitles parallel-fetch preserve-libs protect-owned sandbox sfperms splitdebug strict test test-fail-continue unmerge-logs unmerge-orphans userfetch userpriv" GENTOO_MIRRORS="http://de-mirror.org/distro/gentoo/ http://mirror.netcologne.de/gentoo/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo http://gentoo.tiscali.nl/ " LC_ALL="en_US.UTF-8" LDFLAGS="-Wl,-O1" LINGUAS="en nl he" MAKEOPTS="-j4 V=1" PKGDIR="/keeps/gentoo/packages/elmer" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/dev/shm/" PORTDIR="/keeps/gentoo/portage" PORTDIR_OVERLAY="/keeps/gentoo/local" SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage" USE="7zip X Xaw3d a52 aac aalib abyss accessibility acl ads agg alsa amr amrnb amrwb ao aoss apache2 ares artist-screen asf assistant async asyncns audiofile audit automount avfs bash-completion berkdb bidi bittorrent bittorrent-external bl bluetooth bzip2 c++ cairo caps captury catalogs cblas cdb cddb cdparanoia cdr chardet cjk clarens cleartype cli colors contrast cracklib crypt cups curl custom-cflags custom-cxxflags cxx dbi dbtool dbus designer designer-plugin device-mapper dga dia dirac directfb djbfft djvu domainkeys dri drm dts dv dvd dvdr dvdread ebook edl elf emacs enca encode esd examples exif expat facebook fame fastbuild fastcgi fbcon ffmpeg filter fits flac fluidsynth fontconfig foomaticdb fortran ftp fts3 gadu galago games gcrypt gd gdbm geant4 geoip ggi gif gimp gimpprint glep glib glut gmp gnokii gnome gnutls gphoto2 gpm gps gs gsl gsm gtk gtk2 gtkhtml guidexml guile hal hepmc hesiod hotpixels hppa i18n ical icecast iconv icu idea idn imagemagick imlib indi inquisitio ipv6 isc ithreads jabber jack javascript jbig jingle jpeg jpeg2k judy kde kerberos kpathsea lapack lasi latex lcms ldap leim lensfun libass libcaca libffi libmms libnotify libotf libsamplerate libwww live lm_sensors logrotate logwatch lua lyrics-screen lzo mad manhole matroska mbrola mem-scramble memcache metis mhash midi mikmod mmap mng modplug modules motif mozbranding mp3 mplayer mssql mudflap musepack musicbrainz mysql nagios-dns nagios-game nagios-ntp nagios-ping nagios-ssh nas nautilus ncurses netpbm network-cron nfconntrack nfs nls nntp nova nptl nptlonly nsplugin ntlm offensive ogg openal openexr opengl openmp openssl optimization oss ots overlays pam pango pbs pch pcre pdf pdo-external perl php plasma plotutils plugins png policykit portage portaudio postgres povray ppds pppd pulseaudio python pyzord qalculate qdbm qt3support qt4 quotas raw readline recode reflection rle rpc rrdtool rtc ruby ruby18 ruby19 samba sasl scanner schroedinger scim sdl seamonkey server session sid slang slp sms sndfile snmp soap song-screen soundex speex spell spl spoof-source sqlite srt srtp ssh ssl startup-notification strong-optimization subtitles subversion suhosin supernodal svg swat sysfs syslog talkfilters tcl tcpd test tftp tga theora threads thumbnail thunar-vfs tidy tiff timezone timidity tk tokyocabinet tools truetype tslib tunepimp twolame udev unicode unzip urandom usb userlocales utempter utf v4l v4l2 vanim vcd vidix vim-syntax vorbis watchdog wavpack webdav webinstall winbind wlan wma wmf xanim xattr xcb xchattext xcomposite xface xml xml2 xmp xmpi xorg xpm xrandr xscreensaver xsettings xulrunner xv xvid xvmc zip zip-external zlib" ALSA_CARDS="ad1889 usb-audio" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_ftp proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="evdev joystick keyboard mouse acecad aiptek calcomp citron digitaledge dmc dynapro elo2300 elographics fpit hyperpen jamstudio magellan microtouch mutouch palmax penmount spaceorb summa synaptics tek4957 tslib ur98 virtualbox wacom void" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en nl he" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="stifb fbdev none dummy" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, FFLAGS, INSTALL_MASK, LANG, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Confirmed same here, am using FEATURES="splitdebug" in /etc/make.conf which generates these debug files which python-update sticks its nose into. Don't think it should be doing that!
It's not any regression. python-updater-0.7 also uses scanelf.
(In reply to comment #2) > It's not any regression. python-updater-0.7 also uses scanelf. 0.7 doesn't exhibit this retarded behaviour though.
Yes it still does. # eix python-updater [I] app-admin/python-updater Available versions: 0.7 0.7-r1 0.8 **9999 Installed versions: 0.8(22:39:23 01/04/10) Homepage: http://www.gentoo.org/proj/en/Python Description: Script used to remerge python packages when changing Python version. # python-updater * Starting Python Updater... * Main active version of Python: 2.6 * Active version of Python 2: 2.6 * Active version of Python 3: (None) * Adding to list: app-emulation/vmware-workstation:0 scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/evince/1/backends/libpdfdocument.so.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/evince/1/backends/libpdfdocument.so.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/evince/1/backends/libpdfdocument.so.debug: corrupt ELF symbols scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib/evince/1/backends/libpdfdocument.so.debug: corrupt ELF symbols
python-updater gives me a lot of: scanelf: scanelf_file_sym(): /usr/lib/debug/usr/lib64/librarian.so.0.0.0.debug: corrupt ELF symbols What should I do about it?
Same here. If you need debug info let me know.
On a test system I have ~2000 packages installed which put ~100,000 files in /usr/lib/debug, part of which scanelf is apparently now parsing - I would really hate if this were the case, because the system isn't all that fast to begin with. Give me an 0.8-r1 that fixes this issue and I will stabilise it for HPPA.
scripts shouldnt waste time scanning the debug dir as there's nothing ever useful in there
Please attach output of: python-updater -p -v -v -v
Created attachment 234985 [details] python -p -v -v -v
Created attachment 239849 [details, diff] python-updater.patch Please test this patch.
(In reply to comment #11) > Created an attachment (id=239849) [details] > python-updater.patch > > Please test this patch. > worked here (amd64)
Fixed in r359.
(In reply to comment #13) > Fixed in r359. Can we have a new release, please?
(In reply to comment #14) I will release new version soon.
(In reply to comment #15) > (In reply to comment #14) > > I will release new version soon. Just do it?!
(In reply to comment #15) > (In reply to comment #14) > > I will release new version soon. > Is this still being worked on? Version 0.8 still goes after some of the debug files (though it does look like less of them).
*** Bug 351070 has been marked as a duplicate of this bug. ***
It's been over a year now. Wonderful. Can we somehow speed this up?
(In reply to comment #19) > It's been over a year now. Wonderful. Can we somehow speed this up? My vote for moving the code out of the Python overlay https://overlays.gentoo.org/svn/proj/python/projects/python-updater to git.overlays.gentoo.org. The only way to find these sources (that I know of) is inspecting the 9999er ebuild. If it were in Git over at git.overlays.gentoo.org, maybe someone else would have fixed it already. Arfrever didn't like the idea too much when it was proposed last time. If you need me for a conversion using KDE's svn2git: just let me know.
(In reply to comment #20) > (In reply to comment #19) > > It's been over a year now. Wonderful. Can we somehow speed this up? > > My vote for moving the code out of the Python overlay That's entirely unrelated to this bug or its solution. The attached patch applies fine to 0.8 and needs only minor changes to the ebuild: Index: python-updater-0.8.ebuild =================================================================== RCS file: /var/cvsroot/gentoo-x86/app-admin/python-updater/python-updater-0.8.ebuild,v retrieving revision 1.8 diff -u -B -r1.8 python-updater-0.8.ebuild --- python-updater-0.8.ebuild 30 Jul 2010 16:58:01 -0000 1.8 +++ python-updater-0.8.ebuild 22 Mar 2011 19:53:14 -0000 @@ -2,6 +2,8 @@ # Distributed under the terms of the GNU General Public License v2 # $Header: /var/cvsroot/gentoo-x86/app-admin/python-updater/python-updater-0.8.ebuild,v 1.8 2010/07/30 16:58:01 jer Exp $ +inherit eutils + DESCRIPTION="Script used to remerge python packages when changing Python version." HOMEPAGE="http://www.gentoo.org/proj/en/Python" SRC_URI="mirror://gentoo/${P}.tar.bz2" @@ -16,6 +18,12 @@ dev-lang/python || ( >=sys-apps/portage-2.1.2 sys-apps/paludis )" +src_unpack() { + unpack ${A} + cd "${S}" + epatch "${FILESDIR}"/${P}-splitdebug.patch +} + src_install() { dosbin ${PN} || die "dosbin failed" doman ${PN}.1 || die "doman failed"
I will try to release python-updater-0.9 in this week.
> > > It's been over a year now. Wonderful. Can we somehow speed this up? > > > > My vote for moving the code out of the Python overlay > > That's entirely unrelated to this bug or its solution. I saw potential in speeding things up that way. That is what you were asking for.
PS: I overlooked the existence of a patch before. I guess that's why my comment made no sense to you? Sorry.
(In reply to comment #24) > PS: I overlooked the existence of a patch before. I guess that's why my > comment made no sense to you? Sorry. Right. A simple patch has been out for months, that has been tried and tested and found to be the solution we want. I don't see why we are again being asked to wait for a new version release, which will again need testing as it no doubt will have changed quite a bit more than just this attached patch, and then solve the problems with that version, when we can have a revision out today, and mark it prematurely stable too if we want. What arfrever is doing here is just a display of arrogance.
QA takes care of the tree, not devrel
(In reply to comment #26) > QA takes care of the tree, not devrel Please let us decide ourselves if we should be removed from CC or not. QA does take care of the technical side but issues often have other dimensions too.
I have added an EAPI 2 version of jer's ebuild proposal to overlay "betagarden". I may touch python-updater in the main tree myself if nothing has happened until 2011-03-30.
I have committed 0.8-r1 which applies this patch, with stable keywords so everyone will benefit immediately. I felt it simply couldn't wait (precisely as was the case last time) because a major upgrade (bug #358717) is approaching users. 0.9 will be too late, ppc already has 2.7.1-r1 stable, and the majority of users is about to have the same crappy experience as last year if we do not act now.
(In reply to comment #29) Hooray, Jeroen!
