dev-python/urlgrabber does not emerge in my system.
Created attachment 308921 [details] Build log.
jorgeml@baraddur /var/tmp/portage $ sudo emerge --info =dev-python/urlgrabber-3.9.1-r1 Contraseña: Portage 2.1.10.49 (hardened/linux/amd64, gcc-4.5.3, glibc-2.13-r4, 3.2.2-hardened-r1 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-3.2.2-hardened-r1-x86_64-AMD_Phenom-tm-_II_X6_1055T_Processor-with-gentoo-2.0.3 Timestamp of tree: Sat, 14 Apr 2012 06:15:01 +0000 distcc 3.1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.2_p20 dev-java/java-config: 2.1.11-r3 dev-lang/python: 2.7.2-r3, 3.2.2 dev-util/cmake: 2.8.6-r4 dev-util/pkgconfig: 0.26 sys-apps/baselayout: 2.0.3 sys-apps/openrc: 0.9.8.4 sys-apps/sandbox: 2.5 sys-devel/autoconf: 2.13, 2.68 sys-devel/automake: 1.9.6-r3, 1.10.3, 1.11.1 sys-devel/binutils: 2.21.1-r1 sys-devel/gcc: 4.5.3-r2 sys-devel/gcc-config: 1.5-r2 sys-devel/libtool: 2.4-r1 sys-devel/make: 3.82-r1 sys-kernel/linux-headers: 3.1 (virtual/os-headers) sys-libs/glibc: 2.13-r4 Repositories: gentoo lcd-filtering ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -O2 -pipe -floop-interchange -floop-strip-mine -floop-block" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/themes/oxygen-gtk/gtk-2.0 /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/env.d/java/ /etc/fonts/fonts.conf /etc/games/angband/edit/ /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -O2 -pipe -floop-interchange -floop-strip-mine -floop-block" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps=y --jobs" FEATURES="assume-digests binpkg-logs buildsyspkg collision-protect distlocks ebuild-locks fixlafiles news parallel-fetch protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch xattr" FFLAGS="" GENTOO_MIRRORS="http://gentoo.tiscali.nl/ http://ftp.snt.utwente.nl/pub/os/linux/gentoo" LANG="es_ES.UTF-8" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="es_ES es en en_GB" MAKEOPTS="-j 12 -l 10" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" PORTDIR_OVERLAY="/var/lib/layman/lcd-filtering" SYNC="rsync://rsync.nl.gentoo.org/gentoo-portage" USE="3dnow 3dnowext 64bit X a52 aac aacplus acl addressbook alsa amd64 amr apng artworkextra aspell assistant audio autoipd avahi avcodec avformat banshee bash-completion berkdb bittorrent bluetooth boo bookmarks bootchart bpm branding bzip2 cairo calendar call caps cdda cdparanoia cdr celt cheese chromium cli clucene clutter colord connection-sharing consolekit coverart cracklib crypt css cups cxx daap dbus declarative detex dirac dmraid download dri drm dtmf dts dvd dvipdfm ebook eds embedded evo exif extensions extra extras fam fat festival ffmpeg firefox firefox-bookmarks firefox3 flac flickr fluidsynth fontconfig fts fuse gallium games gdbm gdm gdu gedit gensplash geoip geolocation gif git glchess glitz gnome gnome-keyring gnome-online-accounts gnome-shell gnutls gphoto2 gpm graphics graphite grub gsm gstreamer gtk gtk3 gudev hardened history holidays howl-compat hpcups hpijs hwdb hyperestraier icons iconv icu id3tag idn ieee1394 image innodb inotify ios iphone iplayer iptc ipv6 irc ithreads jabber java javascript jingle jpeg justify karma kdrive keymap kpathsea kqemu kvm lame lastfm lastfmfingerprint latex latex3 lcdfilter lcms lensfun libcanberra libkms libnotify libvirtd lightning lm_sensors luatex lvm lyrics lzma lzo mad map matroska mbrola mdadm mdnsresponder-compat mikmod mjpeg mmx mmxext mng modules mono mp3 mp3tunes mpeg mpi mplayer mtp mudflap multilib music musicbrainz mysql nautilus ncurses networkmanager nls nodrm nowlistening nptl nptlonly nsplugin ntfs offensive ofx ogg ogm opengl openmp otr pam pango parted passiv pax_kernel pcap pcre pdf pdfimport playlist plugins pm-utils png policykit pppd privacy private-headers projectm pstricks pulseaudio python qalculate qemu qt3support rdesktop rdp readline redeyes resolvconf romio rss rubber samba sasl scanner schroedinger science sdl search secure-delete seed sendto sensord session shutdown sip sipim skype smp socialweb sound speex spell spice sql sqlite sse sse2 ssl startup-notification stats stream stun subtitles subversion svg switcher symlink synctex sysfs syslog system-sqlite system-v8 taglib tcpd telepathy templates terminal test-programs tex4ht texteffect theora threads thumbnail thumbnails tidy tiff totem tracker truetype udev udisks unicode unlock-notify upnp urandom usb usbredir uswsusp utils v4l v4l2 vaapi vala vapigen vcd vcdx vde vhosts video videos vim vim-pager vim-syntax virt-network vlc vnc vorbis vpx wav wavpack web webcam webgl webinterface webkit webm webp webpresence webstart x264 xattr xcb xcomposite xetex xine xml xmp xorg xscreensaver xulrunner xv xvid youtube zeitgeist zeroconf zip zlib" ALSA_CARDS="snd-hda-intel" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog contextswitch cpu cpufreq entropy filecount hddtemp java mysql network notify_desktop processes protocols sensors thermal uptime users vmem" DRACUT_MODULES="lvm mdraid syslog plymouth" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="es_ES es en en_GB" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18" USERLAND="GNU" VIDEO_CARDS="radeon" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON ================================================================= Package Settings ================================================================= dev-python/urlgrabber-3.9.1-r1 was built with the following: USE="(multilib)"
Did you run python-updater yet?
I have a similar error, 'emerge urlgrabber' fails with: >>> Source configured. >>> Compiling source in /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1 ... * Building of dev-python/urlgrabber-3.9.1-r1 with CPython 2.7... python2.7 setup.py build -b build-2.7 Traceback (most recent call last): File "setup.py", line 3, in <module> import urlgrabber as _urlgrabber File "/var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1/urlgrabber/__init__.py", line 54, in <module> from grabber import urlgrab, urlopen, urlread File "/var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1/urlgrabber/grabber.py", line 427, in <module> import pycurl ImportError: /usr/lib64/python2.7/site-packages/pycurl.so: undefined symbol: CRYPTO_num_locks * ERROR: dev-python/urlgrabber-3.9.1-r1 failed (compile phase): 'python-updater' says: "* No packages need to be reinstalled." Could it be that this bug is connected with Bug https://bugs.gentoo.org/show_bug.cgi?id=412199 ? At least emerge also complains on this system about: root@leopard:/root(13)# emerge -pvuND curl These are the packages that would be merged, in order: Calculating dependencies... done! Total: 0 packages, Size of downloads: 0 kB WARNING: One or more updates have been skipped due to a dependency conflict: net-misc/curl:0 (net-misc/curl-7.25.0-r1::gentoo, ebuild scheduled for merge) conflicts with net-misc/curl[ssl,nss,-gnutls] required by (net-libs/liboauth-0.9.6::gentoo, installed)
This is a problem related to pycurl that was fixed yesterday. Please, emerge --sync and re-emerge dev-python/pycurl. That should fix the problem
At least one 'emerge --sync', one 'emerge -v1 pycurl' later, 'emerge urlgrabber' still fails: root@leopard:/root(59)# genlop -r | tail rsync'ed at >>> Mon Apr 16 19:59:03 2012 rsync'ed at >>> Tue Apr 17 19:13:10 2012 rsync'ed at >>> Wed Apr 18 11:49:31 2012 rsync'ed at >>> Mon Apr 23 11:51:43 2012 root@leopard:/root(60)# genlop -t pycurl | tail * dev-python/pycurl Fri Apr 20 17:37:08 2012 >>> dev-python/pycurl-7.19.0 merge time: 7 seconds. Mon Apr 23 12:32:15 2012 >>> dev-python/pycurl-7.19.0 merge time: 7 seconds. root@leopard:/root(61)# emerge -vuDN virt-manager * IMPORTANT: 1 news items need reading for repository 'science'. * IMPORTANT: 1 news items need reading for repository 'gentoo'. * Use eselect news to read news items. These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild N ] dev-python/urlgrabber-3.9.1-r1 0 kB [ebuild U ] app-emulation/qemu-kvm-1.0.1 [1.0-r3] USE="aio alsa bluetooth curl ncurses opengl pulseaudio sasl sdl threads vhost-net xattr -brltty -debug -fdt -qemu-ifup (-rbd) -smartcard -spice -static -test -tls -usbredir -vde -xen" QEMU_SOFTMMU_TARGETS="arm i386 x86_64 -cris -m68k -microblaze -mips -mips64 -mips64el -mipsel -ppc -ppc64 -ppcemb -sh4 -sh4eb -sparc -sparc64" QEMU_USER_TARGETS="arm i386 x86_64 -alpha -armeb -cris -m68k -microblaze -mips -mipsel -ppc -ppc64 -ppc64abi32 -sh4 -sh4eb -sparc -sparc32plus -sparc64" 0 kB [ebuild N ] app-emulation/virtualbox-4.1.12 USE="additions alsa doc extensions java opengl pam pulseaudio python qt4 sdk -headless -vboxwebsrv -vnc" 0 kB [ebuild N ] app-emulation/virtualbox-extpack-oracle-4.1.12 0 kB [ebuild N ] app-emulation/libvirt-0.9.11 USE="libvirtd lxc nfs nls policykit python qemu sasl udev virtualbox -avahi -caps -debug -iscsi -lvm -macvtap -numa -openvz -parted -pcap -phyp (-selinux) -uml -virt-network -xen" 0 kB [ebuild N ] app-emulation/virtinst-0.600.1 0 kB [ebuild N ] app-emulation/virt-manager-0.9.1 USE="gnome-keyring policykit sasl -spice" 0 kB Total: 7 packages (1 upgrade, 6 new), Size of downloads: 0 kB WARNING: One or more updates have been skipped due to a dependency conflict: net-misc/curl:0 (net-misc/curl-7.25.0-r1::gentoo, ebuild scheduled for merge) conflicts with net-misc/curl[ssl,nss,-gnutls] required by (net-libs/liboauth-0.9.6::gentoo, installed) >>> Verifying ebuild manifests >>> Running pre-merge checks for app-emulation/qemu-kvm-1.0.1 * Determining the location of the kernel source code * Found kernel source directory: * /usr/src/linux * Found kernel object directory: * /lib/modules/3.3.0-gentoo/build * Found sources for kernel version: * 3.3.0-gentoo * Checking for suitable kernel configuration options... * You will need the Universal TUN/TAP driver compiled into your kernel or loaded as a module to use the virtual network device if using -net tap. * You will also need support for 802.1d Ethernet Bridging for some network configurations. * If you have an AMD CPU, you must enable KVM_AMD in your kernel configuration. * Please check to make sure these options are set correctly. * Failure to do so may cause unexpected problems. >>> Starting parallel fetch >>> Emerging (1 of 7) dev-python/urlgrabber-3.9.1-r1 * urlgrabber-3.9.1.tar.gz RMD160 SHA1 SHA256 size ;-) ... [ ok ] >>> Unpacking source... >>> Unpacking urlgrabber-3.9.1.tar.gz to /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work >>> Source unpacked in /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work >>> Preparing source in /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1 ... * Applying urlgrabber-3.9.1.patch ... [ ok ] >>> Source prepared. >>> Configuring source in /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1 ... >>> Source configured. >>> Compiling source in /var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1 ... * Building of dev-python/urlgrabber-3.9.1-r1 with CPython 2.7... python2.7 setup.py build -b build-2.7 Traceback (most recent call last): File "setup.py", line 3, in <module> import urlgrabber as _urlgrabber File "/var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1/urlgrabber/__init__.py", line 54, in <module> from grabber import urlgrab, urlopen, urlread File "/var/tmp/portage/dev-python/urlgrabber-3.9.1-r1/work/urlgrabber-3.9.1/urlgrabber/grabber.py", line 427, in <module> import pycurl ImportError: /usr/lib64/python2.7/site-packages/pycurl.so: undefined symbol: CRYPTO_num_locks * ERROR: dev-python/urlgrabber-3.9.1-r1 failed (compile phase):
This bug blocks at least the installation of virt-manager and smolt for me.
(In reply to comment #7) > This bug blocks at least the installation of virt-manager and smolt for me. Could please first try to fix the warning portage throws at you? WARNING: One or more updates have been skipped due to a dependency conflict: net-misc/curl:0 (net-misc/curl-7.25.0-r1::gentoo, ebuild scheduled for merge) conflicts with net-misc/curl[ssl,nss,-gnutls] required by (net-libs/liboauth-0.9.6::gentoo, installed) Fix curl, re-emerge pycurl and check if issue is still there.
I don't know, how I can fix the bug regarding curl. I wrote already a bug about it: https://bugs.gentoo.org/show_bug.cgi?id=412199 pycurl was emerged several time in the last days: rose@leopard:/home/rose(3)$ genlop -t pycurl | tail Fri Apr 20 17:37:08 2012 >>> dev-python/pycurl-7.19.0 merge time: 7 seconds. Mon Apr 23 12:32:15 2012 >>> dev-python/pycurl-7.19.0 merge time: 7 seconds. Thu Apr 26 16:42:32 2012 >>> dev-python/pycurl-7.19.0 merge time: 6 seconds.
I cant reproduce this with the fixed pycurl and any combination of USE flags for cUrl. tried -gnutls -nss +ssl, +gnutls -nss +ssl and -gnutls +nss +ssl and all the time (after rebuilding pycurl), urlgrabber just worked. Can you paste the output of curl-config --libs?
root@leopard:/usr/src(14)# curl-config --libs -lcurl -lldap -lrt -L/usr/lib64 -Wl,-O1 -Wl,--as-needed -lgssapi_krb5 -lkrb5 -lk5crypto -lcom_err -lz -lssl3 -lsmime3 -lnssutil3 -lnss3 -lplds4 -lplc4 -lnspr4 -lpthread -ldl root@leopard:/usr/src(15)# emerge -pvD pycurl These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R ] dev-python/pycurl-7.19.0 USE="examples" 0 kB Total: 1 package (1 reinstall), Size of downloads: 0 kB root@leopard:/usr/src(16)# emerge -pvD curl These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild R ] net-misc/curl-7.25.0 USE="ipv6 kerberos ldap nss ssl threads -ares -gnutls -idn -ssh -static-libs -test" 0 kB Total: 1 package (1 reinstall), Size of downloads: 0 kB WARNING: One or more updates have been skipped due to a dependency conflict: net-misc/curl:0 (net-misc/curl-7.25.0-r1::gentoo, ebuild scheduled for merge) conflicts with net-misc/curl[ssl,nss,-gnutls] required by (net-libs/liboauth-0.9.6::gentoo, installed)
I can emerge urlgrabber on system with an old pycurl-7.19.0: root@moose:/root(50)# genlop -t pycurl | tail Tue Nov 1 13:50:58 2011 >>> dev-python/pycurl-7.19.0 merge time: 8 seconds. Wed Nov 2 09:43:16 2011 >>> dev-python/pycurl-7.19.0 merge time: 9 seconds. Thu Nov 3 11:23:58 2011 >>> dev-python/pycurl-7.19.0 merge time: 8 seconds. but I can't emerge urlgrabber on system with a new pycurl-7.19.0: root@dog:/root(78)# genlop -t pycurl | tail * dev-python/pycurl Mon May 7 19:09:27 2012 >>> dev-python/pycurl-7.19.0 merge time: 9 seconds. root@leopard:/root(50)# genlop -t pycurl | tail Mon Apr 23 12:32:15 2012 >>> dev-python/pycurl-7.19.0 merge time: 7 seconds. Thu Apr 26 16:42:32 2012 >>> dev-python/pycurl-7.19.0 merge time: 6 seconds. Tue May 8 14:29:14 2012 >>> dev-python/pycurl-7.19.0 merge time: 6 seconds. Hi Jesus (Comment 10), what do you mean with "fixed pycurl"? Regards
After using the patched liboauth, see bug https://bugs.gentoo.org/show_bug.cgi?id=412199 and emerging net-misc/curl-7.25.0-r1 I could also emerge urlgrabber.
