dev-python/urlgrabber-3.9.1-r2 cannot download data over HTTPS because incompatibility with dev-python/pycurl-7.19.0-r3. If an HTTPS schema to download a document is used, urlgrabber dies: $ urlgrabber https://google.com/ Traceback (most recent call last): [...] File "/usr/lib64/python2.7/site-packages/urlgrabber/grabber.py", line 1161, in _set_opts self.curl_obj.setopt(pycurl.SSL_VERIFYHOST, opts.ssl_verify_host) pycurl.error: (43, '') This is because a wrong value is passed to setopt(pycurl.SSL_VERIFYHOST,). Fix has already been applied by upstream <http://yum.baseurl.org/gitweb?p=urlgrabber.git;a=commitdiff;h=b6bfd59c4393ea8ba5165aabb249c37d6d2a9931>: From b6bfd59c4393ea8ba5165aabb249c37d6d2a9931 Mon Sep 17 00:00:00 2001 From: Seth Vidal <skvidal@fedoraproject.org> Date: Fri, 18 Mar 2011 10:23:09 -0400 Subject: [PATCH] - if we're not using keepalives then don't reuse the connections - ssl verify host needs to be '2' when it is set to true - 1 is kinda meaningless See Debian bug tracking system for reference <http://article.gmane.org/gmane.linux.debian.devel.bugs.general/1069387/match=715416>.
Alternatively it might be better/faster to just update urlgrabber unstable to 3.10 for which I just filed bug 490518. Basically upstream has released a new version after 4 years with *a lot* of bugfixes + testuite addition.
Assuming 3.10.1 is fine then. Will stabilize in another bug.