| Summary: | dev-python/testify-0.2.8: fails tests if localhost resolves to IPv6 | ||
|---|---|---|---|
| Product: | Gentoo Linux | Reporter: | Diego Elio Pettenò (RETIRED) <flameeyes> |
| Component: | New packages | Assignee: | Python Gentoo Team <python> |
| Status: | RESOLVED FIXED | ||
| Severity: | normal | ||
| Priority: | Normal | ||
| Version: | unspecified | ||
| Hardware: | All | ||
| OS: | Linux | ||
| URL: | https://tinderboxlogs.s3.amazonaws.com/tbamd64.excelsior.flameeyes.eu/dev-python%3Atestify-0.2.8%3A20121011-191922.html | ||
| Whiteboard: | |||
| Package list: | Runtime testing required: | --- | |
I'm going to make a call on this and say this isn't a valid instance of attempting to connect to the 'network'. Network
has the 3 types; local, internet and de-militarised zone or such. The error cited here is
<urlopen error [Errno 111] Connection refused>
The connection it's refusing afaict is
self.connect_addr = "localhost:%d" % portnum.
I persistently get
test.plugins.http_reporter_test HTTPReporterTestCase.test_http_reporter_tries_twice ... WARNING 409 POST
/results?runner=tries_twice (127.0.0.1) 0.46ms
WARNING 409 POST /results?runner=tries_twice (127.0.0.1) 0.46ms
ERROR Skipping returning results for test test.plugins.http_reporter_test DummyTestCase.test because of error: error
ok in 0.01s
which happily carries on yielding
PASSED. 65 tests / 33 cases: 65 passed, 0 failed. (Total test time 1.21s)
So;
1. the system that has this fail has something set that mine doesn't to abort on this test
2. The connection self.connect_addr = "localhost:%d" % portnum. as far as connecting to the 'network' is local and is frankly innocuous, imo.
I'm still curious what the setup is that sees this do a fail. Wondering if the network per se is shutdown in total when running tests.
dev-python/testify $ USE_PYTHON="2.7-pypy-1.9 2.6 2.7" ebuild testify-0.2.8.ebuild clean test install.
yields
* Generating '/usr/bin/testify' wrapper script
>>> Completed installing testify-0.2.8 into /mnt/gen2/TmpDir/portage/dev-python/testify-0.2.8/image/
pypy builds fine, fails 3 tests related to sqlite. Final judgement call, I preferred PYTHON_TESTS_FAILURES_TOLERANT_ABIS="2.7-pypy-1.9" but it appears to not work, leaving PYTHON_TESTS_RESTRICTED_ABIS="2.7-pypy-1.*"
So it's a slightly different problem, but RESOLVED FIXED it ain't! frankly I find the test plugging into localhost innocuous. I can at this point find only one to dismiss the illegality of a test that accesses the local network, and I seek a seconder. Skipping the key tests via unittest doesn't apply since it's a custom python test run outside of unittest. The 'error' in fact appears a misanomer. """A simple test to make sure the HTTPReporter actually reports things.""" HTTPReporter appears to be passing the test, by reporting things that get called errors. There is 1 remaining piece to this puzzle though. What is it in yr system that triggers this as an error and would otherwise die except that you appear to have test-fail-continue set in FEATURES. Twice you've put this forward as an error and still my system sees this test blink but sees it continue giving it a pass. An error really does appear a misanomer, IPv6 or ney "frankly I find the test plugging into localhost innocuous." Sure, if it could resolve localhost to the correct IP family it tries to use, but if it fails, it's fucked up. dev-python/testify $ USE_PYTHON="2.6 2.7" ebuild testify-0.2.8.ebuild clean test * Testing of dev-python/testify-0.2.8 with CPython 2.6... ............................................................... PASSED. 63 tests / 32 cases: 63 passed, 0 failed. (Total test time 1.18s) * Testing of dev-python/testify-0.2.8 with CPython 2.7... ............................................................... PASSED. 63 tests / 32 cases: 63 passed, 0 failed. (Total test time 3.17s) "Sure, if it could resolve localhost to the correct IP family it tries to use" yes. By unanimous concensus, the test had to go. Fixed in portage 29 Nov. |
Portage 2.2.0_alpha134 (default/linux/amd64/10.0, gcc-4.7.1-asneeded, glibc-2.16.0, 3.4.7-hardened x86_64) ================================================================= System uname: Linux-3.4.7-hardened-x86_64-AMD_Opteron-TM-_Processor_6272-with-gentoo-2.2 Timestamp of tree: Fri, 28 Sep 2012 14:30:01 +0000 ccache version 3.1.8 [disabled] app-shells/bash: 4.2_p37 dev-java/java-config: 2.1.12 dev-lang/python: 2.6.8, 2.7.3-r2, 3.2.3-r1 dev-util/ccache: 3.1.8 dev-util/cmake: 2.8.9 sys-apps/baselayout: 2.2 sys-apps/openrc: 0.10.5 sys-apps/sandbox: 2.6 sys-devel/autoconf: 2.13, 2.69 sys-devel/automake: 1.4_p6-r1, 1.9.6-r3, 1.10.3, 1.11.6, 1.12.3 sys-devel/binutils: 2.22.90 sys-devel/gcc: 4.5.4, 4.6.3, 4.7.1 sys-devel/gcc-config: 1.7.3 sys-devel/libtool: 2.4.2 sys-devel/make: 3.82-r3 sys-kernel/linux-headers: 3.5 (virtual/os-headers) sys-libs/glibc: 2.16.0 Repositories: gentoo tbamd64 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="*" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -ggdb -march=native -ftracer -frecord-gcc-switches" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /etc/entropy /opt/openjms/config /usr/share/bufrtables /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.0/conf /usr/share/openvpn/easy-rsa /usr/share/qpsmtpd/plugins /usr/share/themes/oxygen-gtk/gtk-2.0 /var/bind /var/lib/hsqldb /var/lib/redmine/config /var/yp/Makefile" CONFIG_PROTECT_MASK="${EPREFIX}/etc/gconf /etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/games/angband/edit/ /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/apache2-php5.4/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cgi-php5.4/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/php/cli-php5.4/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/splash /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c /var/lib/redmine/config/locales /var/lib/redmine/config/settings.yml" CXXFLAGS="-O2 -pipe -ggdb -march=native -ftracer -frecord-gcc-switches" DISTDIR="/var/cache/portage/distfiles" FCFLAGS="-O2 -pipe -ggdb -march=native -frecord-gcc-switches" FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fail-clean fixlafiles news parallel-fetch protect-owned sandbox sfperms strict test test-fail-continue unknown-features-warn unmerge-orphans userfetch userpriv usersandbox" FFLAGS="-O2 -pipe -ggdb -march=native -frecord-gcc-switches" GENTOO_MIRRORS="http://ftp.ucsb.edu/pub/mirrors/linux/gentoo/ http://gentoo.mirrors.hoobly.com/ http://gentoo.llarian.net/" LANG="en_US.utf8" LC_ALL="C" LDFLAGS="-Wl,-O1 -Wl,--as-needed" MAKEOPTS="-j24" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/tmp" PORTDIR="/var/cache/tinderbox/tree" PORTDIR_OVERLAY="/root/overlay" SYNC="rsync://rsync.gentoo.org/gentoo-portage" USE="3dnow 3dnowex acl amd64 berkdb bzip2 cli cracklib crypt cups cxx dri emacs ffmpeg fortran gdbm gnutls gpm iconv ipv6 mmx modules mudflap multilib ncurses nls nptl openmp pam pax_kernel pcre pdf plasma pppd qt3support readline semantic-desktop session snmp sse sse2 sse3 sse4 ssl ssse3 tcmalloc tcpd udev unicode vhosts zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" PHP_TARGETS="php5-3" PYTHON_TARGETS="python3_2 python2_7" RUBY_TARGETS="ruby18 ruby19 ree18" USERLAND="GNU" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LINGUAS, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON