Bug 547058 – net-irc/limnoria-20150318 triggers UnicodeWarning during supybot-test for testNonSnarfing, testTitleSnarfer, testTitle and others when using dev-python/charade

• Status: RESOLVED FIXED
• Product: Gentoo Linux

[Description Chicago 2015-04-19 08:54:15 UTC]

Limnoria offers a comprehensive test suite which can be invoked similarly to the following.

supybot-test --verbose --plugins-dir=/usr/lib64/python2.7/site-packages/supybot/plugins/

When it runs, I see FAILED (failures=6, skipped=1). However, one of these failures can be fixed with a dependency.

The output in the test which shows the problem with the plugin is "UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal"

For at least one of the tests, testTitleSnarfer, this leads to an exception and a test failure.

Changing the dependency to dev-python/chardet[${PYTHON_USEDEP}] ( replacing charade ) fixes these warnings and leaves the test suite with one less failure.

FAILED (failures=5, skipped=1)

For what its worth, of the other 5 failures --

testGoosnarf, testShrink, testShrinkCycle, testUr1snarf and testX0snarf from supybot-test are the only failures which come up for me when I run the test suite. testGoosnarf and testShrinkCycle are both timeout errors, while testShrink returns a 403 forbidden.  The testUr1snarf and testX0snarf checks seem to be legit failures because the assertion errors for one URL do not match the returned URL.

I am still seeking upstream guidance on those five.

Reproducible: Always

Steps to Reproduce:
1. supybot-test --verbose --plugins-dir=/usr/lib64/python2.7/site-packages/supybot/plugins/
2. observe FAILED (failures=6, skipped=1)
Actual Results:  
The output reveals an exception from testTitleSnarfer adding one additional failure to the test suite.

Expected Results:  
Instead, this UnicodeWarning should not occur and there should be one less failure from the test suite.

3. create limnoria-20150318-r1.ebuild with an $RDEPEND on dev-python/chardet[${PYTHON_USEDEP}] ( replacing dev-python/charade ), emerge and run the tests from step one
4. observe FAILED (failures=5, skipped=1) and no further UnicodeWarning messages in the test output

[Comment 1 Chicago 2015-04-19 08:54:44 UTC]

Portage 2.2.14 (python 2.7.9-final-0, hardened/linux/amd64/no-multilib, gcc-4.8.4, glibc-2.19-r1, 3.18.9-hardened x86_64)
=================================================================
System uname: Linux-3.18.9-hardened-x86_64-Intel-R-_Xeon-R-_CPU_E5-2670_0_@_2.60GHz-with-gentoo-2.2
KiB Mem:     2045980 total,    546244 free
KiB Swap:    2097148 total,   2097112 free
Timestamp of tree: Sun, 19 Apr 2015 06:45:01 +0000
ld GNU ld (Gentoo 2.24 p1.4) 2.24
app-shells/bash:          4.2_p53
dev-java/java-config:     2.2.0
dev-lang/perl:            5.20.2
dev-lang/python:          2.7.9-r1, 3.3.5-r1, 3.4.1
dev-util/cmake:           2.8.12.2-r1
dev-util/pkgconfig:       0.28-r2
sys-apps/baselayout:      2.2
sys-apps/openrc:          0.13.11
sys-apps/sandbox:         2.6-r1
sys-devel/autoconf:       2.13, 2.69
sys-devel/automake:       1.13.4
sys-devel/binutils:       2.24-r3
sys-devel/gcc:            4.8.4
sys-devel/gcc-config:     1.7.3
sys-devel/libtool:        2.4.6
sys-devel/make:           4.1-r1
sys-kernel/linux-headers: 3.18 (virtual/os-headers)
sys-libs/glibc:           2.19-r1
Repositories: gentoo Cloud-Servers Version-Bumps
ACCEPT_KEYWORDS="amd64"
ACCEPT_LICENSE="* -@EULA"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -march=corei7"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt /var/bind"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-O2 -march=corei7"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps=y"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles merge-sync news parallel-fetch preserve-libs protect-owned sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://gentoo.cites.uiuc.edu/pub/gentoo/ http://mirror.mcs.anl.gov/pub/gentoo/ http://gentoo.mirrors.tds.net/gentoo"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
MAKEOPTS="-j1"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/Cloud-Servers /opt/overlay/Bumps"
SYNC="rsync://rsync25.us.gentoo.org/gentoo-portage"
USE="X Xaw3d aalib acl amd64 bash-completion berkdb bidi bzip2 cairo caps cdb cjk cli cracklib crypt cscope curl custom-cflags cvs cxx dbi dbus dga djvu dri examples expat fam fastcgi fftw flac fltk fontconfig fortran freetds gdbm geoip gif git glut gmp gnome-keyring gnutls gpm graphviz gtk guile hardened iconv icu idn imagemagick imap imlib iodbc ipv6 java jbig jit jpeg jpeg2k justify kerberos lapack latex lcms ldap libcaca libffi lm_sensors lua lzma lzo mbox mmx mmxext mng modules mono motif mp3 mpi mssql mysql nas ncurses neXt nls nntp nptl odbc offensive ogg openexr opengl openmp pam pax_kernel pcre pdf perl plotutils png postgres postscript python qdbm radius raw readline ruby sasl sdl session skey slp snmp soap socks5 source spell sqlite sse sse2 ssl static-libs subversion svg syslog tcl tcpd threads tiff tk truetype udev unicode urandom vala vim-syntax vorbis wmf xattr xcb xft xinerama xinetd xml xmp xpm xtpax xv zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="sse3 sse4_1 ssse3 mmx sse sse2" CURL_SSL="gnutls" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev keyboard mouse joystick tslib" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" LINGUAS="en en_US" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" RUBY_TARGETS="ruby19 ruby20" USERLAND="GNU" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CPPFLAGS, CTARGET, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON

[Comment 2 Adam Feldman 2015-04-27 00:24:35 UTC]

Yeah, I can confirm it.  Upstream (and ours as a result) tests the plugins with the --no-network flag (If you do that, you should find that you have no failures, please confirm this).  These issues are all exposed by the tests excluded by using the --no-network flag.  I've filed an issue upstream.

[Comment 3 Adam Feldman 2015-04-28 22:30:30 UTC]

Created attachment 402204 [details]
limnoria-99999999.ebuild

Looks like upstream applied some patches to the ShrinkUrl plugin in their testing branch.  Can you confirm whether you still have issues with this build?  Also, if you have issues, can you attach a complete log of your test run?

[Comment 4 Adam Feldman 2015-05-18 19:04:42 UTC]

This was fixed upstream for the 20150429 build, plus dep changes on our end.  Just waiting for a dev to accept the patch and add it to the tree

[Comment 5 Ian Delaney (RETIRED) 2015-05-20 08:47:37 UTC]

  19 May 2015; Ian Delaney <[e-mail]> -limnoria-20150318.ebuild,
  limnoria-20150429.ebuild, limnoria-99999999.ebuild:
  Clean up partial version bump, drop old, resolves bug 547058