Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!

Bug 363421

Summary: dev-util/buildbot-0.8.3_p1 fails tests with root permissions
Product: Gentoo Linux Reporter: Thomas Kahle (RETIRED) <tomka>
Component: Current packagesAssignee: Python Gentoo Team <python>
Status: RESOLVED OBSOLETE    
Severity: normal    
Priority: Normal    
Version: unspecified   
Hardware: All   
OS: Linux   
Whiteboard:
Package list:
Runtime testing required: ---
Attachments: build.log with test failures

Description Thomas Kahle (RETIRED) gentoo-dev 2011-04-13 03:33:15 UTC
Created attachment 269755 [details]
build.log with test failures

As per summary.

 emerge --info
Portage 2.1.9.45 (default/linux/x86/10.0/desktop, gcc-4.4.5, glibc-2.11.3-r0, 2.6.34-gentoo-r12 i686)
=================================================================
System uname: Linux-2.6.34-gentoo-r12-i686-Intel-R-_Core-TM-2_Duo_CPU_L7500_@_1.60GHz-with-gentoo-2.0.2
Timestamp of tree: Tue, 12 Apr 2011 16:45:01 +0000
ccache version 2.4 [enabled]
app-shells/bash:     4.1_p9
dev-java/java-config: 2.1.11-r3
dev-lang/python:     2.6.6-r2, 3.1.3-r1
dev-util/ccache:     2.4-r9
dev-util/cmake:      2.8.1-r2
sys-apps/baselayout: 2.0.2
sys-apps/openrc:     0.7.0
sys-apps/sandbox:    2.4
sys-devel/autoconf:  2.13, 2.65-r1
sys-devel/automake:  1.9.6-r3, 1.10.3, 1.11.1
sys-devel/binutils:  2.20.1-r1
sys-devel/gcc:       4.4.5
sys-devel/gcc-config: 1.4.1
sys-devel/libtool:   2.2.10
sys-devel/make:      3.81-r2
virtual/os-headers:  2.6.36.1 (sys-kernel/linux-headers)
ACCEPT_KEYWORDS="x86"
ACCEPT_LICENSE="* -@EULA nauty PUEL googleearth AdobeFlash-10.1 dlj-1.1 skype-eula IBM-J1.6"
CBUILD="i686-pc-linux-gnu"
CFLAGS="-march=core2 -O2 -pipe"
CHOST="i686-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/openvpn/easy-rsa"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/env.d/java/ /etc/eselect/postgresql /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/php/apache2-php5.3/ext-active/ /etc/php/cgi-php5.3/ext-active/ /etc/php/cli-php5.3/ext-active/ /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c"
CXXFLAGS="-march=core2 -O2 -pipe"
DISTDIR="/usr/portage/distfiles"
FEATURES="assume-digests binpkg-logs ccache collision-protect distlocks fixlafiles fixpackages news parallel-fetch protect-owned sandbox sfperms sign splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch"
FFLAGS=""
GENTOO_MIRRORS="http://de-mirror.org/distro/gentoo/ http://linux.rz.ruhr-uni-bochum.de/download/gentoo-mirror/ http://ftp.uni-erlangen.de/pub/mirrors/gentoo"
LANG="en_US.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu"
LINGUAS="en en_US de ja es fr it"
MAKEOPTS="-j3"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_EXTRA_OPTS="--timeout=180"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages"
PORTAGE_TMPDIR="/var/tmp"
PORTDIR="/usr/portage"
PORTDIR_OVERLAY="/var/lib/layman/java-overlay /var/lib/layman/x11 /var/lib/layman/lisp /var/lib/layman/emacs /var/lib/layman/sunrise /var/lib/layman/betagarden /home/tom/tom-overlay /home/tom/gentoo/sci"
SYNC="rsync://rsync.europe.gentoo.org/gentoo-portage"
USE="X a52 aac acl acpi alsa anthy apache2 avahi bash-completion berkdb bluetooth branding bzip2 cairo cddb cdparanoia cdr cjk cli consolekit cracklib crypt ctype cups curl cxx daap dbus djvu dri dts dvb dvd dvdr emacs encode exif expat fam fbcon ffmpeg firefox flac fortran ftp gd gdbm gdu gif gimp glut gmp gnome gnome-keyring gnutls gpm graphviz gstreamer gtk guile hdaps iconv ieee1394 imagemagick imap imlib ipod ipv6 java javascript jpeg kde latex lcms ldap leim libnotify lm_sensors lzma m17n-lib mad migemo mikmod mime mmx mng modules mp3 mp4 mpeg mplayer mudflap mule musicbrainz mysql mysqli ncurses nls nptl nptlonly nsplugin obex ocaml ogg oggvorbis openal opengl openmp pam pango pcmcia pcre pdf perl php plasma plotutils png policykit ppds pppd python qt3support qt4 readline samba sasl sdl semantic-desktop session slang smartcard spell sqlite sqlite3 sse ssl startup-notification svg sysfs tcpd texlive theora threads tiff tk truetype udev uim unicode usb v4l v4l2 visualization vorbis wicd wifi win32codecs wxwindows x264 x86 xcb xcomposite xft xine xinerama xml xorg xulrunner xv xvid zeroconf zlib zsh-completion" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1 emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic auth_digest authn_anon authn_dbd authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock dbd deflate dir disk_cache env expires ext_filter file_cache filter headers ident imagemap include info log_config logio mem_cache mime mime_magic negotiation proxy proxy_ajp proxy_balancer proxy_connect proxy_http rewrite setenvif so speling status unique_id userdir usertrack vhost_alias" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" DVB_CARDS="usb-dib0700" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ubx" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LINGUAS="en en_US de ja es fr it" PHP_TARGETS="php5-3" RUBY_TARGETS="ruby18 ree18 jruby" USERLAND="GNU" VIDEO_CARDS="intel" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" 
Unset:  CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS
Comment 1 Carter Young 2011-04-15 00:54:54 UTC
try reemerging this with the mail useflag and let us know what happens.

mail should fix buildbot.test.unit.test_contrib_buildbot_cvs_mail.TestBuildbotCvsMail.test_buildbot_cvs_mail_from_cvs1_11
===============================================================================
[FAIL]
{snip}

buildbot.test.unit.test_contrib_buildbot_cvs_mail.TestBuildbotCvsMail.test_buildbot_cvs_mail_from_cvs1_12
===============================================================================
[ERROR]
{snip}

may get the weblinks bit too but we shall see
Comment 2 Thomas Kahle (RETIRED) gentoo-dev 2011-04-15 04:20:23 UTC
Looks similar with USE="mail":

[FAIL]
Traceback (most recent call last):
  File "/var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/test/unit/test_contrib_buildbot_cvs_mail.py", line 108, in test_buildbot_cvs_mail_from_cvs1_11
    self.assertOutputOk(p, stdoutdata, golden_1_11_regex )
  File "/var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/test/unit/test_contrib_buildbot_cvs_mail.py", line 86, in assertOutputOk
    self.failUnlessEqual(p.returncode, 0, "subprocess exited uncleanly")
twisted.trial.unittest.FailTest: subprocess exited uncleanly
not equal:
a = 2
b = 0

[...]
Comment 3 Dustin J. Mitchell 2011-04-15 04:52:15 UTC
Comment on attachment 269755 [details]
build.log with test failures

Is revmacros.html in the search path when the tests are run?  It should be at /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html

The test failures for contrib are expected when running tests from an installed copy of buildbot - see https://github.com/djmitche/buildbot/commit/9bfae71cd723af157ee8f150af78cf7009752b43
Comment 4 Thomas Kahle (RETIRED) gentoo-dev 2011-04-17 12:53:11 UTC
(In reply to comment #3)
> Comment on attachment 269755 [details]
> build.log with test failures
> 
> Is revmacros.html in the search path when the tests are run?  It should be at
> /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html

I don't really know what that means, the file is not an executable?

> The test failures for contrib are expected when running tests from an installed
> copy of buildbot - see
> https://github.com/djmitche/buildbot/commit/9bfae71cd723af157ee8f150af78cf7009752b43

In any case, the tests should be patched to give a working set for running with FEATURES="test".  If some are expected to fail, the optimal solution is to patch those away.  I'm not really interested in the package per se, I reported this b/c I found it during archtesting. Thanks.
Comment 5 Arfrever Frehtes Taifersar Arahesis (RETIRED) gentoo-dev 2011-04-17 17:40:55 UTC
Could you try with FEATURES="userpriv usersandbox"?
Anyway all tests pass for me.
Comment 6 Dustin J. Mitchell 2011-04-17 18:48:33 UTC
(In reply to comment #4)
> > Is revmacros.html in the search path when the tests are run?  It should be at
> > /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html
> 
> I don't really know what that means, the file is not an executable?

What is the output of /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html

And no, it should not be executable - it's a Jinja template file.

> In any case, the tests should be patched to give a working set for running with
> FEATURES="test".  If some are expected to fail, the optimal solution is to
> patch those away.  I'm not really interested in the package per se, I reported
> this b/c I found it during archtesting. Thanks.

Agreed, and the commit in comment #3 is probably a good way to do so.
Comment 7 Dustin J. Mitchell 2011-04-17 18:49:01 UTC
Er, what is the output of

file /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html
Comment 8 Thomas Kahle (RETIRED) gentoo-dev 2011-04-18 06:50:49 UTC
(In reply to comment #7)
> Er, what is the output of
> 
> file
> /var/tmp/portage/dev-util/buildbot-0.8.3_p1/work/buildbot-0.8.3p1/build-2.6/lib/buildbot/status/web/templates/revmacros.html

.../web has no subfolder templates.

Anyway, arfrever is right, privelage issue: Passes all tests with userpriv and usersandbox.
Comment 9 Dustin J. Mitchell 2012-06-23 23:06:07 UTC
As upstream maintainer, this isn't something I can fix.  I pointed out the patch that fixes the problem with running tests on an installed instance.  The optimal solution would be to stabilize something more modern, but barring that, patching out any tests that fail is an easy fix.
Comment 10 Markos Chandras (RETIRED) gentoo-dev 2013-01-27 20:33:23 UTC
This version is no longer in the tree. Please re-open this bug if the problem persists in new versions