Bug 754213

Summary:	dev-python/distlib-0.3.1-r1: test suite hangs during test_write (test_metadata.MetadataTestCase)
Product:	Gentoo Linux	Reporter:	Thomas Deutschmann (RETIRED) <whissi>
Component:	Current packages	Assignee:	Python Gentoo Team <python>
Status:	RESOLVED FIXED
Severity:	normal	CC:	mgorny, sam
Priority:	Normal	Keywords:	TESTFAILURE
Version:	unspecified
Hardware:	All
OS:	Linux
Whiteboard:
Package list:		Runtime testing required:	---
Bug Depends on:
Bug Blocks:	752339
Attachments:	build.log

Description Thomas Deutschmann (RETIRED) gentoo-dev

2020-11-12 22:34:35 UTC

Created attachment 671179 [details]
build.log

Test suite hangs during

> test_write (test_metadata.MetadataTestCase) ...

> portage   4439  0.0  0.0   2380  1688 pts/4    S+   23:22   0:00  |               \_ [dev-python/distlib-0.3.1-r1] sandbox /usr/lib/portage/python3.7/ebuild.sh test
> portage   4440  0.0  0.2  11504  6332 pts/4    S+   23:22   0:00  |                   \_ /bin/bash /usr/lib/portage/python3.7/ebuild.sh test
> portage   4456  0.0  0.1  11632  5464 pts/4    S+   23:22   0:00  |                       \_ /bin/bash /usr/lib/portage/python3.7/ebuild.sh test
> portage   4473  0.0  0.0   7544  2260 pts/4    S+   23:22   0:00  |                           \_ tee -a /var/tmp/portage/dev-python/distlib-0.3.1-r1/temp/build-python3_7.log
> portage   4501 99.3  0.8  33568 25260 pts/4    R+   23:22   8:49  |                           \_ python3.7 tests/test_all.py -v
> portage   4505  0.0  0.0      0     0 pts/4    Z+   23:22   0:00  |                               \_ [pypi-server] <defunct>


Portage 3.0.8 (python 3.7.9-final-0, default/linux/x86/17.0, gcc-9.3.0, glibc-2.32-r2, 5.4.72-gentoo-x86 i686)
=================================================================
System uname: Linux-5.4.72-gentoo-x86-i686-with-gentoo-2.7
KiB Mem:     3106076 total,    534636 free
KiB Swap:    8875836 total,   8855288 free
Timestamp of repository gentoo: Thu, 12 Nov 2020 20:35:32 +0000
Head commit of repository gentoo: b08ecbbd0282935bb94f98dfb478a4e766940f75

sh bash 5.0_p18
ld GNU ld (Gentoo 2.34 p6) 2.34.0
app-shells/bash:          5.0_p18::gentoo
dev-lang/perl:            5.30.3::gentoo
dev-lang/python:          3.6.12::gentoo, 3.7.9::gentoo, 3.8.5::gentoo, 3.9.0::gentoo
dev-util/cmake:           3.17.4-r1::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.7::gentoo
sys-apps/openrc:          0.42.1::gentoo
sys-apps/sandbox:         2.20::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r5::gentoo
sys-devel/automake:       1.16.1-r1::gentoo
sys-devel/binutils:       2.34-r2::gentoo
sys-devel/gcc:            9.3.0-r1::gentoo
sys-devel/gcc-config:     2.3.2::gentoo
sys-devel/libtool:        2.4.6-r6::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.4-r1::gentoo (virtual/os-headers)
sys-libs/glibc:           2.32-r2::gentoo
Repositories:

gentoo
    location: /usr/portage
    sync-type: git
    sync-uri: https://anongit.gentoo.org/git/repo/sync/gentoo.git
    priority: -1000

ABI="x86"
ABI_X86="32"
ACCEPT_KEYWORDS="x86"
ACCEPT_LICENSE="*"
ACCEPT_PROPERTIES="*"
ACCEPT_RESTRICT="*"
ADA_TARGET="gnat_2018"
ANT_HOME="/usr/share/ant"
ARCH="x86"
BINPKG_COMPRESS="bzip2"
BROOT=""
CBUILD="i686-pc-linux-gnu"
CFLAGS="-O2 -pipe -march=pentium4m -mtune=pentium4m -Wno-error=jump-misses-init -Wno-error=sign-compare"
CHOST="i686-pc-linux-gnu"
CHOST_x86="i686-pc-linux-gnu"
COLLISION_IGNORE="/lib/modules/*"
CONFIG_PROTECT="/etc /usr/share/config /usr/share/gnupg/qualified.txt"
CPU_FLAGS_X86="mmx mmxext sse sse2"
CXXFLAGS="-O2 -pipe -march=pentium4m -mtune=pentium4m -Wno-error=jump-misses-init -Wno-error=sign-compare"
DEFAULT_ABI="x86"
EDITOR="/usr/bin/mcedit"
ELIBC="glibc"
ENV_UNSET="CARGO_HOME DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN GOPATH PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
EPREFIX=""
EROOT="/"
ESYSROOT="/"
FCFLAGS="-O2 -march=i686 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs binpkg-multi-instance buildpkg cgroup config-protect-if-modified distlocks downgrade-backup ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned qa-unresolved-soname-deps sandbox sfperms strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -march=i686 -pipe"
GCC_SPECS=""
GRUB_PLATFORMS="efi-32 pc"
GSETTINGS_BACKEND="dconf"
HOME="/root"
INFOPATH="/usr/share/gcc-data/i686-pc-linux-gnu/9.3.0/info:/usr/share/binutils-data/i686-pc-linux-gnu/2.34/info:/usr/share/info"
INPUT_DEVICES="libinput"
IUSE_IMPLICIT="abi_x86_32 prefix prefix-guest prefix-stack"
JAVAC="/etc/java-config-2/current-system-vm/bin/javac"
JAVA_HOME="/etc/java-config-2/current-system-vm"
JDK_HOME="/etc/java-config-2/current-system-vm"
KERNEL="linux"
L10N="en en-US de de-DE"
LADSPA_PATH="/usr/lib/ladspa"
LANG="en_US.UTF-8"
LC_ALL="en_US.UTF-8"
LC_MESSAGES="C"
LC_PAPER="de_DE.UTF-8"
LDFLAGS="-Wl,-O1 -Wl,--as-needed"
LIBDIR_x86="lib"
LINGUAS="en de"
LOGNAME="root"
LUA_SINGLE_TARGET="lua5-1"
LUA_TARGETS="lua5-1"
LV2_PATH="/usr/lib/lv2"
MAIL="/var/mail/root"
MAKEOPTS="--jobs 5 --load-average 7.95"
MANPAGER="manpager"
MOTD_SHOWN="pam"
MULTILIB_ABIS="x86"
NOCOLOR="true"
OFFICE_IMPLEMENTATION="libreoffice"
OPENCL_PROFILE="ocl-icd"
OPENGL_PROFILE="xorg-x11"
PAGER="/usr/bin/less"
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr/lib/llvm/10/bin"
PHP_TARGETS="php7-2 php7-3"
POSTGRES_TARGETS="postgres10 postgres11"
PWD="/root"
PYTHONDONTWRITEBYTECODE="1"
PYTHON_SINGLE_TARGET="python3_7"
PYTHON_TARGETS="python2_7 python3_7"
QT_GRAPHICSSYSTEM="raster"
ROOT="/"
ROOTPATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/opt/bin:/usr/lib/llvm/10/bin"
RUBY_TARGETS="ruby25 ruby26"
SHELL="/bin/bash"
SHLVL="2"
SSH_TTY="/dev/pts/0"
SYSROOT="/"
TERM="tmux-256color"
TMUX="/tmp//tmux-0/default,3581,0"
TMUX_PANE="%2"
TWISTED_DISABLE_WRITING_OF_PLUGIN_CACHE="1"
USER="root"
USERLAND="GNU"
VIDEO_CARDS="vmware"
XDG_CONFIG_DIRS="/etc/xdg"
XDG_DATA_DIRS="/usr/local/share:/usr/share"
XDG_RUNTIME_DIR="/run/user/0"
XDG_SESSION_CLASS="user"
XDG_SESSION_ID="1"
XDG_SESSION_TYPE="tty"

Comment 1 Michał Górny archtester

2020-11-14 21:36:30 UTC

IIRC this package is extremely fragile to broken metadata in installed packages.  If you could test it in a clean minimal chroot to confirm, that'd be helpful.

Comment 2 Thomas Deutschmann (RETIRED) gentoo-dev

2020-11-14 21:56:32 UTC

I just retried, for me, the system is almost clean, world file:

> app-admin/eclean-kernel
> app-admin/logrotate
> app-admin/rsyslog
> app-editors/nano
> app-misc/ca-certificates
> app-misc/colordiff
> app-misc/mc
> app-misc/tmux
> app-portage/cpuid2cpuflags
> app-portage/eix
> app-portage/elogv
> app-portage/genlop
> app-portage/gentoolkit
> app-portage/golop
> app-portage/pfl
> app-portage/portage-utils
> app-portage/repoman
> app-portage/smart-live-rebuild
> app-portage/tatt
> app-shells/bash-completion
> app-shells/gentoo-bashcomp
> app-text/ansifilter
> app-text/tree
> app-text/wgetpaste
> dev-util/strace
> dev-util/valgrind
> dev-vcs/git
> net-analyzer/tcpdump
> net-dns/bind-tools
> net-misc/dhcpcd
> net-misc/ntp
> sys-apps/gptfdisk
> sys-apps/haveged
> sys-apps/iproute2
> sys-apps/less
> sys-apps/mlocate
> sys-apps/pciutils
> sys-apps/portage
> sys-boot/grub
> sys-devel/gdb
> sys-fs/ncdu
> sys-kernel/dracut
> sys-kernel/genkernel
> sys-kernel/gentoo-sources
> sys-process/fcron
> sys-process/htop
> sys-process/iotop

Hanging again. Test is consuming 100% CPU but 

> portage  28800  0.0  0.0      0     0 pts/2    Z+   22:51   0:00  |                               \_ [pypi-server] <defunct>

already crashed.

Maybe problem is related to 

> dev-python/pypiserver-1.3.2-1 ?

Comment 3 Thomas Deutschmann (RETIRED) gentoo-dev

2020-11-14 22:04:11 UTC

Same result with dev-python/pypiserver-1.4.2.

Comment 4 Sam James archtester

2020-11-14 22:51:15 UTC

I've hit this too on amd64 and ago has on both amd64, ppc64 (had to kill the processes).

Comment 5 Michał Górny archtester

2020-11-14 22:52:33 UTC

I'm probably going to restrict tests here.  It's not like upstream cares about this package at all.  It's more like throw-away stuff.

Comment 6 Larry the Git Cow gentoo-dev

2020-11-14 22:55:21 UTC

The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=f76435b9b393c1d3733b8fc79d39dfd18ab4c92b

commit f76435b9b393c1d3733b8fc79d39dfd18ab4c92b
Author:     Michał Górny <mgorny@gentoo.org>
AuthorDate: 2020-11-14 22:54:35 +0000
Commit:     Michał Górny <mgorny@gentoo.org>
CommitDate: 2020-11-14 22:54:35 +0000

    dev-python/distlib: Restrict tests
    
    Closes: https://bugs.gentoo.org/754213
    Signed-off-by: Michał Górny <mgorny@gentoo.org>

 dev-python/distlib/distlib-0.3.1-r1.ebuild | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)