Created attachment 546792 [details] dev-python:cliff-2.12.0-r1:20180912-173002.log To try to work around bug #665746, I installed =dev-python/stestr-1.1.0, which unlike version 2.1.0 doesn't depend on dev-python/cliff. I started my emerge -uND @world running, and came back over an hour later to find that the test phase of =dev-python/cliff-2.12.0-r1 had apparently hung, with (from running ps in another terminal) a python3.6 child process of the "stestr run" process in the "defunct" state. I let it go for a good deal longer, then killed it. The same thing (as far as I can tell without comparing the logs in great detail) happened again when I tried again. The log file also contains, after the tests apparently complete for python2.7 and start for 3.6, the line "The specified repository directory ./stestr already exists. Please check if the repository already exists or select a different path" emerge --info: Portage 2.3.40 (python 3.6.5-final-0, hardened/linux/amd64, gcc-7.3.0, glibc-2.26-r7, 4.14.52-gentoo x86_64) ================================================================= System Settings ================================================================= System uname: Linux-4.14.52-gentoo-x86_64-Intel-R-_Core-TM-_i5-2400_CPU_@_3.10GHz-with-gentoo-2.4.1 KiB Mem: 8065320 total, 1042768 free KiB Swap: 12505080 total, 12240832 free Timestamp of repository gentoo: Wed, 12 Sep 2018 00:45:01 +0000 Head commit of repository gentoo: 20db8b73ffb5f7c4dbac39608da4156848e0cb7d Head commit of repository eclipse: 80b6b0802f9f65864a7064d7e0812154720423f4 sh bash 4.4_p12 ld GNU ld (Gentoo 2.29.1 p3) 2.29.1 distcc 3.2rc1 x86_64-pc-linux-gnu [disabled] app-shells/bash: 4.4_p12::gentoo dev-java/java-config: 2.2.0-r4::gentoo dev-lang/perl: 5.26.1-r2::gentoo dev-lang/python: 2.7.14-r1::gentoo, 3.5.5::gentoo, 3.6.5::gentoo dev-util/cmake: 3.9.6::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.4.1-r2::gentoo sys-apps/openrc: 0.34.11::gentoo sys-apps/sandbox: 2.13::gentoo sys-devel/autoconf: 2.13::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.11.6-r3::gentoo, 1.15.1-r2::gentoo sys-devel/binutils: 2.29.1-r1::gentoo sys-devel/gcc: 7.3.0-r3::gentoo sys-devel/gcc-config: 1.8-r1::gentoo sys-devel/libtool: 2.4.6-r3::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 4.13::gentoo (virtual/os-headers) sys-libs/glibc: 2.26-r7::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://myrriddium.local/gentoo-portage priority: -1000 sync-rsync-verify-metamanifest: yes sync-rsync-verify-jobs: 1 sync-rsync-extra-opts: sync-rsync-verify-max-age: 24 eclipse location: /var/lib/layman/eclipse-overlay sync-type: git sync-uri: git://github.com/gentoo/eclipse-overlay.git masters: gentoo localoverlay location: /usr/local/portage masters: gentoo lovelace eclipse priority: 0 dlang location: /var/lib/layman/dlang sync-type: laymansync sync-uri: https://github.com/gentoo/dlang.git masters: gentoo priority: 50 lovelace location: /var/lib/layman/lovelace sync-type: laymansync sync-uri: https://github.com/kingjon3377/lovelace-overlay.git masters: gentoo priority: 50 steam-overlay location: /var/lib/layman/steam-overlay sync-type: laymansync sync-uri: https://github.com/anyc/steam-overlay.git masters: gentoo priority: 50 Installed sets: @archivers, @backup-options, @devel, @dicts, @doc-conv, @docs, @emulation, @fonts, @kernels, @looked-interesting, @maintenance, @ocr, @office, @sp-devel ACCEPT_KEYWORDS="amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -pipe -march=core2 -mtune=generic -fno-unwind-tables -fno-asynchronous-unwind-tables -fomit-frame-pointer" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/config /usr/share/gnupg/qualified.txt /usr/share/maven-bin-3.1/conf /var/lib/hsqldb" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-O2 -pipe -march=core2 -mtune=generic -fno-unwind-tables -fno-asynchronous-unwind-tables -fomit-frame-pointer" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps y --binpkg-respect-use=n --autounmask-keep-masks --backtrack=1000 --verbose-conflicts" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe -march=core2 -mtune=generic -fno-unwind-tables -fno-asynchronous-unwind-tables -fomit-frame-pointer" FEATURES="assume-digests binpkg-logs candy collision-protect config-protect-if-modified distlocks ebuild-locks fakeroot fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch parallel-install preserve-libs protect-owned sandbox sfperms strict strict-keepdir test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync webrsync-gpg xattr" FFLAGS="-O2 -pipe -march=core2 -mtune=generic -fno-unwind-tables -fno-asynchronous-unwind-tables -fomit-frame-pointer" GENTOO_MIRRORS="http://lug.mtu.edu/gentoo/ http://gentoo.osuosl.org/ http://gentoo.cites.uiuc.edu/pub/gentoo/ http://distfiles.gentoo.org" LDFLAGS="-Wl,-O1 -Wl,--as-needed" LINGUAS="en en_US" MAKEOPTS="-j3 -l5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="acpi alsa amd64 bash-completion berkdb bzip2 cddb cli crypt cxx dri gdbm gnat_2017 hardened iconv ipv6 java java5 java6 jpeg libnotify libsecret libtirpc lm_sensors mmx mmxext modules multilib ncurses nls nptl ogg openmp pam pcre pic pie png readline seccomp sse sse2 sse3 sse4_1 sse4_2 ssl ssp ssse3 startup-notification tcpd theora truetype unicode urandom vorbis xattr xcomposite xdg xft xtpax xvmc zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="sheets words plan kexi braindump flow" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx mmx mmxext popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" INPUT_DEVICES="evdev libinput" KERNEL="linux" L10N="en en_US en-US" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="pdfimport" NETBEANS_MODULES="harness ide java nb javafx profile" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-0" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby23" USERLAND="GNU" VIDEO_CARDS="intel fbdev i915" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LANG, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS ================================================================= Package Settings ================================================================= dev-python/stestr-1.1.0::gentoo was built with the following: USE="" ABI_X86="(64)" PYTHON_TARGETS="python2_7 python3_6 -python3_4 -python3_5"
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=fcd055989bdc2d56e9abf094b8bc7a8fbeac031f commit fcd055989bdc2d56e9abf094b8bc7a8fbeac031f Author: Matthew Thode <prometheanfire@gentoo.org> AuthorDate: 2018-09-14 19:47:36 +0000 Commit: Matthew Thode <prometheanfire@gentoo.org> CommitDate: 2018-09-14 19:47:36 +0000 dev-python/cliff: fix missing stestr dep Fixes: https://bugs.gentoo.org/666112 Fixes: https://bugs.gentoo.org/665746 Package-Manager: Portage-2.3.48, Repoman-2.3.10 dev-python/cliff/{cliff-2.12.0-r1.ebuild => cliff-2.12.0-r2.ebuild} | 1 + 1 file changed, 1 insertion(+)
I've now installed =dev-python/cliff-2.12.0-r2 with tests temporarily masked, upgraded to =dev-python/stestr-2.1.0, and tried rebuilding dev-python/cliff with tests turned back on, and I see the same hanging behavior as with the earlier stestr version. From what I read in the stestr manual about how it stores data in "repositories," perhaps the "stestr init" command should be executed only once per build instead of once per Python implementation, or a separate repository should be set up per Python implementation using the --repo-url flag?
I've just run into this again (with 2.12.0-r2), and when I ran 'ps -af' in another terminal I noticed an "xclip -selection c" process outside, but in the same terminal as, the sandbox process-tree. When I killed it, the build advanced, then apparently hung again; another 'ps -af' revealed another "xclip -selection c" process. When I killed that process, the tests and the rest of the build completed "successfully". Since the string "xclip" doesn't appear anywhere in the dev-python/cliff unpacked sources, nor in the files installed by stestr, I did some digging, and found that it is used by dev-python/pyperclip; based on what I found in https://github.com/asweigart/pyperclip/issues/116 and https://github.com/asweigart/pyperclip/pull/117 , if I had x11-misc/xsel installed it might well use that instead of xclip and not hang.
Closing bugs reported for old versions, no longer in ::gentoo. Please reopen if you can still reproduce.
