The test suite of portage 2.3.53 and 2.3.53-r1 gets gets killed by the OOM reaper after spawning 1000+ processes. Output on the console: testPackageMaskOrder (portage.tests.ebuild.test_config.ConfigTestCase) ... ok testSetCpv (portage.tests.ebuild.test_config.ConfigTestCase) ... ok testDoebuild (portage.tests.ebuild.test_doebuild_fd_pipes.DoebuildFdPipesTestCase) ... * checking ebuild checksums ;-) ... [ ok ] * checking ebuild checksums ;-) ... [ ok ] Killed ps shows 1000+ instances of python2.7 running before being killed: [...] 8905 pts/0 SN+ 0:00 /usr/bin/python2.7 /var/tmp/portage/sys-apps/portage-2.3.53-r1/work/portage-2.3.53-python2_7/bin/install.py -m0700 -d /var/tmp/portage/sys-apps/portage-2.3.53-r1/temp/tmpXQwmq4/var/tmp/portage/app-misct/foo-1/work 8908 pts/0 SN+ 0:00 /usr/bin/python2.7 /var/tmp/portage/sys-apps/portage-2.3.53-r1/work/portage-2.3.53-python2_7/bin/install.py -m0700 -d /var/tmp/portage/sys-apps/portage-2.3.53-r1/temp/tmpXQwmq4/var/tmp/portage/app-misct/foo-1/work 8912 pts/0 RN+ 0:00 /usr/bin/python2.7 /var/tmp/portage/sys-apps/portage-2.3.53-r1/work/portage-2.3.53-python2_7/bin/install.py -m0700 -d /var/tmp/portage/sys-apps/portage-2.3.53-r1/temp/tmpXQwmq4/var/tmp/portage/app-misct/foo-1/work Reproducible: Always
Created attachment 558874 [details] dmesg part with OOM
Created attachment 558876 [details] build.log # emerge -pqv '=sys-apps/portage-2.3.53-r1::gentoo' [ebuild U ] sys-apps/portage-2.3.53-r1 [2.3.52-r1] USE="(ipc) native-extensions rsync-verify (xattr) -build -doc -epydoc -gentoo-dev (-selinux)" PYTHON_TARGETS="python2_7 python3_6 -pypy -python3_4 -python3_5 -python3_7" # emerge --info '=sys-apps/portage-2.3.53-r1::gentoo' Portage 2.3.52 (python 3.6.6-final-0, default/linux/amd64/17.0/no-multilib/hardened, gcc-8.2.0, glibc-2.28-r4, 4.20.0 x86_64) ================================================================= System Settings ================================================================= System uname: Linux-4.20.0-x86_64-Intel-R-_Core-TM-_i7-3720QM_CPU_@_2.60GHz-with-gentoo-2.6 KiB Mem: 16385216 total, 14213868 free KiB Swap: 0 total, 0 free Timestamp of repository gentoo: Sat, 29 Dec 2018 18:00:01 +0000 Head commit of repository gentoo: c9749cd7acbcc6731016ccf8f311c96cb91e6ba3 sh bash 4.4_p23 ld GNU ld (Gentoo 2.31.1 p5) 2.31.1 app-shells/bash: 4.4_p23::gentoo dev-java/java-config: 2.2.0-r4::gentoo dev-lang/perl: 5.26.2::gentoo dev-lang/python: 2.7.15::gentoo, 3.6.6::gentoo dev-util/cmake: 3.13.2::gentoo dev-util/pkgconfig: 0.29.2::gentoo sys-apps/baselayout: 2.6-r1::gentoo sys-apps/openrc: 0.40.3::gentoo sys-apps/sandbox: 2.14::gentoo sys-devel/autoconf: 2.13-r1::gentoo, 2.69-r4::gentoo sys-devel/automake: 1.16.1-r1::gentoo sys-devel/binutils: 2.31.1-r3::gentoo sys-devel/gcc: 7.3.0-r6::gentoo, 8.2.0-r6::gentoo sys-devel/gcc-config: 2.0::gentoo sys-devel/libtool: 2.4.6-r5::gentoo sys-devel/make: 4.2.1-r4::gentoo sys-kernel/linux-headers: 4.20::gentoo (virtual/os-headers) sys-libs/glibc: 2.28-r4::gentoo Repositories: gentoo location: /usr/portage sync-type: rsync sync-uri: rsync://rsync.gentoo.org/gentoo-portage priority: -1000 sync-rsync-verify-max-age: 24 sync-rsync-verify-jobs: 1 sync-rsync-verify-metamanifest: yes sync-rsync-extra-opts: local location: /var/lib/portage-local/local masters: gentoo priority: 0 testing location: /var/lib/portage-local/testing masters: gentoo priority: 1 ACCEPT_KEYWORDS="amd64 ~amd64" ACCEPT_LICENSE="* -@EULA" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-march=native -mtune=native -O2 -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/texmf/language.dat.d /etc/texmf/language.def.d /etc/texmf/updmap.d /etc/texmf/web2c" CXXFLAGS="-march=native -mtune=native -O2 -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--with-bdeps=y" ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR" FCFLAGS="-O2 -pipe" FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs cgroup collision-protect config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms strict test unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr" FFLAGS="-O2 -pipe" GENTOO_MIRRORS="http://distfiles.gentoo.org" LDFLAGS="-Wl,-O1 -Wl,--as-needed -Wl,--hash-style=gnu" LINGUAS="" MAKEOPTS="-j8" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git" PORTAGE_TMPDIR="/var/tmp" USE="X a52 acl acpi alsa amd64 avx bzip2 cairo caps cdda cddb cdparanoia crypt cups cxx dbus dri dts dvd fam ffmpeg fftw flac fontconfig gif gimp gmp gnutls gtk hardened iconv icu idn ipv6 jpeg lame lcms libnotify libtirpc lzma mad matroska mmap mmx mmxext mp3 mpeg ncurses networkmanager nptl ogg opengl openmp pam pcre pie png policykit ppds readline sasl sdl seccomp sse sse2 sse3 sse4 sse4_1 sse4_2 ssl ssp ssse3 startup-notification svg test theora threads tiff truetype udev unicode upower vaapi vorbis wayland x264 xattr xcb xinerama xml xtpax xv xvid zlib" ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon plan sheets stage words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx f16c mmx mmxext pclmul popcnt sse sse2 sse3 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="pc" INPUT_DEVICES="evdev synaptics" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-6 php7-1" POSTGRES_TARGETS="postgres9_5 postgres10" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_6" RUBY_TARGETS="ruby23 ruby24" USERLAND="GNU" VIDEO_CARDS="i965 intel nouveau" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account" Unset: CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LANG, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Apparently install.py calls itself, since this change: https://gitweb.gentoo.org/proj/portage.git/commit/?id=1b5edbb5ec70f1ae95b8f538a02037bb9a1ded9f
https://gitweb.gentoo.org/proj/portage.git/commit/?id=17cb113abf2b155b7b1f2955f7eed54f335badb0 commit 17cb113abf2b155b7b1f2955f7eed54f335badb0 Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-12-29 16:21:17 -0800 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-12-29 16:59:46 -0800 ResolverPlayground: exclude internal wrappers from essential_binaries PATH Ensure that essential_binaries symlinks do not refer to internal wrapper scripts, in order to avoid infinite recursion. Use the same ebuild-helpers pattern as the portageq wrapper script since daeb75b345c4433218ab9e7a5319e8914092f048. Fixes: 1b5edbb5ec70 ("_doebuild_path: do not use host PATH by default and prepend EPREFIX PATH") Signed-off-by: Zac Medico <zmedico@gentoo.org>
Related: https://gitweb.gentoo.org/proj/portage.git/commit/?id=886edf0d01a975b3e4da8c39f999c999242f042c commit 886edf0d01a975b3e4da8c39f999c999242f042c Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-12-29 17:06:19 -0800 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-12-29 17:10:31 -0800 ebuild-helpers: fix PORTAGE_OVERRIDE_EPREFIX usage In case PORTAGE_OVERRIDE_EPREFIX is modified in the environment, the actual ebuild-helpers PATH will not match PORTAGE_OVERRIDE_EPREFIX. Use the same ebuild-helpers pattern as the portageq wrapper script since daeb75b345c4433218ab9e7a5319e8914092f048. Signed-off-by: Zac Medico <zmedico@gentoo.org>
The test suite passes after applying the two patches.
