Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 704218 - dev-python/matplotlib: parallel build issue
Summary: dev-python/matplotlib: parallel build issue
Status: RESOLVED FIXED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Gentoo Science Related Packages
URL:
Whiteboard:
Keywords: PullRequest
Depends on:
Blocks:
 
Reported: 2019-12-29 22:49 UTC by Rémi Cardona (RETIRED)
Modified: 2020-05-12 20:43 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
build.log for failure #1 (build.log,525.42 KB, text/plain)
2019-12-29 22:51 UTC, Rémi Cardona (RETIRED)
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Rémi Cardona (RETIRED) gentoo-dev 2019-12-29 22:49:10 UTC
Building matplotlib 2.2.4 on my system always (AFAICT) results in one of two possible build failures.  Building with MAKEOPTS="-j1" works around the issue and allows the build to finish.

Possible failure #1:

/usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/../../../../x86_64-pc-linux-gnu/bin/ld: /var/tmp/portage/dev-python/matplotlib-2.2.4/work/matplotlib-2.2.4-python3_7/build/temp.linux-x86_64-3.7/src/py_converters.o: file not recognized: file truncated


Possible failure #2 (which of course I can't seem to reproduce anymore) which was during the early part of the build phase, going from memory:

OPTIONAL BACKEND EXTENSIONS
                macosx: no  [Mac OS-X only]
                qt5agg: no  [skipping due to configuration]
                qt4agg: no  [skipping due to configuration]
               gtk3agg: yes [installing, version 3.11.24]
             gtk3cairo: no  [tool timeout]



Reproducible: Always

Steps to Reproduce:
1. emerge -1av dev-python/matplotlib



Things I've noticed:

- it's *always* with py37, never any of the other 3 python implementations I have (27, 35, 36)
- it's *always* the py_converters.o file (with the build failure #1), no other compiled file or lib fails
- it's *always* gtk3cairo that fails (with build failure #2)
Comment 1 Rémi Cardona (RETIRED) gentoo-dev 2019-12-29 22:51:26 UTC
Created attachment 601738 [details]
build.log for failure #1
Comment 2 Rémi Cardona (RETIRED) gentoo-dev 2019-12-29 23:05:22 UTC
exos ~ # emerge --info
Portage 2.3.82 (python 3.7.6-final-0, default/linux/amd64/17.1, gcc-9.2.0, glibc-2.30-r3, 5.1.14-gentoo x86_64)
=================================================================
System uname: Linux-5.1.14-gentoo-x86_64-Intel-R-_Core-TM-_i5-4670_CPU_@_3.40GHz-with-gentoo-2.6
KiB Mem:    16267952 total,   5372160 free
KiB Swap:          0 total,         0 free
Head commit of repository gentoo: 8f547d3d483a8fe962d58d6af9764dbd1aa822c9

sh dash 0.5.10.2
ld GNU ld (Gentoo 2.33.1 p1) 2.33.1
app-shells/bash:          5.0_p11::gentoo
dev-lang/perl:            5.30.1::gentoo
dev-lang/python:          2.7.17::gentoo, 3.5.9::gentoo, 3.6.10::gentoo, 3.7.6::gentoo
dev-util/cmake:           3.16.2-r1::gentoo
dev-util/pkgconfig:       0.29.2::gentoo
sys-apps/baselayout:      2.6-r1::gentoo
sys-apps/sandbox:         2.18::gentoo
sys-devel/autoconf:       2.13-r1::gentoo, 2.69-r5::gentoo
sys-devel/automake:       1.13.4-r2::gentoo, 1.15.1-r2::gentoo, 1.16.1-r2::gentoo
sys-devel/binutils:       2.33.1::gentoo
sys-devel/gcc:            9.2.0-r3::gentoo
sys-devel/gcc-config:     2.1::gentoo
sys-devel/libtool:        2.4.6-r5::gentoo
sys-devel/make:           4.2.1-r4::gentoo
sys-kernel/linux-headers: 5.4::gentoo (virtual/os-headers)
sys-libs/glibc:           2.30-r3::gentoo
Repositories:

gentoo
    location: /home/portage/repo/gentoo
    sync-type: git
    sync-uri: git+ssh://git@git.gentoo.org/repo/gentoo.git
    sync-user: remi:users
    priority: -1000

gnome
    location: /home/portage/gnome
    masters: gentoo
    priority: 0

ACCEPT_KEYWORDS="amd64 ~amd64"
ACCEPT_LICENSE="@FREE AdobeFlash-10.3 AdobeFlash-11.x all-rights-reserved fping google-chrome linux-firmware linux-fw-redistributable netperf no-source-code Q3AEULA unRAR"
CBUILD="x86_64-pc-linux-gnu"
CFLAGS="-O2 -g -pipe"
CHOST="x86_64-pc-linux-gnu"
CONFIG_PROTECT="/etc /usr/lib64/libreoffice/program/sofficerc /usr/share/gnupg/qualified.txt"
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/dconf /etc/env.d /etc/fonts/fonts.conf /etc/gconf /etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo"
CXXFLAGS="-O2 -g -pipe"
DISTDIR="/usr/portage/distfiles"
EMERGE_DEFAULT_OPTS="--with-bdeps=y"
ENV_UNSET="DBUS_SESSION_BUS_ADDRESS DISPLAY GOBIN PERL5LIB PERL5OPT PERLPREFIX PERL_CORE PERL_MB_OPT PERL_MM_OPT XAUTHORITY XDG_CACHE_HOME XDG_CONFIG_HOME XDG_DATA_HOME XDG_RUNTIME_DIR"
FCFLAGS="-O2 -pipe"
FEATURES="assume-digests binpkg-docompress binpkg-dostrip binpkg-logs config-protect-if-modified distlocks ebuild-locks fixlafiles ipc-sandbox merge-sync multilib-strict network-sandbox news parallel-fetch pid-sandbox preserve-libs protect-owned sandbox sfperms sign splitdebug strict unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv usersandbox usersync xattr"
FFLAGS="-O2 -pipe"
GENTOO_MIRRORS="http://gentoo.mirror.ovh.net/gentoo-distfiles/ http://ftp.free.fr/mirrors/ftp.gentoo.org/"
LANG="en_US.utf8"
LDFLAGS="-Wl,-O1,--as-needed"
LINGUAS="en fr"
MAKEOPTS="-j4"
PKGDIR="/usr/portage/packages"
PORTAGE_CONFIGROOT="/"
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --omit-dir-times --compress --force --whole-file --delete --stats --human-readable --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages --exclude=/.git"
PORTAGE_TMPDIR="/var/tmp"
USE="X a52 aac alsa amd64 apng avahi bash-completion bzip2 cairo cdda clang cli crypt cxx dbus dconf dri drm dts dvd dvdnav eds encode exif faac faad fontconfig fuse gbm gdbm gegl glamor gnome gnome-keyring gnutls gstreamer gtk gtk3 iconv icu introspection ipv6 jpeg libnotify libtirpc live matroska mp3 mpeg mtp multilib nautilus ncurses nls nptl ogg opengl pam pcre png policykit pulseaudio python readline rtsp rubberband seccomp spell split-usr ssl startup-notification svg systemd tcpd theora threads truetype udev udisks unicode uxa vala vorbis x264 xattr xcb xv xvfb zeroconf zlib" ABI_X86="64" ADA_TARGET="gnat_2018" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" APACHE2_MODULES="authn_core authz_core socache_shmcb unixd actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache cgi cgid dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" CALLIGRA_FEATURES="karbon sheets words" COLLECTD_PLUGINS="df interface irq load memory rrdtool swap syslog" CPU_FLAGS_X86="aes avx avx2 fma3 mmx mmxext sse sse2 sse3 sse4 sse4_1 sse4_2 ssse3" ELIBC="glibc" GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt gpsclock greis isync itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore rtcm104v2 rtcm104v3 sirf skytraq superstar2 timing tsip tripmate tnt ublox ubx" GRUB_PLATFORMS="efi-64 pc" INPUT_DEVICES="evdev libinput" KERNEL="linux" L10N="en fr" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" NETBEANS_MODULES="apisupport cnd groovy gsf harness ide identity j2ee java mobility nb php profiler soa visualweb webcommon websvccommon xml" OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php7-2" POSTGRES_TARGETS="postgres10 postgres11" PYTHON_SINGLE_TARGET="python3_6" PYTHON_TARGETS="python2_7 python3_5 python3_6 python3_7" RUBY_TARGETS="ruby26" USERLAND="GNU" VIDEO_CARDS="intel" XTABLES_ADDONS="quota2 psd pknock lscan length2 ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq steal rawnat logmark ipmark dhcpmac delude chaos account"
Unset:  CC, CPPFLAGS, CTARGET, CXX, INSTALL_MASK, LC_ALL, PORTAGE_BINHOST, PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS
Comment 3 jon R-B 2019-12-30 16:27:26 UTC
quite a few such libraries are failing. pandas, scipy, matplotlib... all py37 related 

https://bugs.gentoo.org/699966 has some supporting info
Comment 4 Larry the Git Cow gentoo-dev 2020-01-01 11:59:09 UTC
The bug has been closed via the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=cee3e92674e3df672cf73f734edad8397be8b8f8

commit cee3e92674e3df672cf73f734edad8397be8b8f8
Author:     David Seifert <soap@gentoo.org>
AuthorDate: 2020-01-01 11:58:59 +0000
Commit:     David Seifert <soap@gentoo.org>
CommitDate: 2020-01-01 11:58:59 +0000

    dev-python/matplotlib: Force -j1 building
    
    Closes: https://bugs.gentoo.org/704218
    Closes: https://bugs.gentoo.org/704240
    Package-Manager: Portage-2.3.84, Repoman-2.3.20
    Signed-off-by: David Seifert <soap@gentoo.org>

 dev-python/matplotlib/matplotlib-2.2.4.ebuild | 7 ++++---
 1 file changed, 4 insertions(+), 3 deletions(-)
Comment 5 Richard Ash 2020-05-12 20:43:04 UTC
At the risk of sounding like a stuck record, this bug is FIXED for ~amd64 but very much still broken for stable amd64 users, who are now hitting it firmly as Python 3.7 is stable and they have to rebuild all their python packages, including matplotlib-2.2.2-r1 which is the stable version.

matplotlib-2.2.2-r1 needs the same fix as has been applied to version 2.2.4 applying to make it work on amd64 stable.