bzip2: Can't open input file /var/tmp/portage/net-misc/zerotier-1.2.8/image/usr/share/man/man8/zerotier-one.8: No such file or directory. * ERROR: net-misc/zerotier-1.2.8::gentoo failed: * ecompress-file failed * * If you need support, post the output of `emerge --info '=net-misc/zerotier-1.2.8::gentoo'`, * the complete build log and the output of `emerge -pqv '=net-misc/zerotier-1.2.8::gentoo'`. ------------------------------------------------------------------- This is an unstable amd64 chroot image at a tinderbox (==build bot) name: 17.0-no-multilib_libressl_20180923-190711 ------------------------------------------------------------------- gcc-config -l: [1] x86_64-pc-linux-gnu-8.2.0 * Available Python interpreters, in order of preference: [1] python3.7 [2] python3.6 [3] python2.7 (fallback) Available Ruby profiles: [1] ruby23 (with Rubygems) * emerge -qpv net-misc/zerotier [ebuild N ] net-misc/zerotier-1.2.8
Created attachment 547922 [details] emerge-info.txt
Created attachment 547924 [details] emerge-history.txt
Created attachment 547926 [details] environment
Created attachment 547928 [details] etc.portage.tbz2
Created attachment 547930 [details] logs.tbz2
Created attachment 547932 [details] net-misc:zerotier-1.2.8:20180925-175843.log
and: ramage.lucas@openmailbox.org is not known
This actually looks like a Portage problem. Let me grep for duplicates, then investigate.
(In reply to Michał Górny from comment #8) especially as I do miss a pattern like \* ERROR:.* failed (.* phase): do get which phase failed
Oh my. So the ebuild apparently installs both compressed and uncompressed manpages, and this trips the logic in ecompress: │ └── man │ ├── man1 │ │ ├── zerotier-cli.1 │ │ ├── zerotier-cli.1.gz │ │ ├── zerotier-idtool.1 │ │ └── zerotier-idtool.1.gz │ └── man8 │ ├── zerotier-one.8 │ └── zerotier-one.8.gz
...and the problems occurs because of race conditions due to the parallel processing.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage.git/commit/?id=8a1d36088aa54ecb087e76fef166d51a6d5383f7 commit 8a1d36088aa54ecb087e76fef166d51a6d5383f7 Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-09-25 20:58:40 +0000 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-09-25 21:01:15 +0000 Revert "ecompress: Run compression in parallel" (bug 667072) This reverts commit 289d9a17dc9d9287e5dcb75f84b38ad0388e5fde. The parallel ecompress-file calls can interfere with eachoter if a file is installed with both compressed and uncompressed forms. Since compressed files are typically very small, parallel compression is typically not very helpful anyway. Bug: https://bugs.gentoo.org/667072 Signed-off-by: Zac Medico <zmedico@gentoo.org> bin/ecompress | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=3c9785170a03e3b1fe0600cf27d0c55e133d5776 commit 3c9785170a03e3b1fe0600cf27d0c55e133d5776 Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-09-25 21:50:09 +0000 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-09-25 21:56:48 +0000 sys-apps/portage: 2.3.50-r2 revbump for bug 667072 Closes: https://bugs.gentoo.org/667072 Package-Manager: Portage-2.3.50, Repoman-2.3.10 Signed-off-by: Zac Medico <zmedico@gentoo.org> .../portage/{portage-2.3.50-r1.ebuild => portage-2.3.50-r2.ebuild} | 5 +++++ 1 file changed, 5 insertions(+)
happenes still with -r2: bzip2: Can't open input file /var/tmp/portage/net-misc/zerotier-1.2.8/image/usr/share/man/man8/zerotier-one.8: No such file or directory. * ERROR: net-misc/zerotier-1.2.8::gentoo failed: * ecompress-file failed
got at the unstable amd64 chroot image 17.0-hardened_20180923-170657 this : * ecompress-file failed
Created attachment 547988 [details] emerge-info.txt
Created attachment 547990 [details] emerge-history.txt
Created attachment 547992 [details] environment
Created attachment 547994 [details] etc.portage.tbz2
Created attachment 547996 [details] logs.tbz2
Created attachment 547998 [details] net-misc:zerotier-1.2.8:20180926-191014.log
The issue is that it is that ecompress-file is attempting to process the uncompressed file after the precompressed version has already been decompressed and recompressed. The uncompressed file is overwritten during decompression, and then it no longer exists after recompression.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage.git/commit/?id=1fc311ce0afeef9f982213e43220d079a4ffec26 commit 1fc311ce0afeef9f982213e43220d079a4ffec26 Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-09-26 22:29:30 +0000 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-09-26 22:39:31 +0000 ecompress-file: de-duplicate filtered_args (bug 667072) Use an associated array to de-duplicate filtered_args, in order to ensure that compressor arguments are unique when a file is installed in both compressed and uncompressed forms. Bug: https://bugs.gentoo.org/667072 Signed-off-by: Zac Medico <zmedico@gentoo.org> bin/ecompress-file | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
The bug has been closed via the following commit(s): https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=b1f8c00d2c154d4c8bdd4e5176196b3f9dbfb457 commit b1f8c00d2c154d4c8bdd4e5176196b3f9dbfb457 Author: Zac Medico <zmedico@gentoo.org> AuthorDate: 2018-09-26 22:37:19 +0000 Commit: Zac Medico <zmedico@gentoo.org> CommitDate: 2018-09-26 22:56:08 +0000 sys-apps/portage: 2.3.50-r3 revbump for bug 667072 Closes: https://bugs.gentoo.org/667072 Package-Manager: Portage-2.3.50, Repoman-2.3.10 Signed-off-by: Zac Medico <zmedico@gentoo.org> .../portage/{portage-2.3.50-r2.ebuild => portage-2.3.50-r3.ebuild} | 6 ++++++ 1 file changed, 6 insertions(+)
There's a proposal to make the duplicate compressed + uncompressed man pages into a fatal error: https://archives.gentoo.org/gentoo-portage-dev/message/4037d50ac0d46370110adf52aa452fa0 However, I'd prefer to make it a QA warning for now, and make it die in a later EAPI, since making it die can potentially introduce a burden on users if the ebuilds that they rely on will no longer build. It's much easier for users if the ebuild maintainers have an opportunity to fix issues before the ebuilds begin to die.
The bug has been referenced in the following commit(s): https://gitweb.gentoo.org/proj/portage.git/commit/?id=78c036c507ec8c87bf5dd7cc388cbf7e038a51ed commit 78c036c507ec8c87bf5dd7cc388cbf7e038a51ed Author: Michał Górny <mgorny@gentoo.org> AuthorDate: 2018-09-25 19:12:20 +0000 Commit: Michał Górny <mgorny@gentoo.org> CommitDate: 2018-09-28 20:32:40 +0000 ecompress: Detect and report colliding (un)compressed files Whenever the install directory contains files that would collide upon (re)compressing, report them explicitly and skip decompressing. To reduce performance impact, the check is only done whenever compressed files are found. This is sufficient since for issue to occur there must be at least one compressed variant. Bug: https://bugs.gentoo.org/667072 Signed-off-by: Michał Górny <mgorny@gentoo.org> Reviewed-by: Zac Medico <zmedico@gentoo.org> bin/ecompress | 32 ++++++++++++++++++++++++++++++++ 1 file changed, 32 insertions(+)
