Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 734358 - dev-util/bats-1.2.1 : [TEST] not ok 86 parallel suite execution with --jobs
Summary: dev-util/bats-1.2.1 : [TEST] not ok 86 parallel suite execution with --jobs
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Henning Schild
URL:
Whiteboard:
Keywords: TESTFAILURE
Depends on:
Blocks: makeopts-ignored
  Show dependency tree
 
Reported: 2020-07-29 08:00 UTC by Toralf Förster
Modified: 2021-08-23 19:32 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
emerge-info.txt (emerge-info.txt,15.60 KB, text/plain)
2020-07-29 08:00 UTC, Toralf Förster
Details
dev-util:bats-1.2.1:20200729-002133.log (dev-util:bats-1.2.1:20200729-002133.log,7.91 KB, text/plain)
2020-07-29 08:00 UTC, Toralf Förster
Details
emerge-history.txt (emerge-history.txt,135.00 KB, text/plain)
2020-07-29 08:00 UTC, Toralf Förster
Details
environment (environment,19.13 KB, text/plain)
2020-07-29 08:00 UTC, Toralf Förster
Details
etc.portage.tbz2 (etc.portage.tbz2,17.71 KB, application/x-bzip)
2020-07-29 08:00 UTC, Toralf Förster
Details
temp.tbz2 (temp.tbz2,8.76 KB, application/x-bzip)
2020-07-29 08:00 UTC, Toralf Förster
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Toralf Förster gentoo-dev 2020-07-29 08:00:08 UTC
ok 84 parallel test execution with --jobs
ok 85 parallel can preserve environment variables
not ok 86 parallel suite execution with --jobs
# (in test file test/parallell.bats, line 59)
#   `[[ "$duration" -lt 12 ]] || (echo "If this fails on Travis, make sure the failure is repeatable and not due to heavy load."; false)' failed
# 1..40

  -------------------------------------------------------------------

  This is an unstable amd64 chroot image at a tinderbox (==build bot)
  name: 17.1_no-multilib-libressl_test-20200721-185431

  -------------------------------------------------------------------

gcc-config -l:
 [1] x86_64-pc-linux-gnu-10.2.0 *
clang version 10.0.1 
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/lib/llvm/10/bin
/usr/lib/llvm/10
10.0.1
Available Python interpreters, in order of preference:
  [1]   python3.7
  [2]   python3.9 (fallback)
  [3]   python3.8 (fallback)
  [4]   python2.7 (fallback)
Available Rust versions:
  [1]   rust-1.45.0 *
The following VMs are available for generation-2:
*)	IcedTea JDK 3.16.0 [icedtea-bin-8]
Available Java Virtual Machines:
  [1]   icedtea-bin-8  system-vm

The Glorious Glasgow Haskell Compilation System, version 8.0.2

  timestamp(s) of HEAD at this tinderbox image:
/var/db/repos/gentoo	Tue Jul 28 11:35:25 PM UTC 2020
/var/db/repos/libressl	Fri Jul 24 09:42:51 PM UTC 2020

emerge -qpvO dev-util/bats
[ebuild  N    ] dev-util/bats-1.2.1
Comment 1 Toralf Förster gentoo-dev 2020-07-29 08:00:13 UTC
Created attachment 651394 [details]
emerge-info.txt
Comment 2 Toralf Förster gentoo-dev 2020-07-29 08:00:16 UTC
Created attachment 651396 [details]
dev-util:bats-1.2.1:20200729-002133.log
Comment 3 Toralf Förster gentoo-dev 2020-07-29 08:00:19 UTC
Created attachment 651398 [details]
emerge-history.txt
Comment 4 Toralf Förster gentoo-dev 2020-07-29 08:00:22 UTC
Created attachment 651400 [details]
environment
Comment 5 Toralf Förster gentoo-dev 2020-07-29 08:00:25 UTC
Created attachment 651402 [details]
etc.portage.tbz2
Comment 6 Toralf Förster gentoo-dev 2020-07-29 08:00:28 UTC
Created attachment 651404 [details]
temp.tbz2
Comment 7 Henning Schild 2020-07-31 07:20:52 UTC
Did not look at the details but the tests seems to be expected to fail on slow or overloaded systems.

My guess is that it will not happen every time or you can solve it by increasing the timeout. It might be worth talking to upstream and see if we can turn that into a "skip".
Comment 8 Larry the Git Cow gentoo-dev 2021-08-15 14:46:16 UTC
The bug has been referenced in the following commit(s):

https://gitweb.gentoo.org/repo/gentoo.git/commit/?id=ff3c1baa23b2f4513e297407b3bce19682ffe830

commit ff3c1baa23b2f4513e297407b3bce19682ffe830
Author:     Henning Schild <henning@hennsch.de>
AuthorDate: 2021-08-04 18:45:09 +0000
Commit:     Joonas Niilola <juippis@gentoo.org>
CommitDate: 2021-08-15 14:46:03 +0000

    dev-util/bats: respect "makeopts_jobs" in test suite
    
    The fact that the testsuite might run a random number of jobs if
    "sys-process/parallel" is installed was raised in a bug. While this
    commit does not solve the bug in question, it makes the test respect
    MAKEOPTS"-jX".
    
    Bug: https://bugs.gentoo.org/734358
    Signed-off-by: Henning Schild <henning@hennsch.de>
    Closes: https://github.com/gentoo/gentoo/pull/21883
    Signed-off-by: Joonas Niilola <juippis@gentoo.org>

 dev-util/bats/bats-1.4.1.ebuild | 8 ++++++--
 1 file changed, 6 insertions(+), 2 deletions(-)
Comment 9 Henning Schild 2021-08-23 19:32:44 UTC
When not having "sys-process/parallel" installed the testsuite succeeds for the two versions currently in the tree. 

The error reported here might just happen sometimes and could not be reproduced. Plus the affected version is not in the tree anymore.

So i will close this because it can not be reproduces and might have been solved upstream in the meantime.

Feel free to re-open and provide more details on how to reproduce.