Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 633766 - dev-util/bats-0.4.0_p20170219 : not ok 7 summary passing tests
Summary: dev-util/bats-0.4.0_p20170219 : not ok 7 summary passing tests
Status: RESOLVED OBSOLETE
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Henning Schild
URL:
Whiteboard:
Keywords: TESTFAILURE
Depends on:
Blocks:
 
Reported: 2017-10-08 14:48 UTC by Toralf Förster
Modified: 2021-01-14 21:10 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
emerge-info.txt (emerge-info.txt,17.14 KB, text/plain)
2017-10-08 14:48 UTC, Toralf Förster
Details
dev-util:bats-0.4.0_p20170219:20171008-105039.log (dev-util:bats-0.4.0_p20170219:20171008-105039.log,4.28 KB, text/plain)
2017-10-08 14:48 UTC, Toralf Förster
Details
emerge-history.txt (emerge-history.txt,383.20 KB, text/plain)
2017-10-08 14:48 UTC, Toralf Förster
Details
environment (environment,17.06 KB, text/plain)
2017-10-08 14:48 UTC, Toralf Förster
Details
etc.portage.tbz2 (etc.portage.tbz2,21.61 KB, application/x-bzip)
2017-10-08 14:48 UTC, Toralf Förster
Details
temp.tbz2 (temp.tbz2,7.71 KB, application/x-bzip)
2017-10-08 14:48 UTC, Toralf Förster
Details
log.log (log.log,38.28 KB, text/plain)
2017-10-13 21:26 UTC, Toralf Förster
Details
emerge-info.txt (emerge-info.txt,15.77 KB, text/plain)
2018-05-22 16:49 UTC, Toralf Förster
Details
dev-util:bats-0.4.0_p20170219:20180521-204425.log (dev-util:bats-0.4.0_p20170219:20180521-204425.log,4.28 KB, text/plain)
2018-05-22 16:49 UTC, Toralf Förster
Details
emerge-history.txt (emerge-history.txt,67.20 KB, text/plain)
2018-05-22 16:49 UTC, Toralf Förster
Details
environment (environment,15.34 KB, text/plain)
2018-05-22 16:49 UTC, Toralf Förster
Details
etc.portage.tbz2 (etc.portage.tbz2,12.02 KB, application/x-bzip)
2018-05-22 16:49 UTC, Toralf Förster
Details
temp.tbz2 (temp.tbz2,7.20 KB, application/x-bzip)
2018-05-22 16:49 UTC, Toralf Förster
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Toralf Förster gentoo-dev 2017-10-08 14:48:22 UTC
ok 5 empty test file runs zero tests
ok 6 one passing test
not ok 7 summary passing tests
# (in test file test/bats.bats, line 46)
#   `[ "${lines[1]}" = "1 test, 0 failures" ]' failed
not ok 8 summary passing and skipping tests

  -------------------------------------------------------------------

  This is an unstable amd64 chroot image at a tinderbox (==build bot)
  name: 13.0-desktop-plasma-systemd_abi32+64_20170924-152248

  -------------------------------------------------------------------

gcc-config -l:
 [1] x86_64-pc-linux-gnu-6.4.0 *

Available Python interpreters, in order of preference:
  [1]   python3.4
  [2]   python2.7 (fallback)
  [3]   pypy3 (fallback)
  [4]   pypy (fallback)

java-config:
The following VMs are available for generation-2:
1)	IcedTea JDK 7.2.6.11 [icedtea-bin-7]
*)	IcedTea JDK 3.5.1 [icedtea-bin-8]
Available Java Virtual Machines:
  [1]   icedtea-bin-7 
  [2]   icedtea-bin-8  system-vm

emerge -qpv dev-util/bats
[ebuild  N    ] dev-util/bats-0.4.0_p20170219
Comment 1 Toralf Förster gentoo-dev 2017-10-08 14:48:25 UTC
Created attachment 498090 [details]
emerge-info.txt
Comment 2 Toralf Förster gentoo-dev 2017-10-08 14:48:27 UTC
Created attachment 498092 [details]
dev-util:bats-0.4.0_p20170219:20171008-105039.log
Comment 3 Toralf Förster gentoo-dev 2017-10-08 14:48:30 UTC
Created attachment 498094 [details]
emerge-history.txt
Comment 4 Toralf Förster gentoo-dev 2017-10-08 14:48:33 UTC
Created attachment 498096 [details]
environment
Comment 5 Toralf Förster gentoo-dev 2017-10-08 14:48:36 UTC
Created attachment 498098 [details]
etc.portage.tbz2
Comment 6 Toralf Förster gentoo-dev 2017-10-08 14:48:39 UTC
Created attachment 498100 [details]
temp.tbz2
Comment 7 Nelo-T. Wallus (ntnn) 2017-10-09 17:40:59 UTC
Cannot reproduce, please execute the following in the unpacked tarball in the workdir and post the output:

for test in test/fixtures/bats/passing.bats test/fixtures/bats/passing_and_skipping.bats test/fixtures/bats/failing_and_passing.bats test/fixtures/bats/passing_failing_and_skipping.bats; do
    echo ">>> $test"
    echo ">> tap"
    bash -x ./bin/bats --tap $test
    echo ">> pretty"
    bash -x ./bin/bats --pretty $test
done
Comment 8 Toralf Förster gentoo-dev 2017-10-13 21:26:15 UTC
Created attachment 498588 [details]
log.log
Comment 9 Nelo-T. Wallus (ntnn) 2017-10-15 12:13:30 UTC
That output matches what bats tests for, so it shouldn't be failing. A bit suspicious are the log files in tmp, where test results are written to fd 3, which has been closed early. This may not be related though.

Is the test suite failing permanent or intermittent?
Please pack the chroot and send the link, an environment to reproduce the failures in would help a lot.

Thanks.
Comment 10 Toralf Förster gentoo-dev 2017-10-15 17:17:34 UTC
(In reply to Nelo-T. Wallus (ntnn) from comment #9)
you don't want that :

tinderbox@mr-fox ~ $ scw img2/13.0-desktop-plasma-systemd_abi32+64_20170924-152248
mr-fox / # du -hs .
45G     .

Well, let see, if this repeats at an image where test is activated again.
Comment 11 Nelo-T. Wallus (ntnn) 2017-11-29 19:44:21 UTC
It's been almost two months, can we close the issue or hasn't a test build been repeated yet?
Comment 12 Toralf Förster gentoo-dev 2017-12-02 11:12:05 UTC
it works now fine at current images - will close this therefore
Comment 13 Toralf Förster gentoo-dev 2018-05-22 16:49:32 UTC
got at the unstable amd64 chroot image 17.0-desktop-gnome-systemd_test_20180520-112305 this : not ok 7 summary passing tests
Comment 14 Toralf Förster gentoo-dev 2018-05-22 16:49:37 UTC
Created attachment 532608 [details]
emerge-info.txt
Comment 15 Toralf Förster gentoo-dev 2018-05-22 16:49:40 UTC
Created attachment 532610 [details]
dev-util:bats-0.4.0_p20170219:20180521-204425.log
Comment 16 Toralf Förster gentoo-dev 2018-05-22 16:49:43 UTC
Created attachment 532612 [details]
emerge-history.txt
Comment 17 Toralf Förster gentoo-dev 2018-05-22 16:49:46 UTC
Created attachment 532614 [details]
environment
Comment 18 Toralf Förster gentoo-dev 2018-05-22 16:49:49 UTC
Created attachment 532616 [details]
etc.portage.tbz2
Comment 19 Toralf Förster gentoo-dev 2018-05-22 16:49:51 UTC
Created attachment 532618 [details]
temp.tbz2
Comment 20 Nelo-T. Wallus (ntnn) 2018-05-22 17:43:54 UTC
Thanks, I'll try to replicate the issue next weekend.
Comment 21 Nelo-T. Wallus (ntnn) 2018-06-06 18:36:30 UTC
I wasn't able to reproduce the issue again.

Do you record CPU/IO/memory usage and load? That could theoretically also be an issue.

At least the same tests failed again, so it isn't a random issue but rather intermittent.
Comment 22 Nelo-T. Wallus (ntnn) 2021-01-13 22:04:59 UTC
Handing the bug off to the new maintainer of dev-util/bats.
Comment 23 Henning Schild 2021-01-14 21:03:37 UTC
Not sure what i am looking at here. I think we need a repro-case for 1.2.1 and an arch that is affected by it.
Comment 24 Henning Schild 2021-01-14 21:10:27 UTC
In fact the latest stable for amd64 (which seems to have been the problem) is 1.2.1. So i am closing this because it is for 0.4.0_p20170219

While the old ebuild might still be affected, the resolution might just be retiring it in favour of the newer one.

Please re-open if it happens again with that newer version.