Gentoo Websites Logo
Go to: Gentoo Home Documentation Forums Lists Bugs Planet Store Wiki Get Gentoo!
Bug 919047 - dev-java/testng-6.11 fails test verifyThatTestMethodsRunInParallelThreads
Summary: dev-java/testng-6.11 fails test verifyThatTestMethodsRunInParallelThreads
Status: UNCONFIRMED
Alias: None
Product: Gentoo Linux
Classification: Unclassified
Component: Current packages (show other bugs)
Hardware: All Linux
: Normal normal (vote)
Assignee: Java team
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2023-12-02 15:15 UTC by Jonathan Lovelace
Modified: 2023-12-02 18:39 UTC (History)
1 user (show)

See Also:
Package list:
Runtime testing required: ---


Attachments
dev-java:testng-6.11:20231202-145859.log (dev-java:testng-6.11:20231202-145859.log,227.02 KB, text/plain; charset=utf-8)
2023-12-02 15:17 UTC, Jonathan Lovelace
Details
emerge-info.txt (emerge-info.txt,9.13 KB, text/plain; charset=utf-8)
2023-12-02 15:17 UTC, Jonathan Lovelace
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jonathan Lovelace 2023-12-02 15:15:14 UTC
=dev-java/testng-6.11 fails its test phase for me. Specifically, the section "Parallelization" reports

===============================================
    Parallelization
    Tests run: 76, Failures: 4, Skips: 0
===============================================

Those four failures look like four instances of

FAILED: verifyThatTestMethodsRunInParallelThreads

Each instance of that in the log is followed by a very long line that begins

java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs:

followed by four lines of stack trace, followed by "... Removed 27 stack frames"
Comment 1 Jonathan Lovelace 2023-12-02 15:17:05 UTC
Created attachment 876403 [details]
dev-java:testng-6.11:20231202-145859.log
Comment 2 Jonathan Lovelace 2023-12-02 15:17:31 UTC
Created attachment 876404 [details]
emerge-info.txt
Comment 3 Volkmar W. Pogatzki 2023-12-02 17:10:30 UTC
(In reply to Jonathan Lovelace from comment #0)
> =dev-java/testng-6.11 fails its test phase for me. Specifically, the section
> "Parallelization" reports
> [...]

Thanks for reporting. I am sorry but I cannot reproduce those test failures.

In case you would like to help boil it down to the root cause:
- Are these failures reproducible, always same tests with same message?
- Does it also happen with USE"-test"?
- Does it also happen with Java 1.8, 11 or 21?
Comment 4 Jonathan Lovelace 2023-12-02 18:22:07 UTC
I see essentially the same output (likely different Java object addresses in the CLASS_INSTANCE values late in the assertion message, timestamps of course differ, etc.) every time so far running this test suite on this machine. 

I tried with openjdk-8 and openjdk-11 (using "JAVA_PKG_FORCE_VM=openjdk-8 ebuild /path/to/testng-6.11.ebuild clean install clean", etc.), with the same results. This machine (being a "mostly-stable" box) didn't have a Java 21 JDK installed, but I installed openjdk-bin-21 and got the same results with it.

Because java-utils-2.eclass defines RESTRICT="!test? ( test )", when I tried running the build with USE="-test" it skipped running tests entirely: "Skipping make test/check due to ebuild restriction."
Comment 5 Volkmar W. Pogatzki 2023-12-02 18:27:26 UTC
(In reply to Jonathan Lovelace from comment #4)
> [...]
> Because java-utils-2.eclass defines RESTRICT="!test? ( test )", when I tried
> running the build with USE="-test" it skipped running tests entirely:
> "Skipping make test/check due to ebuild restriction."

Sorry, my fault. What I meant to ask is about USE=-doc
Comment 6 Jonathan Lovelace 2023-12-02 18:39:22 UTC
Same failure with USE=-doc (with openjdk-17).