* Package: dev-java/testng-6.11:0 * Repository: gentoo * Maintainer: java@gentoo.org * USE: abi_x86_64 amd64 doc elibc_glibc kernel_linux test * FEATURES: distcc fakeroot network-sandbox preserve-libs sandbox test userpriv usersandbox * Using: openjdk-17 ./gradle/wrapper/gradle-wrapper.jar ./kobalt/wrapper/kobalt-wrapper.jar javac -source 1.8 -target 1.8 -d target/classes -encoding UTF-8 -classpath /usr/share/assertj-core-3/lib/assertj-core.jar:/usr/share/byte-buddy/lib/byte-buddy-agent.jar:/usr/share/byte-buddy/lib/byte-buddy.jar:/usr/share/ant-core/lib/ant.jar:/usr/share/ant-core/lib/ant-bootstrap.jar:/usr/share/ant-core/lib/ant-launcher.jar:/usr/share/bsh/lib/bsh.jar:/usr/share/guice-4/lib/guice.jar:/usr/share/jcommander-1.64/lib/jcommander.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/snakeyaml/lib/snakeyaml.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/aopalliance-1/lib/aopalliance.jar:/usr/share/asm-9/lib/asm.jar:/usr/share/asm-9/lib/asm-tree.jar:/usr/share/asm-9/lib/asm-analysis.jar:/usr/share/asm-9/lib/asm-commons.jar:/usr/share/asm-9/lib/asm-util.jar:/usr/share/guava/lib/guava.jar:/usr/share/javax-inject/lib/javax-inject.jar:/usr/share/bsf-2.3/lib/bsf.jar:/usr/share/jakarta-servlet-api-4/lib/jakarta-servlet-api.jar:/usr/share/commons-logging/lib/commons-logging.jar:/usr/share/commons-logging/lib/commons-logging-api.jar:/usr/share/commons-logging/lib/commons-logging-adapters.jar:/usr/share/xalan/lib/xalan.jar:/usr/share/checker-framework-qual/lib/checker-framework-qual.jar:/usr/share/error-prone-annotations/lib/error-prone-annotations.jar:/usr/share/failureaccess/lib/failureaccess.jar:/usr/share/j2objc-annotations/lib/j2objc-annotations.jar:/usr/share/jsr305/lib/jsr305.jar:/usr/share/bcel/lib/bcel.jar:/usr/share/javacup/lib/javacup.jar:/usr/share/javacup/lib/javacup-runtime.jar:/usr/share/xalan-serializer/lib/xalan-serializer.jar:/usr/share/xerces-2/lib/xerces.jar:/usr/share/xml-commons-external-1.4/lib/xml-commons-external.jar:/usr/share/xml-commons-resolver/lib/xml-commons-resolver.jar:/usr/share/commons-lang-3.6/lib/commons-lang.jar @sources.lst warning: [options] bootstrap class path not set in conjunction with -source 8 Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 warning javadoc -Xdoclint:none -d target/api -encoding UTF-8 -docencoding UTF-8 -charset UTF-8 -classpath /usr/share/assertj-core-3/lib/assertj-core.jar:/usr/share/byte-buddy/lib/byte-buddy-agent.jar:/usr/share/byte-buddy/lib/byte-buddy.jar:/usr/share/ant-core/lib/ant.jar:/usr/share/ant-core/lib/ant-bootstrap.jar:/usr/share/ant-core/lib/ant-launcher.jar:/usr/share/bsh/lib/bsh.jar:/usr/share/guice-4/lib/guice.jar:/usr/share/jcommander-1.64/lib/jcommander.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/snakeyaml/lib/snakeyaml.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/aopalliance-1/lib/aopalliance.jar:/usr/share/asm-9/lib/asm.jar:/usr/share/asm-9/lib/asm-tree.jar:/usr/share/asm-9/lib/asm-analysis.jar:/usr/share/asm-9/lib/asm-commons.jar:/usr/share/asm-9/lib/asm-util.jar:/usr/share/guava/lib/guava.jar:/usr/share/javax-inject/lib/javax-inject.jar:/usr/share/bsf-2.3/lib/bsf.jar:/usr/share/jakarta-servlet-api-4/lib/jakarta-servlet-api.jar:/usr/share/commons-logging/lib/commons-logging.jar:/usr/share/commons-logging/lib/commons-logging-api.jar:/usr/share/commons-logging/lib/commons-logging-adapters.jar:/usr/share/xalan/lib/xalan.jar:/usr/share/checker-framework-qual/lib/checker-framework-qual.jar:/usr/share/error-prone-annotations/lib/error-prone-annotations.jar:/usr/share/failureaccess/lib/failureaccess.jar:/usr/share/j2objc-annotations/lib/j2objc-annotations.jar:/usr/share/jsr305/lib/jsr305.jar:/usr/share/bcel/lib/bcel.jar:/usr/share/javacup/lib/javacup.jar:/usr/share/javacup/lib/javacup-runtime.jar:/usr/share/xalan-serializer/lib/xalan-serializer.jar:/usr/share/xerces-2/lib/xerces.jar:/usr/share/xml-commons-external-1.4/lib/xml-commons-external.jar:/usr/share/xml-commons-resolver/lib/xml-commons-resolver.jar:/usr/share/commons-lang-3.6/lib/commons-lang.jar -quiet @sources.lst src/main/java/org/testng/ClassMethodMap.java:12: warning: invalid input: '<' * This class maintains a map of >. ^ src/main/java/org/testng/xml/Parser.java:130: warning: invalid input: '<' * and possibly, other XmlSuite that are pointed to by ^ src/main/java/org/testng/xml/Parser.java:130: warning: invalid input: '<' * and possibly, other XmlSuite that are pointed to by ^ src/main/java/org/testng/Reporter.java:66: warning: invalid input: '<' * @return If true, use HTML entities for special HTML characters (<, >, &, ...). ^ src/main/java/org/testng/Reporter.java:66: warning: invalid input: '&' * @return If true, use HTML entities for special HTML characters (<, >, &, ...). ^ src/main/java/org/testng/Reporter.java:73: warning: invalid input: '<' * @param escapeHtml If true, use HTML entities for special HTML characters (<, >, &, ...). ^ src/main/java/org/testng/Reporter.java:73: warning: invalid input: '&' * @param escapeHtml If true, use HTML entities for special HTML characters (<, >, &, ...). ^ src/main/java/org/testng/xml/TestNGContentHandler.java:454: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:416: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:437: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:416: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:437: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:454: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/XmlMethodSelector.java:10: warning: invalid input: '<' * This class describes the tag in testng.xml. ^ src/main/java/org/testng/reporters/XMLStringBuffer.java:38: warning: invalid input: '<' * to start the generation. This constructor will not insert an >. ^ src/main/java/org/testng/xml/XmlMethodSelector.java:10: warning: invalid input: '<' * This class describes the tag in testng.xml. ^ src/main/java/org/testng/xml/XmlSuite.java:179: warning: invalid input: '<' /** List of child XML suite specified using tags */ ^ src/main/java/org/testng/xml/XmlSuite.java:182: warning: invalid input: '<' /** Parent XML Suite if this suite was specified in another suite using tag */ ^ src/main/java/org/testng/ClassMethodMap.java:12: warning: invalid input: '<' * This class maintains a map of >. ^ src/main/java/org/testng/xml/XmlMethodSelector.java:10: warning: invalid input: '<' * This class describes the tag in testng.xml. ^ src/main/java/org/testng/ClassMethodMap.java:12: warning: invalid input: '<' * This class maintains a map of >. ^ src/main/java/org/testng/xml/Parser.java:130: warning: invalid input: '<' * and possibly, other XmlSuite that are pointed to by ^ src/main/java/org/testng/xml/TestNGContentHandler.java:454: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/XmlMethodSelector.java:10: warning: invalid input: '<' * This class describes the tag in testng.xml. ^ src/main/java/org/testng/xml/TestNGContentHandler.java:416: warning: invalid input: '<' * Parse ^ src/main/java/org/testng/xml/TestNGContentHandler.java:437: warning: invalid input: '<' * Parse ^ 27 warnings Archive: /var/tmp/portage/dev-java/testng-6.11/distdir/apache-groovy-binary-2.4.21.zip creating: groovy-2.4.21/ inflating: groovy-2.4.21/LICENSE inflating: groovy-2.4.21/NOTICE creating: groovy-2.4.21/lib/ inflating: groovy-2.4.21/lib/groovy-2.4.21.jar inflating: groovy-2.4.21/lib/commons-cli-1.2.jar inflating: groovy-2.4.21/lib/ant-1.9.15.jar inflating: groovy-2.4.21/lib/xstream-1.4.10.jar inflating: groovy-2.4.21/lib/jansi-1.11.jar inflating: groovy-2.4.21/lib/ivy-2.4.0.jar inflating: groovy-2.4.21/lib/gpars-1.2.1.jar inflating: groovy-2.4.21/lib/ant-launcher-1.9.15.jar inflating: groovy-2.4.21/lib/xmlpull-1.1.3.1.jar inflating: groovy-2.4.21/lib/multiverse-core-0.7.0.jar inflating: groovy-2.4.21/lib/jsr166y-1.7.0.jar inflating: groovy-2.4.21/lib/groovy-ant-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-bsf-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-console-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-docgenerator-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-groovydoc-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-groovysh-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-jmx-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-json-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-jsr223-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-nio-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-servlet-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-sql-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-swing-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-templates-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-test-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-testng-2.4.21.jar inflating: groovy-2.4.21/lib/groovy-xml-2.4.21.jar inflating: groovy-2.4.21/lib/ant-junit-1.9.15.jar inflating: groovy-2.4.21/lib/ant-antlr-1.9.15.jar inflating: groovy-2.4.21/lib/bsf-2.4.0.jar inflating: groovy-2.4.21/lib/commons-logging-1.2.jar inflating: groovy-2.4.21/lib/qdox-1.12.1.jar inflating: groovy-2.4.21/lib/jline-2.12.jar inflating: groovy-2.4.21/lib/servlet-api-2.4.jar inflating: groovy-2.4.21/lib/jsp-api-2.0.jar inflating: groovy-2.4.21/lib/junit-4.13.1.jar inflating: groovy-2.4.21/lib/hamcrest-core-1.3.jar inflating: groovy-2.4.21/lib/jcommander-1.47.jar inflating: groovy-2.4.21/lib/testng-6.8.13.jar inflating: groovy-2.4.21/lib/groovy.icns creating: groovy-2.4.21/indy/ inflating: groovy-2.4.21/indy/groovy-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-ant-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-bsf-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-console-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-docgenerator-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-groovydoc-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-groovysh-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-jmx-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-json-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-jsr223-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-nio-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-servlet-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-sql-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-swing-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-templates-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-test-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-testng-2.4.21-indy.jar inflating: groovy-2.4.21/indy/groovy-xml-2.4.21-indy.jar creating: groovy-2.4.21/grooid/ inflating: groovy-2.4.21/grooid/groovy-2.4.21-grooid.jar inflating: groovy-2.4.21/grooid/groovy-test-2.4.21-grooid.jar creating: groovy-2.4.21/conf/ inflating: groovy-2.4.21/conf/groovy-starter.conf creating: groovy-2.4.21/bin/ inflating: groovy-2.4.21/bin/grape inflating: groovy-2.4.21/bin/grape.bat inflating: groovy-2.4.21/bin/groovy inflating: groovy-2.4.21/bin/groovy.bat inflating: groovy-2.4.21/bin/groovyc inflating: groovy-2.4.21/bin/groovyc.bat inflating: groovy-2.4.21/bin/groovyConsole inflating: groovy-2.4.21/bin/groovyConsole.bat inflating: groovy-2.4.21/bin/groovydoc inflating: groovy-2.4.21/bin/groovydoc.bat inflating: groovy-2.4.21/bin/groovysh inflating: groovy-2.4.21/bin/groovysh.bat inflating: groovy-2.4.21/bin/java2groovy inflating: groovy-2.4.21/bin/java2groovy.bat inflating: groovy-2.4.21/bin/startGroovy inflating: groovy-2.4.21/bin/startGroovy.bat creating: groovy-2.4.21/licenses/ inflating: groovy-2.4.21/licenses/antlr2-license.txt inflating: groovy-2.4.21/licenses/asm-license.txt inflating: groovy-2.4.21/licenses/hamcrest-license.txt inflating: groovy-2.4.21/licenses/jline2-license.txt inflating: groovy-2.4.21/licenses/jsp-api-license.txt inflating: groovy-2.4.21/licenses/jsr166y-license.txt inflating: groovy-2.4.21/licenses/jsr223-license.txt inflating: groovy-2.4.21/licenses/junit-license.txt inflating: groovy-2.4.21/licenses/servlet-api-license.txt inflating: groovy-2.4.21/licenses/xstream-license.txt creating: groovy-2.4.21/embeddable/ inflating: groovy-2.4.21/embeddable/groovy-all-2.4.21.jar inflating: groovy-2.4.21/embeddable/groovy-all-2.4.21-indy.jar javac -source 1.8 -target 1.8 -cp src/test/java:testng.jar:/usr/share/guava/lib/guava.jar src/test/java/test/SimpleBaseTest.java warning: [options] bootstrap class path not set in conjunction with -source 8 1 warning javac -source 1.8 -target 1.8 -d target/test-classes -encoding UTF-8 -classpath target/test-classes:testng.jar:/var/tmp/portage/dev-java/testng-6.11/distdir/spock-core-1.0-groovy-2.4.jar:/var/tmp/portage/dev-java/testng-6.11/distdir/groovy-all-2.4.7.jar:/usr/share/assertj-core-3/lib/assertj-core.jar:/usr/share/byte-buddy/lib/byte-buddy-agent.jar:/usr/share/byte-buddy/lib/byte-buddy.jar:/usr/share/ant-core/lib/ant.jar:/usr/share/ant-core/lib/ant-bootstrap.jar:/usr/share/ant-core/lib/ant-launcher.jar:/usr/share/bsh/lib/bsh.jar:/usr/share/guice-4/lib/guice.jar:/usr/share/jcommander-1.64/lib/jcommander.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/snakeyaml/lib/snakeyaml.jar:/usr/share/bsf-2.3/lib/bsf.jar:/usr/share/jakarta-servlet-api-4/lib/jakarta-servlet-api.jar:/usr/share/aopalliance-1/lib/aopalliance.jar:/usr/share/asm-9/lib/asm.jar:/usr/share/asm-9/lib/asm-tree.jar:/usr/share/asm-9/lib/asm-analysis.jar:/usr/share/asm-9/lib/asm-commons.jar:/usr/share/asm-9/lib/asm-util.jar:/usr/share/guava/lib/guava.jar:/usr/share/javax-inject/lib/javax-inject.jar:/usr/share/commons-logging/lib/commons-logging.jar:/usr/share/commons-logging/lib/commons-logging-api.jar:/usr/share/commons-logging/lib/commons-logging-adapters.jar:/usr/share/xalan/lib/xalan.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/checker-framework-qual/lib/checker-framework-qual.jar:/usr/share/error-prone-annotations/lib/error-prone-annotations.jar:/usr/share/failureaccess/lib/failureaccess.jar:/usr/share/j2objc-annotations/lib/j2objc-annotations.jar:/usr/share/jsr305/lib/jsr305.jar:/usr/share/bcel/lib/bcel.jar:/usr/share/javacup/lib/javacup.jar:/usr/share/javacup/lib/javacup-runtime.jar:/usr/share/xalan-serializer/lib/xalan-serializer.jar:/usr/share/xerces-2/lib/xerces.jar:/usr/share/commons-lang-3.6/lib/commons-lang.jar:/usr/share/xml-commons-external-1.4/lib/xml-commons-external.jar:/usr/share/xml-commons-resolver/lib/xml-commons-resolver.jar @test_sources.lst warning: [options] bootstrap class path not set in conjunction with -source 8 src/test/java/test/reports/EmailableReporterTest.java:20: warning: [removal] SecurityManager in java.lang has been deprecated and marked for removal private SecurityManager manager; ^ src/test/java/test/reports/EmailableReporterTest.java:24: warning: [removal] getSecurityManager() in System has been deprecated and marked for removal manager = System.getSecurityManager(); ^ src/test/java/test/reports/EmailableReporterTest.java:25: warning: [removal] setSecurityManager(SecurityManager) in System has been deprecated and marked for removal System.setSecurityManager(new MySecurityManager(manager)); ^ src/test/java/test/reports/EmailableReporterTest.java:30: warning: [removal] setSecurityManager(SecurityManager) in System has been deprecated and marked for removal System.setSecurityManager(manager); ^ src/test/java/test/reports/EmailableReporterTest.java:131: warning: [removal] SecurityManager in java.lang has been deprecated and marked for removal public static class MySecurityManager extends SecurityManager { ^ src/test/java/test/reports/EmailableReporterTest.java:133: warning: [removal] SecurityManager in java.lang has been deprecated and marked for removal private SecurityManager baseSecurityManager; ^ src/test/java/test/reports/EmailableReporterTest.java:135: warning: [removal] SecurityManager in java.lang has been deprecated and marked for removal MySecurityManager(SecurityManager baseSecurityManager) { ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:33: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(1)); ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:39: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(6)); ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:44: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(5)); ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:49: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(2)); ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:54: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(3)); ^ src/test/java/test/testng1231/TestExecutionListenerInvocationOrder.java:60: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal order.add(new Integer(4)); ^ src/test/java/test/dataprovider/DataProviderIntegrationSample.java:11: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal new Object[] {new Integer(4)}, ^ src/test/java/test/dataprovider/DataProviderIntegrationSample.java:12: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal new Object[] {new Integer(8)}, ^ src/test/java/test/dataprovider/DataProviderIntegrationSample.java:13: warning: [removal] Integer(int) in Integer has been deprecated and marked for removal new Object[] {new Integer(12)}}; ^ src/test/java/test/dataprovider/TestContextSample.java:20: warning: [removal] Integer(String) in Integer has been deprecated and marked for removal int n = groups.length > 0 ? new Integer(groups[0]) : 0; ^ Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 18 warnings [TestNG] [WARN] Ignoring duplicate listener : org.testng.internal.ConsoleReporter [TestNG] [WARN] Ignoring duplicate listener : org.testng.internal.ConsoleReporter ===== Invoked methods public void test.junit.SetNameTest.testBar() 993452032 public void test.junit.SetNameTest.testFoo() 859617558 ===== PASSED: testBar on testBar(test.junit.SetNameTest) PASSED: testFoo on testFoo(test.junit.SetNameTest) =============================================== Junit via TestNG XML Tests run: 2, Failures: 0, Skips: 0 =============================================== =============================================== TestNG Running Junit Tests Total tests run: 2, Failures: 0, Skips: 0 =============================================== ===== Invoked methods GuiceParentModuleTest.testService()[pri:0, instance:test.guice.GuiceParentModuleTest@17814b1c] 394349340 ===== PASSED: testService =============================================== Guice Tests run: 1, Failures: 0, Skips: 0 =============================================== =============================================== parent-module-suite Total tests run: 1, Failures: 0, Skips: 0 =============================================== ===== Invoked methods NoPackageTest.test()[pri:0, instance:NoPackageTest@1efee8e7] 520022247 NoPackageTest.after()[pri:0, instance:NoPackageTest@1efee8e7] 520022247 ===== PASSED: test =============================================== Nopackage Tests run: 1, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [Utils] [ERROR] [Error] java.lang.IllegalArgumentException: No enum constant test.parameters.EnumParameterSample.MyEnum.INVALID_VALUE at java.base/java.lang.Enum.valueOf(Enum.java:273) at org.testng.internal.Parameters.convertType(Parameters.java:313) at org.testng.internal.Parameters.createParameters(Parameters.java:203) at org.testng.internal.Parameters.createParameters(Parameters.java:443) at org.testng.internal.Parameters.handleParameters(Parameters.java:569) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.parameters.ParameterTest.invalidEnumParameters(ParameterTest.java:86) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) PASSED: testNonExistentParameter(null) PASSED: testSingleString("Cedric") PASSED: noNPEInCountingResults When verbose is set to >1, TNG prints test results on CLI which are printed using SuiteResultCounts.calculateResultCounts(). This method has been throwing NPE because it's unable to find SuiteRunner in HashMap, because the list of parameters in SuiteRunner changed during execution. This test makes sure we dont run into any NPEs PASSED: parameterInheritanceAndOverriding Checks to make sure parameters are inherited and overridden properly PASSED: beforeMethodWithParameters PASSED: enumParameters PASSED: invalidEnumParameters GITHUB-1105: Test skipped instead failed if incorrect enum value PASSED: stringSingle PASSED: excludedGroups PASSED: groupsOfGroupsSimple PASSED: groupsOfGroupsWithCycle PASSED: groupsOfGroupsWithIndirections PASSED: includedGroups PASSED: logger PASSED: regexp PASSED: noGroups PASSED: partialGroupsClass PASSED: partialGroupsMethod PASSED: setUpWithGroups PASSED: testMethod1 PASSED: testMethod2 PASSED: testMethod3 PASSED: expectedExceptions PASSED: expectedExceptionsDeprecatedSyntax PASSED: allAccessModifiersConfiguration PASSED: testTimeout =============================================== Regression1 Tests run: 26, Failures: 0, Skips: 0 =============================================== [TestNG] [WARN] Ignoring duplicate listener : test.reports.UniqueReporterInjectionTest$ReporterListenerForIssue1227 [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. RUN class test.groupbug.ITCaseOne.beforeClass() RUN class test.groupbug.ITCaseOne.one1() RUN class test.groupbug.ITCaseOne.one2() RUN class test.groupbug.ITCaseOne.afterClass() RUN class test.groupbug.ITCaseTwo.beforeClass() RUN class test.groupbug.ITCaseTwo.two1() RUN class test.groupbug.ITCaseTwo.two2() RUN class test.groupbug.ITCaseTwo.afterClass() ===== Invoked methods ITCaseOne.beforeClassOne()[pri:0, instance:test.groupbug.ITCaseOne@bc6288b] 197535883 ITCaseOne.one1()[pri:0, instance:test.groupbug.ITCaseOne@bc6288b] 197535883 ITCaseOne.one2()[pri:0, instance:test.groupbug.ITCaseOne@bc6288b] 197535883 ITCaseOne.afterClassOne()[pri:0, instance:test.groupbug.ITCaseOne@bc6288b] 197535883 ITCaseTwo.beforeClassTwo()[pri:0, instance:test.groupbug.ITCaseTwo@4a3bd45b] 1245434971 ITCaseTwo.two1()[pri:0, instance:test.groupbug.ITCaseTwo@4a3bd45b] 1245434971 ITCaseTwo.two2()[pri:0, instance:test.groupbug.ITCaseTwo@4a3bd45b] 1245434971 ITCaseTwo.afterClassTwo()[pri:0, instance:test.groupbug.ITCaseTwo@4a3bd45b] 1245434971 ===== =============================================== Command line suite Total tests run: 4, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 [TestNG] [WARN] Ignoring duplicate listener : test.testng1232.TestListenerFor1232 WARNING: A terminally deprecated method in java.lang.System has been called WARNING: System::setSecurityManager has been called by test.reports.EmailableReporterTest (file:/var/tmp/portage/dev-java/testng-6.11/work/testng-6.11/target/test-classes/) WARNING: Please consider reporting this to the maintainers of test.reports.EmailableReporterTest WARNING: System::setSecurityManager will be removed in a future release ... ... TestNG DEV-SNAPSHOT by Cédric Beust (cedric@beust.com) ... ... ... TestNG DEV-SNAPSHOT by Cédric Beust (cedric@beust.com) ... =============================================== A Total tests run: 2, Failures: 0, Skips: 0 =============================================== =============================================== A Total tests run: 2, Failures: 0, Skips: 0 =============================================== ... ... TestNG DEV-SNAPSHOT by Cédric Beust (cedric@beust.com) ... =============================================== A Total tests run: 2, Failures: 0, Skips: 0 =============================================== =============================================== A Total tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: excludedGroups PASSED: groupsOfGroupsSimple PASSED: groupsOfGroupsWithCycle PASSED: groupsOfGroupsWithIndirections PASSED: includedGroups PASSED: logger PASSED: regexp PASSED: skippedMethodsShouldBeCounted Make sure that skipped methods are accurately counted PASSED: test PASSED: excludeMethodsOnly PASSED: excludePackage PASSED: includeMethodsOnly PASSED: xmlFileShouldBeRunAtItsPlaceAndNotCopied(org.testng.TestRunner@3ca9d3b2) PASSED: test1 Verify that beforeClass and afterClass are called correctly PASSED: test2 PASSED: test3 PASSED: testApi PASSED: cycleShouldBeCorrect PASSED: cycleShouldFail PASSED: findPredecessors PASSED: findPredecessorsTiming PASSED: sort PASSED: testPruningOfDuplicateReporter PASSED: test2 PASSED: test8 PASSED: testJUnitReportReporter PASSED: testJUnitReportReporterWithMultipleClasses PASSED: testJUnitXMLReporter PASSED: testTestCaseOrderingInJUnitReportReporterWhenPrioritiesDefined PASSED: testPrivateMethod PASSED: abstractShouldRun Abstract methods defined in a superclass should be run PASSED: multiple PASSED: overrideExcludeShouldWork Override -excludegroups PASSED: overrideIncludeAndExcludeShouldWork Override -groups and -excludegroups PASSED: overrideIncludeShouldWork Override -groups PASSED: testOne PASSED: testThree PASSED: testTwo PASSED: priorityInSequential1 Make sure priorities work in sequential mode PASSED: priorityInSequential2 Make sure priorities work in sequential mode PASSED: priorityWithDependsOnMethods GITHUB #793: Test suite with tests using dependency and priority has wrong behavior PASSED: withAlwaysRunAfter PASSED: withoutAlwaysRunAfter PASSED: withoutAlwaysRunBefore PASSED: nestedClassShouldBeIncluded PASSED: beforeTestClassFails PASSED: beforeTestSuiteFails PASSED: listenerShouldBeCalled PASSED: baseMethodIsCalledWithClassTest PASSED: baseMethodIsCalledWithMethodTest PASSED: excludeFromSuite1([Ljava.lang.String;@28f3a218, true) PASSED: excludeFromSuite1([Ljava.lang.String;@67730dab, false) PASSED: excludeFromSuite1([Ljava.lang.String;@466cca41, true) PASSED: excludeFromSuite1([Ljava.lang.String;@7c3ae369, false) PASSED: excludeFromSuite1([Ljava.lang.String;@496c6d94, true) PASSED: excludeFromSuite1([Ljava.lang.String;@360d3f47, false) PASSED: excludeFromSuite2([Ljava.lang.String;@1693d505, true) PASSED: excludeFromSuite2([Ljava.lang.String;@3d195d15, false) PASSED: excludeFromSuite2([Ljava.lang.String;@17b387ef, true) PASSED: excludeFromSuite2([Ljava.lang.String;@489b7559, false) PASSED: excludeFromSuite2([Ljava.lang.String;@4028aab2, true) PASSED: excludeFromSuite2([Ljava.lang.String;@37aea657, false) PASSED: excludeTestAndSuite2Cli Include in suite, exclude in test PASSED: excludeTestAndSuite2Xml Include in suite, exclude in test PASSED: includeFromSuite0([Ljava.lang.String;@2f8b48c3, true) PASSED: includeFromSuite0([Ljava.lang.String;@2af31aba, false) PASSED: includeFromSuite0([Ljava.lang.String;@682d8dad, true) PASSED: includeFromSuite0([Ljava.lang.String;@1aebe759, false) PASSED: includeFromSuite0([Ljava.lang.String;@6fd37997, true) PASSED: includeFromSuite0([Ljava.lang.String;@5dc7881d, false) PASSED: includeFromSuite1([Ljava.lang.String;@590336ed, true) PASSED: includeFromSuite1([Ljava.lang.String;@1c97c3bb, false) PASSED: includeFromSuite1([Ljava.lang.String;@68fc1e7f, true) PASSED: includeFromSuite1([Ljava.lang.String;@99af41d, false) PASSED: includeFromSuite1([Ljava.lang.String;@496e0f9d, true) PASSED: includeFromSuite1([Ljava.lang.String;@6b468710, false) PASSED: includeFromSuite2([Ljava.lang.String;@63c163e1, true) PASSED: includeFromSuite2([Ljava.lang.String;@3da55998, false) PASSED: includeFromSuite2([Ljava.lang.String;@40ebb56, true) PASSED: includeFromSuite2([Ljava.lang.String;@5b2fc2c0, false) PASSED: includeFromSuite2([Ljava.lang.String;@33197c2f, true) PASSED: includeFromSuite2([Ljava.lang.String;@24e79a4d, false) PASSED: includeTestAndSuite1Cli Include in both suite and test PASSED: includeTestAndSuite1Xml Include in both suite and test PASSED: shouldExcludeBaseMethods PASSED: test PASSED: shouldIncludeFailedMethodsFromBaseClass PASSED: serviceLoaderShouldWork PASSED: serviceLoaderShouldWorkWithConfigurationListener GITHUB-491 PASSED: serviceLoaderWithNoClassLoader PASSED: verifyConfigurationAfter PASSED: verifyConfigurationBefore PASSED: verifyConfigurationOthers PASSED: verifyDataProvider PASSED: verifyExpectedExceptions PASSED: verifyFactory PASSED: verifyNewConfigurationAfter PASSED: verifyNewConfigurationBefore PASSED: verifyParameters PASSED: verifyTestClassLevel PASSED: verifyTestConstructorLevel PASSED: verifyTestMethodLevel PASSED: commandLineExcludedGroupsShouldOverrideXml Specifying -excludegroups on the command line should override testng.xml PASSED: commandLineGroupsShouldOverrideXml Specifying -groups on the command line should override testng.xml PASSED: shouldRunBothMethods PASSED: verifyConfigurationGroupsInheritance PASSED: verifyTestDependsOnGroupsInheritance PASSED: verifyTestDependsOnMethodsInheritance PASSED: verifyTestEnabledInheritance PASSED: verifyTestGroupsInheritance PASSED: afterClassShouldRun PASSED: verifyFactoryNotParallel PASSED: verifyFactoryParallelMethods PASSED: verifyFactoryParallelTests PASSED: afterClassShouldRun Fix for https://github.com/cbeust/testng/issues/90 PASSED: verifySequential1 PASSED: verifySequential2 PASSED: verifySequential3 PASSED: verifySingleThreaded1 PASSED: verifySingleThreaded2 PASSED: verifySingleThreaded3 PASSED: BeforeTestShouldRunOnce Fix for https://github.com/cbeust/testng/issues/92 PASSED: verifyParallel(true, none, 1) PASSED: verifyParallel(false, none, 1) PASSED: verifyParallel(true, tests, 2) PASSED: verifyParallel(false, tests, 2) PASSED: verifyParallel(true, methods, 4) PASSED: verifyParallel(false, methods, 4) PASSED: verifyParallel(true, classes, 2) PASSED: verifyParallel(false, classes, 2) PASSED: verifyParallel(true, instances, 2) PASSED: verifyParallel(false, instances, 2) PASSED: verifyParallelWithFactory(true, none, 1) PASSED: verifyParallelWithFactory(false, none, 1) PASSED: verifyParallelWithFactory(true, instances, 2) PASSED: verifyParallelWithFactory(false, instances, 2) PASSED: suiteReturnValueTestShouldBeRun PASSED: suiteReturnValueTestShouldNotBeRun PASSED: testReturnValueTestShouldBeRun PASSED: shouldNotUseThreadsIfNotUsingParallel PASSED: shouldUseDefaultDataProviderThreadCount PASSED: shouldUseSpecifiedDataProviderThreadCount PASSED: shouldOrderByClass Comment out dependsOnGroups in ITCaseOne will fix the ordering, that's the bug PASSED: test2Threads PASSED: test3Threads PASSED: parametersShouldNotBeShadowed PASSED: shouldRunInParallel PASSED: testOverrideParameter("testOverrideSuite", PASS_TEST) PASSED: testOverrideParameter("classOverrideSuite", PASS_CLASS) PASSED: testOverrideParameter("includeOverrideClass", PASS_INCLUDE) PASSED: verifyIncludedExcludedCount1 First test method PASSED: verifyIncludedExcludedCount2 Second test method PASSED: failedFile PASSED: directoryShouldBeSuiteName PASSED: github1090 GITHUB-1090 PASSED: oneDirectoryPerSuite PASSED: reportLogShouldBeAvailableEvenWithTimeOut PASSED: reportLogShouldBeAvailableWithListener PASSED: runFailedTestTwiceShouldBeConsistent(class test.reports.GitHub1148Sample, [Ljava.lang.String;@6dbdbb69, [Ljava.lang.String;@576a8b00) PASSED: runFailedTestTwiceShouldBeConsistent(class test.reports.GitHub148Sample, [Ljava.lang.String;@1d988297, [Ljava.lang.String;@116efe65) PASSED: shouldHonorSuiteName PASSED: verifyIndex PASSED: annotationTransformerInXmlShouldBeRun PASSED: verifyAnnotationTransformerClass PASSED: verifyAnnotationTransformerClass2 PASSED: verifyAnnotationTransformerHasOnlyOneNonNullArgument PASSED: verifyAnnotationTransformerMethod PASSED: verifyAnnotationWithoutTransformer PASSED: verifyConfigurationTransformer PASSED: verifyDataProviderTransformer PASSED: verifyFactoryTransformer PASSED: verifyInvocationCountTransformer Test for issue #605 PASSED: verifyListenerAnnotationTransformerClass PASSED: verifyMyParamTransformerOnlyOneNonNull PASSED: handleInvalidSuites Ensure that TestNG stops without running any tests if some class included in suite is missing PASSED: preserverOrderAttribute PASSED: simple PASSED: issue629_InvokedMethodDoesNotRecognizeConfigurationMethod Invoked method does not recognize configuration method PASSED: issue87_method_orderning_with_disable_test_class PASSED: sameMethodInvokedMultipleTimesShouldHaveDifferentTimeStamps PASSED: testMethodsWithExpectedExceptionsShouldShowUpAsPass Test methods with expected exceptions should show up as pass in IInvokedMethodListener's afterInvocation method PASSED: withFailure PASSED: withSuccess PASSED: verify PASSED: testContextShouldBeInitialized PASSED: beforeTestFailingShouldCauseSkips PASSED: verifyBug PASSED: failedAndSkippedMethodsShouldBeIncluded PASSED: failedMethodWithDataProviderShouldHaveInvocationNumbers PASSED: testExclusionOfPassedConfigs github-1297 PASSED: testExclusionOfPassedConfigsAmidstInheritance github-1297 PASSED: testExclusionOfPassedConfigsInvolvingGroupsAtSuiteLevel github-1297 PASSED: testExclusionOfPassedConfigsInvolvingGroupsAtTestLevel github-1297 PASSED: f1(org.testng.TestRunner@3ca9d3b2) PASSED: f2(org.testng.TestRunner@3ca9d3b2) PASSED: verifyBaseClassTestListener PASSED: verifyTestListener PASSED: verifyWithAnnotation PASSED: verifyWithoutAnnotation PASSED: test1 Test depends on a config method that has implements an abstract methods PASSED: factoryPreserve preserve-order on a factory doesn't cause an NPE PASSED: orderShouldBePreservedWithDependencies PASSED: preserveClassOrder([Ljava.lang.Class;@5542418c) PASSED: preserveClassOrder([Ljava.lang.Class;@705eb026) PASSED: preserveClassOrder([Ljava.lang.Class;@8de4206) PASSED: preserveClassOrder([Ljava.lang.Class;@10f384a2) PASSED: preserveClassOrder([Ljava.lang.Class;@57fae911) PASSED: preserveClassOrder([Ljava.lang.Class;@52a0bc48) PASSED: preserveMethodOrder([Ljava.lang.String;@28941a68) PASSED: preserveMethodOrder([Ljava.lang.String;@24ce5d4c) PASSED: preserveMethodOrder([Ljava.lang.String;@24fc9aa5) PASSED: preserveMethodOrder([Ljava.lang.String;@7369208e) PASSED: preserveMethodOrder([Ljava.lang.String;@7ba623d1) PASSED: preserveMethodOrder([Ljava.lang.String;@2d5435d4) PASSED: preserveOrderValueShouldBeTheDefaultOne GITHUB-1122 Use default value for preserve-order PASSED: testFileCreationInMixedMode PASSED: testFileCreationSkipWhenNoFailuresExist PASSED: testFileCreationWhenFailuresExist PASSED: failedSuiteShouldHaveParameters PASSED: shouldLogFromListener(class test.reports.ReporterLogSuccessSample, "Listener: onTestSuccess") PASSED: shouldLogFromListener(class test.reports.ReporterLogSkippedSample, "Listener: onTestSkipped") PASSED: shouldLogFromListener(class test.reports.ReporterLogFailureSample, "Listener: onTestFailure") PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testInvocationCounterIsCorrectForMethodWithDataProvider PASSED: testListenerOrder PASSED: testIfOnlyOneListenerInstanceExists PASSED: testIfOnlyOneListenerInstanceExistsUsingAnnotations PASSED: testIfOnlyOneListenerInstanceExistsUsingListenerTag PASSED: testExceptionDetailsUsingGroupsWithFailures PASSED: testExceptionDetailsWhenClassHasExplicitSkipInConfiguration PASSED: testExceptionDetailsWhenClassHasMultipleFailures PASSED: testExceptionDetailsWhenConfigHasAlwaysRun PASSED: testExceptionDetailsWhenFailuresExistInABaseClass PASSED: testExceptionDetailsWhenFailuresExistInSuiteConfigs PASSED: testIfTestMethodHasException PASSED: testIfTestMethodHasExceptionInInheritance PASSED: testFailingBeforeSuiteShouldSkipAllTests PASSED: testSuiteParameterModificationFromListener GITHUB-107, Check that suite parameters set from listener does not affects tests count PASSED: testSuiteParameterSetFromListener GITHUB-107, Check that suite parameters modification from listener does not affects tests count PASSED: testAbstract PASSED: test PASSED: orderShouldBePreservedInMethodsWithSameNameAndInDifferentClasses PASSED: orderShouldBePreservedInMethodsWithSameNameAndInDifferentClassesAndDifferentPackage PASSED: testExecutionTimeOfFailedConfig PASSED: testGitHub1197 PASSED: testInstances PASSED: testReportsNameCustomizationViaRunMethodInvocationAndJVMArguments(org.testng.reporters.EmailableReporter@37f7ce20, "emailable.report.name") PASSED: testReportsNameCustomizationViaRunMethodInvocationAndJVMArguments(org.testng.reporters.EmailableReporter2@42457891, "emailable.report2.name") PASSED: verifyWithoutListener PASSED: testReportsNameCustomizationViaRunMethodInvocation(org.testng.reporters.EmailableReporter@1e75bef1) PASSED: testReportsNameCustomizationViaRunMethodInvocation(org.testng.reporters.EmailableReporter2@317fa5dd) PASSED: verifyWithListener PASSED: testReportsNameCustomizationViaMainMethodInvocation("org.testng.reporters.EmailableReporter") PASSED: testReportsNameCustomizationViaMainMethodInvocation("org.testng.reporters.EmailableReporter2") PASSED: verifyWithChildSuite PASSED: testReportsNameCustomizationViaMainMethodInvocationAndJVMArguments("org.testng.reporters.EmailableReporter", "emailable.report.name") PASSED: testReportsNameCustomizationViaMainMethodInvocationAndJVMArguments("org.testng.reporters.EmailableReporter2", "emailable.report2.name") =============================================== Regression2 Tests run: 755, Failures: 0, Skips: 0 =============================================== PASSED: f1 PASSED: f1 PASSED: f1 PASSED: f1 PASSED: f1 PASSED: verify PASSED: f1 PASSED: f1 PASSED: f1 PASSED: f1 PASSED: f1 PASSED: threadPoolAndTimeOutShouldFail PASSED: verify =============================================== Threads Tests run: 13, Failures: 0, Skips: 0 =============================================== [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNG] [WARN] Ignoring duplicate listener : test.listeners.MultiListener [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNG] Reporter test.multiplelisteners.SimpleReporter@66acaa54 failed java.lang.RuntimeException: java.lang.NoSuchFieldException: m_configuration at test.multiplelisteners.SimpleReporter.generateReport(SimpleReporter.java:31) at org.testng.TestNG.generateReports(TestNG.java:1197) at org.testng.TestNG.run(TestNG.java:1122) at test.multiplelisteners.TestMaker.run(TestMaker.java:26) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) Caused by: java.lang.NoSuchFieldException: m_configuration at java.base/java.lang.Class.getDeclaredField(Class.java:2610) at test.multiplelisteners.SimpleReporter.generateReport(SimpleReporter.java:24) ... 27 more PASSED: f1 PASSED: f2 Make sure that ITestResult#getEndMillis is properly set PASSED: endMillisShouldBeNonNull PASSED: aggregateListeners Inherited @Listeners annotations should aggregate PASSED: classListenerShouldBeOnlyRunOnce PASSED: classListenerShouldWork GITHUB-356: Add listeners for @BeforeClass/@AfterClass PASSED: classListenerShouldWorkFromAnnotation GITHUB-356: Add listeners for @BeforeClass/@AfterClass PASSED: classListenerShouldWorkWithManyTestMethods PASSED: failureBeforeAfterMethod TESTNG-400: onTestFailure should be called before @AfterMethod PASSED: invokedMethodListenersShouldBeOnlyRunOnceWithManyTests GITHUB-169 PASSED: listenerRegistration GITHUB-1084: Using deprecated addListener methods should not register many times PASSED: listenerShouldBeCalledBeforeConfiguration Ensure that if a listener is present, we get test(), onSuccess(), afterMethod() PASSED: methodInterceptorShouldBeRunOnce GITHUB-154: MethodInterceptor will be called twice PASSED: methodListenersShouldNotBeCalledForSkippedMethods GITHUB-911: Should not call method listeners for skipped methods PASSED: setStatusShouldWorkInListener GITHUB-895: Changing status of test by setStatus of ITestResult PASSED: shouldAttachOnlyOneInstanceOfTheSameListenerClassPerTest Should attach only one instance of the same @Listener class per test PASSED: suiteListenerInListernersAnnotationShouldBeRunOnce GITHUB-767: ISuiteListener called twice when @Listeners PASSED: suiteListenersShouldBeOnlyRunOnceWithManyIdenticalTests GITHUB-795 PASSED: suiteListenersShouldBeOnlyRunOnceWithManyTests GITHUB-171 PASSED: suiteListenersShouldWork @Listeners with an ISuiteListener PASSED: testListenerCallInvocation PASSED: bothListenersShouldRun PASSED: bothListenersShouldRun PASSED: listenerInXmlShouldBeInvoked Make sure that listeners defined in testng.xml are invoked PASSED: executionListenerAnnotation PASSED: executionListenerWithXml PASSED: executionListenerWithoutListener PASSED: shouldFail PASSED: shouldSkip PASSED: shouldSucceed PASSED: run Make sure only one listener is created and not 2^3 PASSED: classListenerShouldBeOnlyInstantiatedOnce PASSED: classListenerShouldBeOnlyInstantiatedOnceInMultiTestContext GITHUB-1130: IClassListener should only be instantiated once PASSED: test_number_of_call_of_configuration_listener https://github.com/cbeust/testng/issues/1296 =============================================== Listeners Tests run: 34, Failures: 0, Skips: 0 =============================================== exactMatchDP: s1, [[Ljava.lang.Object;@5f01361e s1, [[Ljava.lang.Object;@769a9b7a s1, [[Ljava.lang.Object;@2d568cff s1, [[Ljava.lang.Object;@5003c114 s1, [[Ljava.lang.Object;@6e4bccc s0, [[Ljava.lang.Object;@2487b621 s0, [[Ljava.lang.Object;@3d2ff73a s0, [[Ljava.lang.Object;@736a8aea s0, [[Ljava.lang.Object;@504b4a97 s0, [[Ljava.lang.Object;@4964d801 matchArrayEndingDP: s1, [[Ljava.lang.Object;@5d24703e s1, [[Ljava.lang.Object;@4ef10d3b s1, [[Ljava.lang.Object;@749ffdc7 s1, [[Ljava.lang.Object;@690e7b89 s1, [[Ljava.lang.Object;@17554316 s0, [[Ljava.lang.Object;@518b0c12 s0, [[Ljava.lang.Object;@5af1b221 s0, [[Ljava.lang.Object;@40b958c5 s0, [[Ljava.lang.Object;@7d49fe37 s0, [[Ljava.lang.Object;@74ab8610 In: [Parameter{index=0, type=test.reflect.TestContextJustForTesting, declaredAnnotations=[]}, Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] Out: [Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] In: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=org.testng.ITestContext, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] Out: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] In: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=java.lang.Boolean, declaredAnnotations=[]}, Parameter{index=2, type=org.testng.ITestContext, declaredAnnotations=[]}] Out: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=java.lang.Boolean, declaredAnnotations=[]}] In: [Parameter{index=0, type=org.testng.ITestContext, declaredAnnotations=[]}, Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}, Parameter{index=3, type=org.testng.ITestContext, declaredAnnotations=[]}] Out: [Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] In: [Parameter{index=0, type=test.reflect.TestContextJustForTesting, declaredAnnotations=[]}, Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] args: [343, true] injectedArgs: [null, 343, true] In: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=org.testng.ITestContext, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}] args: [343, true] injectedArgs: [343, null, true] In: [Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=java.lang.Boolean, declaredAnnotations=[]}, Parameter{index=2, type=org.testng.ITestContext, declaredAnnotations=[]}] args: [343, true] injectedArgs: [343, true, null] In: [Parameter{index=0, type=org.testng.ITestContext, declaredAnnotations=[]}, Parameter{index=1, type=int, declaredAnnotations=[]}, Parameter{index=2, type=java.lang.Boolean, declaredAnnotations=[]}, Parameter{index=3, type=org.testng.ITestContext, declaredAnnotations=[]}] args: [343, true] injectedArgs: [null, 343, true, null] An item is "three" An item is "four" An item is "three" An item is "four" An item is "three" An item is "four" An item is "three" An item is "four" An item is "four" An item is "four" MyMethod1 is "public void test.reflect.TestMethodMatcher.mixedArgs(int,java.lang.Boolean,java.lang.String[],java.lang.String[])" MyMethod2 is "public void test.reflect.TestMethodMatcher.badTestIssue122(java.lang.String,java.lang.String[])" CurrentTestMethod is "public void test.reflect.TestMethodMatcher.potpourri0(java.lang.reflect.Method,org.testng.xml.XmlTest,java.lang.reflect.Method,int,java.lang.reflect.Method,org.testng.ITestContext,org.testng.ITestContext,java.lang.Boolean,org.testng.ITestResult,org.testng.ITestResult,java.lang.String[],org.testng.xml.XmlTest,java.lang.String[])" MyITestContext is "test.reflect.TestContextJustForTesting@623ed5ed" ITestContext is "org.testng.TestRunner@49e92724" ITestResult is "null" MyTestResult is "test.reflect.TestResultJustForTesting@2ba4b32b" XmlTest is "[Test: "Reflection" verbose:1[parameters:][metagroups:] [included: ][excluded: ] classes:[XmlClass class=test.reflect.ReflectionRecipesTest] [XmlClass class=test.reflect.TestMethodMatcher] packages:] " MyXmlTest is "[Test: "null" verbose:1[parameters:][metagroups:] [included: ][excluded: ] classes: packages:] " An item is "four" MyMethod1 is "public void test.reflect.TestMethodMatcher.mixedArgs(int,java.lang.Boolean,java.lang.String[],java.lang.String[])" MyMethod2 is "public void test.reflect.TestMethodMatcher.badTestIssue122(java.lang.String,java.lang.String[])" CurrentTestMethod is "public void test.reflect.TestMethodMatcher.potpourri1(java.lang.reflect.Method,org.testng.xml.XmlTest,java.lang.reflect.Method,int,java.lang.reflect.Method,org.testng.ITestContext,org.testng.ITestContext,java.lang.Boolean,org.testng.ITestResult,org.testng.ITestResult,java.lang.String[],org.testng.xml.XmlTest,java.lang.String[])" MyITestContext is "test.reflect.TestContextJustForTesting@47ab3688" ITestContext is "org.testng.TestRunner@49e92724" ITestResult is "null" MyTestResult is "test.reflect.TestResultJustForTesting@47fbf95e" XmlTest is "[Test: "Reflection" verbose:1[parameters:][metagroups:] [included: ][excluded: ] classes:[XmlClass class=test.reflect.ReflectionRecipesTest] [XmlClass class=test.reflect.TestMethodMatcher] packages:] " MyXmlTest is "[Test: "null" verbose:1[parameters:][metagroups:] [included: ][excluded: ] classes: packages:] " An item is "four" org.testng.internal.reflect.MethodMatcherException: Data provider mismatch Method: goodTestIssue122([Parameter{index=0, type=java.lang.String, declaredAnnotations=[]}, Parameter{index=1, type=[Ljava.lang.String;, declaredAnnotations=[]}]) Arguments: [(java.lang.Integer)3,(java.lang.String)three,(java.lang.String)four] at org.testng.internal.reflect.DataProviderMethodMatcher.getConformingArguments(DataProviderMethodMatcher.java:49) at test.reflect.TestMethodMatcher.testNegativeCaseMatcher(TestMethodMatcher.java:101) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) org.testng.internal.reflect.MethodMatcherException: Data provider mismatch Method: badTestIssue122([Parameter{index=0, type=java.lang.String, declaredAnnotations=[]}, Parameter{index=1, type=[Ljava.lang.String;, declaredAnnotations=[]}]) Arguments: [(java.lang.Integer)3,(java.lang.String)three,(java.lang.String)four] at org.testng.internal.reflect.DataProviderMethodMatcher.getConformingArguments(DataProviderMethodMatcher.java:49) at test.reflect.TestMethodMatcher.testNegativeCaseMatcher(TestMethodMatcher.java:101) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) org.testng.internal.reflect.MethodMatcherException: Data provider mismatch Method: mixedArgs([Parameter{index=0, type=int, declaredAnnotations=[]}, Parameter{index=1, type=java.lang.Boolean, declaredAnnotations=[]}, Parameter{index=2, type=[Ljava.lang.String;, declaredAnnotations=[]}, Parameter{index=3, type=[Ljava.lang.String;, declaredAnnotations=[]}]) Arguments: [(java.lang.Integer)3,(java.lang.Boolean)true,(java.lang.String)three,(java.lang.String)four] at org.testng.internal.reflect.DataProviderMethodMatcher.getConformingArguments(DataProviderMethodMatcher.java:49) at test.reflect.TestMethodMatcher.testNegativeCaseMatcher(TestMethodMatcher.java:101) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) PASSED: exactMatchTest([[Ljava.lang.Object;@5f01361e, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s1(org.testng.ITestContext,int)) PASSED: exactMatchTest([[Ljava.lang.Object;@769a9b7a, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s1(int)) PASSED: exactMatchTest([[Ljava.lang.Object;@2d568cff, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s1(org.testng.ITestContext,org.testng.ITestResult,int,org.testng.xml.XmlTest,java.lang.reflect.Method)) PASSED: exactMatchTest([[Ljava.lang.Object;@5003c114, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s1(org.testng.ITestContext,java.lang.Integer,org.testng.ITestResult)) PASSED: exactMatchTest([[Ljava.lang.Object;@6e4bccc, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s1(int,org.testng.ITestContext,org.testng.ITestResult,org.testng.xml.XmlTest)) PASSED: exactMatchTest([[Ljava.lang.Object;@2487b621, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s0(org.testng.ITestContext,org.testng.ITestResult,org.testng.xml.XmlTest,java.lang.reflect.Method)) PASSED: exactMatchTest([[Ljava.lang.Object;@3d2ff73a, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s0()) PASSED: exactMatchTest([[Ljava.lang.Object;@736a8aea, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s0(org.testng.ITestContext)) PASSED: exactMatchTest([[Ljava.lang.Object;@504b4a97, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s0(org.testng.ITestContext,org.testng.ITestResult)) PASSED: exactMatchTest([[Ljava.lang.Object;@4964d801, public abstract void test.reflect.ReflectionRecipesTest$ExactMatchTest.s0(org.testng.ITestContext,org.testng.ITestResult,org.testng.xml.XmlTest)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@5d24703e, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s1(org.testng.ITestContext,int,float[])) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@4ef10d3b, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s1(int,float[])) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@749ffdc7, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s1(org.testng.ITestContext,org.testng.ITestResult,int,org.testng.xml.XmlTest,float[],java.lang.reflect.Method)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@690e7b89, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s1(org.testng.ITestContext,java.lang.Integer,org.testng.ITestResult,float[])) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@17554316, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s1(int,org.testng.ITestContext,org.testng.ITestResult,float[],org.testng.xml.XmlTest)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@518b0c12, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s0(org.testng.ITestContext,org.testng.ITestResult,org.testng.xml.XmlTest,float[],java.lang.reflect.Method)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@5af1b221, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s0(float[])) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@40b958c5, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s0(float[],org.testng.ITestContext)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@7d49fe37, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s0(org.testng.ITestContext,float[],org.testng.ITestResult)) PASSED: matchArrayEndingTest([[Ljava.lang.Object;@74ab8610, public abstract void test.reflect.ReflectionRecipesTest$MatchArrayEndingTest.s0(org.testng.ITestContext,org.testng.ITestResult,org.testng.xml.XmlTest,float[])) PASSED: testFilters([Lorg.testng.internal.reflect.Parameter;@2305aad0) PASSED: testFilters([Lorg.testng.internal.reflect.Parameter;@1c15a6aa) PASSED: testFilters([Lorg.testng.internal.reflect.Parameter;@7dc963be) PASSED: testFilters([Lorg.testng.internal.reflect.Parameter;@61c4fc34) PASSED: testInject([Lorg.testng.internal.reflect.Parameter;@6f9999f6, [Ljava.lang.Object;@5e085259) PASSED: testInject([Lorg.testng.internal.reflect.Parameter;@68ea1eb5, [Ljava.lang.Object;@5e085259) PASSED: testInject([Lorg.testng.internal.reflect.Parameter;@2e096ac0, [Ljava.lang.Object;@5e085259) PASSED: testInject([Lorg.testng.internal.reflect.Parameter;@d7c00de, [Ljava.lang.Object;@5e085259) PASSED: testIsOrImplementsInterface(class org.testng.TestRunner) PASSED: testIsOrImplementsInterface(interface org.testng.ITestContext) PASSED: testIsOrImplementsInterface(class test.reflect.TestContextJustForTesting) PASSED: testNegativeCaseIsOrImplementsInterface(class java.lang.Object) PASSED: testNegativeCaseIsOrImplementsInterface(class java.lang.Class) PASSED: testNegativeCaseIsOrImplementsInterface(interface java.sql.Connection) PASSED: testMatcher("goodTestIssue122", [Ljava.lang.Object;@11fa11b2, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("badTestIssue122", [Ljava.lang.Object;@29ddaa8e, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("goodTestIssue122", [Ljava.lang.Object;@4c678a1f, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("badTestIssue122", [Ljava.lang.Object;@217009bd, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("mixedArgs", [Ljava.lang.Object;@6046fba0, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("mixedArgs", [Ljava.lang.Object;@248ba4fc, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("potpourri0", [Ljava.lang.Object;@54cce500, org.testng.TestRunner@49e92724, null) PASSED: testMatcher("potpourri1", [Ljava.lang.Object;@755033c5, org.testng.TestRunner@49e92724, null) PASSED: testNegativeCaseMatcher("goodTestIssue122", [Ljava.lang.Object;@229c4d34, org.testng.TestRunner@49e92724, null) PASSED: testNegativeCaseMatcher("badTestIssue122", [Ljava.lang.Object;@5b49b1df, org.testng.TestRunner@49e92724, null) PASSED: testNegativeCaseMatcher("mixedArgs", [Ljava.lang.Object;@689eab53, org.testng.TestRunner@49e92724, null) =============================================== Reflection Tests run: 45, Failures: 0, Skips: 0 =============================================== PASSED: injectionAndParameters("Cedric", org.testng.TestRunner@3a36da5e) PASSED: f("a") PASSED: f("b") PASSED: verifyTestResultInjection PASSED: dpObject1(1, org.testng.TestRunner@3a36da5e, "a") PASSED: dpObject1(2, org.testng.TestRunner@3a36da5e, "b") PASSED: dpObject2(org.testng.TestRunner@3a36da5e, 1, "a") PASSED: dpObject2(org.testng.TestRunner@3a36da5e, 2, "b") PASSED: dpObject3(1, "a", org.testng.TestRunner@3a36da5e) PASSED: dpObject3(2, "b", org.testng.TestRunner@3a36da5e) PASSED: withInjection(public void test.inject.NoInjectionTest.withInjection(java.lang.reflect.Method)) PASSED: withoutInjection(public void test.inject.CC.f()) PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadBeforeSuiteSample, "beforeSuite", "Can inject only one of into a BeforeSuite annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadBeforeTestSample, "beforeTest", "Can inject only one of into a BeforeTest annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadBeforeClassSample, "beforeClass", "Can inject only one of into a BeforeClass annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadBeforeMethodSample, "beforeMethod", "Can inject only one of into a BeforeMethod annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadAfterMethodSample, "afterMethod", "Can inject only one of into a AfterMethod annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadAfterClassSample, "afterClass", "Can inject only one of into a AfterClass annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadAfterTestSample, "afterTest", "Can inject only one of into a AfterTest annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadAfterSuiteSample, "afterSuite", "Can inject only one of into a AfterSuite annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadBeforeGroupsSample, "beforeGroups", "Can inject only one of into a BeforeGroups annotated ") PASSED: testBeforeSuiteInjection(class test.inject.NativeInjectionTestSamples$BadAfterGroupsSample, "afterGroups", "Can inject only one of into a AfterGroups annotated ") PASSED: testPlugin =============================================== Injection Tests run: 23, Failures: 0, Skips: 0 =============================================== PASSED: mainTest =============================================== BeforeMethod Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: basic1 PASSED: makeSureSetUpWithParameterWithNoParametersFails PASSED: basic2 =============================================== Basic Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: noGroups PASSED: partialGroupsClass PASSED: partialGroupsMethod PASSED: setUpWithGroups =============================================== Exclusion Tests run: 4, Failures: 0, Skips: 0 =============================================== PASSED: z_first0 PASSED: z_premiere1 PASSED: dependentGroupsWithCycle PASSED: dependentMethods PASSED: dependentMethodsWithCycle PASSED: dependentMethodsWithNonExistentMethod PASSED: dependentMethodsWithSkip PASSED: dependentWithDataProvider PASSED: instanceDependencies PASSED: methodDependencyBetweenClassesShouldWork([Ljava.lang.Class;@56fc2cea, true) GITHUB-1156 PASSED: methodDependencyBetweenClassesShouldWork([Ljava.lang.Class;@e30a8ef, false) GITHUB-1156 PASSED: methodDependencyBetweenClassesShouldWork([Ljava.lang.Class;@2ffaa711, true) GITHUB-1156 PASSED: methodDependencyBetweenClassesShouldWork([Ljava.lang.Class;@3abb6aa, false) GITHUB-1156 PASSED: multipleSkips PASSED: simpleSkip PASSED: test2 PASSED: canBeRunAnytime PASSED: oneA PASSED: oneB PASSED: one PASSED: one("Cedric") PASSED: verifyDependents PASSED: verifyDependsOnGroups PASSED: verifyGroupsAcrossClasses PASSED: verifyDependsOnGroups1AlwaysRun PASSED: verifyDependsOnGroups2AlwaysRun PASSED: verifyDependsOnMethodsAlwaysRun PASSED: verifyDependsOnMultiGroups PASSED: verifyImplicitGroupInclusion PASSED: verifyImplicitGroupInclusion2 PASSED: verifyImplicitGroupInclusion3 PASSED: verifyImplicitGroupInclusion4 PASSED: verifyImplicitMethodInclusion PASSED: m1 PASSED: send PASSED: verify PASSED: verifyBeforeInvocations PASSED: methodsShouldBeGroupedByClasses PASSED: dontGroupByInstances PASSED: groupByInstances PASSED: verifyGroupMulti([Ljava.lang.String;@34074149) PASSED: verifyGroupMulti([Ljava.lang.String;@3f7bf0f6) PASSED: verifyGroupMulti([Ljava.lang.String;@45430a27) PASSED: verifyGroupMulti([Ljava.lang.String;@1b83fac3) PASSED: verifyGroupMulti([Ljava.lang.String;@1500edf3) PASSED: verifyGroupMulti([Ljava.lang.String;@759c53e5) PASSED: verifyGroupSingle([Ljava.lang.String;@28d37d43) PASSED: verifyGroupSingle([Ljava.lang.String;@2c02cf78) PASSED: verifyGroupSingle([Ljava.lang.String;@3e7fc07e) PASSED: verifyGroupSingle([Ljava.lang.String;@29ebaf2f) PASSED: verifyGroupSingle([Ljava.lang.String;@1a61f634) PASSED: verifyGroupSingle([Ljava.lang.String;@20a2930f) PASSED: dependentOnNonExistingGroup PASSED: dependentOnNonExistingMethod PASSED: a_second0 PASSED: a_second1 PASSED: secondA PASSED: secondA PASSED: m2 PASSED: get PASSED: dependentOnExistingMethod PASSED: third0 PASSED: thirdA =============================================== Dependents Tests run: 63, Failures: 0, Skips: 0 =============================================== ===== Invoked methods SuperClass1.beforeSuperClass1()[pri:0, instance:test.inheritance.testng471.Class1@238d27ef] 596453359 Class1.beforeClass1()[pri:0, instance:test.inheritance.testng471.Class1@238d27ef] 596453359 Class1.beforeMethodClass1()[pri:0, instance:test.inheritance.testng471.Class1@238d27ef] 596453359 Class1.test1_1()[pri:0, instance:test.inheritance.testng471.Class1@238d27ef] 596453359 Class1.afterMethodClass1()[pri:0, instance:test.inheritance.testng471.Class1@238d27ef] 596453359 SuperClass1.beforeSuperClass1()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.beforeClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.beforeMethodClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.test2_1()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.afterMethodClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.beforeMethodClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.test2_2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.afterMethodClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 Class2.afterClass2()[pri:0, instance:test.inheritance.testng471.Class2@91c11b6] 152834486 SuperClass2.beforeSuperClass2()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.beforeClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.beforeMethodClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.test3_1()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.afterMethodClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.beforeMethodClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.test3_2()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.afterMethodClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 Class3.afterClass3()[pri:0, instance:test.inheritance.testng471.Class3@3ec6f3f1] 1053225969 ===== =============================================== Command line suite Total tests run: 6, Failures: 0, Skips: 1 Configuration Failures: 1, Skips: 2 =============================================== ===== Invoked methods BaseSampleInheritance.baseConfiguration()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 SampleInheritance.configuration0()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 BaseSampleInheritance.configuration1()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 SampleInheritance.configuration2()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 BaseSampleInheritance.baseMethod()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 SampleInheritance.configurationsWereCalledInOrder()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 ClassScopeTest.setVerify()[pri:0, instance:test.inheritance.ClassScopeTest@7748410a] 2001223946 TestNG739.test_classes_should_be_skipped_when_a_before_class_fails()[pri:0, instance:test.inheritance.testng739.TestNG739@37f1104d] 938545229 PolymorphicFailureTest.superclassFailureShouldCauseFailure()[pri:0, instance:test.inheritance.testng234.PolymorphicFailureTest@55740540] 1433666880 TestNG471.test_classes_should_not_be_skipped_when_a_after_method_fails()[pri:0, instance:test.inheritance.testng471.TestNG471@60015ef5] 1610702581 BaseSampleInheritance.testBooleans()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 SampleInheritance.inheritedMethodsWereCalledInOrder()[pri:0, instance:test.SampleInheritance@4470f8a6] 1148254374 ClassScopeTest.verify()[pri:0, instance:test.inheritance.ClassScopeTest@7748410a] 2001223946 ===== PASSED: baseMethod PASSED: configurationsWereCalledInOrder PASSED: setVerify PASSED: test_classes_should_be_skipped_when_a_before_class_fails PASSED: superclassFailureShouldCauseFailure PASSED: test_classes_should_not_be_skipped_when_a_after_method_fails PASSED: testBooleans PASSED: inheritedMethodsWereCalledInOrder PASSED: verify =============================================== Inheritance Tests run: 9, Failures: 0, Skips: 0 =============================================== ===== Invoked methods Scope.outerDeprecated(java.lang.String)[pri:0, instance:test.sample.Scope@186f8716]out 409962262 ===== PASSED: outerDeprecated("out") =============================================== Test outer scope Tests run: 1, Failures: 0, Skips: 0 =============================================== ===== Invoked methods Scope.innerDeprecated(java.lang.String)[pri:0, instance:test.sample.Scope@574b560f]in 1464555023 ===== PASSED: innerDeprecated("in") =============================================== Test inner scope Tests run: 1, Failures: 0, Skips: 0 =============================================== ===== Invoked methods AfterClassCalledAtEnd.before1Class()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 AfterClassCalledAtEnd.test1()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 AfterClassCalledAtEnd.test2()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 AfterClassCalledAtEnd.test3()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 AfterClassCalledAtEnd.afterClass()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 BaseAfterClassCalledAtEnd.baseAfterClass()[pri:0, instance:test.sample.AfterClassCalledAtEnd@236e3f4e] 594427726 ===== PASSED: test1 Verify that beforeClass and afterClass are called correctly PASSED: test2 PASSED: test3 =============================================== AfterClassCalledAtEnd Tests run: 3, Failures: 0, Skips: 0 =============================================== ===== Invoked methods Base.initBeforeTestClass()[pri:0, instance:test.triangle.Child1@1329eff] 20094719 Child1.child1()[pri:0, instance:test.triangle.Child1@1329eff] 20094719 Child1.child1a()[pri:0, instance:test.triangle.Child1@1329eff] 20094719 Base.postAfterTestClass()[pri:0, instance:test.triangle.Child1@1329eff] 20094719 Base.initBeforeTestClass()[pri:0, instance:test.triangle.Child2@6497b078] 1687662712 Child2.child2()[pri:0, instance:test.triangle.Child2@6497b078] 1687662712 Base.postAfterTestClass()[pri:0, instance:test.triangle.Child2@6497b078] 1687662712 ===== PASSED: child1 PASSED: child1a PASSED: child2 =============================================== Triangle Tests run: 3, Failures: 0, Skips: 0 =============================================== ===== Invoked methods CheckCount.testCheckCount(java.lang.String)[pri:0, instance:test.triangle.CheckCount@8317c52]2 137460818 CheckCount.testCheckCountDeprecated(java.lang.String)[pri:0, instance:test.triangle.CheckCount@8317c52]2 137460818 ===== PASSED: testCheckCount("2") PASSED: testCheckCountDeprecated("2") =============================================== CheckTrianglePost Tests run: 2, Failures: 0, Skips: 0 =============================================== ===== Invoked methods First.first1()[pri:0, instance:test.classgroup.First@524d6d96] 1380806038 First.first2()[pri:0, instance:test.classgroup.First@524d6d96] 1380806038 Second.verify()[pri:0, instance:test.classgroup.Second@2525ff7e] 623247230 ===== PASSED: first1 PASSED: first2 PASSED: verify =============================================== Test class groups 1 Tests run: 3, Failures: 0, Skips: 0 =============================================== ===== Invoked methods First.first1()[pri:0, instance:test.classgroup.First@4e268090] 1311146128 First.first2()[pri:0, instance:test.classgroup.First@4e268090] 1311146128 Second.verify()[pri:0, instance:test.classgroup.Second@1bb266b3] 464676531 ===== PASSED: first1 PASSED: first2 PASSED: verify =============================================== Test class groups 2 Tests run: 3, Failures: 0, Skips: 0 =============================================== =============================================== Command line suite Total tests run: 0, Failures: 0, Skips: 0 =============================================== PASSED: testOne PASSED: verifyDataProvider PASSED: factoriesShouldBeInvokedInTheOrderOfCreation PASSED: factoryThrowingShouldNotRunTests PASSED: factoryInSuperClassShouldWork PASSED: testBeforeAfterClassInvocationsWithFactory PASSED: methodsShouldBeInterleaved PASSED: factoryWithLocalDataProvider Test @Factory(dataProvider) on a local static data provider PASSED: factoryWithNonStaticDataProvider Test @Factory(dataProvider) on a non static data provider with no arg ctor PASSED: factoryWithNonStaticDataProviderShouldFail Should fail because the data provider is not static PASSED: factoryWithNotStaticDataProvider Test @Factory(dataProvider) on a data provider in another class (not static) PASSED: factoryWithStaticDataProvider Test @Factory(dataProvider) on a data provider in another class (static) PASSED: disabledFactoryShouldNotRun PASSED: test PASSED: doubleFactoryMethodShouldWork PASSED: testExceptionWithBadFactoryMethodReturnType PASSED: testExceptionWithNonStaticFactoryMethod https://github.com/cbeust/testng/issues/876 PASSED: testNonPublicFactoryMethodShouldWork PASSED: test PASSED: testFactoryOnEmptyConstructor PASSED: testFactoryOnIntConstructor PASSED: testFactoryOnStringConstructor PASSED: testGitHub1307 PASSED: testInputImages PASSED: testInputImages PASSED: testInt on [FactoryTest2 42] PASSED: testInt on [FactoryTest2 43] PASSED: testInt PASSED: testInt PASSED: testMethod PASSED: testMethod PASSED: testMethod PASSED: mainCheck PASSED: checkSum PASSED: mainCheck PASSED: testImages PASSED: testImages PASSED: verifyThatTestMethodOnFactoryClassWasRun PASSED: verifyThatTestMethodOnFactoryClassWasRun PASSED: verifyThatTestMethodOnFactoryClassWasRun =============================================== Factory Tests run: 40, Failures: 0, Skips: 0 =============================================== Test1 Test2 PASSED: timeOutInNonParallel PASSED: timeOutInParallel(tests) PASSED: timeOutInParallel(methods) PASSED: timeOutInParallel(classes) PASSED: timeOutInParallel(instances) PASSED: timeOutInParallel(none) PASSED: timeOutInParallel(true) PASSED: timeOutInParallel(false) PASSED: verifyInvocationTimeOut PASSED: noTimeOut PASSED: timeOutInParallelTestsFromXml PASSED: timeOutOnSuiteTag PASSED: timeOutOnTestTag PASSED: twoDifferentTests PASSED: testGitHub1314 https://github.com/cbeust/testng/issues/1314 PASSED: testTimeOutWhenParallelIsTest https://github.com/cbeust/testng/issues/811 =============================================== TimeOut Tests run: 16, Failures: 0, Skips: 0 =============================================== PASSED: invocationCount PASSED: successPercentageThatFails PASSED: successPercentageThatSucceeds PASSED: verifyAttributeShouldStop PASSED: verifyGloballyShouldNotStop PASSED: verifyGloballyShouldStop PASSED: verifyDataProviderFalseFalse PASSED: verifyDataProviderFalseTrue PASSED: verifyDataProviderTrueFalse PASSED: verifyDataProviderTrueTrue PASSED: verifyInvocationCountFalseFalse PASSED: verifyInvocationCountFalseTrue PASSED: verifyInvocationCountTrueFalse PASSED: verifyInvocationCountTrueTrue =============================================== InvocationCount Tests run: 14, Failures: 0, Skips: 0 =============================================== PASSED: shouldRun1 PASSED: shouldRun2 PASSED: verify =============================================== Method1 Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: shouldRun1 PASSED: shouldRun2 PASSED: verify =============================================== Method2 Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: shouldRun1 PASSED: shouldRun2 PASSED: verify =============================================== Method3 Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: factoryReceivesContext PASSED: setFactoryByAnnotation This broke after I made the change to enable AbstractTest PASSED: setFactoryOnSuite PASSED: setFactoryOnTestNG PASSED: setInvalidMethodFactoryByAnnotation PASSED: combinedTestAndObjectFactory PASSED: factoryOnSuiteShouldWork PASSED: factoryOnTestNGShouldWork =============================================== Object factory Tests run: 8, Failures: 0, Skips: 0 =============================================== PASSED: verify =============================================== Parameters for constructors Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: included1 PASSED: included2 PASSED: verify =============================================== Excluded methods Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: testMethod("value1") =============================================== Parameters in init 1 Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: testMethod("value2") =============================================== Parameters in init 2 Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: testMethod =============================================== Individual method Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: helloWorld PASSED: testDescriptionInclusion =============================================== Individual method with description Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: test PASSED: verify =============================================== Method inheritance Tests run: 2, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. PASSED: greaterThanPriorityTest1Test2 PASSED: lessThanPriorityAllTests PASSED: lessThanPriorityTest1Test PASSED: negativePriorityAllGroups PASSED: negativePriorityGroup2 PASSED: onlyGroup1 PASSED: testNegativeScenario PASSED: commandLineGreaterThanPriorityTest1Test2 PASSED: commandLineLessThanPriorityAllTests PASSED: commandLineLessThanPriorityTest1Test PASSED: commandLineMultipleSelectors PASSED: commandLineNegativePriorityAllGroups PASSED: commandLineNegativePriorityGroup2 PASSED: commandLineNoTest1Selector PASSED: commandLineTestWithXmlFile PASSED: fileOnCommandLine PASSED: programmaticXmlSuite PASSED: xmlXmlSuite =============================================== Method selectors Tests run: 18, Failures: 0, Skips: 0 =============================================== PASSED: invocationOrder =============================================== Test order invocation Tests run: 1, Failures: 0, Skips: 0 =============================================== [Utils] [ERROR] [Error] org.testng.TestNGException: Found two providers called 'duplicate' on class test.dataprovider.DuplicateDataProviderSample at org.testng.internal.Parameters.findDataProvider(Parameters.java:416) at org.testng.internal.Parameters.findDataProvider(Parameters.java:332) at org.testng.internal.Parameters.handleParameters(Parameters.java:498) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.duplicateDataProviders(FailingDataProviderTest.java:20) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) [Utils] [ERROR] [Error] java.lang.RuntimeException: expected exception from @DP at test.dataprovider.FailingDataProviderSample.throwsExpectedException(FailingDataProviderSample.java:11) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:55) at org.testng.internal.MethodInvocationHelper.invokeMethodNoCheckedException(MethodInvocationHelper.java:45) at org.testng.internal.MethodInvocationHelper.invokeDataProvider(MethodInvocationHelper.java:115) at org.testng.internal.Parameters.handleParameters(Parameters.java:509) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.failingDataProvider(FailingDataProviderTest.java:13) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) [Utils] [ERROR] [Error] java.lang.RuntimeException: Fail at test.dataprovider.DataProviderWithErrorSample.Data(DataProviderWithErrorSample.java:21) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:55) at org.testng.internal.MethodInvocationHelper.invokeMethodNoCheckedException(MethodInvocationHelper.java:45) at org.testng.internal.MethodInvocationHelper.invokeDataProvider(MethodInvocationHelper.java:115) at org.testng.internal.Parameters.handleParameters(Parameters.java:509) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.failingDataProviderAndInvocationCount(FailingDataProviderTest.java:27) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) [Utils] [ERROR] [Error] java.lang.RuntimeException: Fail at test.dataprovider.DataProviderWithErrorSample.Data(DataProviderWithErrorSample.java:21) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:55) at org.testng.internal.MethodInvocationHelper.invokeMethodNoCheckedException(MethodInvocationHelper.java:45) at org.testng.internal.MethodInvocationHelper.invokeDataProvider(MethodInvocationHelper.java:115) at org.testng.internal.Parameters.handleParameters(Parameters.java:509) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.failingDataProviderAndInvocationCount(FailingDataProviderTest.java:27) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) [Utils] [ERROR] [Error] java.lang.RuntimeException: Fail at test.dataprovider.DataProviderWithErrorSample.Data(DataProviderWithErrorSample.java:21) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:55) at org.testng.internal.MethodInvocationHelper.invokeMethodNoCheckedException(MethodInvocationHelper.java:45) at org.testng.internal.MethodInvocationHelper.invokeDataProvider(MethodInvocationHelper.java:115) at org.testng.internal.Parameters.handleParameters(Parameters.java:509) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.failingDataProviderAndInvocationCount(FailingDataProviderTest.java:27) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) [Utils] [ERROR] [Error] java.lang.RuntimeException: Fail at test.dataprovider.DataProviderWithErrorSample.Data(DataProviderWithErrorSample.java:21) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:55) at org.testng.internal.MethodInvocationHelper.invokeMethodNoCheckedException(MethodInvocationHelper.java:45) at org.testng.internal.MethodInvocationHelper.invokeDataProvider(MethodInvocationHelper.java:115) at org.testng.internal.Parameters.handleParameters(Parameters.java:509) at org.testng.internal.Invoker.handleParameters(Invoker.java:1308) at org.testng.internal.Invoker.createParameters(Invoker.java:1036) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1126) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at test.SimpleBaseTest.run(SimpleBaseTest.java:42) at test.dataprovider.FailingDataProviderTest.failingDataProviderAndInvocationCount(FailingDataProviderTest.java:27) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:568) at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:108) at org.testng.internal.Invoker.invokeMethod(Invoker.java:661) at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:869) at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1193) at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129) at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112) at org.testng.TestRunner.privateRun(TestRunner.java:756) at org.testng.TestRunner.run(TestRunner.java:610) at org.testng.SuiteRunner.runTest(SuiteRunner.java:380) at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:375) at org.testng.SuiteRunner.privateRun(SuiteRunner.java:340) at org.testng.SuiteRunner.run(SuiteRunner.java:289) at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) at org.testng.TestNG.runSuitesSequentially(TestNG.java:1306) at org.testng.TestNG.runSuitesLocally(TestNG.java:1231) at org.testng.TestNG.runSuites(TestNG.java:1146) at org.testng.TestNG.run(TestNG.java:1117) at org.testng.TestNG.privateMain(TestNG.java:1447) at org.testng.TestNG.main(TestNG.java:1416) PASSED: verifyExternal("Cedric") PASSED: verifyStatic("Cedric") PASSED: verify(10, "verifyTen") PASSED: verify(5, "verifyFive") PASSED: verifySix PASSED: duplicateDataProviders TESTNG-447: Abort when two data providers have the same name PASSED: failingDataProvider TESTNG-142: Exceptions in DataProvider are not reported as failed test PASSED: failingDataProviderAndInvocationCount PASSED: failingDataProvider PASSED: failingDataProviderWithInvocationNumber PASSED: test PASSED: test2 PASSED: allMethodsShouldBeInvoked PASSED: booleanTest PASSED: classTest PASSED: configurationAndDataProvidersTest PASSED: createDataTest PASSED: dataProviderAsTest PASSED: emptyDataProviderTest PASSED: failedDataProviderShouldCauseSkip PASSED: inheritedDataProviderTest PASSED: instanceDataProviderTest PASSED: methodTest PASSED: oneDimDataProviderShouldWork GITHUB-1139 PASSED: parallelDataProviderSample PASSED: shouldNotThrowConcurrentModificationException PASSED: should_prefer_dataProvider_explicit_name TESTNG-576: Prefer DataProvider explicit name PASSED: staticDataProviderSampleWithoutGuiceTest PASSED: staticDataProviderTest PASSED: testExceptions PASSED: testInstanceFactoryTest PASSED: testNG411Test PASSED: unnamedDataProviderTest PASSED: varArgsDataProviderTest =============================================== DataProvider Tests run: 34, Failures: 0, Skips: 0 =============================================== PASSED: verify PASSED: verify PASSED: testAfter =============================================== UniqueSuite Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: test1 =============================================== InheritGroups Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: testGarf =============================================== Nested Tests run: 1, Failures: 0, Skips: 0 =============================================== PASSED: configurableFailure PASSED: configurableSuccess PASSED: configurableSuccessWithListener PASSED: hookFailure PASSED: hookSuccess PASSED: hookSuccessWithListener PASSED: issue599 https://github.com/cbeust/testng/issues/599 PASSED: issue862 https://github.com/cbeust/testng/pull/862 =============================================== Hookable Tests run: 8, Failures: 0, Skips: 0 =============================================== PASSED: f1 PASSED: fa PASSED: f1 PASSED: fa PASSED: g1 PASSED: f1 PASSED: fa PASSED: f PASSED: run PASSED: f PASSED: run1 PASSED: run2 PASSED: f PASSED: run1 PASSED: run2 PASSED: testSomething PASSED: testSomethingMore PASSED: verify PASSED: verify PASSED: verify PASSED: verify PASSED: verify PASSED: verify PASSED: verify =============================================== BeforeGroups-AfterGroups-1 Tests run: 24, Failures: 0, Skips: 0 =============================================== PASSED: testSomething PASSED: testSomethingMore PASSED: verify =============================================== BeforeGroups-AfterGroups-2 Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: methodsThatStartWithTest PASSED: methodsWithSetup PASSED: setNameShouldBeInvoked PASSED: setUpFailingShouldCauseMethodsToBeSkipped PASSED: testAbstract PASSED: testNewInstance PASSED: testSuite PASSED: junitParsing PASSED: junitParsing2 PASSED: suiteNameOverride PASSED: testMethodParameter PASSED: testNameOverride PASSED: testUseDefaultListenersArgument PASSED: testTests([Ljava.lang.Class;@6d598162, [Ljava.lang.String;@679f3e12, [Ljava.lang.String;@5b285847, [Ljava.lang.String;@57af157c) PASSED: testTests([Ljava.lang.Class;@765ccc7a, [Ljava.lang.String;@68ad030d, [Ljava.lang.String;@71de943f, [Ljava.lang.String;@5e756b8d) PASSED: testTests([Ljava.lang.Class;@4eda5325, [Ljava.lang.String;@4eef8498, [Ljava.lang.String;@4b158e16, [Ljava.lang.String;@3e49adfa) PASSED: testTests([Ljava.lang.Class;@2296926d, [Ljava.lang.String;@10ef09e3, [Ljava.lang.String;@776d50d6, [Ljava.lang.String;@43815bc) PASSED: testTests([Ljava.lang.Class;@122bfaac, [Ljava.lang.String;@7ae3591b, [Ljava.lang.String;@67954d71, [Ljava.lang.String;@234421ca) PASSED: testTests([Ljava.lang.Class;@6e774194, [Ljava.lang.String;@ebcf6c0, [Ljava.lang.String;@438fcca3, [Ljava.lang.String;@41c7ef69) PASSED: testTests([Ljava.lang.Class;@15e86d24, [Ljava.lang.String;@7c0b83af, [Ljava.lang.String;@415cb259, [Ljava.lang.String;@3f1eb1bc) PASSED: easyGroovySampleShouldWork PASSED: reporterWithSpockSampleShouldWork PASSED: specialNameGroovySampleShouldWork PASSED: spockSampleShouldWork =============================================== JUnit Tests run: 24, Failures: 0, Skips: 0 =============================================== PASSED: testDOSPathResolution PASSED: testPathResolution PASSED: testUnixPathResolution =============================================== Ant-ClassFileResolution Tests run: 3, Failures: 0, Skips: 0 =============================================== PASSED: testA PASSED: testB =============================================== Class Run Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: testA PASSED: testB =============================================== Groups Run Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: testA PASSED: testAB =============================================== External group invocation Tests run: 2, Failures: 0, Skips: 0 =============================================== =============================================== Command line suite Total tests run: 3, Failures: 1, Skips: 1 =============================================== PASSED: skippedExceptionInConfigurationMethods PASSED: skippedExceptionInTestMethods PASSED: shouldSkip =============================================== SkipExceptions Tests run: 3, Failures: 0, Skips: 0 =============================================== Test Called : Test6 Test Called : Test1 Test Called : Test2 Test Called : Test9 Test Called : Test7 Test Called : Test5 Test Called : Test5 Test Called : Test5 Test Called : Test5 Test Called : Test8 Test Called : Test4 Test Called : Test3 Test Called : Test0 PASSED: testInvocationCounts PASSED: exitsWithNonzeroOnFailure PASSED: exitsWithZeroAfterSuccessfulRetry PASSED: exitsWithZeroOnSuccess PASSED: testRetryCounts =============================================== RetryAnalyzer Tests run: 5, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. PASSED: fastShouldNotRunFirst PASSED: fastShouldRunFirst PASSED: noMethodsShouldRun PASSED: nullMethodInterceptorWorksInTestngXml PASSED: shouldNotLockUpWithInterceptorThatRemovesMethods PASSED: AfterClass_method_should_be_fired_when_IMethodInterceptor_removes_test_methods test for https://github.com/cbeust/testng/issues/392 PASSED: testMultipleInterceptors PASSED: testMultipleInterceptorsWithPreserveOrder =============================================== MethodInterceptor Tests run: 8, Failures: 0, Skips: 0 =============================================== PASSED: assertEqualsMapShouldFail PASSED: assertEqualsSymmetricArrays PASSED: assertEqualsSymmetricScalar PASSED: mapAssertEquals PASSED: nullCollectionAssertEquals PASSED: nullMapAssertEquals PASSED: nullObjectArrayAssertEquals PASSED: nullObjectArrayAssertNoOrder PASSED: nullSetAssertEquals PASSED: oneNullMapAssertEquals PASSED: oneNullSetAssertEquals PASSED: setAssertEquals PASSED: arraysFailures_1 PASSED: arraysFailures_2 PASSED: arraysFailures_3 PASSED: doubleNaNAssertion PASSED: expectThrowsDetectsTypeMismatchesViaExplicitTypeHint PASSED: expectThrowsIncludesAnInformativeDefaultMessage PASSED: expectThrowsRequiresAnExceptionToBeThrown PASSED: expectThrowsReturnsTheSameObjectThrown PASSED: expectThrowsSuppliesACoherentErrorMessageUponTypeMismatch PASSED: expectThrowsWrapsAndPropagatesUnexpectedExceptions PASSED: intArray_Issue4 PASSED: noOrderFailure PASSED: noOrderSuccess PASSED: setsSuccess PASSED: arrayAssertEquals PASSED: arrayAssertNotEquals PASSED: arrayDeepInArrayAndListAssertEquals PASSED: arrayDeepInArraysAssertEquals PASSED: arrayDeepInIterablesAssertEquals PASSED: arrayDeepInListAndMapAssertEquals PASSED: arrayDeepInListsAssertEquals PASSED: arrayDeepInMapAndListAssertEquals PASSED: arrayDeepInMapsAssertEquals PASSED: arrayInsideArrayAssertEquals PASSED: arrayInsideIterableAssertEquals PASSED: arrayInsideListAssertEquals PASSED: arrayInsideListAssertNotEquals PASSED: arrayInsideMapAssertEquals PASSED: arrayInsideMapAssertEqualsDeep PASSED: arrayInsideMapAssertEqualsDeepWithMessage PASSED: arrayInsideMapAssertEqualsWithMessage PASSED: arrayInsideMapAssertNotEquals PASSED: arrayInsideMapAssertNotEqualsDeep PASSED: arrayInsideSetAssertEquals PASSED: arrayInsideSetAssertEqualsDeep PASSED: arrayInsideSetAssertNotEquals PASSED: arrayInsideSetAssertNotEqualsDeep PASSED: boxedArrayAssertEquals PASSED: boxedArrayAssertNotEquals PASSED: mixedArraysAssertEquals PASSED: mixedArraysAssertNotEquals =============================================== Asserts Tests run: 53, Failures: 0, Skips: 0 =============================================== PASSED: createEmptyStringWhenJoiningEmptyListWithJoin PASSED: createEmptyStringWhenJoiningEmptyListWithJoinStrings PASSED: escapeUnicode PASSED: joinTwoStringsWithJoinStrings PASSED: testGetAvailableMethods =============================================== Utils Tests run: 5, Failures: 0, Skips: 0 =============================================== PASSED: test PASSED: test PASSED: testClassWithRedundantGroups PASSED: testClassWithUniqueGroups =============================================== Invoker Tests run: 4, Failures: 0, Skips: 0 =============================================== PASSED: commandLineTestWithXMLFile_policyAsContinue PASSED: commandLineTestWithXMLFile_policyAsSkip PASSED: commandLineTest_policyAsContinue PASSED: commandLineTest_policyAsSkip PASSED: confFailureTest([Ljava.lang.Class;@30c96ea9, 1, 1, 1) PASSED: confFailureTest([Ljava.lang.Class;@62a9d176, 2, 0, 2) PASSED: confFailureTest([Ljava.lang.Class;@71ea9a0d, 4, 0, 4) PASSED: confFailureTest([Ljava.lang.Class;@62ba4c62, 2, 2, 2) PASSED: confFailureTest([Ljava.lang.Class;@19fdcaba, 1, 1, 1) PASSED: confFailureTest([Ljava.lang.Class;@35738a92, 1, 2, 2) PASSED: confFailureTest([Ljava.lang.Class;@10ec54c3, 2, 3, 3) PASSED: confFailureTest([Ljava.lang.Class;@2005d3e0, 0, 1, 1) PASSED: confFailureTest([Ljava.lang.Class;@575a6540, 2, 0, 2) PASSED: confFailureTest([Ljava.lang.Class;@7e544223, 8, 0, 8) PASSED: confFailureTest([Ljava.lang.Class;@c6c5b66, 2, 2, 2) =============================================== ConfigFailurePolicy Tests run: 15, Failures: 0, Skips: 0 =============================================== PASSED: nestedA PASSED: nestedWithInheritedTest =============================================== Nested2 Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: guiceTest PASSED: guiceWithNoModules PASSED: singletonShouldWork PASSED: singletonShouldWork =============================================== Guice Tests run: 4, Failures: 0, Skips: 0 =============================================== PASSED: testFromListenerUsingExtendedListenerInstance PASSED: testFromListenerUsingSimpleListenerInstance =============================================== Listener invokers Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: compareFiles("a1") PASSED: compareFiles("a2") PASSED: compareFiles("a3") PASSED: compareFiles("a4") =============================================== YAML Tests run: 4, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. PASSED: testParse("goodWithDoctype.xml", true) PASSED: testParse("goodWithoutDoctype.xml", true) PASSED: testParse("badWithDoctype.xml", false) PASSED: testParse("badWithoutDoctype.xml", false) PASSED: testParse("issue174.xml", true) PASSED: testIncludedAndExcludedGroups PASSED: testIncludedAndExcludedGroupsWithRun =============================================== XML Tests run: 7, Failures: 0, Skips: 0 =============================================== [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. [TestNGContentHandler] [WARN] It is strongly recommended to add "" at the top of your file, otherwise TestNG may fail or not work as expected. PASSED: checkNoError PASSED: checkTestNamesForProgrammaticSuites PASSED: checkWithChildSuites PASSED: checkWithoutChildSuites PASSED: checkChildSuites PASSED: checkChildSuitesFails PASSED: checkProgrammaticSuitesFails PASSED: checkXmlSuiteAddition =============================================== Sanity Check Tests run: 8, Failures: 0, Skips: 0 =============================================== PASSED: verifyBeforeGroupUseAppropriateInstance https://github.com/cbeust/testng/issues/1338 PASSED: verifySingleInvocation Verify that a base class with a BeforeGroups method only gets invoked once, no matter how many subclasses it has PASSED: verifyBothAfterGroups PASSED: verifyDataProviderAfterGroups PASSED: verifyIteratorDataProviderAfterGroups PASSED: verifyParametersAfterGroups PASSED: verify PASSED: verify PASSED: beforeClassMethodsShouldRunInParallel PASSED: realTest PASSED: afterClassShouldRunEvenWithDisabledMethods PASSED: verifyBeforeTestOrdering PASSED: test PASSED: verify PASSED: verify PASSED: test1 PASSED: test2 PASSED: suiteMethodsShouldOnlyRunOnce PASSED: test1 =============================================== Configuration Tests run: 19, Failures: 0, Skips: 0 =============================================== PASSED: runTest({two=orld, one=ello}, "H{{one}} W{{two}}", "Hello World") PASSED: runTest({}, "E{{#foo}}xxx{{/foo}}lephant", "Elephant") PASSED: runTest({}, "Hello {{#foo}}@ {{/foo}}World", "Hello World") PASSED: runTest({day=Monday, person=test.mustache.MustacheTest$Person@5145dddc}, "Hello {{#person}}{{name}}{{/person}}, {{day}}", "Hello John, Monday") PASSED: runTest({name=Carl, person=test.mustache.MustacheTest$Person@31d96cd6}, "Hello {{#person}}{{name}}{{/person}}, {{name}}", "Hello John, Carl") PASSED: runTest({people=[test.mustache.MustacheTest$Person@b6a5cf5, test.mustache.MustacheTest$Person@6f1ba660]}, "People:@{{#people}}-{{/people}}!", "People:@--!") PASSED: runTest({ages=[test.mustache.MustacheTest$Age@30a0a440, test.mustache.MustacheTest$Age@116c43d4], people=[test.mustache.MustacheTest$Person@b6a5cf5, test.mustache.MustacheTest$Person@6f1ba660]}, ":@{{#people}}{{name}}{{#ages}}{{age}}{{/ages}}@{{/people}}!_", ":@Carl4243@Christopher4243@!_") =============================================== Mustache Tests run: 7, Failures: 0, Skips: 0 =============================================== PASSED: mixedClasses PASSED: mixedMethods PASSED: mixedWithExcludedGroups =============================================== Mixed Tests run: 3, Failures: 0, Skips: 0 =============================================== =============================================== Issue 107 Tests run: 0, Failures: 0, Skips: 0 =============================================== PASSED: test1 PASSED: test2 PASSED: test2_fails PASSED: testAssertAllCount PASSED: testOnSucceedAndFailureCalled =============================================== Assertion Tests run: 5, Failures: 0, Skips: 0 =============================================== PASSED: disabled_methods_should_not_be_run PASSED: issue420 https://github.com/cbeust/testng/issues/420 =============================================== @Test(enable) Tests run: 2, Failures: 0, Skips: 0 =============================================== PASSED: blankNameTest PASSED: blankNameTestWithXml PASSED: complexITestTest PASSED: itestTest PASSED: itestTestWithXml PASSED: noNameTest PASSED: noNameTestWithXml PASSED: testNameTest PASSED: testNameTestWithXml PASSED: testOnClassFromReporter GITHUB-922: ITestResult doesn't contain name if a class has @Test PASSED: testCustomTestNames =============================================== Name Tests run: 11, Failures: 0, Skips: 0 =============================================== PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethods PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderInSameThread PASSED: verifyTestMethodLevelEventsAllOccurBetweenTestListenerStartAndFinish PASSED: verifyThatAllEventsForATestMethodExecuteInSameThread PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifySuitesRunSequentiallyInSameThread PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifyTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatSuitesRunInParallelThreads PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifyTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatSuitesRunInParallelThreads PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethods PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderInSameThread PASSED: verifyTestMethodLevelEventsAllOccurBetweenTestListenerStartAndFinish PASSED: verifyThatAllEventsForATestMethodExecuteInSameThread PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifySuitesRunSequentiallyInSameThread PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: sanityCheck PASSED: verifyOnlyOneInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifyTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatSuitesRunInParallelThreads PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: sanityCheck PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderInSameThread PASSED: verifyTestMethodLevelEventsAllOccurBetweenTestListenerStartAndFinish PASSED: verifyThatAllEventsForATestMethodInClassInstanceExecuteInSameThread PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: verifyTwoInstancesOfTestClassForAllTestMethods PASSED: sanityCheck PASSED: verifyNumberOfInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifySuitesRunSequentiallyInSameThread PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: sanityCheck PASSED: verifyNumberOfInstanceOfTestClassForAllTestMethodsForAllSuites PASSED: verifyTestLevelEventsRunInSequentialOrderForIndividualSuites PASSED: verifyTestLevelMethodLevelEventLogsOccurBetweenAfterTestListenerStartAndFinishEventLogs PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatSuitesRunInParallelThreads PASSED: sanityCheck PASSED: verifySuiteAndTestLevelEventsRunInSequentialOrderInSameThread PASSED: verifyTestMethodLevelEventsAllOccurBetweenTestListenerStartAndFinish PASSED: verifyThatAllEventsForATestMethodExecuteInSameThread PASSED: verifyThatMethodLevelEventsRunInDifferentThreadsFromSuiteAndTestLevelEvents PASSED: verifyThatTestMethodsRunInParallelThreads PASSED: verifyThreeInstancesOfTestClassForAllTestMethods FAILED: verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268256, threadId=5251, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268267, threadId=5252, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268281, threadId=5253, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268296, threadId=5254, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268308, threadId=5255, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268321, threadId=5256, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268333, threadId=5257, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268344, threadId=5258, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268356, threadId=5251, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268357, threadId=5259, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268367, threadId=5252, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268374, threadId=5260, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268381, threadId=5253, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodC}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase1Scenario2.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase1Scenario2.java:569) ... Removed 27 stack frames FAILED: verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 14 for TestSuiteB-ThreeTestClassTest so no more than 14 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284438, threadId=5301, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284460, threadId=5302, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284478, threadId=5303, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284488, threadId=5304, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284504, threadId=5305, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284529, threadId=5306, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284538, threadId=5301, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284543, threadId=5307, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284560, threadId=5308, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@511f21f9, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284560, threadId=5302, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284578, threadId=5303, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodC}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284579, threadId=5309, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@511f21f9, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284588, threadId=5304, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase2Scenario1.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase2Scenario1.java:351) ... Removed 27 stack frames FAILED: verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371688, threadId=5453, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371712, threadId=5454, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371725, threadId=5455, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371740, threadId=5456, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371750, threadId=5457, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371763, threadId=5458, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371787, threadId=5459, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371788, threadId=5453, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371802, threadId=5460, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371809, threadId=5461, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371812, threadId=5454, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371825, threadId=5455, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371827, threadId=5462, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371840, threadId=5456, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371848, threadId=5463, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371850, threadId=5457, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371863, threadId=5464, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371863, threadId=5458, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371869, threadId=5466, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371869, threadId=5465, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase5Scenario2.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase5Scenario2.java:363) ... Removed 27 stack frames FAILED: verifyThatTestMethodsRunInParallelThreads java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381529, threadId=5488, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381534, threadId=5489, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381540, threadId=5490, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381545, threadId=5491, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381554, threadId=5492, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381555, threadId=5493, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381561, threadId=5494, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381570, threadId=5495, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381576, threadId=5496, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381585, threadId=5497, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381591, threadId=5498, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381596, threadId=5499, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381603, threadId=5500, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381610, threadId=5501, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5502, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5503, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5504, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381626, threadId=5505, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529381629, threadId=5488, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381630, threadId=5506, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase6Scenario1.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase6Scenario1.java:571) ... Removed 27 stack frames =============================================== Parallelization Tests run: 76, Failures: 4, Skips: 0 =============================================== =============================================== TestNG Total tests run: 1463, Failures: 4, Skips: 0 =============================================== Failures in :TestNG, :Parallelization test.thread.parallelization.ParallelByMethodsTestCase1Scenario2.verifyThatTestMethodsRunInParallelThreads() StackTrace: java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268256, threadId=5251, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268267, threadId=5252, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268281, threadId=5253, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268296, threadId=5254, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268308, threadId=5255, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268321, threadId=5256, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268333, threadId=5257, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@67171221, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268344, threadId=5258, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268356, threadId=5251, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268357, threadId=5259, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268367, threadId=5252, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529268374, threadId=5260, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@2f3a3fec, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529268381, threadId=5253, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@207fce87, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodC}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase1Scenario2.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase1Scenario2.java:569) ... Removed 27 stack frames test.thread.parallelization.ParallelByMethodsTestCase6Scenario1.verifyThatTestMethodsRunInParallelThreads() StackTrace: java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381529, threadId=5488, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381534, threadId=5489, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381540, threadId=5490, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381545, threadId=5491, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381554, threadId=5492, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381555, threadId=5493, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381561, threadId=5494, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381570, threadId=5495, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381576, threadId=5496, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381585, threadId=5497, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381591, threadId=5498, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381596, threadId=5499, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381603, threadId=5500, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381610, threadId=5501, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5502, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7ec9d826, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5503, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381619, threadId=5504, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@27dfd939, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381626, threadId=5505, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@441e789e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529381629, threadId=5488, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1dd17c0c, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529381630, threadId=5506, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@6c1a9613, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase6Scenario1.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase6Scenario1.java:571) ... Removed 27 stack frames test.thread.parallelization.ParallelByMethodsTestCase5Scenario2.verifyThatTestMethodsRunInParallelThreads() StackTrace: java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 20 for TestSuiteB-ThreeTestClassTest so no more than 20 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371688, threadId=5453, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371712, threadId=5454, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371725, threadId=5455, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371740, threadId=5456, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371750, threadId=5457, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371763, threadId=5458, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371787, threadId=5459, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371788, threadId=5453, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371802, threadId=5460, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371809, threadId=5461, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371812, threadId=5454, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371825, threadId=5455, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371827, threadId=5462, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371840, threadId=5456, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371848, threadId=5463, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371850, threadId=5457, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@7e753fd6, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371863, threadId=5464, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2350e46, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529371863, threadId=5458, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@1f234e35, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371869, threadId=5466, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@5409305f, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529371869, threadId=5465, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@51a6af38, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase5Scenario2.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase5Scenario2.java:363) ... Removed 27 stack frames test.thread.parallelization.ParallelByMethodsTestCase2Scenario1.verifyThatTestMethodsRunInParallelThreads() StackTrace: java.lang.AssertionError: The expected maximum number of methods to execute simultaneously is 14 for TestSuiteB-ThreeTestClassTest so no more than 14 methods should be executing at the same time. Event logs: [EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284438, threadId=5301, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284460, threadId=5302, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284478, threadId=5303, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284488, threadId=5304, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284504, threadId=5305, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284529, threadId=5306, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodC, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284538, threadId=5301, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284543, threadId=5307, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, METHOD_NAME=testMethodD, SUITE_NAME=TestSuiteB}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284560, threadId=5308, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@511f21f9, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodA, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284560, threadId=5302, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284578, threadId=5303, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample@7781b55f, CLASS_NAME=test.thread.parallelization.sample.TestClassDThreeMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodC}}, EventLog{event=TEST_METHOD_EXECUTION, timeOfEvent=1701529284579, threadId=5309, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample@511f21f9, CLASS_NAME=test.thread.parallelization.sample.TestClassFSixMethodsWithNoDepsSample, METHOD_NAME=testMethodB, SUITE_NAME=TestSuiteB}}, EventLog{event=LISTENER_TEST_METHOD_PASS, timeOfEvent=1701529284588, threadId=5304, data={TEST_NAME=TestSuiteB-ThreeTestClassTest, CLASS_INSTANCE=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample@2cb3bc0e, CLASS_NAME=test.thread.parallelization.sample.TestClassBFourMethodsWithNoDepsSample, SUITE_NAME=TestSuiteB, METHOD_NAME=testMethodA}}] expected [true] but found [false] at test.thread.parallelization.BaseParallelizationTest.verifyEventTypeForEventsLogs(BaseParallelizationTest.java:94) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethodExecutionEvents(BaseParallelizationTest.java:532) at test.thread.parallelization.BaseParallelizationTest.verifySimultaneousTestMethods(BaseParallelizationTest.java:334) at test.thread.parallelization.ParallelByMethodsTestCase2Scenario1.verifyThatTestMethodsRunInParallelThreads(ParallelByMethodsTestCase2Scenario1.java:351) ... Removed 27 stack frames * ERROR: dev-java/testng-6.11::gentoo failed (test phase): * Running TestNG failed. * * Call stack: * ebuild.sh, line 136: Called src_test * environment, line 2554: Called java-pkg-simple_src_test * environment, line 1070: Called etestng '-classpath' 'target/test-classes:testng.jar:/var/tmp/portage/dev-java/testng-6.11/distdir/spock-core-1.0-groovy-2.4.jar:/var/tmp/portage/dev-java/testng-6.11/distdir/groovy-all-2.4.7.jar:/usr/share/assertj-core-3/lib/assertj-core.jar:/usr/share/byte-buddy/lib/byte-buddy-agent.jar:/usr/share/byte-buddy/lib/byte-buddy.jar:/usr/share/ant-core/lib/ant.jar:/usr/share/ant-core/lib/ant-bootstrap.jar:/usr/share/ant-core/lib/ant-launcher.jar:/usr/share/bsh/lib/bsh.jar:/usr/share/guice-4/lib/guice.jar:/usr/share/jcommander-1.64/lib/jcommander.jar:/usr/share/junit-4/lib/junit.jar:/usr/share/snakeyaml/lib/snakeyaml.jar:/usr/share/bsf-2.3/lib/bsf.jar:/usr/share/jakarta-servlet-api-4/lib/jakarta-servlet-api.jar:/usr/share/aopalliance-1/lib/aopalliance.jar:/usr/share/asm-9/lib/asm.jar:/usr/share/asm-9/lib/asm-tree.jar:/usr/share/asm-9/lib/asm-analysis.jar:/usr/share/asm-9/lib/asm-commons.jar:/usr/share/asm-9/lib/asm-util.jar:/usr/share/guava/lib/guava.jar:/usr/share/javax-inject/lib/javax-inject.jar:/usr/share/commons-logging/lib/commons-logging.jar:/usr/share/commons-logging/lib/commons-logging-api.jar:/usr/share/commons-logging/lib/commons-logging-adapters.jar:/usr/share/xalan/lib/xalan.jar:/usr/share/hamcrest-core-1.3/lib/hamcrest-core.jar:/usr/share/checker-framework-qual/lib/checker-framework-qual.jar:/usr/share/error-prone-annotations/lib/error-prone-annotations.jar:/usr/share/failureaccess/lib/failureaccess.jar:/usr/share/j2objc-annotations/lib/j2objc-annotations.jar:/usr/share/jsr305/lib/jsr305.jar:/usr/share/bcel/lib/bcel.jar:/usr/share/javacup/lib/javacup.jar:/usr/share/javacup/lib/javacup-runtime.jar:/usr/share/xalan-serializer/lib/xalan-serializer.jar:/usr/share/xerces-2/lib/xerces.jar:/usr/share/commons-lang-3.6/lib/commons-lang.jar:/usr/share/xml-commons-external-1.4/lib/xml-commons-external.jar:/usr/share/xml-commons-resolver/lib/xml-commons-resolver.jar' 'src/test/resources/testng.xml' * environment, line 769: Called die * The specific snippet of code: * java ${args[@]} || die "Running TestNG failed." * * If you need support, post the output of `emerge --info '=dev-java/testng-6.11::gentoo'`, * the complete build log and the output of `emerge -pqv '=dev-java/testng-6.11::gentoo'`. !!! When you file a bug report, please include the following information: GENTOO_VM=openjdk-17 CLASSPATH="" JAVA_HOME="/usr/lib64/openjdk-17" JAVACFLAGS="-source 1.8 -target 1.8" COMPILER="" and of course, the output of emerge --info =testng-6.11 * The complete build log is located at '/var/log/portage/dev-java:testng-6.11:20231202-145859.log'. * For convenience, a symlink to the build log is located at '/var/tmp/portage/dev-java/testng-6.11/temp/build.log'. * The ebuild environment file is located at '/var/tmp/portage/dev-java/testng-6.11/temp/environment'. * Working directory: '/var/tmp/portage/dev-java/testng-6.11/work/testng-6.11' * S: '/var/tmp/portage/dev-java/testng-6.11/work/testng-6.11'