Bug 872323

Summary:	net-misc/frr-8.2.2 doesn't output test results to test-suite.log
Product:	Gentoo Linux	Reporter:	Agostino Sarubbo <ago>
Component:	Current packages	Assignee:	Alarig Le Lay <alarig>
Status:	CONFIRMED ---
Severity:	normal	CC:	jaco, matoro_bugzilla_gentoo, proxy-maint
Priority:	Normal
Version:	unspecified
Hardware:	All
OS:	Linux
Whiteboard:
Package list:		Runtime testing required:	---
Attachments:	build.log

Description Agostino Sarubbo gentoo-dev

2022-09-22 09:28:24 UTC

https://blogs.gentoo.org/ago/2020/07/04/gentoo-tinderbox/

Issue: net-misc/frr-8.2.2 passed test suite but did not execute any tests.
Discovered on: amd64 (internal ref: tinderbox_musl)

NOTE:
This machine uses MUSL libc

Comment 1 Agostino Sarubbo gentoo-dev

2022-09-22 09:28:27 UTC

Created attachment 813487 [details]
build.log

build log and emerge --info

Comment 2 Jakov Smolić archtester

2022-09-22 10:58:25 UTC

Tests are being executed and pass correctly looking at the build log, but I guess it doesn't output the final results in the test-suite.log, which is what the QA check is looking for I guess. 

It looks like there is another file generated that contains test results

> - generated xml file: /var/tmp/portage/net-misc/frr-8.2.2/work/frr-frr->8.2.2/tests/tests.xml -

Maybe the QA check can be updated to look for these files as well (I'm not really sure if the same thing is happening with any other package in the tree, so it might also be a build system bug in frr...)

Comment 3 matoro archtester

2022-09-22 16:05:22 UTC

While technically true that the main test suite is invoked via run_tests.py which doesn't output in test-suite.log, there are some optional tests under pceplib/test that are executed based on an automagic dep on dev-util/cunit.  Add that as a dep and we kill two birds with one stone - increase test suite coverage and get rid of the warning.