Created attachment 407274 [details] build log make[3]: Entering directory '/var/tmp/portage/dev-libs/libgdata-0.16.1/work/libgdata-0.16.1/gdata/tests' /comparable: OK /tests/xml_comparison: OK /service/network_error: < HTTP/1.1 2 Error resolving 'thisshouldnotexist.localhost': Name or service not known < Soup-Debug-Timestamp: 1437408938 < Soup-Debug: SoupMessage 0 (0x1200a91a0) OK /service/locale: OK /entry/get_xml: OK /entry/get_json: OK /entry/parse_xml: Unhandled XML in GDataEntry: <foobar>Test!</foobar> Unhandled XML in GDataEntry: <barfoo shizzle="zing"/> Unhandled XML in GDataEntry: <ns:barfoo shizzle="zing" fo="shizzle">How about some characters‽</ns:barfoo> libgdata-Message: Parsable: <?xml version='1.0' encoding='UTF-8'?><entry xmlns='http://www.w3.org/2005/Atom' xmlns:gd='http://schemas.google.com/g/2005' xmlns:ns='http://example.com/'><title type='text'>Testing unhandled XML</title><updated>2009-01-25T14:07:37Z</updated><published>2009-01-23T14:06:37Z</published><content type='text'>Here we test unhandled XML elements.</content><foobar>Test!</foobar><barfoo shizzle="zing"/><ns:barfoo shizzle="zing" fo="shizzle">How about some characters?</ns:barfoo></entry> Expected: <?xml version='1.0' encoding='UTF-8'?><entry xmlns='http://www.w3.org/2005/Atom' xmlns:gd='http://schemas.google.com/g/2005' xmlns:ns='http://example.com/'><title type='text'>Testing unhandled XML</title><updated>2009-01-25T14:07:37.000001+00:00</updated><published>2009-01-23T14:06:37.000001+00:00</published><content type='text'>Here we test unhandled XML elements.</content><foobar>Test!</foobar><barfoo shizzle="zing"/><ns:barfoo shizzle="zing" fo="shizzle">How about some characters?</ns:barfoo></entry> ** libgdata:ERROR:general.c:537:test_entry_parse_xml: assertion failed: (_test_success == TRUE) FAIL GTester: last random seed: R02Sc454a005cb356e88b01d2e0dc8969ec4 /bin/sh: line 1: 23486 Terminated gtester --verbose general perf calendar client-login-authorizer contacts documents oauth1-authorizer picasaweb youtube Makefile:1620: recipe for target 'test' failed make[2]: *** [test] Error 143 make[2]: *** Waiting for unfinished jobs.... ../../build-aux/test-driver: line 95: 23570 Aborted "$@" > $log_file 2>&1 FAIL: general ../../build-aux/test-driver: line 95: 23569 Aborted "$@" > $log_file 2>&1 FAIL: calendar ../../build-aux/test-driver: line 95: 24188 Aborted "$@" > $log_file 2>&1 FAIL: tasks PASS: contacts ../../build-aux/test-driver: line 95: 23568 Aborted "$@" > $log_file 2>&1 FAIL: youtube PASS: authorization PASS: picasaweb PASS: documents PASS: perf PASS: oauth1-authorizer PASS: client-login-authorizer PASS: streams make[4]: Entering directory '/var/tmp/portage/dev-libs/libgdata-0.16.1/work/libgdata-0.16.1/gdata/tests' make[4]: Nothing to be done for 'all'. make[4]: Leaving directory '/var/tmp/portage/dev-libs/libgdata-0.16.1/work/libgdata-0.16.1/gdata/tests' ============================================================================ Testsuite summary for libgdata 0.16.1 ============================================================================ # TOTAL: 12 # PASS: 8 # SKIP: 0 # XFAIL: 0 # FAIL: 4 # XPASS: 0 # ERROR: 0 ============================================================================ See gdata/tests/test-suite.log Please report to https://bugzilla.gnome.org/enter_bug.cgi?product=libgdata ============================================================================ Makefile:1234: recipe for target 'test-suite.log' failed ERROR: youtube - missing test plan ERROR: youtube - exited with status 134 (terminated by signal 6?) PASS: streams 14 /upload-stream/resumable/content-only/subsequent-error/1048576 PASS: streams 15 /upload-stream/resumable/content-only/subsequent-error/1049600 ERROR: perf - missing test plan ERROR: perf - exited with status 134 (terminated by signal 6?) How do youw ant to proceed
Reading the XML output, it looks like there is a problem the date serialization. The actual output does not have fractions of milliseconds. I don't know whether this is the responsability of libgdata to serialize this or if the problem comes from elsewhere. Could you also check libgdata-0.17.1 ?
0.17.1 fails, too: make check-TESTS check-local make[2]: Entering directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' make[3]: Entering directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' PASS: general ../../build-aux/test-driver: line 107: 25659 Trace/breakpoint trap "$@" > $log_file 2>&1 FAIL: calendar PASS: authorization ../../build-aux/test-driver: line 107: 25653 Trace/breakpoint trap "$@" > $log_file 2>&1 FAIL: contacts ../../build-aux/test-driver: line 107: 25654 Trace/breakpoint trap "$@" > $log_file 2>&1 FAIL: picasaweb PASS: tasks ../../build-aux/test-driver: line 107: 25862 Trace/breakpoint trap "$@" > $log_file 2>&1 FAIL: oauth1-authorizer PASS: oauth2-authorizer ../../build-aux/test-driver: line 107: 25843 Trace/breakpoint trap "$@" > $log_file 2>&1 FAIL: client-login-authorizer PASS: perf make[4]: Entering directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' make[4]: Nothing to be done for 'all'. make[4]: Leaving directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' ============================================================================ Testsuite summary for libgdata 0.17.1 ============================================================================ # TOTAL: 10 # PASS: 5 # SKIP: 0 # XFAIL: 0 # FAIL: 5 # XPASS: 0 # ERROR: 0 ============================================================================ See gdata/tests/test-suite.log Please report to https://bugzilla.gnome.org/enter_bug.cgi?product=libgdata ============================================================================ Makefile:1286: recipe for target 'test-suite.log' failed make[3]: *** [test-suite.log] Error 1 make[3]: Leaving directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' Makefile:1392: recipe for target 'check-TESTS' failed make[2]: *** [check-TESTS] Error 2 make[2]: Leaving directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' Makefile:1528: recipe for target 'check-am' failed make[1]: *** [check-am] Error 2 make[1]: Leaving directory '/var/tmp/portage/dev-libs/libgdata-0.17.1/work/libgdata-0.17.1/gdata/tests' Makefile:3225: recipe for target 'check-recursive' failed make: *** [check-recursive] Error 1 The logfiles didn't look useful to me. Still, I tarred up the workdir and put it here: http://skade.schwarzvogel.de/~klausman/libgdata-workdir.tar.bz2
If still valid with 0.17.5 it would be interesting to report it to upstream, otherwise I wonder if it will be fixed ever :/ -> bugzilla.gnome.org
Preliminary note, from profiles/arch/alpha/package.use.mask: # Pacho Ramos <pacho@gentoo.org> (11 Nov 2014) # Missing keywords, bug #523686 >=dev-libs/libgdata-0.16.1 test So we wouldn't even run the tests now, but for the wrong reasons (the deps are all there). So I removed that USE-mask locally and ran the tests again. [...] ERROR: youtube - too few tests run (expected 49, got 38) ERROR: youtube - exited with status 134 (terminated by signal 6?) ERROR: perf - too few tests run (expected 1, got 0) ERROR: perf - exited with status 134 (terminated by signal 6?) [...] # TOTAL: 386 # PASS: 382 # SKIP: 0 # XFAIL: 0 # FAIL: 0 # XPASS: 0 # ERROR: 4 Attached is work/libgdata-0.17.5/gdata/tests/test-suite.log.
Created attachment 439664 [details] libgdata test suite log.
Filed upstream bug at $URL.
I re-ran the tests today (for 0.17.6) and it looks like the whole test suite is just flaky, though sandboxing seems to make failures slightly more likely. Our best bet is probably to just keep FEATURES=test masked on alpha an move on. Feel free to reopen if you'd like to dig deeper.
Can you retest with 0.17.7? Albeit pretty sure they now fail on amd64 too that I need to investigate, but maybe the tests that failed before now pass? (streams now fails for me with 0.17.7 and tests passed with 0.17.6, but same day, maybe hit some API key limit inbetween)
(In reply to Mart Raudsepp from comment #8) > Can you retest with 0.17.7? Albeit pretty sure they now fail on amd64 too > that I need to investigate, but maybe the tests that failed before now pass? > (streams now fails for me with 0.17.7 and tests passed with 0.17.6, but same > day, maybe hit some API key limit inbetween) Still fails the same way ("Too few tests were run...") with 0.17.7 on alpha.
For youtube, perf and streams, or just streams?
Created attachment 467120 [details] build/test log, v0.17.7 (In reply to Mart Raudsepp from comment #10) > For youtube, perf and streams, or just streams? Just streams: PASS: calendar 10 /calendar/query/own_calendars/async PASS: contacts 18 /contacts/photo/has_photo PASS: contacts 19 /contacts/photo/add PASS: calendar 11 /calendar/query/own_calendars/async/progress_closure ERROR: streams - too few tests run (expected 46, got 0) ERROR: streams - exited with status 133 (terminated by signal 5?) PASS: contacts 20 /contacts/photo/get PASS: calendar 12 /calendar/query/own_calendars/async/cancellation PASS: contacts 21 /contacts/photo/delete
streams test should work if libsoup is upgraded to 2.56.0; upstream will make it skip the TLS part if it's older
(In reply to Mart Raudsepp from comment #12) > streams test should work if libsoup is upgraded to 2.56.0; upstream will > make it skip the TLS part if it's older Fails exactly the same way with =net-libs/libsoup-2.56.0
Created attachment 467126 [details] build/test log, v0.17.7, with =net-libs/libsoup-2.56.0
Created attachment 467128 [details] test-suite.log, v0.17.7, with =net-libs/libsoup-2.56.0
Tests pass now except for 'perf' > ERROR: perf - Bail out! libgdata:ERROR:perf.c:107:test_perf_parsing: assertion failed (per_iteration_time < 2000): (2477 < 2000)
