Details
-
Bug
-
Resolution: Unresolved
-
P2: Important
-
None
-
dev, 6.8
-
None
-
Android
Description
The CI Bot summary seems to be reporting the wrong test failure when integration fails on Android, if a test fails and then passes after the re-run and another test fails, it might report the test that passed instead of the test that actually failed. For example it happens with tst_qvulkan where the report summary starts with:
145526: ********* Start testing of tst_QVulkan ********* FAIL! : tst_QVulkan::vulkanWindowRenderer() 'testVulkan.initSwcResCount == 1' returned FALSE. () Loc: [/home/qt/work/qt/qtbase/tests/auto/gui/qvulkan/tst_qvulkan.cpp(444)] SKIP : tst_QVulkan::vulkanWindowGrab() Fails on Android 12 (QTBUG-105739) Loc: [/home/qt/work/qt/qtbase/tests/auto/gui/qvulkan/tst_qvulkan.cpp(462)] Totals: 6 passed, 1 failed, 3 skipped, 0 blacklisted, 248ms 167076: 425: ****** End logcat crash buffer output ****** Execute /opt/android/sdk/platform-tools/adb uninstall org.qtproject.example.tst_qwidgetrepaintmanager. Success 425: qt-testrunner.py INFO: Test process exited with code: 1 qt-testrunner.py ERROR: XML log file not found: /home/qt/work/testresults/tst_qwidgetrepaintmanager-1724447917744.xml qt-testrunner.py ERROR: exception:FileNotFoundError [Errno 2] No such file or directory: '/home/qt/work/testresults/tst_qwidgetrepaintmanager-1724447917744.xml' qt-testrunner.py ERROR: The test executable probably crashed, see above for details qt-testrunner.py ERROR: Full test run failed repeatedly, aborting! CMake Error at tst_qwidgetrepaintmanagerWrapperRelWithDebInfo.cmake:18 (message):
While it shows both test fails in this summary, it is still misleading that it shows the first test as failing, because checking the test log I can see that tst_qvulkan passed after the re-run.