Details
-
Bug
-
Resolution: Done
-
P1: Critical
-
5.15.10, 6.4
-
None
-
383368a321 (qt/qtbase/dev) 383368a321 (qt/tqtc-qtbase/dev) 2c6ac19595 (qt/qtbase/6.3) 2c6ac19595 (qt/tqtc-qtbase/6.3) 2c6ac19595 (qt/qtbase/6.3.1) 2c6ac19595 (qt/tqtc-qtbase/6.3.1) 1bdf2799eb (qt/tqtc-qtbase/6.2)
Description
If a test case uses global data tags, then those data tags are listed when running the test case via -datatags, e.g.
vohi@global/qlogging$ ./tst_qmessagelogger -datatags tst_QMessageLogger logMessage __global__ debug tst_QMessageLogger logMessage __global__ info tst_QMessageLogger logMessage __global__ warning tst_QMessageLogger logMessage __global__ critical tst_QMessageLogger logMessage __global__ stream debug tst_QMessageLogger logMessage __global__ stream info tst_QMessageLogger logMessage __global__ stream warning tst_QMessageLogger logMessage __global__ stream critical tst_QMessageLogger logMessageWithLoggingCategory __global__ debug tst_QMessageLogger logMessageWithLoggingCategory __global__ info tst_QMessageLogger logMessageWithLoggingCategory __global__ warning tst_QMessageLogger logMessageWithLoggingCategory __global__ critical tst_QMessageLogger logMessageWithLoggingCategory __global__ stream debug tst_QMessageLogger logMessageWithLoggingCategory __global__ stream info tst_QMessageLogger logMessageWithLoggingCategory __global__ stream warning tst_QMessageLogger logMessageWithLoggingCategory __global__ stream critical tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ debug tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ info tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ warning tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ critical tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream debug tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream info tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream warning tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream critical tst_QMessageLogger logMessageWithCategoryFunction __global__ debug tst_QMessageLogger logMessageWithCategoryFunction __global__ info tst_QMessageLogger logMessageWithCategoryFunction __global__ warning tst_QMessageLogger logMessageWithCategoryFunction __global__ critical tst_QMessageLogger logMessageWithCategoryFunction __global__ stream debug tst_QMessageLogger logMessageWithCategoryFunction __global__ stream info tst_QMessageLogger logMessageWithCategoryFunction __global__ stream warning tst_QMessageLogger logMessageWithCategoryFunction __global__ stream critical tst_QMessageLogger logMessageWithNoDebug __global__ debug tst_QMessageLogger logMessageWithNoDebug __global__ info tst_QMessageLogger logMessageWithNoDebug __global__ warning tst_QMessageLogger logMessageWithNoDebug __global__ critical tst_QMessageLogger logMessageWithNoDebug __global__ stream debug tst_QMessageLogger logMessageWithNoDebug __global__ stream info tst_QMessageLogger logMessageWithNoDebug __global__ stream warning tst_QMessageLogger logMessageWithNoDebug __global__ stream critical
However, it's not possible to run any of the test functions with a specific global data tag, e.g.
vohi@global/qlogging$ ./tst_qmessagelogger logMessageWithNoDebug:critical ********* Start testing of tst_QMessageLogger ********* Config: Using QtTest library 6.4.0, Qt 6.4.0 (x86_64-little_endian-lp64 shared (dynamic) debug build; by Clang 12.0.0 (clang-1200.0.32.29) (Apple)), macos 10.15 PASS : tst_QMessageLogger::initTestCase() Unknown testdata for function logMessageWithNoDebug(): 'critical' Function has no testdata. PASS : tst_QMessageLogger::cleanupTestCase(debug) Totals: 2 passed, 0 failed, 0 skipped, 0 blacklisted, 1ms ********* Finished testing of tst_QMessageLogger *********
Note that these test functions don't provide local data tags.
This is inconvenient, and breaks (at least) the test runner script, as it tries to rerun failing test with the tag that failed, which then doesn't work. Hence P1, as the QtSpeech unit test relies on this feature, and currently tests are failing, then fail to re-run, but the test runner interprets the test as a pass anyway.
Attachments
Issue Links
- relates to
-
QTBUG-100870 QtTestLib's blacklisting doesn't take global data tags into account
- Closed
For Gerrit Dashboard: QTBUG-102269 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
404297,6 | Support test-case selection based on global data tag | dev | qt/qtbase | Status: MERGED | +2 | 0 |
412122,4 | Support test-case selection based on global data tag | 6.3 | qt/qtbase | Status: MERGED | +2 | 0 |
419932,3 | Support test-case selection based on global data tag | tqtc/lts-6.2 | qt/tqtc-qtbase | Status: MERGED | +2 | 0 |