Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-102269

Test cases can't be called with a global data tag

    XMLWordPrintable

Details

    • 383368a321 (qt/qtbase/dev) 383368a321 (qt/tqtc-qtbase/dev) 2c6ac19595 (qt/qtbase/6.3) 2c6ac19595 (qt/tqtc-qtbase/6.3) 2c6ac19595 (qt/qtbase/6.3.1) 2c6ac19595 (qt/tqtc-qtbase/6.3.1) 1bdf2799eb (qt/tqtc-qtbase/6.2)

    Description

      If a test case uses global data tags, then those data tags are listed when running the test case via -datatags, e.g.

      vohi@global/qlogging$ ./tst_qmessagelogger -datatags
      tst_QMessageLogger logMessage __global__ debug
      tst_QMessageLogger logMessage __global__ info
      tst_QMessageLogger logMessage __global__ warning
      tst_QMessageLogger logMessage __global__ critical
      tst_QMessageLogger logMessage __global__ stream debug
      tst_QMessageLogger logMessage __global__ stream info
      tst_QMessageLogger logMessage __global__ stream warning
      tst_QMessageLogger logMessage __global__ stream critical
      tst_QMessageLogger logMessageWithLoggingCategory __global__ debug
      tst_QMessageLogger logMessageWithLoggingCategory __global__ info
      tst_QMessageLogger logMessageWithLoggingCategory __global__ warning
      tst_QMessageLogger logMessageWithLoggingCategory __global__ critical
      tst_QMessageLogger logMessageWithLoggingCategory __global__ stream debug
      tst_QMessageLogger logMessageWithLoggingCategory __global__ stream info
      tst_QMessageLogger logMessageWithLoggingCategory __global__ stream warning
      tst_QMessageLogger logMessageWithLoggingCategory __global__ stream critical
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ debug
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ info
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ warning
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ critical
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream debug
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream info
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream warning
      tst_QMessageLogger logMessageWithLoggingCategoryDisabled __global__ stream critical
      tst_QMessageLogger logMessageWithCategoryFunction __global__ debug
      tst_QMessageLogger logMessageWithCategoryFunction __global__ info
      tst_QMessageLogger logMessageWithCategoryFunction __global__ warning
      tst_QMessageLogger logMessageWithCategoryFunction __global__ critical
      tst_QMessageLogger logMessageWithCategoryFunction __global__ stream debug
      tst_QMessageLogger logMessageWithCategoryFunction __global__ stream info
      tst_QMessageLogger logMessageWithCategoryFunction __global__ stream warning
      tst_QMessageLogger logMessageWithCategoryFunction __global__ stream critical
      tst_QMessageLogger logMessageWithNoDebug __global__ debug
      tst_QMessageLogger logMessageWithNoDebug __global__ info
      tst_QMessageLogger logMessageWithNoDebug __global__ warning
      tst_QMessageLogger logMessageWithNoDebug __global__ critical
      tst_QMessageLogger logMessageWithNoDebug __global__ stream debug
      tst_QMessageLogger logMessageWithNoDebug __global__ stream info
      tst_QMessageLogger logMessageWithNoDebug __global__ stream warning
      tst_QMessageLogger logMessageWithNoDebug __global__ stream critical
      

      However, it's not possible to run any of the test functions with a specific global data tag, e.g.

      vohi@global/qlogging$ ./tst_qmessagelogger logMessageWithNoDebug:critical
      ********* Start testing of tst_QMessageLogger *********
      Config: Using QtTest library 6.4.0, Qt 6.4.0 (x86_64-little_endian-lp64 shared (dynamic) debug build; by Clang 12.0.0 (clang-1200.0.32.29) (Apple)), macos 10.15
      PASS   : tst_QMessageLogger::initTestCase()
      Unknown testdata for function logMessageWithNoDebug(): 'critical'
      Function has no testdata.
      PASS   : tst_QMessageLogger::cleanupTestCase(debug)
      Totals: 2 passed, 0 failed, 0 skipped, 0 blacklisted, 1ms
      ********* Finished testing of tst_QMessageLogger *********
      

      Note that these test functions don't provide local data tags.

      This is inconvenient, and breaks (at least) the test runner script, as it tries to rerun failing test with the tag that failed, which then doesn't work. Hence P1, as the QtSpeech unit test relies on this feature, and currently tests are failing, then fail to re-run, but the test runner interprets the test as a pass anyway.

      Attachments

        Issue Links

          For Gerrit Dashboard: QTBUG-102269
          # Subject Branch Project Status CR V

          Activity

            People

              Eddy Edward Welbourne
              vhilshei Volker Hilsheimer
              Vladimir Minenko Vladimir Minenko
              Alex Blasche Alex Blasche
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes