Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-5703

Failure to re-run flaky tests that have quotes in the datatag

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • P2: Important
    • None
    • 6.6
    • Test scripts
    • None
    • Android
    • ee874e7ca (dev), b044323c1 (dev), 10a706df2 (dev), 82a40f084 (dev)
    • 2023wk48FOQtforAndroid

    Description

      From https://testresults.qt.io/coin/integration/qt/qtbase/tasks/1695696529

      The test fails with:

      QFATAL : tst_QKeyEvent::modifiers("M","e","t","a") Test function timed out
      FAIL!  : tst_QKeyEvent::modifiers("M","e","t","a") Received a fatal error.
      

      And then the re-run doesn't happen because of some quoting error. Here are all the quoting-relevant lines of the re-run log (backslashes followed by newlines added by me for readability of the important parts):

      234: qt-testrunner.py     INFO: Re-running testcase: modifiers:"M","e","t","a"
      234: qt-testrunner.py    DEBUG: Running test command line: ['/home/qt/work/install/bin/androidtestrunner', '--path', '/home/qt/work/qt/qtbase_standalone_tests/tests/auto/gui/kernel/qkeyevent/android-build', '--adb', '/opt/android/sdk/platform-tools/adb', '--skip-install-root', '--make', '/opt/cmake-3.24.2/bin/cmake --build /home/qt/work/qt/qtbase_standalone_tests --target tst_qkeyevent_make_apk', '--apk', '/home/qt/work/qt/qtbase_standalone_tests/tests/auto/gui/kernel/qkeyevent/android-build/tst_qkeyevent.apk', '--timeout', '-1', '--verbose', '-o', '/home/qt/work/testresults/tst_qkeyevent-1690194535453.xml,xml', '-o', '/home/qt/work/testresults/tst_qkeyevent-1690194535453.junit.xml,junitxml', \
          '-o', '/home/qt/work/testresults/tst_qkeyevent-1690194535453.txt,txt', '-o', '-,txt', 'modifiers:"M","e","t","a"']
      [...]
      234: Execute /opt/android/sdk/platform-tools/adb shell am start \
          -e applicationArguments "'-o output.txt,txt -o output.junitxml,junitxml -o output.xml,xml \"modifiers:"M","e","t","a"\"'" \
          -n org.qtproject.example.tst_qkeyevent/org.qtproject.qt.android.bindings.QtActivity.
      [...]
      234: FAIL!  : tst_QKeyEvent::modifiers() Data tag not found: M,e,t,a
      

      This is /probably/ a bug in the quoting while generating the adb shell command line.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              assam Assam Boudjelthia
              jimis Dimitrios Apostolou
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews