Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-106656

Test execution retry logic broken for tst_opcua:AbsoluteNodeTest

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P2: Important
    • None
    • 6.5
    • OpcUA
    • None

    Description

      tst_opcua:AbsoluteNodeTest is reported flaky in QTBUG-104418

      The system tries to execute a test 5 times before declaring it failed.
      This doesn't work properly for the tst_opcua, it fails on "Could not find the following test functions":

      agent:2022/09/15 22:36:40 build.go:394: 4: Totals: 82 passed, 1 failed, 0 skipped, 1 blacklisted, 15635ms
      agent:2022/09/15 22:36:40 build.go:394: 4: ********* Finished testing of opcua *********
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py INFO: Test process exited with code: 1
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py INFO: Parsed XML file /Users/qt/work/testresults/tst_opcua-1663281382272.xml in 0.003 seconds
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py INFO: Found 83 passes and 1 failures
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py INFO: Some tests failed, will re-run at most 5 times.
      agent:2022/09/15 22:36:40 build.go:394: 4:
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py INFO: Re-running testcase: AbsoluteNodeTest: open62541: Assign int value to double node::test_nodeTest
      agent:2022/09/15 22:36:40 build.go:394: 4: qt-testrunner.py DEBUG: Running test command line: ['/Users/qt/work/qt/qtopcua_standalone_tests/tests/auto/declarative/tst_opcua', '-import', '/Users/qt/work/qt/qtopcua/tests/auto/declarative/../../../src/plugins/declarative', '-o', '/Users/qt/work/testresults/tst_opcua-1663281400453.xml,xml', '-o', '-,txt', 'AbsoluteNodeTest: open62541: Assign int value to double node::test_nodeTest']
      agent:2022/09/15 22:36:40 build.go:394: 4: Server Path: "/Users/qt/work/qt/qtopcua_standalone_tests/tests/auto/declarative/../../open62541-testserver/open62541-testserver.app/Contents/MacOS/open62541-testserver"
      agent:2022/09/15 22:36:40 build.go:394: 4: Starting test server
      agent:2022/09/15 22:36:42 build.go:394: 4: Could not find the following test functions:
      agent:2022/09/15 22:36:42 build.go:394: 4: AbsoluteNodeTest()
      agent:2022/09/15 22:36:42 build.go:394: 4: qt-testrunner.py INFO: Test process exited with code: 1
      agent:2022/09/15 22:36:42 build.go:394: 4: qt-testrunner.py INFO: Re-running testcase: AbsoluteNodeTest: open62541: Assign int value to double node::test_nodeTest
      agent:2022/09/15 22:36:42 build.go:394: 4: qt-testrunner.py DEBUG: Running test command line: ['/Users/qt/work/qt/qtopcua_standalone_tests/tests/auto/declarative/tst_opcua', '-import', '/Users/qt/work/qt/qtopcua/tests/auto/declarative/../../../src/plugins/declarative', '-o', '/Users/qt/work/testresults/tst_opcua-1663281402828.xml,xml', '-o', '-,txt', 'AbsoluteNodeTest: open62541: Assign int value to double node::test_nodeTest']
      agent:2022/09/15 22:36:42 build.go:394: 4: Server Path: "/Users/qt/work/qt/qtopcua_standalone_tests/tests/auto/declarative/../../open62541-testserver/open62541-testserver.app/Contents/MacOS/open62541-testserver"

      Full log: https://testresults.qt.io/coin/api/results/qt/qtopcua/517be9ecbcd233cf2151ab4d7900f4369cb3dec6/MacOSMacOS_10_15x86_64MacOSMacOS_10_15x86_64Clangqtci-macos-10.15-x86_64-102-da9aadSccache_TestOnly/87fe524a5c43acae36e6125b3ce6264db17e7668/test_1670075932/log.txt.gz

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              fmeerkoetter Frank Meerkötter
              jujokini Jukka Jokiniva
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes