Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-99269

tst_Integration_External test is failing on MacOS-arm64

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • P2: Important
    • 6.2.3, 6.3.0 Alpha
    • 6.3.0 Alpha
    • Remote Objects
    • None
    • macOS
    • 105831732d (qt/qtremoteobjects/dev) 8d7db4f61f (qt/qtremoteobjects/6.3) f32a15c881 (qt/qtremoteobjects/6.2) f32a15c881 (qt/tqtc-qtremoteobjects/6.2) 8d7db4f61f (qt/tqtc-qtremoteobjects/6.3) f32a15c881 (qt/qtremoteobjects/6.2.3)

    Description

      Example output:

      agent:2021/12/16 09:56:34 build.go:394: 18: Test command: /Applications/CMake.app/Contents/bin/cmake "-P" "/Users/qt/work/qt/qtremoteobjects_standalone_tests/tests/auto/integration_external/external/tst_integration_externalWrapperRelWithDebInfo.cmake"
agent:2021/12/16 09:56:34 build.go:394: 18: Test timeout computed to be: 1500
agent:2021/12/16 09:56:34 build.go:394: 18: ********* Start testing of tst_Integration_External *********
agent:2021/12/16 09:56:34 build.go:394: 18: Config: Using QtTest library 6.3.0, Qt 6.3.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Clang 12.0.5 (clang-1205.0.22.11) (Apple)), macos 11.6
agent:2021/12/16 09:56:34 build.go:394: 18: PASS   : tst_Integration_External::initTestCase()
agent:2021/12/16 09:56:34 build.go:394: 18: QDEBUG : tst_Integration_External::testRun(non-templated enableRemoting) Starting server process
agent:2021/12/16 09:56:34 build.go:394: 18: ********* Start testing of tst_Server_Process *********
agent:2021/12/16 09:56:34 build.go:394: 18: Config: Using QtTest library 6.3.0, Qt 6.3.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Clang 12.0.5 (clang-1205.0.22.11) (Apple)), macos 11.6
agent:2021/12/16 09:56:34 build.go:394: 18: PASS   : tst_Server_Process::initTestCase()
agent:2021/12/16 09:56:34 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Server started
agent:2021/12/16 09:56:34 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Waiting for incoming connections
agent:2021/12/16 09:56:34 build.go:394: 18: QDEBUG : tst_Integration_External::testRun(non-templated enableRemoting) Starting client process
agent:2021/12/16 09:56:34 build.go:394: 18: ********* Start testing of tst_Client_Process *********
agent:2021/12/16 09:56:34 build.go:394: 18: Config: Using QtTest library 6.3.0, Qt 6.3.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Clang 12.0.5 (clang-1205.0.22.11) (Apple)), macos 11.6
agent:2021/12/16 09:56:34 build.go:394: 18: PASS   : tst_Client_Process::initTestCase()
agent:2021/12/16 09:56:35 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Client connected
agent:2021/12/16 09:56:35 build.go:394: 18: PASS   : tst_Client_Process::testRun()
agent:2021/12/16 09:56:35 build.go:394: 18: PASS   : tst_Client_Process::testEnumDetails()
agent:2021/12/16 09:56:35 build.go:394: 18: PASS   : tst_Client_Process::testMethodSignalParamDetails()
agent:2021/12/16 09:56:35 build.go:394: 18: PASS   : tst_Client_Process::testMethodSignal()
agent:2021/12/16 09:56:36 build.go:394: 18: FAIL!  : tst_Client_Process::testDisconnect() 'm_rep->state() == QRemoteObjectReplica::Suspect' returned FALSE. ()
agent:2021/12/16 09:56:36 build.go:394: 18:    Loc: [/Users/qt/work/qt/qtremoteobjects/tests/auto/integration_external/client/main.cpp(181)]
agent:2021/12/16 09:56:36 build.go:394: 18: PASS   : tst_Client_Process::cleanupTestCase()
agent:2021/12/16 09:56:36 build.go:394: 18: Totals: 6 passed, 1 failed, 0 skipped, 0 blacklisted, 1555ms
agent:2021/12/16 09:56:36 build.go:394: 18: ********* Finished testing of tst_Client_Process *********
agent:2021/12/16 09:56:36 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Done. Shutting down.
agent:2021/12/16 09:56:36 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Server stopped
agent:2021/12/16 09:56:36 build.go:394: 18: PASS   : tst_Server_Process::testRun()
agent:2021/12/16 09:56:36 build.go:394: 18: PASS   : tst_Server_Process::cleanupTestCase()
agent:2021/12/16 09:56:36 build.go:394: 18: Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 2096ms
agent:2021/12/16 09:56:36 build.go:394: 18: ********* Finished testing of tst_Server_Process *********
agent:2021/12/16 09:56:36 build.go:394: 18: FAIL!  : tst_Integration_External::testRun(non-templated enableRemoting) Compared values are not the same
agent:2021/12/16 09:56:36 build.go:394: 18:    Actual   (clientProc.exitCode()): 1
agent:2021/12/16 09:56:36 build.go:394: 18:    Expected (0)                    : 0
agent:2021/12/16 09:56:36 build.go:394: 18:    Loc: [/Users/qt/work/qt/qtremoteobjects/tests/auto/integration_external/external/tst_integration_external.cpp(89)]
agent:2021/12/16 09:56:36 build.go:394: 18: QDEBUG : tst_Integration_External::testRun(templated enableRemoting) Starting server process
agent:2021/12/16 09:56:36 build.go:394: 18: ********* Start testing of tst_Server_Process *********
agent:2021/12/16 09:56:36 build.go:394: 18: Config: Using QtTest library 6.3.0, Qt 6.3.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Clang 12.0.5 (clang-1205.0.22.11) (Apple)), macos 11.6
agent:2021/12/16 09:56:36 build.go:394: 18: PASS   : tst_Server_Process::initTestCase()
agent:2021/12/16 09:56:36 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Server started
agent:2021/12/16 09:56:36 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Waiting for incoming connections
agent:2021/12/16 09:56:37 build.go:394: 18: QDEBUG : tst_Integration_External::testRun(templated enableRemoting) Starting client process
agent:2021/12/16 09:56:37 build.go:394: 18: ********* Start testing of tst_Client_Process *********
agent:2021/12/16 09:56:37 build.go:394: 18: Config: Using QtTest library 6.3.0, Qt 6.3.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Clang 12.0.5 (clang-1205.0.22.11) (Apple)), macos 11.6
agent:2021/12/16 09:56:37 build.go:394: 18: PASS   : tst_Client_Process::initTestCase()
agent:2021/12/16 09:56:37 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Client connected
agent:2021/12/16 09:56:37 build.go:394: 18: PASS   : tst_Client_Process::testRun()
agent:2021/12/16 09:56:37 build.go:394: 18: PASS   : tst_Client_Process::testEnumDetails()
agent:2021/12/16 09:56:37 build.go:394: 18: PASS   : tst_Client_Process::testMethodSignalParamDetails()
agent:2021/12/16 09:56:38 build.go:394: 18: PASS   : tst_Client_Process::testMethodSignal()
agent:2021/12/16 09:56:38 build.go:394: 18: FAIL!  : tst_Client_Process::testDisconnect() 'm_rep->state() == QRemoteObjectReplica::Suspect' returned FALSE. ()
agent:2021/12/16 09:56:38 build.go:394: 18:    Loc: [/Users/qt/work/qt/qtremoteobjects/tests/auto/integration_external/client/main.cpp(181)]
agent:2021/12/16 09:56:38 build.go:394: 18: PASS   : tst_Client_Process::cleanupTestCase()
agent:2021/12/16 09:56:38 build.go:394: 18: Totals: 6 passed, 1 failed, 0 skipped, 0 blacklisted, 1528ms
agent:2021/12/16 09:56:38 build.go:394: 18: ********* Finished testing of tst_Client_Process *********
agent:2021/12/16 09:56:38 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Done. Shutting down.
agent:2021/12/16 09:56:38 build.go:394: 18: QDEBUG : tst_Server_Process::testRun() Server stopped
agent:2021/12/16 09:56:38 build.go:394: 18: PASS   : tst_Server_Process::testRun()
agent:2021/12/16 09:56:38 build.go:394: 18: PASS   : tst_Server_Process::cleanupTestCase()
agent:2021/12/16 09:56:38 build.go:394: 18: Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 1980ms
agent:2021/12/16 09:56:38 build.go:394: 18: ********* Finished testing of tst_Server_Process *********
agent:2021/12/16 09:56:38 build.go:394: 18: FAIL!  : tst_Integration_External::testRun(templated enableRemoting) Compared values are not the same
agent:2021/12/16 09:56:38 build.go:394: 18:    Actual   (clientProc.exitCode()): 1
agent:2021/12/16 09:56:38 build.go:394: 18:    Expected (0)                    : 0
agent:2021/12/16 09:56:38 build.go:394: 18:    Loc: [/Users/qt/work/qt/qtremoteobjects/tests/auto/integration_external/external/tst_integration_external.cpp(89)]
agent:2021/12/16 09:56:39 build.go:394: 18: PASS   : tst_Integration_External::cleanupTestCase()
agent:2021/12/16 09:56:39 build.go:394: 18: Totals: 2 passed, 2 failed, 0 skipped, 0 blacklisted, 4771ms
agent:2021/12/16 09:56:39 build.go:394: 18: ********* Finished testing of tst_Integration_External *********
agent:2021/12/16 09:56:39 build.go:394: 18: CMake Error at tst_integration_externalWrapperRelWithDebInfo.cmake:17 (message):
agent:2021/12/16 09:56:39 build.go:394: 18:   python3 /Users/qt/work/qt/qtremoteobjects/coin_ctest_runner.py
agent:2021/12/16 09:56:39 build.go:394: 18:   /Users/qt/work/qt/qtremoteobjects_standalone_tests/tests/auto/integration_external/external/tst_integration_external
agent:2021/12/16 09:56:39 build.go:394: 18:   execution failed.
agent:2021/12/16 09:56:39 build.go:394: 18: 
agent:2021/12/16 09:56:39 build.go:394: 18: 
agent:2021/12/16 09:56:39 build.go:394: 18/21 Test #18: tst_integration_external .........***Failed    5.04 sec

      Increasing timeouts in tst_Client_Process::testDisconnect seems to help, but leads to new failures (see the logs from https://codereview.qt-project.org/c/qt/qtremoteobjects/+/386849/)

      Attachments

        For Gerrit Dashboard: QTBUG-99269
        # Subject Branch Project Status CR V
        386849,14 Fix test failures on macOS-arm64 dev qt/qtremoteobjects Status: MERGED +2 0
        387000,2 Fix test failures on macOS-arm64 6.2 qt/qtremoteobjects Status: MERGED +2 0
        387001,2 Fix test failures on macOS-arm64 6.3 qt/qtremoteobjects Status: MERGED +2 0

        Activity

          People

            sonakur Sona Kurazyan
            sonakur Sona Kurazyan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes