Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-82983

Q12020 Flaky failing autotest function basicFunctions in modelreplica



    • Type: Bug
    • Status: Reported
    • Priority: P1: Critical
    • Resolution: Unresolved
    • Affects Version/s: 5.14, 5.15
    • Fix Version/s: None
    • Component/s: Remote Objects
    • Labels:
    • Platform/s:
      Linux/X11, macOS


      When processing this issue, please have a look at the old issue for the same test binary.

      https://bugreports.qt.io/browse/QTBUG-72789 If that is no longer valid, please close it.


      Here is the log from the incident

      Coin task #1: http://coin/coin/integration/qt/qtremoteobjects/tasks/1584374474

      Host OS versions: macOS_10_13, Ubuntu_18_04. Target OS versions: macOS_10_13, QEMU, GCC and Clang compilers

      Log #1: http://coin/coin/logview/qt/qtremoteobjects/d2073f2aa3d62a2a4bd6b77504cabb02b1cb2753/MacOSMacOS_10_13x86_64MacOSMacOS_10_13x86_64Clangqtci-macos-10.13-x86_64-2-dc4a1e/6abdf457db9cf8cf905f9a890fac27266367e38c/test_1584374536

      ********* Start testing of ModelreplicaTest *********
      Config: Using QtTest library 5.14.2, Qt 5.14.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by Clang 10.0.0 (clang-1000.11.45.5) (Apple))
      PASS : ModelreplicaTest::initTestCase()
      QWARN : ModelreplicaTest::basicFunctions(non-templated enableRemoting) qt.remoteobjects: "localhost" is not an IP address, trying to resolve it
      PASS : ModelreplicaTest::basicFunctions(non-templated enableRemoting)
      QWARN : ModelreplicaTest::basicFunctions(templated enableRemoting) qt.remoteobjects: "localhost" is not an IP address, trying to resolve it
      FAIL! : ModelreplicaTest::basicFunctions(templated enableRemoting) Compared values are not the same
      Actual (model->data(model->index(i), Qt::DisplayRole)) : QVariant(QString,Track1)
      Expected (replica->tracks()->data(replica->tracks()->index(i, 0))): QVariant()
      Loc: [tst_modelreplicatest.cpp(87)]
      QWARN : ModelreplicaTest::nullModel() qt.remoteobjects: "localhost" is not an IP address, trying to resolve it
      QWARN : ModelreplicaTest::nullModel() qt.remoteobjects: QRemoteObjectSourceBase: Cannot replicate a NULL object "tracks"
      PASS : ModelreplicaTest::nullModel()
      PASS : ModelreplicaTest::cleanupTestCase()
      Totals: 4 passed, 1 failed, 0 skipped, 0 blacklisted, 1552ms
      ********* Finished testing of ModelreplicaTest *********

      Externally accessible log: http://testresults.qt.io/coin/integration/qt/qtremoteobjects/tasks/1584374474

      The wanted action

      • Please delegate this task to a suitable developer
      • Fix the autotest flakiness in all affected versions, not just one. 
      • Cherry-pick the fix to all relevant branches
      • Mark the fix versions to Jira
      • Try to fix the actual issue instead of just blacklisting the test function

      Guidelines for debugging

      Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

      How to locate the failed flaky test:

      Please open the link to the Grafana dashboard showing the failure history of the test:


      Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

      Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. 

      Need to know more about the test binary execution history?

      Please see this Grafana dashboard: 



        No reviews matched the request. Check your Options in the drop-down menu of this sections header.



            bstottle Brett Stottlemyer
            assaarel Asmo Saarela
            0 Vote for this issue
            1 Start watching this issue



                Gerrit Reviews

                There are no open Gerrit changes