Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-82582

Q12020 Flaky failing autotest function notifySignals in qmediaobject

    XMLWordPrintable

    Details

    • Platform/s:
      Linux/X11, Windows
    • Commits:
      a7f0ba8c2d64dcb942069a6fd5ea17166b3b7a6d (qt/qtmultimedia/5.14) e27ba234274a2a3325241db58a3da908952c603a (qt/qtmultimedia/dev)

      Description

      The wanted action

      • Fix the autotest flakiness in all affected versions, not just one. 
      • Please delegate this task to a suitable developer

      Guidelines for debugging

      Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

      How to locate the failed flaky test:

      Please open the link to the Grafana dashboard showing the failure history of the test:

      https://testresults.qt.io/grafana/d/5GKDJSPZz/02-qt-framework-please-fix-these-flaky-tests-random-fails?orgId=1&from=now-30d&to=now&var-project=qt%2Fqtmultimedia&var-testcase=tests%2Fauto%2Funit%2Fqmediaobject&var-testfunction=notifySignals&var-branch=5.12&var-branch=5.13&var-branch=5.14&var-branch=5.15&var-branch=5.9&var-branch=dev&var-inter=24h

      Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

      Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. There are two versions of the links. The first one is for the Qt company internal use allowing you to re-schedule build for debugging. The second one is public, allowing only to browse the logs.

      List of the incidents: 

      The Coin log shows details and the location of the error message in it. At need, the raw log can be opened to see the entire log at once. 

      Example log:

      Here is an example of the log from the incident 6:

      Public link to the log: https://testresults.qt.io/coin/logview/qt/qtmultimedia/1dcfa6ed65a8a52662c9ee9fd37dd7e3570653a0/LinuxUbuntu_18_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-18.04-x86_64-22d77f/112209028f84c1dba0d04aef767fff68fcad6fa1/test_1582753558

      ********* Start testing of tst_QMediaObject *********Config: Using QtTest library 5.15.0, Qt 5.15.0 (arm-little_endian-ilp32-eabi-hardfloat shared (dynamic) release build; by GCC 8.2.0)PASS : tst_QMediaObject::initTestCase()PASS : tst_QMediaObject::propertyWatch()FAIL! : tst_QMediaObject::notifySignals(single 750ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1165, expected: 1125)Loc: [tst_qmediaobject.cpp(303)]FAIL! : tst_QMediaObject::notifySignals(single 600ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1276, expected: 900)Loc: [tst_qmediaobject.cpp(303)]PASS : tst_QMediaObject::notifySignals(x3 300ms)FAIL! : tst_QMediaObject::notifySignals(x5 180ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1605, expected: 1350)Loc: [tst_qmediaobject.cpp(303)]PASS : tst_QMediaObject::notifyInterval(single 750ms)PASS : tst_QMediaObject::notifyInterval(single 600ms)PASS : tst_QMediaObject::notifyInterval(x3 300ms)PASS : tst_QMediaObject::notifyInterval(x5 180ms)PASS : tst_QMediaObject::nullMetaDataControl()PASS : tst_QMediaObject::isMetaDataAvailable()PASS : tst_QMediaObject::metaDataChanged()PASS : tst_QMediaObject::metaData()PASS : tst_QMediaObject::availability()PASS : tst_QMediaObject::service()PASS : tst_QMediaObject::cleanupTestCase()Totals: 14 passed, 3 failed, 0 skipped, 0 blacklisted, 8245ms********* Finished testing of tst_QMediaObject *********
      

      The keywords for searching the logs are "FAIL!", "re-running" and the test function name itself.

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

              People

              Assignee:
              valentyn.doroshchuk Valentyn Doroshchuk
              Reporter:
              assaarel Asmo Saarela
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: