Q12020 Flaky failing autotest function notifySignals in qmediaobject

The wanted action

• Fix the autotest flakiness in all affected versions, not just one. 
• Please delegate this task to a suitable developer

Guidelines for debugging

Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

How to locate the failed flaky test:

Please open the link to the Grafana dashboard showing the failure history of the test:

https://testresults.qt.io/grafana/d/5GKDJSPZz/02-qt-framework-please-fix-these-flaky-tests-random-fails?orgId=1&from=now-30d&to=now&var-project=qt%2Fqtmultimedia&var-testcase=tests%2Fauto%2Funit%2Fqmediaobject&var-testfunction=notifySignals&var-branch=5.12&var-branch=5.13&var-branch=5.14&var-branch=5.15&var-branch=5.9&var-branch=dev&var-inter=24h

Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. There are two versions of the links. The first one is for the Qt company internal use allowing you to re-schedule build for debugging. The second one is public, allowing only to browse the logs.

List of the incidents: 

• Incident 1: Qt 5.14: Host Ubuntu_18_04, target QEMU, GCC compiler
  • Internal link: http://coin/coin/integration/qt/qtmultimedia/tasks/1582643285
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1582643285
• Incident 2: Qt 5.15: Host Ubuntu_18_04, target QEMU, GCC compiler
  • Internal link:  http://coin/coin/integration/qt/qtmultimedia/tasks/1582796663
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1582796663
• Incident 3: Qt 5.15: Host Windows_10, target Windows_10, MSVC2017 compiler
  • Internal link: http://coin/coin/integration/qt/qtmultimedia/tasks/1580720340
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1580720340
• Incident 4: Qt 5.15: Host Windows_10, target Windows_10, MSVC2017 compiler
  • Internal link: http://coin/coin/integration/qt/qtmultimedia/tasks/1580906161
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1580906161
• Incident 5: Qt 5.15: Host Ubuntu_18_04, target QEMU, GCC compiler
  • Internal link: http://coin/coin/integration/qt/qtmultimedia/tasks/1582727625
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1582727625
• Incident 6: Qt 5.15: Host Ubuntu_18_04, target QEMU, GCC compiler
  • Internal link: http://coin/coin/integration/qt/qtmultimedia/tasks/1582753534
  • Public link: https://testresults.qt.io/coin/integration/qt/qtmultimedia/tasks/1582753534

The Coin log shows details and the location of the error message in it. At need, the raw log can be opened to see the entire log at once. 

Example log:

Here is an example of the log from the incident 6:

Public link to the log: https://testresults.qt.io/coin/logview/qt/qtmultimedia/1dcfa6ed65a8a52662c9ee9fd37dd7e3570653a0/LinuxUbuntu_18_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-18.04-x86_64-22d77f/112209028f84c1dba0d04aef767fff68fcad6fa1/test_1582753558

********* Start testing of tst_QMediaObject *********Config: Using QtTest library 5.15.0, Qt 5.15.0 (arm-little_endian-ilp32-eabi-hardfloat shared (dynamic) release build; by GCC 8.2.0)PASS : tst_QMediaObject::initTestCase()PASS : tst_QMediaObject::propertyWatch()FAIL! : tst_QMediaObject::notifySignals(single 750ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1165, expected: 1125)Loc: [tst_qmediaobject.cpp(303)]FAIL! : tst_QMediaObject::notifySignals(single 600ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1276, expected: 900)Loc: [tst_qmediaobject.cpp(303)]PASS : tst_QMediaObject::notifySignals(x3 300ms)FAIL! : tst_QMediaObject::notifySignals(x5 180ms) 'elapsed < expectedElapsed' returned FALSE. (elapsed: 1605, expected: 1350)Loc: [tst_qmediaobject.cpp(303)]PASS : tst_QMediaObject::notifyInterval(single 750ms)PASS : tst_QMediaObject::notifyInterval(single 600ms)PASS : tst_QMediaObject::notifyInterval(x3 300ms)PASS : tst_QMediaObject::notifyInterval(x5 180ms)PASS : tst_QMediaObject::nullMetaDataControl()PASS : tst_QMediaObject::isMetaDataAvailable()PASS : tst_QMediaObject::metaDataChanged()PASS : tst_QMediaObject::metaData()PASS : tst_QMediaObject::availability()PASS : tst_QMediaObject::service()PASS : tst_QMediaObject::cleanupTestCase()Totals: 14 passed, 3 failed, 0 skipped, 0 blacklisted, 8245ms********* Finished testing of tst_QMediaObject *********

The keywords for searching the logs are "FAIL!", "re-running" and the test function name itself.