Details
-
Bug
-
Resolution: Done
-
P1: Critical
-
5.12, 5.15
-
None
-
Linux/X11
-
21
-
Qt6_Foundation_Sprint 17
Description
This a new instance of the bug report instead of reopening one related QTBUG-58713.
Many platforms have this bug blacklisted. Is it possible to fix the root cause of flaky failures?
Here is the log from the incident
Coin task #1: http://coin/coin/integration/qt/qtbase/tasks/1583395375
Host OS version: Ubuntu_18_04, target OS version QEMU. GCC compiler
********* Start testing of tst_QElapsedTimer ********* Config: Using QtTest library 5.12.8, Qt 5.12.8 (arm64-little_endian-lp64 shared (dynamic) release build; by GCC 6.4.0) PASS : tst_QElapsedTimer::initTestCase() QDEBUG : tst_QElapsedTimer::statics() Clock type is 1 QDEBUG : tst_QElapsedTimer::statics() Said clock is monotonic QDEBUG : tst_QElapsedTimer::statics() Current time is 460416 PASS : tst_QElapsedTimer::statics() PASS : tst_QElapsedTimer::validity() QDEBUG : tst_QElapsedTimer::basics() value1: 460418 t1: (460418) QDEBUG : tst_QElapsedTimer::basics() value2: 460419 t1: (460419) elapsed: 1 nsecs: 1139548 PASS : tst_QElapsedTimer::basics() FAIL! : tst_QElapsedTimer::elapsed() 'elapsed < 3*minResolution' returned FALSE. () Loc: [tst_qelapsedtimer.cpp(132)] PASS : tst_QElapsedTimer::cleanupTestCase() Totals: 5 passed, 1 failed, 0 skipped, 0 blacklisted, 539ms ********* Finished testing of tst_QElapsedTimer ********* ... ********* Start testing of tst_QElapsedTimer ********* Config: Using QtTest library 5.12.8, Qt 5.12.8 (arm64-little_endian-lp64 shared (dynamic) release build; by GCC 6.4.0) PASS : tst_QElapsedTimer::initTestCase() PASS : tst_QElapsedTimer::elapsed() PASS : tst_QElapsedTimer::cleanupTestCase() Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 238ms ********* Finished testing of tst_QElapsedTimer ********* ... ********* Start testing of tst_QElapsedTimer ********* Config: Using QtTest library 5.12.8, Qt 5.12.8 (arm64-little_endian-lp64 shared (dynamic) release build; by GCC 6.4.0) PASS : tst_QElapsedTimer::initTestCase() FAIL! : tst_QElapsedTimer::elapsed() 'elapsed < 3*minResolution' returned FALSE. () Loc: [tst_qelapsedtimer.cpp(132)] PASS : tst_QElapsedTimer::cleanupTestCase() Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 644ms ********* Finished testing of tst_QElapsedTimer *********
Externally accessible log: https://testresults.qt.io/coin/integration/qt/qtbase/tasks/1583395375
The wanted action
- Please delegate this task to a suitable developer
- Fix the autotest flakiness in all affected versions, not just one.
- Cherry-pick the fix to all relevant branches
- Mark the fix versions to Jira
- Try to fix the actual issue instead of just blacklisting the test function
Guidelines for debugging
Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues
How to locate the failed flaky test:
Please open the link to the Grafana dashboard showing the failure history of the test:
Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances.
Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs.