Details
Description
Recent test runs indicate that tst_opcua:AbsoluteNodeTest is flaky.
Flakiness has been seen on MacOS_10_14, MacOS_10_15, MacOS_11 ARM, MacOS_12 intel, MacOS_12 ARM.
Example of a fail:
agent:2022/06/16 20:37:54 build.go:394: 4: FAIL! : opcua::AbsoluteNodeTest: open62541: Assign int value to double node::test_nodeTest() Compared values are not the same
agent:2022/06/16 20:37:54 build.go:394: 4: Actual (): 2
agent:2022/06/16 20:37:54 build.go:394: 4: Expected (): 1
agent:2022/06/16 20:37:54 build.go:394: 4: Loc: [/Users/qt/work/qt/qtopcua/tests/auto/declarative/AbsoluteNodeTest.qml(440)]
There is a bug, QTBUG-103386, that causes that this flakiness is not visible in the flakyness Grafana dashboards.
Attachments
Issue Links
- relates to
-
QTBUG-103386 A test can FAIL then PASS and no failure will be recorded in the log
-
- Reported
-
- resulted in
-
QTBUG-106656 Test execution retry logic broken for tst_opcua:AbsoluteNodeTest
-
- Reported
-
Gerrit Reviews
For Gerrit Dashboard: QTBUG-104418 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
428408,2 | Blacklist the failing opcua::AbsoluteNodeTest | dev | qt/qtopcua | Status: MERGED | +2 | 0 |
434544,2 | Blacklist the failing opcua::AbsoluteNodeTest | 6.4 | qt/qtopcua | Status: MERGED | +2 | 0 |
517327,2 | Blacklist the failing opcua::AbsoluteNodeTest | tqtc/lts-5.15.16 | qt/tqtc-qtopcua | Status: MERGED | +2 | 0 |
517345,2 | Blacklist the failing opcua::AbsoluteNodeTest | tqtc/lts-5.15 | qt/tqtc-qtopcua | Status: MERGED | +2 | 0 |