Details
-
Bug
-
Resolution: Unresolved
-
P3: Somewhat important
-
None
-
6.5
-
None
Description
This test is now very flaky on macOS (I see it happening almost always), but it's also blacklisted so integrations are passing.
The error message doesn't always make sense:
agent:2022/07/27 10:07:06 build.go:394: 39: BFAIL : tst_QPauseAnimation::pauseAndPropertyAnimations() QTestLib: This test case check ("(animation.state()) == (QAbstractAnimation::Stopped)") failed because the requested timeout (400 ms) was too short, 400 ms would have been sufficient this time. agent:2022/07/27 10:07:06 build.go:394: 39: Loc: [/Users/qt/work/qt/qtbase/tests/auto/corelib/animation/qpauseanimation/tst_qpauseanimation.cpp(205)]
(400 ms) was too short, 400 ms would have been sufficient this time.
Just pick a random integration from dev and you will most likely see the test failing.
It's not OK to have a stable failure as BFAIL. If it flakes this much, then either the feature is broken or the test is buggy.