Details
-
Bug
-
Resolution: Unresolved
-
P2: Important
-
None
-
master, 1.5
-
None
Description
workitem failed after re-running failed testcase. With first run there was two functions failing:
FAIL! : tst_HoverHandler::deviceCursor(synth, tablet wins) FAIL! : tst_HoverHandler::deviceCursor(synth, mouse wins)
No with re-runs only
FAIL! : tst_HoverHandler::deviceCursor(synth, tablet wins)
kept failing.
Even that the test failed, tests functions was marked as flaky in influxdb.
Now when COIN parses the testresult XML files it checks for testcase name and test function name. In this specific case the test function names were the same. So even if the deviceCursor() kept failing, deviceCursor was also among the passed test functions so COIN considers it as flaky. Which is wrong.
Attachments
Issue Links
- is duplicated by
-
COIN-1057 Failed tests classified as flaky
- Closed