Details
-
Epic
-
Resolution: Unresolved
-
P2: Important
-
None
-
None
-
None
-
Categorize flaky/random fails in CI
Description
Currently in is unclear if a flakiness is due to "bad test case" or "inconsistent CI system". Categorizing would help identifying the improvement actions. Categorization would also make the follow-up easier, to see if improvement actions made any differences.
Known reasons for a fail:
- test fails
- test fails because of test specific timeout
- test crashes
- test execution is stopped because no output in the log for 15 minutes
- VM appears to be frozen
- max test execution timeout reaches (max VM lifetime)
example of crashes:
Attachments
Issue Links
- mentioned in
-
Page Loading...