Details
-
Technical task
-
Resolution: Fixed
-
P2: Important
-
None
-
None
-
None
Description
Needs to verify what makes Testcase names unique
- testname = test_executable + test_function + test_datatag
- sometimes there isn't test datatag because it's only in use if there's many variations of the same test
Fond out there's same test with same DataTag tested twice or even over 300 times - even though test is PASS in first run.
This causes some obstacles for XML parsing and sending results to DB
Obstacles:
- Retesting
- Not sure which of those are retested?
- Or how many times retested?
- Testname uniqueness
- Might need new name addition to make testnames unique
- Not yet sure which solution works the best - tests not yet that familiar
Some tests are tested 56, 361 or 625 times - Could need more unique testnames to separate them
This 625 is having same DataTag content in every test run (XML file attached)
grep "[CDATA[exhaustive]]" ./temp_folder/tst_qquaternion-1664035244811.xml | wc -l
625
Possible fix:
- If "exhaustive" would be made more unique like in other tests, could fix this issue
- Test to verify this in future: New test verification to check that DataTags are unique
Attachments
Issue Links
- relates to
-
QTBUG-107185 Some tests appear to be re-testing the exact same data tag
- Closed
-
QTBUG-124349 Duplicate data tags in tst_QVariant::compareNumerics()
- Closed
- resulted in
-
QTBUG-107185 Some tests appear to be re-testing the exact same data tag
- Closed