Details
-
Sub-task
-
Resolution: Done
-
P2: Important
-
None
-
9b2971cbb4ebf102198c2320a575e2fd718c182e (qtbase), 5572b4c9ed6041d23c79c9cd93d196653a690a43 (qtdeclarative)
Description
There are three problems with counting test results for data-driven tests:
1. If a test function passes for all data rows, that is counted as one pass, but each skipped or failed row counts as one skip or fail.
2. Only skipped and failed rows are reported individually in the test output. Passed rows are not reported, so it is impossible to see how many rows were executed.
3. A skip followed by a pass will be reported as an overall pass for the test function, but the same rows in reverse order will not report any overall result for the test function.
These issues should be addressed by altering qtestlib to count each data row as a test, with one result recorded per row.