Details
-
Technical task
-
Resolution: Fixed
-
P3: Somewhat important
-
None
-
None
Description
Description:
We keep statistics on the absolute number of distinct executed blacklisted test functions that are part of passed HealthCheck coin tasks. We observe that these numbers are increasing over time. Given the growth of the qt project and the continuous addition of new test functions, we need a relevant indicator to understand this trend better. We need those numbers to prepare for discussion for the upcoming QtContributor Summit 5th-6th September 2024.
To achieve this, we should calculate the percentage of executed functions that are blacklisted for each nightly build and compare the relative increase. Specifically, we need to evaluate and compare the data from the last passing HealthChecks, namely:
- nightly1720476616 (7th Aug 2024)
- nightly1708294925 (18th Feb 2024)
Task
- Extract the total number (or list) of executed test functions (without data tags) from the PostgreSQL database for nightly1720476616 . The number should contain distinct test functions (without repetitions) for the whole HeathCheck.
- Extract the total number (or list) of executed test functions (without data tags) from the PostgreSQL database for nightly1708294925 . The number should contain distinct test functions (without repetitions) for the whole HealthCheck.