Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-287 Handle false positives
  3. QTQAINFRA-360

Clean up test cases that are either passing or failing in a stable way in CI

    XMLWordPrintable

Details

    Description

      It would be useful to execute benchmarks on more than one physical host for a given platform/branch combination. This could eliminate false positives arising from certain unintended/uncontrollable changes in performance characteristics in the test environment (disk fragmentation is one example). More precisely, we could make such a host correlation analysis influence the score of a performance regression (i.e. the more hosts that show the regression, the higher the score).

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            bdo Jo Asplin (Inactive)
            bdo Jo Asplin (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes