Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-21848 Improve reporting of autotest run-rates and pass-rates
  3. QTBUG-21851

Make autotests accurately represent which tests are valid for each platform

    XMLWordPrintable

Details

    • Sub-task
    • Resolution: Done
    • P1: Critical
    • 5.0.0
    • Testing: qtestlib
    • None

    Description

      Currently, the metrics system reports too many test as being valid for some platforms. One of the reasons for this is that there are some test programs and a lot of test functions that are effectively empty for certain platforms because they have most/all of their content ifdef'd out.

      The existing autotests must be reviewed and corrected to ensure that:
      1. Test programs that are not useful on a particular platform are neither built nor executed on that platform.
      2. Individual test functions that need to be excluded on a particular platform are excluded by ifdef'ing out the entire function instead of ifdef'ing just the function body and leaving an empty function to inflate the pass-rate.

      Additionally, the correct way to exclude test programs and test functions should be documented in the qtestlib manual.

      Attachments

        For Gerrit Dashboard: QTBUG-21851
        # Subject Branch Project Status CR V

        Activity

          People

            jasmcdon Jason McDonald (Closed Nokia Identity. Please assign to "macadder" instead) (Inactive)
            jasmcdon Jason McDonald (Closed Nokia Identity. Please assign to "macadder" instead) (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: