Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-21848 Improve reporting of autotest run-rates and pass-rates
  3. QTBUG-21851

Make autotests accurately represent which tests are valid for each platform

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: P1: Critical
    • Resolution: Done
    • Fix Version/s: 5.0.0
    • Component/s: Testing: qtestlib
    • Labels:
      None
    • Technical Risk:
      Normal

      Description

      Currently, the metrics system reports too many test as being valid for some platforms. One of the reasons for this is that there are some test programs and a lot of test functions that are effectively empty for certain platforms because they have most/all of their content ifdef'd out.

      The existing autotests must be reviewed and corrected to ensure that:
      1. Test programs that are not useful on a particular platform are neither built nor executed on that platform.
      2. Individual test functions that need to be excluded on a particular platform are excluded by ifdef'ing out the entire function instead of ifdef'ing just the function body and leaving an empty function to inflate the pass-rate.

      Additionally, the correct way to exclude test programs and test functions should be documented in the qtestlib manual.

        Attachments

        For Gerrit Dashboard: QTBUG-21851
        # Subject Branch Project Status CR V

          Activity

            People

            Assignee:
            jasmcdon Jason McDonald (Closed Nokia Identity. Please assign to "macadder" instead) (Inactive)
            Reporter:
            jasmcdon Jason McDonald (Closed Nokia Identity. Please assign to "macadder" instead) (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: