Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-6400

Create a policy about handling and following up on flaky tests

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • P2: Important
    • None
    • unversioned
    • Quality Assurance

    Description

      Define and align a policy to cover the following questions:

      • Who owns a flaky test?
      • Who is responsible for an initial analysis and assigning the task to a developer, depending on whether it is a CI or a development problem?
      • When can a test be blacklisted?
      • Who is responsible to follow up on a blacklisted test?
      • Who should approve a backlisting?
      • Who is responsible for un-blacklisting?

      => Feel free to add / rephrase topics.
      => Feel free to add opinions and ideas.

      Attachments

        Issue Links

          duplicates

          Task - A task that needs to be done. QTQAINFRA-3070 Create a QUIP that documents the rules surrounding the management of failing/flaky auto tests

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed
          relates to

          Task - A task that needs to be done. QTBUG-96295 Replace blacklisting of tests with QKNOWN_FLAKY() macro

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Closed

          User Story - Created by Jira Software - do not edit or delete. Issue type for a user story. QTQAINFRA-6285 Reduce blacklisted tests on Android

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Open
          There are no Sub-Tasks for this issue.
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              anwojcie Anna Wojciechowska
              axelspoerl Axel Spoerl
              Olli Hirvonen Olli Hirvonen
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes