Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-6499

Task tracking changes flaky summary counting algorithm

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • Not Evaluated
    • None
    • None
    • Grafana
    • None

    Description

      Update top flaky tests measurement with additional field allowing seeing if the failures are Health check only. This would allow for distinguishing if potential  flakiness of  test due to CI. So far we do not have algorithm allowing for automatic classification if the root of the flakiness is in the test itself or the running environment (CI). The triage (classification) is done manually by checking logs. Calculated, refined numbers (splitting the fail counter to fails in integration vs fail in health check runs) would provide more insight obtained at one click. 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            anwojcie Anna Wojciechowska
            anwojcie Anna Wojciechowska
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes