Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-6499

Task tracking changes flaky summary counting algorithm

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Not Evaluated Not Evaluated
    • None
    • None
    • Grafana
    • None

      Update top flaky tests measurement with additional field allowing seeing if the failures are Health check only. This would allow for distinguishing if potential  flakiness of  test due to CI. So far we do not have algorithm allowing for automatic classification if the root of the flakiness is in the test itself or the running environment (CI). The triage (classification) is done manually by checking logs. Calculated, refined numbers (splitting the fail counter to fails in integration vs fail in health check runs) would provide more insight obtained at one click. 

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            anwojcie Anna Wojciechowska
            anwojcie Anna Wojciechowska
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:

                There are no open Gerrit changes