Uploaded image for project: 'Coin'
  1. Coin
  2. COIN-1057

Failed tests classified as flaky

    XMLWordPrintable

Details

    • Task
    • Resolution: Duplicate
    • P2: Important
    • None
    • master
    • Influxdb
    • None

    Description

      Recently we had p0 and everyone got very confused since they could not find information about failed test.
      A test was failing but was wrongly classified as flaky.

      We should check if we have more of such cases (I can probably provide data)

      link to failed integration:
      https://testresults.qt.io/coin/integration/qt/qtdeclarative/tasks/1692342835

      link to log:
      https://testresults.qt.io/coin/api/log/qt/qtdeclarative/82dd0b963cafeb07ff780e6ce8c5b64695a82828/MacOSMacOS_13x86_64MacOSMacOS_13x86_64Clangqtci-macos-13-x86_64-103-ec69b6Sccache_TestOnly/b53867e6f03e365003ed49d6fba21131732a0186/test_1692342943/log.txt.gz

      agent:2023/06/20 19:58:07 build.go:402: The following tests FAILED:
      agent:2023/06/20 19:58:07 build.go:402: 140 - tst_qquickpopup (Failed)
      agent:2023/06/20 19:58:07 build.go:402: Errors while running CTest

      https://testresults.qt.io/grafana/d/3dhio4K7k/fastcheck-ci-test-info?orgId=1&var-testCase=tst_qquickpopup&var-testFunction=hover&var-branch=dev&from=now-90d&to=now

      bug:
      https://bugreports.qt.io/browse/QTBUG-114718

      Attachments

        1. screenshot-1.png
          159 kB
          Anna Wojciechowska

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              tosaario Toni Saario
              anwojcie Anna Wojciechowska
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes