Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-7349

Wrong handling of failed tests re-run on Android

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: P2: Important P2: Important
    • None
    • production
    • Test scripts
    • None

      In this other Teams thread about tst_qquickpopup failing, we can see that the test has been crashing for multiple people 100% of the time locally, but the CI seems to pass it sometimes. For example look at https://testresults.qt.io/coin/integration/qt/qtdeclarative/tasks/1755553310 (check android-15-x86_64-on-linux target).

      Looking at the log files (androidtestrunner-1755561648641.txt) it shows that the test crashes at the and doesn't finish running all the test cases. Then, there's another attempt to run only the test case that failed (fadedimmer at androidtestrunner-1755561720150.txt) but the other test cases after that case don't seem to be run at all and the whole test is marked as passed after that. The android test runner correctly returns that the test failed in the first time, so I'm assuming this has to do with the test output processing and re-run logic?

        1. androidtestrunner-1755561720150.txt
          1 kB
        2. androidtestrunner-1755561648641.txt
          9 kB
        3. androidtestrunner-1755561648641.junit.xml
          12 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            jimis Dimitrios Apostolou
            assam Assam Boudjelthia
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:

                There are no open Gerrit changes