Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-5971

Qtbase tests fail/crash with Android 14

    XMLWordPrintable

Details

    • Android
    • 7bc6a1c86 (dev), 2f0726c8c (6.7), bba26d722 (dev), 5260dcc61 (6.7), a9f16c0ab (dev), feff219aa (dev), 471098918 (dev), 4244b4194 (dev), 772fd609c (dev), 715e9f618 (6.7), 21ff70afb (6.7), a4be920e1 (6.7), 34d856be2 (6.7), 002d6cb2a (tqtc/lts-6.5)
    • 2023wk48FOQtforAndroid, 2023wk50FOQtforAndroid, 2024wk02FOQtforAndroid, 2024wk04FOQtforAndroid, 2024wk06FOQtforAndroid, 2024wk08FOQtforAndroid, 2024wk10FOQtforAndroid, 2024wk12FOQtforAndroid, 2024wk14FOQtforAndroid

    Description

      When running Android NDK r26b in Coin - Android 14 tests have begun to fail consistently.

      I have run r26b three times against Android-14, all have given the same fail, latest run:

      https://coin.ci.qt.io/coin/integration/qt/qt5/tasks/web_qt_qt5_1701681683523

      Test

      qt/qtbase 24627d9bce444cee6bc593680c494d58ec241171

      android-14-x86_64-on-linux rhel-8.8  Error log raw log downloads

       

      The following tests FAILED:
      461 - tst_qrhiwidget (Failed)
      462 - tst_qdom (Failed) 	
      463 - tst_gestures (Failed) 	
      464 - tst_languagechange (Failed) 	
      465 - tst_qfocusevent (Failed) 	
      466 - tst_qsharedpointer_and_qwidget (Failed) 	
      467 - tst_qnetworkaccessmanager_and_qprogressdialog (Failed) 	
      468 - tst_networkselftest (Failed) 	
      469 - tst_qaccessibility (Failed) 	
      470 - tst_qcomplextext (Failed) 	
      471 - tst_qobjectrace (Failed) 	
      472 - tst_toolsupport (Failed) 	
      473 - tst_android_deployment_settings (Failed) 	
      474 - tst_baseline_painting (Failed) 	
      475 - tst_baseline_widgets (Failed) 	
      476 - tst_baseline_stylesheet (Failed) 	
      477 - tst_baseline_text (Failed) 
      Errors while running CTest 
      Process finished with error: exit status 8

      I checked if this is an issue with current dev branch (with NDK r25b), two nightly runs have failed the same tests:

      2023-12-04 01:04:09

      https://testresults.qt.io/coin/integration/qt/qt5/tasks/nightly1704905214

      2023-12-03 01:04:01 

      https://testresults.qt.io/coin/integration/qt/qt5/tasks/nightly1704888222

      There were many Qtbase changes made recently to Android, Coin integration of that passed:

      https://testresults.qt.io/coin/integration/qt/qtbase/tasks/1704829526

      I think a key difference is what provisioning VM was used for the runs. Qtbase integration run used a provision VM that was created 2023-11-21. Nightlies/health checks build and use fresh provisions for their runs. Something is inconsistent with Android scripts / emulator in provisioning.

      UPDATE (Jan 11 2024):

      This issue seems to be back and now failing dev and 6.7 for tst_qrhiwidget. It might be related to https://developer.android.com/studio/releases/emulator#33-1-23 update that adds support for Vulkan 1.3. We had a patch for 6.6 and 6.5 https://codereview.qt-project.org/c/qt/qt5/+/527815 to use the emulator version that used to work, that seemed to help with tst_rhi test on 6.6 and 6.5 branches but not with tst_qrhiwidget on dev.

      Also, locally using the old emulator seems to also fix the issue and without I get a crash (attached) but on CI we get different behavior where the emulator version doesn't seem to affect anything.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              assam Assam Boudjelthia
              eltoivol Elias Toivola
              Votes:
              2 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: