Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-100312

androidtestrunner: A test with XPASS does not return error

    XMLWordPrintable

    Details

    • Commits:
      bc71496a34 (qt/qtbase/dev) bc71496a34 (qt/tqtc-qtbase/dev) 388f959080 (qt/qtbase/6.2) 388f959080 (qt/tqtc-qtbase/6.2) e4b439c8de (qt/qtbase/6.3) e4b439c8de (qt/tqtc-qtbase/6.3)
    • Sprint:
      2022wk14FOAndroid&Automotive

      Description

      Example log:

      XPASS  : tst_QFontDatabase::condensedFontMatching() QCOMPARE(QFontMetrics(tfcByStretch).horizontalAdvance(testString()), QFontMetrics(tfcByStyleName).horizontalAdvance(testString())) returned TRUE unexpectedly.
         Loc: [/home/qt/work/qt/qtbase/tests/auto/gui/text/qfontdatabase/tst_qfontdatabase.cpp(449)]
      SKIP   : tst_QFontDatabase::condensedFontMatching() This platform doesn't support font sub-family names (QTBUG-55625)
      
      [..]
      
      Totals: 12 passed, 1 failed, 13 skipped, 1 blacklisted, 82ms
      ********* Finished testing of tst_QFontDatabase *********
      Execute /opt/android/sdk/platform-tools/adb uninstall org.qtproject.example.tst_qfontdatabase.
      Success
      
      qt-testrunner.py     INFO: Test process exited with code: 0
      

      The process returns 0, while it should have returned 1. Additionally the XML log file contains one "xpass" entry correctly.

      EDIT: Even for crashed tests androidtestrunner can return success, see comment-644144.

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

              People

              Assignee:
              assam Assam Boudjelthia
              Reporter:
              jimis Dimitrios Apostolou
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes