Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-2226

CI consistently fails to merge patch in qtvirtualkeyboard for (mostly) inconsistent reasons

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • P0: Blocker
    • 5.11
    • 5.11
    • Coin (obsolete)
    • None
    • 50d1d95af5cb271285abb4375e63ca28cbadd77a 8b3a4d6f305955171a595ad93460346c58df51d7 6d429be4d77841218d89f5e563593fb39812395d

    Description

      Integration of this gerrit patch, https://codereview.qt-project.org/#/c/240356/, keeps failing. The consistency is that the failing tests are inconsistent; with one honorable exception:

      inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

      This may point towards a flaky test.

      Still, if this one doesn't fail, a new/previously unseen test failure appears. In one run, two tests fail. The change itself is likely not the culprit, as it is in a comment and instructive to QDoc only. It is also the only change being tested in each run.

      This behavior effectively blocks new changes from getting merged.

      These are the failures this far:

      agent:2018/09/18 16:12:40 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

      agent:2018/09/18 16:25:10 build.go:193: FAIL! : inputpanel::tst_plugin::test_keyPress(row 5) 'wait for signal virtualKeyClicked' returned FALSE. ()

      agent:2018/09/19 04:43:02 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

      agent:2018/09/19 04:53:54 build.go:193: FAIL! : inputpanel::tst_plugin::test_inputMethodHints(row 6) 'wait for signal onVisibleChanged' returned FALSE. ()

      agent:2018/09/19 05:27:35 build.go:193: FAIL! : inputpanel::tst_plugin::test_inputMethodHints(row 6) 'wait for signal onVisibleChanged' returned FALSE. ()

      agent:2018/09/19 05:41:10 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

      agent:2018/09/19 05:41:14 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 2) 'wait for signal onVisibleConditionChanged' returned FALSE. ()

      agent:2018/09/19 06:12:19 build.go:193: FAIL! : inputpanel::tst_plugin::test_keyPress(row 1) 'verify()' returned FALSE. ()

      agent:2018/09/19 06:25:24 build.go:193: FAIL! : inputpanel::tst_plugin::test_pinyinInputMethod(row 2) 'verify()' returned FALSE. ()

      agent:2018/09/19 07:01:59 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 0) Compared values are not the same

      agent:2018/09/19 08:13:24 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

      agent:2018/09/19 08:43:31 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 1) Uncaught exception: Cannot read property 'width' of null
      agent:2018/09/19 08:43:31 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/inputpanel/inputpanel.qml(575)]

      agent:2018/09/19 09:01:33 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:01:33 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

      agent:2018/09/19 09:13:09 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:13:09 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

      agent:2018/09/19 09:24:12 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:24:12 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

      agent:2018/09/19 09:24:16 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 2) 'wait for signal onVisibleConditionChanged' returned FALSE. () agent:2018/09/19 09:24:16 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1669)]

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-62518 Qt Virtual Keyboard tests are flaky

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-70615 tst_plugin: "this plugin does not support raise"

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Reported

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-61279 Test tst_plugin::test_wclAutoCommitWordSetting fails with hunspell

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed
          resulted from

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-70602 Incorrect image set in docs of Qt Virtual Keyboard layout for Romanian layout

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Closed
          For Gerrit Dashboard: QTQAINFRA-2226
          # Subject Branch Project Status CR V
          240402,1 Blacklist tst_plugin::test_wclAutoCommitWordSetting on all platforms 5.11 qt/qtvirtualkeyboard Status: ABANDONED -1 0
          240418,5 Improve some auto tests 5.11 qt/qtvirtualkeyboard Status: ABANDONED -2 0
          240459,5 tests: Speed up inputpanel tests 5.11 qt/qtvirtualkeyboard Status: ABANDONED -1 0
          240460,5 tests: Backport test_wclAutoCommitWordSetting from 5.12 5.11 qt/qtvirtualkeyboard Status: MERGED +2 0
          240503,4 tests: Fix test_wclAutoCommitWordSetting 5.11 qt/qtvirtualkeyboard Status: ABANDONED -1 0
          240756,2 tests: Verify current item in selectionListSelectCurrentItem 5.11 qt/qtvirtualkeyboard Status: MERGED +2 0
          240761,2 Fix word candidate list auto hiding 5.11 qt/qtvirtualkeyboard Status: MERGED +2 0

          Activity

            People

              tosaraja Tony Sarajärvi
              paulwicking Paul Wicking
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes