Integration of this gerrit patch, https://codereview.qt-project.org/#/c/240356/, keeps failing. The consistency is that the failing tests are inconsistent; with one honorable exception:

inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

This may point towards a flaky test.

Still, if this one doesn't fail, a new/previously unseen test failure appears. In one run, two tests fail. The change itself is likely not the culprit, as it is in a comment and instructive to QDoc only. It is also the only change being tested in each run.

This behavior effectively blocks new changes from getting merged.

These are the failures this far:

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537597766/log.txt.gz

agent:2018/09/18 16:12:40 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/WindowsWindows_10x86_64WindowsWindows_10x86_64MSVC2017qtci-windows-10-x86_64-10-391659DebugAndRelease_Release_ForceDebugInfo_OpenGLDynamic/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537598139/log.txt.gz

agent:2018/09/18 16:25:10 build.go:193: FAIL! : inputpanel::tst_plugin::test_keyPress(row 5) 'wait for signal virtualKeyClicked' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537630275/log.txt.gz

agent:2018/09/19 04:43:02 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/WindowsWindows_10x86_64WindowsWindows_10x86_64MSVC2015qtci-windows-10-x86_64-10-391659DebugAndRelease_Release_ForceDebugInfo_OpenGLDynamic/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537630347/log.txt.gz

agent:2018/09/19 04:53:54 build.go:193: FAIL! : inputpanel::tst_plugin::test_inputMethodHints(row 6) 'wait for signal onVisibleChanged' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/WindowsWindows_10x86_64WindowsWindows_10x86_64MSVC2017qtci-windows-10-x86_64-10-391659DebugAndRelease_Release_ForceDebugInfo_OpenGLDynamic/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537630775/log.txt.gz

agent:2018/09/19 05:27:35 build.go:193: FAIL! : inputpanel::tst_plugin::test_inputMethodHints(row 6) 'wait for signal onVisibleChanged' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537631143/log.txt.gz

agent:2018/09/19 05:41:10 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

agent:2018/09/19 05:41:14 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 2) 'wait for signal onVisibleConditionChanged' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/WindowsWindows_10x86_64WindowsWindows_10x86MSVC2015qtci-windows-10-x86_64-10-391659DebugAndRelease_Release_ForceDebugInfo_OpenGLDynamic/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537631736/log.txt.gz

agent:2018/09/19 06:12:19 build.go:193: FAIL! : inputpanel::tst_plugin::test_keyPress(row 1) 'verify()' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/WindowsWindows_10x86_64WindowsWindows_10x86_64MSVC2017qtci-windows-10-x86_64-10-391659DebugAndRelease_Release_ForceDebugInfo_OpenGLDynamic/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537632340/log.txt.gz

agent:2018/09/19 06:25:24 build.go:193: FAIL! : inputpanel::tst_plugin::test_pinyinInputMethod(row 2) 'verify()' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537633459/log.txt.gz

agent:2018/09/19 07:01:59 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 0) Compared values are not the same

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537634895/log.txt.gz

agent:2018/09/19 08:13:24 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. ()

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537641224/log.txt.gz

agent:2018/09/19 08:43:31 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 1) Uncaught exception: Cannot read property 'width' of null
agent:2018/09/19 08:43:31 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/inputpanel/inputpanel.qml(575)]

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537642316/log.txt.gz

agent:2018/09/19 09:01:33 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:01:33 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537642716/log.txt.gz

agent:2018/09/19 09:13:09 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:13:09 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

• https://testresults.qt.io/logs/qt/qtvirtualkeyboard/97332e650ee7d87c10d7e2a5a2d31abfe07b75b1/LinuxUbuntu_16_04x86_64LinuxQEMUarmv7GCCqtci-linux-Ubuntu-16.04-x86_64-2-359a24Release/f5c40a9d187590c7f8217a1bbb2c0f34bba95cb2/test_1537643329/log.txt.gz

agent:2018/09/19 09:24:12 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoCommitWordSetting(row 1) 'verify()' returned FALSE. () agent:2018/09/19 09:24:12 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1705)]

agent:2018/09/19 09:24:16 build.go:193: FAIL! : inputpanel::tst_plugin::test_wclAutoHide(row 2) 'wait for signal onVisibleConditionChanged' returned FALSE. () agent:2018/09/19 09:24:16 build.go:193: Loc: [/home/qt/work/qt/qtvirtualkeyboard/tests/auto/inputpanel/data/tst_inputpanel.qml(1669)]