testtime.pl can be used to extract times when run from the folder as obtained from a test-log zip archive fex available from http://testresults.qt-project.org/ci/Qt5_stable_Integration/latest-success/ .

As of 5.7 , the plain text logger outputs the total test time.

Findings

• gui/painting/qcolor is ideal for profiling testlib since it performs a ton of comparisons.
• tst_QXmlSimpleReader taking 170s on Windows stands out, other than that, no spectacular issues.
• Geopositioninfosource also takes quite a while
• The sequence QEXPECT_FAIL / QTRY_COMPARE is really a bad idea since the check always times out

The logs from Android, iOS, WinCE are missing, unfortunately.

Hardcoded qWaits():

findwaits.sh greps the test sources for qWait() and produces qwait_stable_140523.log . There is clearly room for improvement (introduce QTRY_... ) but one has to be careful, some delays are there to wait until animations are finished, etc.

Pending Changes:

• WIP: Testlib: Add class for delayed formatting of the values. (qtbase/5.6) https://codereview.qt-project.org/#/c/139744/

• "Testlib: Gather methods in a class." (qtbase/dev) https://codereview.qt-project.org/142344

Submitted Changes:

• "Testlib: Move documentation from qtestcase.cpp to qtestcase.qdoc." b24bb12f6a93b98e9bc44c99e151b995eb7cea71(qtbase/dev, 3.12.2015, 5.7.) https://codereview.qt-project.org/142343
• "Testlib: Replace linked lists in QTestTablePrivate by std::vector." ecb83fc9c3ae48030c6a49a6f171718bad6937af (qtbase/5.6, 7.11.2015) https://codereview.qt-project.org/#/c/140136/
• "QMessageBox test: Decrease timer interval to 50ms." 3c50f459c6f3e4e3cc47f961d52c30f3d63cf2a0 (qtbase/5.6, 5.11.2015, 5.6) https://codereview.qt-project.org/139758
• "Testlib: Output total test time in plain text logger." 84042523f272c1d30247e9329eea21036ff793f4 (qtbase/dev, 30.10.2015, 5.7) https://codereview.qt-project.org/#/c/139321/
• "Testlib: Avoid formatting unneeded messages." d946507727b363326d05f48da93c2af04bdda76d (qtbase/5.6,30.10.2015, 5.6b) https://codereview.qt-project.org/#/c/139366/
• Reduce repetitive invocation of QFINDTESTDATA: 72024fd50cdead8d890886dba32fd81ac54ff3ae (dev, 10.7.2014, 5.4) https://codereview.qt-project.org/#/c/89503/ and cdf9aed6302df57a8a1c56f03e6f82254ea87043 (5.3, 9.7.2014, 5.3.2) https://codereview.qt-project.org/89464

• tst_QXmlSimpleReader (170s, Windows) c82668d39dbc7b59217b728cf4ea1ea05e3e6f48 (stable, 9.5.2014, 5.3.1) https://codereview.qt-project.org/#change,84940
• tst_QWidget::windowMoveResize() (40s, Windows) f528fff97394554ccac9c2d9ced790cc0e6e4350 (stable, 12,54,2014, 5.3.1) : https://codereview.qt-project.org/#change,85058

• Remove some qWait() in widgets (low hanging fruits): 787c0d76a2d7dbc6d7493915f4f765ac19a14062 (stable, 27.5.2014, 5.3.1) https://codereview.qt-project.org/#change,86125