Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-38890

Speed up autotests

    XMLWordPrintable

    Details

    • Type: Suggestion
    • Status: Reported
    • Priority: P2: Important
    • Resolution: Unresolved
    • Affects Version/s: 5.3.0 RC1
    • Fix Version/s: None
    • Labels:
    • Environment:

      All

      Description

      testtime.pl can be used to extract times when run from the folder as obtained from a test-log zip archive fex available from http://testresults.qt-project.org/ci/Qt5_stable_Integration/latest-success/ .

      As of 5.7 , the plain text logger outputs the total test time.

      Findings

      • gui/painting/qcolor is ideal for profiling testlib since it performs a ton of comparisons.
      • tst_QXmlSimpleReader taking 170s on Windows stands out, other than that, no spectacular issues.
      • Geopositioninfosource also takes quite a while
      • The sequence QEXPECT_FAIL / QTRY_COMPARE is really a bad idea since the check always times out

      The logs from Android, iOS, WinCE are missing, unfortunately.

      Hardcoded qWaits():

      findwaits.sh greps the test sources for qWait() and produces qwait_stable_140523.log . There is clearly room for improvement (introduce QTRY_... ) but one has to be careful, some delays are there to wait until animations are finished, etc.

      Pending Changes:

      Submitted Changes:

        Attachments

        1. findwaits.sh
          0.3 kB
        2. qt_57_test_times_160226.txt
          62 kB
        3. qt_dev_test_times_151216.txt
          48 kB
        4. qt5_56_test_times_win_151110.txt
          8 kB
        5. qt5_dev_test_times_151105.txt
          23 kB
        6. qtbug38890_stringcompare.zip
          1 kB
        7. qtdeclarative_dev_test_times_151030.txt
          11 kB
        8. testtime_fromplainlog.pl
          1 kB
        9. testtime.pl
          1 kB

          Issue Links

          For Gerrit Dashboard: QTBUG-38890
          # Subject Branch Project Status CR V

            Activity