Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-38890

Speed up autotests

    XMLWordPrintable

Details

    Description

      testtime.pl can be used to extract times when run from the folder as obtained from a test-log zip archive fex available from http://testresults.qt-project.org/ci/Qt5_stable_Integration/latest-success/ .

      As of 5.7 , the plain text logger outputs the total test time.

      Findings

      • gui/painting/qcolor is ideal for profiling testlib since it performs a ton of comparisons.
      • tst_QXmlSimpleReader taking 170s on Windows stands out, other than that, no spectacular issues.
      • Geopositioninfosource also takes quite a while
      • The sequence QEXPECT_FAIL / QTRY_COMPARE is really a bad idea since the check always times out

      The logs from Android, iOS, WinCE are missing, unfortunately.

      Hardcoded qWaits():

      findwaits.sh greps the test sources for qWait() and produces qwait_stable_140523.log . There is clearly room for improvement (introduce QTRY_... ) but one has to be careful, some delays are there to wait until animations are finished, etc.

      Pending Changes:

      Submitted Changes:

      Attachments

        1. findwaits.sh
          0.3 kB
          Friedemann Kleint
        2. qt_57_test_times_160226.txt
          62 kB
          Friedemann Kleint
        3. qt_dev_test_times_151216.txt
          48 kB
          Friedemann Kleint
        4. qt5_56_test_times_win_151110.txt
          8 kB
          Friedemann Kleint
        5. qt5_dev_test_times_151105.txt
          23 kB
          Friedemann Kleint
        6. qtbug38890_stringcompare.zip
          1 kB
          Friedemann Kleint
        7. qtdeclarative_dev_test_times_151030.txt
          11 kB
          Friedemann Kleint
        8. testtime_fromplainlog.pl
          1 kB
          Friedemann Kleint
        9. testtime.pl
          1 kB
          Friedemann Kleint

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              cnn Qt Core & Network
              kleint Friedemann Kleint
              Vladimir Minenko Vladimir Minenko
              Alex Blasche Alex Blasche
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: