Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-5949

coin_testresults_parser should report the duration as seen in the XML file, i.e. per test function

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Not Evaluated
    • None
    • unversioned
    • Metrics / Test Results
    • None

    Description

      Currently the duration is reported for each datatag individually, by dividing the duration reported in the XML file, by the total number of datatags in the test function.

      The reason is that in case we have many datatags, we don't really have a separate entry for "the total" in the struct returned:

       TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,100 200x200, flags 0', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,100 200x200, flags 800', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,100 120x416, flags 0', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,100 120x416, flags 800', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='130,100 0x200, flags 0', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='130,100 0x200, flags 800', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,50 200x0, flags 0', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='100,50 200x0, flags 800', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='130,50 0x0, flags 0', result='pass'),
 TestResult(started_on=datetime.datetime(2023, 11, 15, 12, 2, 49, 542000), duration_ms=247.05100000000002, test_executable='tst_QWidget', test_function='windowMoveResize', test_datatag='130,50 0x0, flags 800', result='pass'),

      So dividing the time in the XML and spreading it all over the datatags was an inaccurate compromise.

      I'm now considering adding a None datatag under the testfunction, just to assign the total runtime.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            jimis Dimitrios Apostolou
            jimis Dimitrios Apostolou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes