Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-108648

Missing result attribute in testcase element from junitxml report in Qt6

    XMLWordPrintable

Details

    • Bug
    • Resolution: Invalid
    • P2: Important
    • None
    • 6.4.0, 6.4.2
    • Testing: qtestlib
    • None
    • Linux/X11
    • 5
    • Foundation PM Staging

    Description

      In Qt 5.15, we get <testcase> elements with a result attribute but no time or classname, but in Qt 6.4, running the same tests, we get time and classname attributes but no result!
      I think this a bug/regression in Qt6's QTestLib's report generators "xunitxml" and also "junitxml".
       

      <?xml version="1.0" encoding="UTF-8" ?>
       <testsuite errors="0" failures="0" tests="3" name="CocoTests">
         <properties>
           <property value="5.15.10" name="QTestVersion"/>
           <property value="5.15.10" name="QtVersion"/>
           <property value="Qt 5.15.10 (x86_64&#x002D;little_endian&#x002D;lp64 shared (dynamic) release build; by GCC 5.3.1 20160406 (Red Hat 5.3.1&#x002D;6))" name="QtBuild"/>
         </properties>
         <testcase result="pass" name="initTestCase"/>
         <testcase result="pass" name="IF2_QML"/>
         <testcase result="pass" name="cleanupTestCase"/>
         <system-err/>
       </testsuite>
      
      <?xml version="1.0" encoding="UTF-8" ?>
       <testsuite name="CocoTests" timestamp="2022&#x002D;11&#x002D;17T05:41:13" hostname="cerberus" tests="3" failures="0" errors="0" skipped="0" time="4.262">
         <properties>
           <property name="QTestVersion" value="6.4.0"/>
           <property name="QtVersion" value="6.4.0"/>
           <property name="QtBuild" value="Qt 6.4.0 (x86_64&#x002D;little_endian&#x002D;lp64 shared (dynamic) release build; by GCC 10.3.1 20210422 (Red Hat 10.3.1&#x002D;1))"/>
         </properties>
         <testcase name="initTestCase" classname="CocoTests" time="0.000"/>
         <testcase name="IF2_QML" classname="CocoTests" time="4.261"/>
         <testcase name="cleanupTestCase" classname="CocoTests" time="0.000"/>
       </testsuite>
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Eddy Edward Welbourne
            ezust alan ezust
            Vladimir Minenko Vladimir Minenko
            Alex Blasche Alex Blasche
            Votes:
            2 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes