Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-124557

Datatags that XFAIL are recorded twice (once as XFAIL and once as PASS)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P3: Somewhat important
    • None
    • 6.8
    • Testing: qtestlib
    • None

    Description

      In this example log we see the same datatag "AProperty" printing its result twice:

      XFAIL  : tst_qml_common::tst_propertyNameToChangedHandlerName(AProperty) Cannot distinguish between property names starting with upper case from properties starting with a lower case letter.
         Loc: [/home/qt/work/qt/qtdeclarative/tests/auto/qml/common/tst_qml_common.cpp(56)]
      PASS   : tst_qml_common::tst_propertyNameToChangedHandlerName(AProperty)
      

      In the XML file (attached) we see that there are two incidents recorded on this datatag:

          <Incident type="xfail" file="/home/qt/work/qt/qtdeclarative/tests/auto/qml/common/tst_qml_common.cpp" line="92">
            <DataTag><![CDATA[AProperty]]></DataTag>
            <Description><![CDATA[Cannot distinguish between signal names starting with upper case from signal names starting with a lower case letter.]]></Description>
          </Incident>
          <Incident type="pass" file="" line="0">
            <DataTag><![CDATA[AProperty]]></DataTag>
          </Incident>
      

      This leads to recording two test results, like the datatag has re-run.

      Just for sake of completion, we see opposite behaviour in the JUnit XML file (attached), and no indication that there was an XFAIL. It's recorded just as a single PASS:

        <testcase name="tst_propertyNameToChangedHandlerName(AProperty)" classname="tst_qml_common" time="0.000">
          <system-out>
            <![CDATA[Cannot distinguish between property names starting with upper case from properties starting with a lower case letter.]]>
          </system-out>
        </testcase>
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            vestbo Tor Arne Vestbø
            jimis Dimitrios Apostolou
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes