XMLWordPrintable

    Details

    • Type: User Story
    • Status: Open
    • Priority: P2: Important
    • Resolution: Unresolved
    • Affects Version/s: 5.11, 5.12, 5.14
    • Fix Version/s: 6.0
    • Component/s: Metrics / Test Results
    • Labels:
      None

      Description

      We have a lot of old "insignificant_test" flags in different .pro -files. These tests are totally skipped while testing and they should be replaced with blacklisting when possible or just fix it.

      Situation as of 20th April 2018:

      ./qtpim/tests/auto/versit/qvcard21writer/qvcard21writer.pro:CONFIG+=insignificant_test # QTBUG-25382
      ./qtquick1/tests/auto/declarative/qmlvisual/qmlvisual.pro:CONFIG+=insignificant_test # QTBUG-26705
      ./qtquick1/tests/auto/declarative/qdeclarativetext/qdeclarativetext.pro:CONFIG += insignificant_test # QTBUG-21015
      ./qtquick1/tests/auto/declarative/qdeclarativedebug/qdeclarativedebug.pro:CONFIG+=insignificant_test # QTBUG-26702
      ./qtquick1/tests/auto/declarative/qdeclarativedebugjs/tst_qdeclarativedebugjs.pro:CONFIG+=insignificant_test # QTQAINFRA-428
      ./qtquick1/tests/auto/declarative/qdeclarativedebugobservermode/tst_qdeclarativedebugobservermode.pro:CONFIG+=insignificant_test # QTBUG-28298
      ./qtdeclarative/tests/auto/quick/qquickcanvasitem/qquickcanvasitem.pro:CONFIG += insignificant_test # QTBUG-41043
      ./qtlocation/tests/auto/qnmeapositioninfosource/qnmeapositioninfosource_simulation/qnmeapositioninfosource_simulation.pro:win32:CONFIG+=insignificant_test
      ./qtlocation/tests/auto/qnmeapositioninfosource/qnmeapositioninfosource_simulation_generic/qnmeapositioninfosource_simulation_generic.pro:win32:CONFIG+=insignificant_test
      ./qtlocation/tests/auto/qnmeapositioninfosource/qnmeapositioninfosource_realtime/qnmeapositioninfosource_realtime.pro:win32:CONFIG+=insignificant_test
      ./qtlocation/tests/auto/qnmeapositioninfosource/qnmeapositioninfosource_realtime_generic/qnmeapositioninfosource_realtime_generic.pro:win32:CONFIG+=insignificant_test
      ./qtlocation/tests/auto/qnmeapositioninfosource/dummynmeapositioninfosource/dummynmeapositioninfosource.pro:win32:CONFIG+=insignificant_test
      ./qtscript/tests/auto/qscriptjstestsuite/qscriptjstestsuite.pro:win32:CONFIG += insignificant_test # QTBUG-36632
      ./qtqa/tests/postbuild/symbols/symbols.pro:CONFIG += insignificant_test # QTQAINFRA-325
      ./qtqa/tests/postbuild/guiapplauncher/guiapplauncher.pro:CONFIG += insignificant_test # QTQAINFRA-323
      ./qtqa/scripts/generic/t/data/test-projects/tests/tests.pro: passing_insignificant_test\
      ./qtqa/scripts/generic/t/data/test-projects/tests/tests.pro: failing_insignificant_test\
      ./qtqa/scripts/generic/t/data/test-projects/tests/passing_insignificant_test/passing_insignificant_test.pro:CONFIG+=insignificant_test
      ./qtqa/scripts/generic/t/data/test-projects/tests/failing_insignificant_test/failing_insignificant_test.pro:CONFIG+=insignificant_test
      ./qtqa/scripts/scripts.pro:linux-*:system(". /etc/lsb-release && [ $DISTRIB_CODENAME = precise ]"):CONFIG+=insignificant_test # QTQAINFRA-708
      ./qtbase/tests/auto/network/access/spdy/spdy.pro:win32:CONFIG += insignificant_test # QTBUG-47128
      ./qtbase/tests/auto/widgets/dialogs/qfilesystemmodel/qfilesystemmodel.pro:CONFIG += insignificant_test # QTBUG-29403
      ./qtbase/tests/auto/widgets/dialogs/qcolordialog/qcolordialog.pro:linux*: CONFIG += insignificant_test # Crashes on different Linux distros
      ./qtbase/tests/auto/widgets/itemviews/qlistview/qlistview.pro:linux*: CONFIG += insignificant_test # Crashes
      ./qtbase/tests/auto/gui/kernel/qopenglwindow/qopenglwindow.pro:win32:CONFIG+=insignificant_test # QTBUG-46452, QTBUG-49630
      ./qtbase/tests/auto/gui/kernel/qtouchevent/qtouchevent.pro:osx: CONFIG += insignificant_test # QTBUG-46266, crashes
      ./qtbase/tests/auto/corelib/io/qprocess/test/test.pro:mac:CONFIG += insignificant_test # QTBUG-25895 - sometimes hangs
      ./qtfeedback/tests/auto/qfeedbackmmk/qfeedbackmmk.pro:linux-*:system(". /etc/lsb-release && [ $DISTRIB_CODENAME = oneiric ]"):CONFIG += insignificant_test # QTBUG-25448
      ./qtfeedback/tests/auto/qfeedbackmmk/qfeedbackmmk.pro:win32: CONFIG += insignificant_test # QTBUG-25448

        Attachments

          Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            Activity

              People

              Assignee:
              rampe Rami Potinkara
              Reporter:
              tosaraja Tony Sarajärvi
              PM Owner:
              Veli-Pekka Heinonen Veli-Pekka Heinonen
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:

                  Gerrit Reviews

                  There are no open Gerrit changes