Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-534

parse_build_log identifies wrong failing test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Not Evaluated
    • 2012q2
    • 2012q2
    • Test scripts
    • None
    • fba4d523e56433ed84a60a6cf66c41356ec8847a

    Description

      In this log: http://testresults.qt-project.org/ci/QtBase_master_Integration/build_03056/linux-g%2B%2B-32_developer-build_Ubuntu_10.04_x86/log.txt.gz

      parse_build_log said:

          Autotest `tst_qdialogbuttonbox' failed for linux-g++-32 developer-build
          Ubuntu 10.04 x86 :(
      
            Testing tst_QDialogButtonBox
            Totals: 79 passed, 0 failed, 0 skipped
            QtQA::App::TestRunner: end [./tst_qdialogbuttonbox] [-silent] [-o]
        [/home/qt/.pulse2-agent/data/recipes/187520633/base/_artifacts/test-logs/tst_qdialogbuttonbox-testresults-00.xml,xml] [-o] [-,txt], 1 seconds, exit code 0
      

      This is incorrect.

      The problem is this sequence of output:

      6/9/12 12:26:24 AM EST: PASS   : tst_QChar::cleanupTestCase()
      6/9/12 12:26:24 AM EST: Totals: 19423 passed, 1 failed, 0 skipped
      6/9/12 12:26:24 AM EST: ********* Finished testing of tst_QChar *********
      6/9/12 12:26:24 AM EST: QtQA::App::TestRunner: test failure could be reproduced twice consecutively
      6/9/12 12:26:24 AM EST: QtQA::App::TestRunner: end [./tst_qchar] [-silent] [-o] [/home/qt/.pulse2-agent/data/recipes/187520633/base/_artifacts/test-logs/tst_qchar-testresults-00.xml,xml] [-o] [-,txt], 17 seconds, exit code 1
      6/9/12 12:26:24 AM EST: QtQA::App::TestRunner: begin [./tst_qdialogbuttonbox] [-silent] [-o] [/home/qt/.pulse2-agent/data/recipes/187520633/base/_artifacts/test-logs/tst_qdialogbuttonbox-testresults-00.xml,xml] [-o] [-,txt]
      6/9/12 12:26:24 AM EST: Testing tst_QDialogButtonBox
      6/9/12 12:26:24 AM EST: Totals: 79 passed, 0 failed, 0 skipped
      6/9/12 12:26:24 AM EST: QtQA::App::TestRunner: end [./tst_qdialogbuttonbox] [-silent] [-o] [/home/qt/.pulse2-agent/data/recipes/187520633/base/_artifacts/test-logs/tst_qdialogbuttonbox-testresults-00.xml,xml] [-o] [-,txt], 1 seconds, exit code 0
      6/9/12 12:26:24 AM EST: QtQA::App::TestScheduler: tst_qchar failed; run concurrently with qobjectrace, tst_lancelot, tst_qatomicint, tst_qbytearraymatcher, tst_qcolor, tst_qcolordialog, tst_qcolumnview, tst_qcomplextext, tst_qcontiguouscache, tst_qcoreapplication, tst_qcryptographichash, tst_qcssparser, tst_qdataurl, tst_qdatawidgetmapper, tst_qdate, tst_qdatetime, tst_qdatetimeedit, tst_qdebug, tst_qdesktopservices, tst_qdesktopwidget, tst_qdial, tst_qdialog, tst_qdialogbuttonbox
      

      The testrunner instances co-operate with each other to synchronize output, but testscheduler's output isn't synchronized, so another parallel test (tst_qdialogbuttonbox) was able to output something in between the tst_qchar failure message from testrunner and testscheduler.

      Attachments

        For Gerrit Dashboard: QTQAINFRA-534
        # Subject Branch Project Status CR V

        Activity

          People

            rmcgover Rohan McGovern (Inactive)
            rmcgover Rohan McGovern (Inactive)
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes