Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-25483

Fix unstable tst_lupdate test

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • P2: Important
    • 5.0.0 Beta 2
    • None
    • Tools: Linguist
    • None

    Description

      This test is currently marked as insignificant and appears to contain a mixture of stable and unstable failures.

      tests/auto/linguist/lupdate/lupdate.pro
      # June 2011: Marked as unstable due to tst_lupdate::good(heuristics) failing
# due to changes in qtbase/mkspecs/features/qt_config.prf.
CONFIG+=insignificant_test

      Example of unstable behaviour:

      http://testresults.qt-project.org/ci/QtTools_master_Integration/build_00229/win32-msvc2010_Windows_7/log.txt.gz
      4/20/12 7:28:54 PM EST: Testing tst_lupdate
4/20/12 7:29:00 PM EST: FAIL!  : tst_lupdate::good(parsejscontexts) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/parsejscontexts/project.ts.result does not meet expectations:
4/20/12 7:29:00 PM EST:         <source>Five</source>
4/20/12 7:29:00 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:00 PM EST:     </message>
4/20/12 7:29:00 PM EST: <<<<<<< got
4/20/12 7:29:00 PM EST:     <message>
4/20/12 7:29:00 PM EST:         <location filename="main.js" line="16"/>
4/20/12 7:29:00 PM EST:         <source>Six</source>
4/20/12 7:29:00 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:00 PM EST:     </message>
4/20/12 7:29:00 PM EST: </context>
4/20/12 7:29:00 PM EST: ...
4/20/12 7:29:00 PM EST: =========
4/20/12 7:29:00 PM EST: </context>
4/20/12 7:29:00 PM EST: <context>
4/20/12 7:29:00 PM EST:     <name>Bar::Baz</name>
4/20/12 7:29:00 PM EST:     <message>
4/20/12 7:29:00 PM EST:         <location filename="main.js" line="22"/>
4/20/12 7:29:00 PM EST:         <source>Eight</source>
4/20/12 7:29:00 PM EST: ...
4/20/12 7:29:00 PM EST: >>>>>>> expected
4/20/12 7:29:00 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:00 PM EST:     </message>
4/20/12 7:29:00 PM EST: </context>
4/20/12 7:29:00 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:00 PM EST: FAIL!  : tst_lupdate::good(parseqml) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/parseqml/project.ts.result does not meet expectations:
4/20/12 7:29:00 PM EST:         <source>This string has even more information</source>
4/20/12 7:29:01 PM EST:         <extracomment>This is another comment for the translator.</extracomment>
4/20/12 7:29:01 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:01 PM EST: <<<<<<< got
4/20/12 7:29:01 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:01 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:01 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:01 PM EST:     </message>
4/20/12 7:29:01 PM EST: </context>
4/20/12 7:29:01 PM EST: <context>
4/20/12 7:29:01 PM EST: ...
4/20/12 7:29:01 PM EST: =========
4/20/12 7:29:01 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:01 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:01 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:01 PM EST:     </message>
4/20/12 7:29:01 PM EST: </context>
4/20/12 7:29:01 PM EST: <context>
4/20/12 7:29:01 PM EST: ...
4/20/12 7:29:01 PM EST: >>>>>>> expected
4/20/12 7:29:01 PM EST:     </message>
4/20/12 7:29:01 PM EST:     <message>
4/20/12 7:29:01 PM EST:         <location filename="main.qml" line="83"/>
4/20/12 7:29:01 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:01 PM EST: FAIL!  : tst_lupdate::good(proparsing2) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/proparsing2/project.ts.result does not meet expectations:
4/20/12 7:29:01 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:01 PM EST:     </message>
4/20/12 7:29:01 PM EST:     <message>
4/20/12 7:29:01 PM EST: <<<<<<< got
4/20/12 7:29:04 PM EST: =========
4/20/12 7:29:04 PM EST:         <location filename="b.cpp" line="44"/>
4/20/12 7:29:04 PM EST:         <source>b.cpp</source>
4/20/12 7:29:04 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:04 PM EST:     </message>
4/20/12 7:29:04 PM EST:     <message>
4/20/12 7:29:04 PM EST: >>>>>>> expected
4/20/12 7:29:04 PM EST:         <location filename="e" line="44"/>
4/20/12 7:29:04 PM EST:         <source>e</source>
4/20/12 7:29:04 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:04 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:09 PM EST: Totals: 51 passed, 3 failed, 0 skipped
4/20/12 7:29:09 PM EST: QtQA::App::TestRunner: test failed, running again to see if it is flaky...
4/20/12 7:29:09 PM EST: Testing tst_lupdate
4/20/12 7:29:14 PM EST: FAIL!  : tst_lupdate::good(parsejs) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/parsejs/project.ts.result does not meet expectations:
4/20/12 7:29:14 PM EST:         <source>This string has even more information</source>
4/20/12 7:29:14 PM EST:         <extracomment>This is another comment for the translator.</extracomment>
4/20/12 7:29:14 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:14 PM EST: <<<<<<< got
4/20/12 7:29:14 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:14 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:14 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST: </context>
4/20/12 7:29:14 PM EST: <context>
4/20/12 7:29:14 PM EST: ...
4/20/12 7:29:14 PM EST: =========
4/20/12 7:29:14 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:14 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:14 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST: </context>
4/20/12 7:29:14 PM EST: <context>
4/20/12 7:29:14 PM EST: ...
4/20/12 7:29:14 PM EST: >>>>>>> expected
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST:     <message>
4/20/12 7:29:14 PM EST:         <location filename="main.js" line="79"/>
4/20/12 7:29:14 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:14 PM EST: FAIL!  : tst_lupdate::good(parsejscontexts) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/parsejscontexts/project.ts.result does not meet expectations:
4/20/12 7:29:14 PM EST:         <source>Five</source>
4/20/12 7:29:14 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST: <<<<<<< got
4/20/12 7:29:14 PM EST:     <message>
4/20/12 7:29:14 PM EST:         <location filename="main.js" line="16"/>
4/20/12 7:29:14 PM EST:         <source>Six</source>
4/20/12 7:29:14 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST: </context>
4/20/12 7:29:14 PM EST: ...
4/20/12 7:29:14 PM EST: =========
4/20/12 7:29:14 PM EST: </context>
4/20/12 7:29:14 PM EST: <context>
4/20/12 7:29:14 PM EST:     <name>Bar::Baz</name>
4/20/12 7:29:14 PM EST:     <message>
4/20/12 7:29:14 PM EST:         <location filename="main.js" line="22"/>
4/20/12 7:29:14 PM EST:         <source>Eight</source>
4/20/12 7:29:14 PM EST: ...
4/20/12 7:29:14 PM EST: >>>>>>> expected
4/20/12 7:29:14 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:14 PM EST:     </message>
4/20/12 7:29:14 PM EST: </context>
^M4/20/12 7:29:14 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:14 PM EST: FAIL!  : tst_lupdate::good(parseqml) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/parseqml/project.ts.result does not meet expectations:
4/20/12 7:29:14 PM EST:         <source>This string has even more information</source>
4/20/12 7:29:14 PM EST:         <extracomment>This is another comment for the translator.</extracomment>
4/20/12 7:29:14 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:14 PM EST: <<<<<<< got
4/20/12 7:29:14 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:16 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:16 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:16 PM EST: =========
4/20/12 7:29:16 PM EST:         <extra-needle-in-haystack>Found</extra-needle-in-haystack>
4/20/12 7:29:16 PM EST:         <extra-overflow>True</extra-overflow>
4/20/12 7:29:16 PM EST:         <extra-foo-bar>Important stuff</extra-foo-bar>
4/20/12 7:29:16 PM EST: >>>>>>> expected
4/20/12 7:29:16 PM EST:     </message>
4/20/12 7:29:16 PM EST: </context>
4/20/12 7:29:16 PM EST: <context>
4/20/12 7:29:16 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:16 PM EST: FAIL!  : tst_lupdate::good(proparsing2) Result for C:/test/recipes/179088726/base/qt/qttools/tests/auto/linguist/lupdate/testdata/good/proparsing2/project.ts.result does not meet expectations:
4/20/12 7:29:16 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:16 PM EST:     </message>
4/20/12 7:29:16 PM EST:     <message>
4/20/12 7:29:16 PM EST: <<<<<<< got
4/20/12 7:29:16 PM EST: =========
4/20/12 7:29:16 PM EST:         <location filename="b.cpp" line="44"/>
4/20/12 7:29:16 PM EST:         <source>b.cpp</source>
4/20/12 7:29:16 PM EST:         <translation type="unfinished"></translation>
4/20/12 7:29:16 PM EST:     </message>
4/20/12 7:29:16 PM EST:     <message>
4/20/12 7:29:16 PM EST: >>>>>>> expected
4/20/12 7:29:16 PM EST:         <location filename="e" line="44"/>
4/20/12 7:29:16 PM EST:         <source>e</source>
4/20/12 7:29:16 PM EST:         <translation type=unfinished"></translation>
4/20/12 7:29:19 PM EST: .\tst_lupdate.cpp(218) : failure location
4/20/12 7:29:19 PM EST: Totals: 50 passed, 4 failed, 0 skipped
4/20/12 7:29:19 PM EST: QtQA::App::TestRunner: test failed on first and second attempts, but with different behavior each time:
4/20/12 7:29:19 PM EST: QtQA::App::TestRunner:   first attempt:  exited with exit code 3
4/20/12 7:29:19 PM EST: QtQA::App::TestRunner:   second attempt: exited with exit code 4
4/20/12 7:29:19 PM EST: QtQA::App::TestRunner: the test seems to be flaky, please fix this
4/20/12 7:29:19 PM EST: QtQA::App::TestRunner: this flaky test is being treated as a FAIL

      Attachments

        For Gerrit Dashboard: QTBUG-25483
        # Subject Branch Project Status CR V
        24343,1 Add bug number for unstable test. master qt/qttools Status: MERGED +2 0
        34372,5 make lupdate test significant again master qt/qttools Status: MERGED +2 0

        Activity

          People

            buddenha Oswald Buddenhagen
            jasmcdon Jason McDonald (Closed Nokia Identity. Please assign to "macadder" instead) (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes