Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-82683

Q12020 Flaky failing autotest function pull in qaudiooutput

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • P1: Critical
    • 5.15.0 Beta3
    • 5.14
    • Multimedia
    • None
    • Linux/X11
    • a8131f05b9b3290fa4888c617adbbb6253d2b410 (qt/qtmultimedia/5.14)

    Description

      Here is the log from the incident

      Coin task #1: http://coin/coin/integration/qt/qtmultimedia/tasks/1583164775

      Coin task #2: http://coin/coin/integration/qt/qtmultimedia/tasks/1582659472

      Host os version: RHEL_7_6, target os version: RHEL_7_6, GCC compiler

      Log #1:

      http://coin/coin/logview/qt/qtmultimedia/a76df4032ca063c7db6b5c35d21a29e5a11e6523/LinuxRHEL_7_6x86_64LinuxRHEL_7_6x86_64GCCqtci-linux-RHEL-7.6-x86_64-dba6f3/c79680a26dc3be4cf182221cd8e4f8b9c13dcc03/test_1583164829

      ********* Start testing of tst_QAudioOutput *********
      Config: Using QtTest library 5.14.2, Qt 5.14.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 5.3.1 20160406 (Red Hat 5.3.1-6))
      PASS : tst_QAudioOutput::initTestCase()
      PASS : tst_QAudioOutput::pull(Audio File 0)
      FAIL! : tst_QAudioOutput::pull(Audio File 1) Compared values are not the same
      Loc: [tst_qaudiooutput.cpp(529)]
      PASS : tst_QAudioOutput::pull(Audio File 2)
      PASS : tst_QAudioOutput::pull(Audio File 3)
      PASS : tst_QAudioOutput::pull(Audio File 4)
      PASS : tst_QAudioOutput::pull(Audio File 5)
      PASS : tst_QAudioOutput::cleanupTestCase()
      Totals: 7 passed, 1 failed, 0 skipped, 0 blacklisted, 23273ms
      ********* Finished testing of tst_QAudioOutput *********
      

      Please also see if this test function fails is somehow related or not. It is happening after the first fail of pull function, and only the first fail of pull function is repeated.

      FAIL! : tst_QAudioOutput::pushSuspendResume(Audio File 5) '(audioOutput.state() == QAudio::IdleState)' returned FALSE. (didn't transitions to IdleState when at EOF)Loc: [tst_qaudiooutput.cpp(842)]
      

      External log:

      https://testresults.qt.io/coin/logview/qt/qtmultimedia/a76df4032ca063c7db6b5c35d21a29e5a11e6523/LinuxRHEL_7_6x86_64LinuxRHEL_7_6x86_64GCCqtci-linux-RHEL-7.6-x86_64-dba6f3/c79680a26dc3be4cf182221cd8e4f8b9c13dcc03/test_1583164829

      The wanted action

      • Please delegate this task to a suitable developer
      • Fix the autotest flakiness in all affected versions, not just one. 
      • Cherry-pick the fix to all relevant branches
      • Mark the fix versions to Jira

      Guidelines for debugging

      Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

      How to locate the failed flaky test:

      Please open the link to the Grafana dashboard showing the failure history of the test:

      https://testresults.qt.io/grafana/d/5GKDJSPZz/02-qt-framework-please-fix-these-flaky-tests-random-fails?orgId=1&from=now-90d&to=now&var-project=qt%2Fqtmultimedia&var-testcase=tests%2Fauto%2Fintegration%2Fqaudiooutput&var-testfunction=pull&var-branch=All&var-inter=24h

      Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

      Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. 

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            valentyn.doroshchuk Valentyn Doroshchuk
            assaarel Asmo Saarela (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes