Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-82829

Q12020 Flaky failing autotest function WebEngineViewSource::test_viewSource in qmltests

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • P1: Critical
    • None
    • 5.14, 5.15
    • WebEngine
    • None
    • Linux/X11

    Description

      Here is the log from the incident

      Coin task #1: http://coin/coin/integration/qt/qtwebengine/tasks/1579807175

      Host OS: openSUSE_15_0, target OS openSUSE_15_0, GCC compiler

      Log #1: http://coin/coin/logview/qt/qtwebengine/af588e373ab5ee88c6ff46f713f6019ced53cf4f/LinuxopenSUSE_15_0x86_64LinuxopenSUSE_15_0x86_64GCCqtci-linux-openSUSE-15.0-x86_64-000a8e/be8b88d8441dceebf6c4d5d8e48f6b742fb9dae9/test_1579807334

      ********* Start testing of qmltests *********
      Config: Using QtTest library 5.14.1, Qt 5.14.1 (x86_64-little_endian-lp64 shared (dynamic) debug build; by GCC 7.4.1 20190905 [gcc-7-branch revision 275407])
      PASS : qmltests::initTestCase()
      PASS : qmltests::cleanupTestCase()
      ...
      PASS : qmltests::WebEngineViewSource::initTestCase()
      FAIL! : qmltests::WebEngineViewSource::test_viewSource() Compared values are not the same
      Actual (): Qt.url(file:///home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/test1.html)
      Expected (): view-source:file:///home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/test1.html
      Loc: [/home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/tst_viewSource.qml(94)]
      PASS : qmltests::WebEngineViewSource::test_viewSourceCredentials()
      ...
      
      ********* Start testing of qmltests *********
      Config: Using QtTest library 5.14.1, Qt 5.14.1 (x86_64-little_endian-lp64 shared (dynamic) debug build; by GCC 7.4.1 20190905 [gcc-7-branch revision 275407])
      PASS : qmltests::WebEngineViewSource::initTestCase()
      ...
      QDEBUG : qmltests::WebEngineViewSource::test_viewSource() [ 2.222 D] qt.v4.asm QV4::JIT::printDisassembledOutputWithCalls - disassembly not available for range 0x7f78a416f000...0x7f78a417071d
      FAIL! : qmltests::WebEngineViewSource::test_viewSource() Compared values are not the same
      Actual (): Qt.url(file:///home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/test1.html)
      Expected (): view-source:file:///home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/test1.html
      Loc: [/home/qt/work/qt/qtwebengine/tests/auto/quick/qmltests/data/tst_viewSource.qml(94)]
      

      Externally accessible log: https://testresults.qt.io/coin/integration/qt/qtwebengine/tasks/1579807175

      The wanted action

      • Please delegate this task to a suitable developer
      • Fix the autotest flakiness in all affected versions, not just one. 
      • Cherry-pick the fix to all relevant branches
      • Mark the fix versions to Jira

      Guidelines for debugging

      Please see the internal page https://intranet.qt.io/display/QTRD/Metrics+Guidelines+for+Grafana+Tool+for+Autotests+with+Issues

      How to locate the failed flaky test:

      Please open the link to the Grafana dashboard showing the failure history of the test:

      https://testresults.qt.io/grafana/d/5GKDJSPZz/02-qt-framework-please-fix-these-flaky-tests-random-fails?orgId=1&from=now%2Fy&to=now&var-project=qt%2Fqtwebengine&var-testcase=tests%2Fauto%2Fquick%2Fqmltests&var-testfunction=WebEngineViewSource::test_viewSource&var-branch=5.12&var-branch=5.13&var-branch=5.14&var-branch=5.15&var-branch=dev&var-inter=24h

      Please see the panel List of the recent flaky tests (both passed and failed). Sort it based on the results to see the failed instances. 

      Please open the links to the Coin tasks containing the logs. Please see the test section containing state "Error" and open corresponding logs. 

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ablasche Alex Blasche
              assaarel Asmo Saarela (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes