Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-137400

tst_qquickcontextmenu::menuItemShouldntTriggerOnRelease is flaky

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P1: Critical
    • None
    • 5.10
    • Quick: Controls 2
    • None
    • Android, Linux/X11

    Description

      See grafana: https://testresults.qt.io/grafana/d/d8bebf9c-6e1c-4bff-a214-8d506943f23c/new-flaky-crashed-failed-tests?var-group_by_interval=1d&orgId=1&from=now-6M&to=now&timezone=browser&var-branch=1&var-test_case_n=4881&var-test_function_n=147508

      Seems it started on February 23rd.

      Log snippet:

      agent:2025/06/04 07:54:31 build.go:412: ********* Start testing of tst_QQuickContextMenu *********
agent:2025/06/04 07:54:31 build.go:412: Config: Using QtTest library 6.10.0, Qt 6.10.0 (x86_64-little_endian-lp64 shared (dynamic) debug build; by GCC 9.3.1 20200406 [revision 6db837a5288ee3ca5ec504fbd5a765817e556ac2]), opensuse-leap 15.6
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: MESA: error: ZINK: vkCreateInstance failed (VK_ERROR_INCOMPATIBLE_DRIVER)
agent:2025/06/04 07:54:31 build.go:412: glx: failed to create drisw screen
agent:2025/06/04 07:54:31 build.go:412: failed to load driver: zink
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::menuItemShouldntTriggerOnRelease()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Fusion::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Fusion::menuItemShouldntTriggerOnRelease()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Fusion::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::FluentWinUI3::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::FluentWinUI3::menuItemShouldntTriggerOnRelease()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::FluentWinUI3::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Imagine::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Imagine::menuItemShouldntTriggerOnRelease()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Imagine::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Material::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Material::menuItemShouldntTriggerOnRelease()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Material::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Universal::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: FAIL!  : tst_QQuickContextMenu::Universal::menuItemShouldntTriggerOnRelease() Compared values are not the same
agent:2025/06/04 07:54:31 build.go:412:    Actual   (firstMenuItemPriv->animateTimer): 1174405125
agent:2025/06/04 07:54:31 build.go:412:    Expected (0)                              : 0
agent:2025/06/04 07:54:31 build.go:412:    Loc: [/home/qt/work/qt/qtdeclarative/tests/auto/quickcontrols/qquickcontextmenu/tst_qquickcontextmenu.cpp(348)]
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Universal::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: Totals: 17 passed, 1 failed, 0 skipped, 0 blacklisted, 4365ms
agent:2025/06/04 07:54:31 build.go:412: ********* Finished testing of tst_QQuickContextMenu *********
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py     INFO: Test process exited with code: 1
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py     INFO: Re-running testcase: menuItemShouldntTriggerOnRelease
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py    DEBUG: Running test command line: ['/home/qt/work/qt/qtdeclarative_standalone_tests/tests/auto/quickcontrols/qquickcontextmenu/tst_qquickcontextmenu', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023667152.xml,xml', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023667152.junit.xml,junitxml', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023667152.txt,txt', '-o', '-,txt', 'menuItemShouldntTriggerOnRelease']
agent:2025/06/04 07:54:31 build.go:412: ********* Start testing of tst_QQuickContextMenu *********
agent:2025/06/04 07:54:31 build.go:412: Config: Using QtTest library 6.10.0, Qt 6.10.0 (x86_64-little_endian-lp64 shared (dynamic) debug build; by GCC 9.3.1 20200406 [revision 6db837a5288ee3ca5ec504fbd5a765817e556ac2]), opensuse-leap 15.6
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: MESA: error: ZINK: vkCreateInstance failed (VK_ERROR_INCOMPATIBLE_DRIVER)
agent:2025/06/04 07:54:31 build.go:412: glx: failed to create drisw screen
agent:2025/06/04 07:54:31 build.go:412: failed to load driver: zink
agent:2025/06/04 07:54:31 build.go:412: FAIL!  : tst_QQuickContextMenu::Basic::menuItemShouldntTriggerOnRelease() Compared values are not the same
agent:2025/06/04 07:54:31 build.go:412:    Actual   (firstMenuItemPriv->animateTimer): 50331652
agent:2025/06/04 07:54:31 build.go:412:    Expected (0)                              : 0
agent:2025/06/04 07:54:31 build.go:412:    Loc: [/home/qt/work/qt/qtdeclarative/tests/auto/quickcontrols/qquickcontextmenu/tst_qquickcontextmenu.cpp(348)]
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 1632ms
agent:2025/06/04 07:54:31 build.go:412: ********* Finished testing of tst_QQuickContextMenu *********
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py     INFO: Test process exited with code: 6
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py     INFO: Re-running testcase: menuItemShouldntTriggerOnRelease
agent:2025/06/04 07:54:31 build.go:412: qt-testrunner.py    DEBUG: Running test command line: ['/home/qt/work/qt/qtdeclarative_standalone_tests/tests/auto/quickcontrols/qquickcontextmenu/tst_qquickcontextmenu', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023668877.xml,xml', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023668877.junit.xml,junitxml', '-o', '/home/qt/work/testresults/tst_qquickcontextmenu-1749023668877.txt,txt', '-o', '-,txt', 'menuItemShouldntTriggerOnRelease']
agent:2025/06/04 07:54:31 build.go:412: ********* Start testing of tst_QQuickContextMenu *********
agent:2025/06/04 07:54:31 build.go:412: Config: Using QtTest library 6.10.0, Qt 6.10.0 (x86_64-little_endian-lp64 shared (dynamic) debug build; by GCC 9.3.1 20200406 [revision 6db837a5288ee3ca5ec504fbd5a765817e556ac2]), opensuse-leap 15.6
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::initTestCase()
agent:2025/06/04 07:54:31 build.go:412: MESA: error: ZINK: vkCreateInstance failed (VK_ERROR_INCOMPATIBLE_DRIVER)
agent:2025/06/04 07:54:31 build.go:412: glx: failed to create drisw screen
agent:2025/06/04 07:54:31 build.go:412: failed to load driver: zink
agent:2025/06/04 07:54:31 build.go:412: FAIL!  : tst_QQuickContextMenu::Basic::menuItemShouldntTriggerOnRelease() Compared values are not the same
agent:2025/06/04 07:54:31 build.go:412:    Actual   (firstMenuItemPriv->animateTimer): 50331652
agent:2025/06/04 07:54:31 build.go:412:    Expected (0)                              : 0
agent:2025/06/04 07:54:31 build.go:412:    Loc: [/home/qt/work/qt/qtdeclarative/tests/auto/quickcontrols/qquickcontextmenu/tst_qquickcontextmenu.cpp(348)]
agent:2025/06/04 07:54:31 build.go:412: PASS   : tst_QQuickContextMenu::Basic::cleanupTestCase()
agent:2025/06/04 07:54:31 build.go:412: Totals: 2 passed, 1 failed, 0 skipped, 0 blacklisted, 679ms
agent:2025/06/04 07:54:31 build.go:412: ********* Finished testing of tst_QQuickContextMenu *********

      The values are interesting in hex:

      1174405125 == 0x46000005
50331652 == 0x03000004

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. QTBUG-137311 tst_QQuickContextMenu::menuItemShouldntTriggerOnRelease is flaky

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; Flaky tests; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed
          For Gerrit Dashboard: QTBUG-137400
          # Subject Branch Project Status CR V
          650171,1 Blacklist tst_qquickcontextmenu::menuItemShouldntTriggerOnRelease dev qt/qtdeclarative Status: NEW +2 0
          650574,1 Blacklist tst_qquickcontextmenu::menuItemShouldntTriggerOnRelease 6.10 qt/qtdeclarative Status: NEW +2 0

          Activity

            People

              fredericl Frederic Lefebvre
              ulherman Ulf Hermann
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: