Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-127755

tst_qspinbox is very flaky on many of its tests on macos 12 arm64

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • P2: Important
    • None
    • 7.0 (Next Major Release)
    • macOS

    Description

      This is seen almost exclusively on macos12 arm64.

      Here is a log from a nightly HealthCheck from dev

      agent:2024/08/03 23:28:50 build.go:404: 549: PASS   : tst_QSpinBox::wheelEvents(halfDownShiftWithMetaKeyboardModifierSynthesizedBySystem)
      agent:2024/08/03 23:28:50 build.go:404: 549: PASS   : tst_QSpinBox::wheelEvents(halfDownShiftWithMetaKeyboardModifierSynthesizedByQt)
      agent:2024/08/03 23:28:50 build.go:404: 549: PASS   : tst_QSpinBox::wheelEvents(halfDownShiftWithMetaKeyboardModifierSynthesizedByApplication)
      agent:2024/08/03 23:28:50 build.go:404: 549: PASS   : tst_QSpinBox::adaptiveDecimalStep()
      agent:2024/08/03 23:28:55 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upNoWithNoKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:28:55 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      agent:2024/08/03 23:29:00 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upCtrlWithNoKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:29:00 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      agent:2024/08/03 23:29:05 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upShiftWithNoKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:29:05 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      agent:2024/08/03 23:29:10 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upNoWithShiftKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:29:10 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      agent:2024/08/03 23:29:15 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upCtrlWithShiftKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:29:15 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      agent:2024/08/03 23:29:20 build.go:404: 549: FAIL!  : tst_QSpinBox::stepModifierKeys(upShiftWithShiftKeyboardModifier) 'QTest::qWaitForWindowActive(&spin)' returned FALSE. ()
      agent:2024/08/03 23:29:20 build.go:404: 549:    Loc: [/Users/qt/work/qt/qtbase/tests/auto/widgets/widgets/qspinbox/tst_qspinbox.cpp(1655)]
      [ ... many more failures ... ]
      

      On the automated re-run of each failed test, the test mostly passes, for example:

      agent:2024/08/03 23:36:24 build.go:404: 549: qt-testrunner.py     INFO: Re-running testcase: stepModifierKeys:upNoWithNoKeyboardModifier
      agent:2024/08/03 23:36:24 build.go:404: 549: qt-testrunner.py    DEBUG: Running test command line: ['/Users/qt/work/qt/qtbase_standalone_tests/tests/auto/widgets/widgets/qspinbox/tst_qspinbox', '-o', '/Users/qt/work/testresults/tst_qspinbox-1722728184003.xml,xml', '-o', '/Users/qt/work/testresults/tst_qspinbox-1722728184003.junit.xml,junitxml', '-o', '/Users/qt/work/testresults/tst_qspinbox-1722728184003.txt,txt', '-o', '-,txt', 'stepModifierKeys:upNoWithNoKeyboardModifier']
      agent:2024/08/03 23:36:24 build.go:404: 549: ********* Start testing of tst_QSpinBox *********
      agent:2024/08/03 23:36:24 build.go:404: 549: Config: Using QtTest library 6.9.0, Qt 6.9.0 (arm64-little_endian-lp64 shared (dynamic) release build; by Apple LLVM 15.0.0 (clang-1500.3.9.4)), macos 12.7
      agent:2024/08/03 23:36:24 build.go:404: 549: PASS   : tst_QSpinBox::initTestCase()
      agent:2024/08/03 23:36:24 build.go:404: 549: PASS   : tst_QSpinBox::stepModifierKeys(upNoWithNoKeyboardModifier)
      agent:2024/08/03 23:36:24 build.go:404: 549: PASS   : tst_QSpinBox::cleanupTestCase()
      agent:2024/08/03 23:36:24 build.go:404: 549: Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 70ms
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            qt.team.quick.subscriptions Qt Quick and Widgets Team
            jimis Dimitrios Apostolou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes