Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-76566

qgraphicsitem test is very flaky

    XMLWordPrintable

    Details

    • Platform/s:
      macOS
    • Commits:
      b426cff1e0363b350f98bc64691b9b279bc6c757 (qt/qtbase/5.12)

      Description

      EDIT: This ticket is about tst_qgraphicsitem::paint and tst_qgraphicsitem::QTBUG_7714_fullUpdateDiscardingOpacityUpdate2 on MacOS_10_12. While doing stress tests many more tests flake a bit, but the focus is on these two tests as they flake almost on 25% of the CI test runs. For now the paint test has been QSKIPped on MacOS_10_12.

      According to the grafana testresults dashboard this is the most flaky test currently, affecting around 30 integrations per week. It shows as flaky only on MacOS_10_12, and the two flaky functions are paint and QTBUG_7714_fullUpdateDiscardingOpacityUpdate2. Also cursor test seems to be flaking a tiny bit, most likely that one has been fixed in the past with QTBUG-73167.

      Here is a log snippet for the paint test failing, from this log.

      agent:2019/06/21 07:57:45 build.go:207: PASS   : tst_QGraphicsItem::sceneEventFilter()
      agent:2019/06/21 07:57:45 build.go:207: PASS   : tst_QGraphicsItem::prepareGeometryChange()
      agent:2019/06/21 07:58:04 build.go:207: FAIL!  : tst_QGraphicsItem::paint() Compared values are not the same
      agent:2019/06/21 07:58:04 build.go:207:    Actual   (((tester2.painted))): 3
      agent:2019/06/21 07:58:04 build.go:207:    Expected (1)                  : 1
      agent:2019/06/21 07:58:04 build.go:207:    Loc: [tst_qgraphicsitem.cpp(5082)]
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::deleteItemInEventHandlers()
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::itemClipsToShape()
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::itemClipsChildrenToShape() 

      Unfortunately the logs for the other flaky test function (QTBUG_7714_fullUpdateDiscardingOpacityUpdate2) are not available, which leaves it to developers with Mac to reproduce the flakiness. Usually it's enough to load all the CPU cores and keep running the test function in a while loop.

      And cursor2 test seems to be the most "flaky fail" test we have, considering the last 30 days of measurements (err, this one is in the tst_qgraphicsview, not tst_qgraphicsitem and has been blacklisted recently).

        Attachments

          Issue Links

          For Gerrit Dashboard: QTBUG-76566
          # Subject Branch Project Status CR V

            Activity

              People

              • Assignee:
                qt.team.quick.subscriptions Qt Quick and Widgets Team
                Reporter:
                jimis Dimitrios Apostolou
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes