Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-76566

qgraphicsitem test is very flaky

    XMLWordPrintable

Details

    • macOS
    • b426cff1e0363b350f98bc64691b9b279bc6c757 (qt/qtbase/5.12)

    Description

      EDIT: This ticket is about tst_qgraphicsitem::paint and tst_qgraphicsitem::QTBUG_7714_fullUpdateDiscardingOpacityUpdate2 on MacOS_10_12. While doing stress tests many more tests flake a bit, but the focus is on these two tests as they flake almost on 25% of the CI test runs. For now the paint test has been QSKIPped on MacOS_10_12.

      According to the grafana testresults dashboard this is the most flaky test currently, affecting around 30 integrations per week. It shows as flaky only on MacOS_10_12, and the two flaky functions are paint and QTBUG_7714_fullUpdateDiscardingOpacityUpdate2. Also cursor test seems to be flaking a tiny bit, most likely that one has been fixed in the past with QTBUG-73167.

      Here is a log snippet for the paint test failing, from this log.

      agent:2019/06/21 07:57:45 build.go:207: PASS   : tst_QGraphicsItem::sceneEventFilter()
      agent:2019/06/21 07:57:45 build.go:207: PASS   : tst_QGraphicsItem::prepareGeometryChange()
      agent:2019/06/21 07:58:04 build.go:207: FAIL!  : tst_QGraphicsItem::paint() Compared values are not the same
      agent:2019/06/21 07:58:04 build.go:207:    Actual   (((tester2.painted))): 3
      agent:2019/06/21 07:58:04 build.go:207:    Expected (1)                  : 1
      agent:2019/06/21 07:58:04 build.go:207:    Loc: [tst_qgraphicsitem.cpp(5082)]
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:04 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: WARNING: tst_QGraphicsItem::deleteItemInEventHandlers() Mouse event "MousePress" not accepted by receiving widget
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::deleteItemInEventHandlers()
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::itemClipsToShape()
      agent:2019/06/21 07:58:05 build.go:207: PASS   : tst_QGraphicsItem::itemClipsChildrenToShape() 

      Unfortunately the logs for the other flaky test function (QTBUG_7714_fullUpdateDiscardingOpacityUpdate2) are not available, which leaves it to developers with Mac to reproduce the flakiness. Usually it's enough to load all the CPU cores and keep running the test function in a while loop.

      And cursor2 test seems to be the most "flaky fail" test we have, considering the last 30 days of measurements (err, this one is in the tst_qgraphicsview, not tst_qgraphicsitem and has been blacklisted recently).

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              qt.team.quick.subscriptions Qt Quick and Widgets Team
              jimis Dimitrios Apostolou
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes