Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-3813

Introduce new platforms with tests enabled, but pass even with tests failing

XMLWordPrintable

    • Icon: User Story User Story
    • Resolution: Done
    • Icon: P1: Critical P1: Critical
    • None
    • None
    • None

      Problem: We can't enable autotests on new platforms because a lot of the tests are failing. Currently the solution is to create bug reports out of each and every failure we find, perhaps blacklist the lot and hope for a fix. This is very slow and cumbersome.

      Solution: We will add a new feature flag in platform_configurations in qt5.git, say "IgnoreTestFailures". This will pass on the information to the agent not to mind about the exit code of the autotests. If a build now has these failing autotests, we will not mark it as green, but instead use the color brown or something. It's like "yes it passed, but...". When such a build eventually passes without failures, the build could leave a remark that the "ignoretestfailures" should be removed. Where this remark is done or how Coin reports this is still open.

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            falt Simo Fält
            tosaraja Tony Sarajärvi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved:

                There are no open Gerrit changes