XMLWordPrintable

Details

    • Epic
    • Resolution: Unresolved
    • P2: Important
    • None
    • None
    • Metrics / Test Results
    • None
    • Test metrics from nightly builds

    Description

      Goals:

      • Get statistics of most flaky tests by re-running already passed integrations nightly
      • Get statistics of which tests are being run and which are being skipped per branch (from the same nightly runs)
      • Notice broken provisioning earlier (parallel builds)

      Desired architecture

      • nightly runs in coin on already integrated branch heads, results available publicly
      • test result parser & db importer running outside of COIN
      • new database with optimized data model
      • Grafana (testresults) for viewing

      Phases

      1. Enable just for a QtBase branch
      2. Enable for a whole Qt5 branch integration
      3. Enable for multiple (2 or 3) branches
      4. Separate nightly builds for provisioning

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              jujokini Jukka Jokiniva
              jujokini Jukka Jokiniva
              Jukka Jokiniva Jukka Jokiniva
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes