Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-5842

Bot feature to send automatic update to Teams channels + Grafana when Gerrit review of platform change is merged

    XMLWordPrintable

Details

    • Task
    • Resolution: Unresolved
    • P3: Somewhat important
    • None
    • None
    • None

    Description

      This is related to new CI process - How to introduce changes to CI platforms

      Most important goal:

      To give accurate and ontime information to developers about new CI Platform changes. Sometimes new changes have been integrated outside of office hours and person might have other priority tasks ongoing to notice merging - therefore info updates are best, and fortunately quite easily, added into our automation Bots to send info to Teams and Grafana immediately when specific review has merged.

       

      Questions so far, thanks Daniel:

      1.  Confirmation from the CI team of what to monitor. Which paths confirm a significant platform change.
      2. Are there any exclusion criteria that would denote a change as insignificant such that it should not be reported?
      3. Which teams channel should a message be posted to
      4. What information should the message include?

       

      A:

      1. Good point
        1. Dedicated reviews which are introducing new OS to CI
        2. Trigger to send message: when review commit is merged
      2. Good point, we have new CI process where:
        • All new OS will have InsignificantTests -flag when they are introduced to CI
        • Week is used for monitoring flakiness, until flags are removed and previous version is possible to remove
        • How to introduce changes to CI platforms
      3. CI, Development and Platforms -channels + Grafana/InfluxDB platforms info
      4. Message content could be linked to the new process phases 2 - 4 which merge at the end of each phase ()

       

      = More details for Q4 about phases and example messages:

      • Pre-text for Teams could always be the same "Platform changes in CI:"
      • Grafana/InfluxDB doesn't need pre-text - only Msg + datetime for Anna's grafana_scripts
      • Phase 1 - Development/Testing the change
        • No merging - No need to add information (yet)
        • In future: Option to introduce that new OS provisioning has started
      • Phase 2 - Activating the platform in CI as non-blocking
        • Msg: "<OS_new> <version_new> added in CI with InsignificantTest flags enabled"
        • Flakiness monitoring ongoing for a week
      • Phase 3 - Making test blocking
        • Msg: "<OS_new> <version_new> Insignificant flags disabled"
      • Phase 4 - Remove previous platform from CI
        • Msg: "<OS_new> <version_new> replaced <OS_prev> <version_prev>"
        • OR "<OS_prev> <version_prev> has been removed"

       

      Message could be given in Gerrit review with keyword:

      • Provisioning: "<OS_new> <version_new> added in CI with InsignificantTest flags enabled"
      • Or it could be built in the bots when it would reduce typos etc. issues. (this might be better)

       

      Other information to add in Teams message content:

      • Review owner username tagged as the visible Contact, as bot adds the msg
      • Link to the merged review + date (Example here)
      • Optionally in future:
        • Link to CI Metrics which we use to monitor flakiness for new CI platforms

      Attachments

        Issue Links

          For Gerrit Dashboard: QTQAINFRA-5842
          # Subject Branch Project Status CR V

          Activity

            People

              daniel.smith Daniel Smith
              teheikki Tero Heikkinen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There is 1 open Gerrit change