Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-3267

Disk Utilisation Alerts

    XMLWordPrintable

Details

    Description

      Today the OpenNebula root partition got full, went from 90% to 100% in one go and things stopped working. This has happened before on other hosts and shared storage.

      As a sysadmin, I would like all servers to be regularly operational with under 70% disk utilised, or get notified if not.

      Alerts

      Every single host should be setup automatically to throw alerts:

      • yellow alerts if utilisation goes over 80%
      • red alerts if it goes over 90%

      How to deliver alerts

      • emails

      How to automate setting this up on each and every host

      puppet, ansible, cfengine, cdist?

      (feel free to edit description as details are figured out)

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. QTQAINFRA-3361 qtinfluxdb01 /data partition is full

          • P0: Blocker - MUST be fixed ASAP. This includes issues that prevent/block further Qt development; Legal issues & Serious data loss issues.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. QTQAINFRA-1851 Cachefilesd needs a restart once in a while

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. QTQAINFRA-3242 qtinfluxdb01 needs more disk space and swap

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. QTQAINFRA-1864 Not enough disk space on ON1-OpenNebula

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Closed

          Task - A task that needs to be done. QTQAINFRA-3275 Set up automatic archiving on old stuff from ci-files02

          • P3: Somewhat important - Should be fixed, but doesn't affect the release in any way.
          • Open

          Task - A task that needs to be done. QTQAINFRA-3274 Move CI-Master aka vmbuilder to the Compellent

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Task - A task that needs to be done. QTQAINFRA-3276 Increase disk size of downloads.qt.io

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Task - A task that needs to be done. QTQAINFRA-3277 Increase disk size of master.qt.io

          • P1: Critical - Urgent and Important, will STOP the release if matched with set FixVersion field. This includes regressions from the last version that are not edge cases; Data loss; Build issues; All but the most unlikely crashes/lockups/hanging; Serious usability issues and embarrassing bugs & Bugs critical to a deliverable. This is the highest possible priority for requirements.
          • Closed

          Suggestion - Public suggestions QTQAINFRA-1759 CI system should be automatically monitored

          • P2: Important - Urgent, should be fixed, but will not stop the release.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              hehalmet Heikki Halmet
              jimis Dimitrios Apostolou
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes