Uploaded image for project: 'Qt Quality Assurance Infrastructure'
  1. Qt Quality Assurance Infrastructure
  2. QTQAINFRA-2420

Agent launch may be sent multiple times by the same agent

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Not Evaluated
    • None
    • master, production
    • Coin (obsolete)
    • None
    • e86f398d7d7afba2a5aec0585be0f704e2ce9074 (qtqa/tqtc-coin-ci/master)

    Description

      Coin logs are filled with errors that are caused by agents sending multiple launch requests

      2018-12-05 15:11:14,291 ERROR:workitem(31196): Agent 1546002726-5107 is in an invalid state: Watchdog (activated on: 1544022314.198271, buildKey: qt/qt3d/28df7ba1f5f189852fb119245eac4ab04f126244/WindowsWindows_7x86WindowsWindows_7x86Mingw73qtci-windows-7-x86-3-293694DeveloperBuild_Release_OpenGLDynamic/bb97298896428d72040c8af61f38022066be7f0b/Test) has not been updated for 300s, timeout., buildKey qt/qt3d/28df7ba1f5f189852fb119245eac4ab04f126244/WindowsWindows_7x86WindowsWindows_7x86Mingw73qtci-windows-7-x86-3-293694DeveloperBuild_Release_OpenGLDynamic/bb97298896428d72040c8af61f38022066be7f0b/Test, will try another agen

      The invalid state error will cause the VM to be killed and re-created, which wastes resources. According to  coin logs there might be up to 50 cases per week such as these:

      coin.log:6
      coin.log.2018-06-17:13
      ...
      coin.log.2018-11-04:1
      coin.log.2018-11-05:5
      coin.log.2018-11-06:12
      coin.log.2018-11-07:7
      coin.log.2018-11-08:10
      coin.log.2018-11-09:7
      coin.log.2018-11-10:6
      coin.log.2018-11-11:3
      coin.log.2018-11-12:18
      coin.log.2018-11-13:8
      coin.log.2018-11-14:20
      coin.log.2018-11-15:13
      coin.log.2018-11-16:30
      coin.log.2018-11-17:51
      coin.log.2018-11-18:17
      coin.log.2018-11-19:43
      coin.log.2018-11-20:22
      coin.log.2018-11-21:11
      coin.log.2018-11-22:22
      coin.log.2018-11-23:36
      coin.log.2018-11-24:18
      coin.log.2018-11-25:6
      coin.log.2018-11-26:31
      coin.log.2018-11-27:40
      coin.log.2018-11-28:33
      coin.log.2018-11-29:19
      coin.log.2018-11-30:2
      coin.log.2018-12-03:3
      coin.log.2018-12-04:7
      

      Attachments

        For Gerrit Dashboard: QTQAINFRA-2420
        # Subject Branch Project Status CR V

        Activity

          People

            hehalmet Heikki Halmet
            aakeskimo Aapo Keskimölö
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes