Uploaded image for project: 'Coin'
  1. Coin
  2. COIN-551

MacOS fails to power off due to timeout during provisioning

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: P1: Critical
    • Resolution: Done
    • Affects Version/s: 1.3
    • Fix Version/s: None
    • Component/s: Opennebula
    • Labels:
      None
    • Commits:
      f01a55663d726055c698a7f50bbfca3c894fdc73 (qtqa/tqtc-coin-ci/1.3) cca1dbc249852c9ba4194a4d603762f569387264 (qtqa/tqtc-coin-ci/master)

      Description

      Provisioned machines fail to shutdown the VM after provision has been finished successfully. The timeout could be increased to allow longer termination await time.

      INFO:workitem.py:610(29852): Agent FINISHED PASS: provisioning/qtci-macos-10.13-x86_64-2-dc4a1e/Provision
      WARNING:workitem.py:567(29852): The same agent (1585768544-3195, RpcServiceAddress(hostName='10.215.100.69', port=49170)), called agentLaunched twice, that should not happen, forcefully restarting this workitem (provisioning/qtci-macos-10.13-x86_64-2-dc4a1e/Provision)
      INFO:workitem.py:570(29852): Agent 1585768544-3195 one_id: 23252 running 10.215.100.69:49170 (buildKey: provisioning/qtci-macos-10.13-x86_64-2-dc4a1e/Provision)
      agent:2020/04/02 06:10:27 ciapp.go:39: terminated
      INFO:workitem.py:679(29852): <a href="https://qtmetrics.intra.qt.io/d/nOAsINmZz/jimis-telegraf-vms?orgId=1&from=1585805171000&to=1585808031000&var-server=1585768544-3195">VM metrics</a>
      INFO:workitem.py:681(29852): <a href="https://qtmetrics.intra.qt.io/d/nOAsINNZz/jimis-telegraf-hosts?orgId=1&from=1585805171000&to=1585808031000&var-server=intent-hornet.on1.qt.io">Host metrics</a>
      ERROR:workitem.py:396(29852): Houston? Houston! Unhandled exception occurred while running a WorkItem. This is potentially serious! Investigate it immediately.
      Traceback (most recent call last):
        File "/home/vmbuilder/qt-ci/src/workitem.py", line 365, in _run
          await self.run()
        File "/home/vmbuilder/qt-ci/src/workitem.py", line 846, in run
          raise AgentException("An instruction failed.")
        File "/home/vmbuilder/qt-ci/src/agentlauncher.py", line 189, in __aexit__
          await self._exit_action()
        File "/home/vmbuilder/qt-ci/src/opennebulahardwarepool.py", line 370, in save_agent_as_template
          await _block_until_vm_is_in_state(self.vm_id, one_vm_state.poweroff, max_iterations=6 * 5)
        File "/home/vmbuilder/qt-ci/src/opennebulahardwarepool.py", line 202, in _block_until_vm_is_in_state
          await _block_until_object_is_in_state(getter, vm_id, state, "VM", ERROR_STATES, check_interval, max_iterations)
        File "/home/vmbuilder/qt-ci/src/opennebulahardwarepool.py", line 184, in _block_until_object_is_in_state
          raise TimeoutError(message % (type, id, current_state, state))
      concurrent.futures._base.TimeoutError: VM (id:23252) is still in a undesired state (3), while we wanted to see it in state: one_vm_state.poweroff
      

      http://ci-files01-hki.intra.qt.io:8080/coin/integration/qt/tqtc-qt5/tasks/1585804963

      http://ci-files01-hki.intra.qt.io:8080/coin/logview/provisioning/qtci-macos-10.13-x86_64-2-dc4a1e/provision_1585805048

       

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

            Assignee:
            hehalmet Heikki Halmet
            Reporter:
            aakeskimo Aapo Keskimölö
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Gerrit Reviews

                There are no open Gerrit changes